2024-02-15T22:44:57.547 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-15T22:44:57.547 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707 --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} --name yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi --verbose -- /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707/orig.config.yaml 2024-02-15T22:44:57.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T22:44:57.658 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707 branch: wip-yuri2-testing-2024-02-15-0913-squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} email: yweinste@redhat.com first_in_suite: false job_id: '7561707' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri2-testing-2024-02-15-0913-squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 rgw: ec-data-pool: false frontend: beast thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2024-02-15-0913-squid sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 owner: scheduled_yuriw@teuthology priority: 51 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9739 sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 sleep_before_teardown: 0 subset: 111/120000 suite: rgw suite_branch: wip-yuri2-testing-2024-02-15-0913-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKCk4BwJnZymaHN/ARCzS3eOsR0slziOZuvfx0UsCDD5bj2XIGFF5DrCUAu+9PGI3+TWMx9K5w8XUq/HbPPEea4= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0WhKIadFldsvJzv+uLEq/oD+fbtnukUMhfslv/NPByzWgRcLNvq+Mzt4nxxjSWfDBGCtxrcJLos5hvLNWA7DA= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-15_21:10:42 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-15T22:44:57.658 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa; will attempt to use it 2024-02-15T22:44:57.659 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa/tasks 2024-02-15T22:44:57.659 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-15T22:44:57.661 INFO:teuthology.task.internal:Checking packages... 2024-02-15T22:44:57.688 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'fddf34c14d11a944c077fae4b86a8722d85c0772' 2024-02-15T22:44:57.689 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T22:44:57.689 INFO:teuthology.packaging:ref: None 2024-02-15T22:44:57.689 INFO:teuthology.packaging:tag: None 2024-02-15T22:44:57.689 INFO:teuthology.packaging:branch: wip-yuri2-testing-2024-02-15-0913-squid 2024-02-15T22:44:57.689 INFO:teuthology.packaging:sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-15T22:44:57.689 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri2-testing-2024-02-15-0913-squid 2024-02-15T22:44:57.832 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1468.gfddf34c1 2024-02-15T22:44:57.834 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-15T22:44:57.843 INFO:teuthology.task.internal:no buildpackages task found 2024-02-15T22:44:57.843 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-15T22:44:57.858 INFO:teuthology.task.internal:Saving configuration 2024-02-15T22:44:57.871 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-15T22:44:57.882 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T22:44:57.908 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:40:06.509864', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKCk4BwJnZymaHN/ARCzS3eOsR0slziOZuvfx0UsCDD5bj2XIGFF5DrCUAu+9PGI3+TWMx9K5w8XUq/HbPPEea4='} 2024-02-15T22:44:57.926 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:40:06.511499', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0WhKIadFldsvJzv+uLEq/oD+fbtnukUMhfslv/NPByzWgRcLNvq+Mzt4nxxjSWfDBGCtxrcJLos5hvLNWA7DA='} 2024-02-15T22:44:57.926 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-15T22:44:57.937 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-02-15T22:44:57.937 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-02-15T22:44:57.937 INFO:teuthology.run_tasks:Running task console_log... 2024-02-15T22:44:58.015 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1e592f9f70>, signals=[15]) 2024-02-15T22:44:58.015 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-15T22:44:58.022 INFO:teuthology.task.internal:Opening connections... 2024-02-15T22:44:58.022 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-02-15T22:44:58.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:44:58.136 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T22:44:58.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:44:58.226 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-15T22:44:58.232 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-02-15T22:44:58.250 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-02-15T22:44:58.251 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-02-15T22:44:58.308 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-15T22:44:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T22:44:58.310 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-02-15T22:44:58.335 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-02-15T22:44:58.353 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-02-15T22:44:58.353 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-02-15T22:44:58.410 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-02-15T22:44:58.410 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-02-15T22:44:58.410 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-02-15T22:44:58.410 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-02-15T22:44:58.410 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-02-15T22:44:58.410 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-02-15T22:44:58.411 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-15T22:44:58.411 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-02-15T22:44:58.411 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-02-15T22:44:58.411 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-15T22:44:58.411 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-02-15T22:44:58.411 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T22:44:58.411 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-15T22:44:58.411 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T22:44:58.411 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-02-15T22:44:58.435 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-15T22:44:58.446 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-15T22:44:58.457 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-15T22:44:58.457 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-02-15T22:44:58.460 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2024-02-15T22:44:58.476 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-15T22:44:58.481 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-15T22:44:58.482 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-02-15T22:44:58.517 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2024-02-15T22:44:58.537 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-15T22:44:58.589 INFO:teuthology.run_tasks:Running task kernel... 2024-02-15T22:44:58.606 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-15T22:44:58.606 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-15T22:44:58.606 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T22:44:58.607 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T22:44:58.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:44:58.622 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-02-15T22:44:58.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:44:58.624 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-02-15T22:44:58.677 INFO:teuthology.orchestra.run.smithi133.stdout:5.14.0-361.el9.x86_64 2024-02-15T22:44:58.678 INFO:teuthology.task.kernel:Running kernel on smithi133: 5.14.0-361.el9.x86_64 2024-02-15T22:44:58.678 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum install -y kernel 2024-02-15T22:44:58.681 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-361.el9.x86_64 2024-02-15T22:44:58.681 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.14.0-361.el9.x86_64 2024-02-15T22:44:58.681 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2024-02-15T22:45:01.177 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS-9 - AppStream 7.4 MB/s | 6.7 MB 00:00 2024-02-15T22:45:01.239 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - AppStream 7.5 MB/s | 6.7 MB 00:00 2024-02-15T22:45:02.844 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2024-02-15T22:45:02.997 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2024-02-15T22:45:04.238 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.0 MB 00:00 2024-02-15T22:45:05.709 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.0 MB 00:02 2024-02-15T22:45:08.010 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-02-15T22:45:08.764 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 19 MB 00:03 2024-02-15T22:45:13.161 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.1 MB 00:01 2024-02-15T22:45:14.597 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.1 MB 00:02 2024-02-15T22:45:14.611 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 15 kB 00:00 2024-02-15T22:45:16.315 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2024-02-15T22:45:17.458 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 20 MB/s | 20 MB 00:01 2024-02-15T22:45:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 7.1 MB/s | 20 MB 00:02 2024-02-15T22:45:22.537 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-02-15T22:45:22.574 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-02-15T22:45:24.827 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-15T22:45:24.827 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-15T22:45:24.918 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:45:24.928 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:45:24.928 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T22:45:24.928 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:45:24.928 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:45:24.928 INFO:teuthology.orchestra.run.smithi133.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout:Install 4 Packages 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 100 M 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 123 M 2024-02-15T22:45:24.929 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:45:24.973 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-15T22:45:24.973 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-15T22:45:25.066 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:45:25.074 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:45:25.074 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-02-15T22:45:25.074 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:45:25.074 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:45:25.074 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-15T22:45:25.074 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-02-15T22:45:25.075 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-15T22:45:25.075 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-15T22:45:25.075 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-15T22:45:25.075 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:45:25.075 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:45:25.075 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:45:25.075 INFO:teuthology.orchestra.run.smithi052.stdout:Install 4 Packages 2024-02-15T22:45:25.075 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:45:25.076 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 100 M 2024-02-15T22:45:25.076 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 123 M 2024-02-15T22:45:25.076 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:45:25.605 INFO:teuthology.orchestra.run.smithi133.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 9.0 MB/s | 6.1 MB 00:00 2024-02-15T22:45:26.137 INFO:teuthology.orchestra.run.smithi052.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 5.7 MB/s | 6.1 MB 00:01 2024-02-15T22:45:26.657 INFO:teuthology.orchestra.run.smithi133.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 12 MB/s | 21 MB 00:01 2024-02-15T22:45:27.243 INFO:teuthology.orchestra.run.smithi052.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 9.7 MB/s | 21 MB 00:02 2024-02-15T22:45:27.572 INFO:teuthology.orchestra.run.smithi133.stdout:(3/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 15 MB/s | 39 MB 00:02 2024-02-15T22:45:27.863 INFO:teuthology.orchestra.run.smithi133.stdout:(4/4): kernel-modules-core-5.14.0-421.el9.x86_6 15 MB/s | 33 MB 00:02 2024-02-15T22:45:27.866 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:45:27.867 INFO:teuthology.orchestra.run.smithi133.stdout:Total 34 MB/s | 100 MB 00:02 2024-02-15T22:45:27.867 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:45:28.026 INFO:teuthology.orchestra.run.smithi052.stdout:(3/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 13 MB/s | 39 MB 00:02 2024-02-15T22:45:28.253 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:45:28.253 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:45:28.335 INFO:teuthology.orchestra.run.smithi052.stdout:(4/4): kernel-modules-core-5.14.0-421.el9.x86_6 15 MB/s | 33 MB 00:02 2024-02-15T22:45:28.338 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:45:28.338 INFO:teuthology.orchestra.run.smithi052.stdout:Total 31 MB/s | 100 MB 00:03 2024-02-15T22:45:28.338 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:45:28.784 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:45:28.785 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:45:29.291 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:45:29.291 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:45:29.846 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:45:29.847 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:45:31.707 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:45:32.375 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:45:32.455 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:45:32.588 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:45:33.068 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:45:33.202 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:45:35.349 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:45:35.539 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:45:36.094 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:45:36.272 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:45:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:45:40.368 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:45:41.343 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:45:41.453 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:45:45.143 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:45:46.561 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:46:14.351 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:46:14.352 INFO:teuthology.orchestra.run.smithi133.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-15T22:46:14.352 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:46:14.422 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:46:14.880 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:46:14.880 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:46:14.880 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:46:14.880 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:46:15.315 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:46:15.315 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:46:15.315 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:46:15.315 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-15T22:46:15.315 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-15T22:46:15.315 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-15T22:46:15.315 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-15T22:46:15.315 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:46:15.315 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:46:15.805 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:46:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:46:15.949 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:46:15.949 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-15T22:46:15.949 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T22:46:15.949 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T22:46:15.949 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-02-15T22:46:15.949 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi133.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T22:46:15.949 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:46:16.057 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:46:16.057 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:46:16.057 DEBUG:teuthology.orchestra.run.smithi133:> sudo rpm -qi grub2-tools 2024-02-15T22:46:16.101 INFO:teuthology.orchestra.run.smithi133.stdout:Name : grub2-tools 2024-02-15T22:46:16.101 INFO:teuthology.orchestra.run.smithi133.stdout:Epoch : 1 2024-02-15T22:46:16.101 INFO:teuthology.orchestra.run.smithi133.stdout:Version : 2.06 2024-02-15T22:46:16.101 INFO:teuthology.orchestra.run.smithi133.stdout:Release : 68.el9 2024-02-15T22:46:16.101 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: x86_64 2024-02-15T22:46:16.101 INFO:teuthology.orchestra.run.smithi133.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-15T22:46:16.101 INFO:teuthology.orchestra.run.smithi133.stdout:Group : Unspecified 2024-02-15T22:46:16.101 INFO:teuthology.orchestra.run.smithi133.stdout:Size : 8264254 2024-02-15T22:46:16.101 INFO:teuthology.orchestra.run.smithi133.stdout:License : GPLv3+ 2024-02-15T22:46:16.101 INFO:teuthology.orchestra.run.smithi133.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:Packager : builder@centos.org 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:Vendor : CentOS 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:Summary : Support tools for GRUB. 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:Description : 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-15T22:46:16.102 INFO:teuthology.orchestra.run.smithi133.stdout:hardware devices. 2024-02-15T22:46:16.103 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:46:16.103 INFO:teuthology.orchestra.run.smithi133.stdout:This subpackage provides tools for support of all platforms. 2024-02-15T22:46:16.104 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-15T22:46:16.104 INFO:teuthology.task.kernel:Updating grub on smithi133 to boot 5.14.0-421.el9.x86_64 2024-02-15T22:46:16.104 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-15T22:46:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2024-02-15T22:46:17.104 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:46:17.105 INFO:teuthology.orchestra.run.smithi052.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-15T22:46:17.105 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:46:17.177 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:46:17.591 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:46:17.591 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:46:17.591 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:46:17.591 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:46:17.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:46:17.992 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:46:17.992 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:46:17.992 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-15T22:46:17.992 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-15T22:46:17.992 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-15T22:46:17.993 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-15T22:46:17.993 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:46:17.993 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:46:18.232 INFO:teuthology.orchestra.run.smithi133.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-15T22:46:18.253 INFO:teuthology.orchestra.run.smithi133.stderr:done 2024-02-15T22:46:18.255 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-02-15T22:46:18.270 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.U4QvIrD9av 2024-02-15T22:46:18.270 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.U4QvIrD9av 2024-02-15T22:46:18.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.U4QvIrD9av 2024-02-15T22:46:18.476 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.U4QvIrD9av is 6KB 2024-02-15T22:46:18.524 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.U4QvIrD9av 2024-02-15T22:46:18.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo /bin/ls /boot/loader/entries || true 2024-02-15T22:46:18.543 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:46:18.603 INFO:teuthology.orchestra.run.smithi133.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-15T22:46:18.603 INFO:teuthology.orchestra.run.smithi133.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-15T22:46:18.603 INFO:teuthology.orchestra.run.smithi133.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-15T22:46:18.603 INFO:teuthology.orchestra.run.smithi133.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-15T22:46:18.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-15T22:46:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:46:18.672 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:46:18.673 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-15T22:46:18.673 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T22:46:18.673 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T22:46:18.673 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-15T22:46:18.673 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T22:46:18.673 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:46:18.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo shutdown -r now 2024-02-15T22:46:18.785 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:46:18.786 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:46:18.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -qi grub2-tools 2024-02-15T22:46:18.823 INFO:teuthology.orchestra.run.smithi052.stdout:Name : grub2-tools 2024-02-15T22:46:18.823 INFO:teuthology.orchestra.run.smithi052.stdout:Epoch : 1 2024-02-15T22:46:18.823 INFO:teuthology.orchestra.run.smithi052.stdout:Version : 2.06 2024-02-15T22:46:18.823 INFO:teuthology.orchestra.run.smithi052.stdout:Release : 68.el9 2024-02-15T22:46:18.823 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: x86_64 2024-02-15T22:46:18.823 INFO:teuthology.orchestra.run.smithi052.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-15T22:46:18.823 INFO:teuthology.orchestra.run.smithi052.stdout:Group : Unspecified 2024-02-15T22:46:18.823 INFO:teuthology.orchestra.run.smithi052.stdout:Size : 8264254 2024-02-15T22:46:18.823 INFO:teuthology.orchestra.run.smithi052.stdout:License : GPLv3+ 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:Packager : builder@centos.org 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:Vendor : CentOS 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:Summary : Support tools for GRUB. 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:Description : 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:hardware devices. 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:46:18.824 INFO:teuthology.orchestra.run.smithi052.stdout:This subpackage provides tools for support of all platforms. 2024-02-15T22:46:18.825 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-15T22:46:18.825 INFO:teuthology.task.kernel:Updating grub on smithi052 to boot 5.14.0-421.el9.x86_64 2024-02-15T22:46:18.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-15T22:46:19.449 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2024-02-15T22:46:20.840 INFO:teuthology.orchestra.run.smithi052.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-15T22:46:20.875 INFO:teuthology.orchestra.run.smithi052.stderr:done 2024-02-15T22:46:20.878 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-02-15T22:46:20.893 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.nSEzjWaXZ0 2024-02-15T22:46:20.893 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nSEzjWaXZ0 2024-02-15T22:46:20.965 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.nSEzjWaXZ0 2024-02-15T22:46:21.113 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.nSEzjWaXZ0 is 6KB 2024-02-15T22:46:21.162 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.nSEzjWaXZ0 2024-02-15T22:46:21.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo /bin/ls /boot/loader/entries || true 2024-02-15T22:46:21.244 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-15T22:46:21.245 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-15T22:46:21.245 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-15T22:46:21.245 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-15T22:46:21.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-15T22:46:21.405 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2024-02-15T22:46:48.809 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-02-15T22:46:48.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T22:46:48.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:46:51.408 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-15T22:46:51.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-02-15T22:46:51.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:47:07.324 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-15T22:47:16.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T22:47:16.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:47:19.388 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-15T22:47:31.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T22:47:31.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:47:49.820 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-15T22:47:51.413 DEBUG:teuthology.orchestra.remote:timed out 2024-02-15T22:48:00.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-02-15T22:48:00.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:48:00.728 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-02-15T22:48:01.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-02-15T22:48:01.150 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-421.el9.x86_64"... 2024-02-15T22:48:01.151 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-02-15T22:48:01.208 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-421.el9.x86_64 2024-02-15T22:48:01.209 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-15T22:48:01.209 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T22:48:01.209 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-15T22:48:02.210 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-15T22:48:02.210 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T22:48:02.275 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2024-02-15T22:48:02.317 DEBUG:teuthology.parallel:result is None 2024-02-15T22:48:04.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T22:48:04.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:48:05.135 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-02-15T22:48:05.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T22:48:05.522 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-421.el9.x86_64"... 2024-02-15T22:48:05.523 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-02-15T22:48:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:5.14.0-421.el9.x86_64 2024-02-15T22:48:05.536 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-15T22:48:05.536 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T22:48:05.537 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-15T22:48:06.538 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-02-15T22:48:06.538 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T22:48:06.625 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2024-02-15T22:48:06.683 DEBUG:teuthology.parallel:result is None 2024-02-15T22:48:06.684 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-15T22:48:06.691 INFO:teuthology.task.internal:Creating test directory... 2024-02-15T22:48:06.691 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T22:48:06.694 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T22:48:06.708 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-15T22:48:06.714 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-15T22:48:06.722 INFO:teuthology.task.internal:Creating archive directory... 2024-02-15T22:48:06.722 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T22:48:06.750 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T22:48:06.779 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-15T22:48:06.786 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-15T22:48:06.786 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T22:48:06.817 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T22:48:06.844 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:48:06.849 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:48:06.857 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:48:06.862 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:48:06.863 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-15T22:48:06.870 INFO:teuthology.task.internal:Configuring sudo... 2024-02-15T22:48:06.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T22:48:06.901 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T22:48:06.942 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-15T22:48:06.951 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-15T22:48:06.951 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T22:48:06.968 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T22:48:07.000 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:48:07.064 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:48:07.113 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:48:07.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:48:07.236 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:48:07.236 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T22:48:07.302 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:48:07.351 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:48:07.429 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:48:07.478 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:48:07.544 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:48:07.544 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T22:48:07.633 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-02-15T22:48:07.636 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2024-02-15T22:48:07.687 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T22:48:07.753 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T22:48:08.191 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-15T22:48:08.199 INFO:teuthology.task.internal:Starting timer... 2024-02-15T22:48:08.199 INFO:teuthology.run_tasks:Running task pcp... 2024-02-15T22:48:08.217 INFO:teuthology.run_tasks:Running task selinux... 2024-02-15T22:48:08.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-02-15T22:48:08.298 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-02-15T22:48:08.299 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2024-02-15T22:48:08.351 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2024-02-15T22:48:08.353 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-15T22:48:08.353 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-02-15T22:48:08.372 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-02-15T22:48:08.372 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2024-02-15T22:48:08.392 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2024-02-15T22:48:08.393 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi133.front.sepia.ceph.com': 'permissive'} 2024-02-15T22:48:08.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T22:48:08.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:48:08.441 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T22:48:08.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:48:08.468 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-15T22:48:08.469 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-02-15T22:48:08.515 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2024-02-15T22:48:08.570 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-15T22:48:08.581 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-15T22:48:08.586 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-15T22:48:08.713 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-15T22:48:08.728 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-15T22:48:08.729 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-15T22:52:22.254 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com')] 2024-02-15T22:52:22.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-02-15T22:52:22.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:52:22.351 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-02-15T22:52:22.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-02-15T22:52:22.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T22:52:22.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:52:22.549 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-02-15T22:52:22.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T22:52:22.628 INFO:teuthology.run_tasks:Running task clock... 2024-02-15T22:52:22.639 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-15T22:52:22.639 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T22:52:22.640 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T22:52:22.642 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T22:52:22.642 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T22:52:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-15T22:52:22.690 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-15T22:52:22.701 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-15T22:52:22.718 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-15T22:52:22.721 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-02-15T22:52:22.735 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-02-15T22:52:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2024-02-15T22:52:22.752 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-15T22:52:22.762 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2024-02-15T22:52:22.768 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-15T22:52:22.778 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-15T22:52:22.794 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-15T22:52:22.822 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-02-15T22:52:22.825 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T22:52:22.825 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-02-15T22:52:22.825 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:52:22.825 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:52:22.825 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:52:22.825 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:52:22.845 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-02-15T22:52:22.849 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T22:52:22.849 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-02-15T22:52:22.849 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:52:22.849 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:52:22.849 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:52:22.849 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:52:22.850 INFO:teuthology.run_tasks:Running task install... 2024-02-15T22:52:22.858 DEBUG:teuthology.task.install:project ceph 2024-02-15T22:52:22.858 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}} 2024-02-15T22:52:22.858 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'} 2024-02-15T22:52:22.858 INFO:teuthology.task.install:Using flavor: default 2024-02-15T22:52:22.864 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-15T22:52:22.864 INFO:teuthology.task.install:extra packages: [] 2024-02-15T22:52:22.865 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'tag': None, 'wait_for_package': False} 2024-02-15T22:52:22.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-15T22:52:22.867 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'tag': None, 'wait_for_package': False} 2024-02-15T22:52:22.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-15T22:52:23.032 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/ 2024-02-15T22:52:23.032 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1468.gfddf34c1 2024-02-15T22:52:23.114 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/ 2024-02-15T22:52:23.114 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1468.gfddf34c1 2024-02-15T22:52:23.213 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-15T22:52:23.213 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:52:23.213 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-15T22:52:23.220 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-15T22:52:23.220 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:52:23.220 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-15T22:52:23.241 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-15T22:52:23.242 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/fddf34c14d11a944c077fae4b86a8722d85c0772/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-15T22:52:23.248 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-15T22:52:23.248 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/fddf34c14d11a944c077fae4b86a8722d85c0772/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-15T22:52:23.311 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-15T22:52:23.315 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-15T22:52:23.391 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-15T22:52:23.395 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-15T22:52:23.457 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-02-15T22:52:23.459 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-02-15T22:52:23.461 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2024-02-15T22:52:23.462 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2024-02-15T22:52:23.711 INFO:teuthology.orchestra.run.smithi133.stdout:74 files removed 2024-02-15T22:52:23.715 INFO:teuthology.orchestra.run.smithi052.stdout:74 files removed 2024-02-15T22:52:23.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw 2024-02-15T22:52:23.742 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw 2024-02-15T22:52:24.393 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 245 kB/s | 82 kB 00:00 2024-02-15T22:52:24.462 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 206 kB/s | 82 kB 00:00 2024-02-15T22:52:24.827 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 26 kB/s | 10 kB 00:00 2024-02-15T22:52:24.837 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 31 kB/s | 10 kB 00:00 2024-02-15T22:52:25.195 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2024-02-15T22:52:25.305 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-02-15T22:52:25.731 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-02-15T22:52:25.874 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-02-15T22:52:27.382 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2024-02-15T22:52:27.756 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS-9 - BaseOS 2.4 MB/s | 2.0 MB 00:00 2024-02-15T22:52:28.956 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.0 MB 00:01 2024-02-15T22:52:29.579 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.0 MB 00:01 2024-02-15T22:52:33.730 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-02-15T22:52:33.740 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 19 MB 00:03 2024-02-15T22:52:38.389 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.1 MB 00:01 2024-02-15T22:52:39.033 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.1 MB 00:01 2024-02-15T22:52:40.484 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 15 kB 00:00 2024-02-15T22:52:40.798 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 15 kB 00:01 2024-02-15T22:52:42.013 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2024-02-15T22:52:45.507 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 4.4 MB/s | 20 MB 00:04 2024-02-15T22:52:47.144 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-02-15T22:52:49.899 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:52:49.902 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 9.8 M 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.4 M 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.1 M 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 5.3 M 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 20 M 2024-02-15T22:52:49.903 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 25 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 741 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 498 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 5.1 M 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-15T22:52:49.904 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 45 k 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 131 k 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 161 k 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 320 k 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 298 k 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 99 k 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:52:49.905 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:52:49.906 INFO:teuthology.orchestra.run.smithi052.stdout:Install 30 Packages 2024-02-15T22:52:49.906 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 2 Packages 2024-02-15T22:52:49.906 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:52:49.906 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 58 M 2024-02-15T22:52:49.906 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:52:50.415 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-02-15T22:52:50.595 INFO:teuthology.orchestra.run.smithi052.stdout:(1/32): ceph-base-19.0.0-1468.gfddf34c1.el9.x86 8.7 MB/s | 5.3 MB 00:00 2024-02-15T22:52:50.679 INFO:teuthology.orchestra.run.smithi052.stdout:(2/32): ceph-selinux-19.0.0-1468.gfddf34c1.el9. 302 kB/s | 25 kB 00:00 2024-02-15T22:52:50.854 INFO:teuthology.orchestra.run.smithi052.stdout:(3/32): libcephfs2-19.0.0-1468.gfddf34c1.el9.x8 4.1 MB/s | 741 kB 00:00 2024-02-15T22:52:50.963 INFO:teuthology.orchestra.run.smithi052.stdout:(4/32): ceph-radosgw-19.0.0-1468.gfddf34c1.el9. 9.9 MB/s | 9.8 MB 00:00 2024-02-15T22:52:51.346 INFO:teuthology.orchestra.run.smithi052.stdout:(5/32): libradosstriper1-19.0.0-1468.gfddf34c1. 1.0 MB/s | 498 kB 00:00 2024-02-15T22:52:51.513 INFO:teuthology.orchestra.run.smithi052.stdout:(6/32): python3-ceph-argparse-19.0.0-1468.gfddf 271 kB/s | 45 kB 00:00 2024-02-15T22:52:51.622 INFO:teuthology.orchestra.run.smithi052.stdout:(7/32): librgw2-19.0.0-1468.gfddf34c1.el9.x86_6 7.8 MB/s | 5.1 MB 00:00 2024-02-15T22:52:51.705 INFO:teuthology.orchestra.run.smithi052.stdout:(8/32): python3-ceph-common-19.0.0-1468.gfddf34 685 kB/s | 131 kB 00:00 2024-02-15T22:52:51.730 INFO:teuthology.orchestra.run.smithi052.stdout:(9/32): python3-cephfs-19.0.0-1468.gfddf34c1.el 1.5 MB/s | 161 kB 00:00 2024-02-15T22:52:51.806 INFO:teuthology.orchestra.run.smithi052.stdout:(10/32): python3-rados-19.0.0-1468.gfddf34c1.el 3.1 MB/s | 320 kB 00:00 2024-02-15T22:52:51.839 INFO:teuthology.orchestra.run.smithi052.stdout:(11/32): python3-rbd-19.0.0-1468.gfddf34c1.el9. 2.7 MB/s | 298 kB 00:00 2024-02-15T22:52:51.923 INFO:teuthology.orchestra.run.smithi052.stdout:(12/32): python3-rgw-19.0.0-1468.gfddf34c1.el9. 851 kB/s | 99 kB 00:00 2024-02-15T22:52:51.982 INFO:teuthology.orchestra.run.smithi052.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 746 kB/s | 106 kB 00:00 2024-02-15T22:52:52.007 INFO:teuthology.orchestra.run.smithi052.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 159 kB 00:00 2024-02-15T22:52:52.024 INFO:teuthology.orchestra.run.smithi052.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-02-15T22:52:52.066 INFO:teuthology.orchestra.run.smithi052.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-02-15T22:52:52.091 INFO:teuthology.orchestra.run.smithi052.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.1 MB/s | 282 kB 00:00 2024-02-15T22:52:52.117 INFO:teuthology.orchestra.run.smithi052.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 830 kB/s | 41 kB 00:00 2024-02-15T22:52:52.142 INFO:teuthology.orchestra.run.smithi052.stdout:(19/32): qatlib-23.11.0-1.el9.x86_64.rpm 4.2 MB/s | 215 kB 00:00 2024-02-15T22:52:52.167 INFO:teuthology.orchestra.run.smithi052.stdout:(20/32): qatlib-service-23.11.0-1.el9.x86_64.rp 677 kB/s | 34 kB 00:00 2024-02-15T22:52:52.193 INFO:teuthology.orchestra.run.smithi052.stdout:(21/32): qatzip-libs-1.1.2-2.el9.x86_64.rpm 869 kB/s | 43 kB 00:00 2024-02-15T22:52:52.393 INFO:teuthology.orchestra.run.smithi052.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.3 MB/s | 309 kB 00:00 2024-02-15T22:52:52.460 INFO:teuthology.orchestra.run.smithi052.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-02-15T22:52:52.502 INFO:teuthology.orchestra.run.smithi052.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-02-15T22:52:52.544 INFO:teuthology.orchestra.run.smithi052.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-02-15T22:52:52.603 INFO:teuthology.orchestra.run.smithi052.stdout:(26/32): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-02-15T22:52:52.703 INFO:teuthology.orchestra.run.smithi052.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 838 kB 00:00 2024-02-15T22:52:52.728 INFO:teuthology.orchestra.run.smithi052.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-02-15T22:52:52.803 INFO:teuthology.orchestra.run.smithi052.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-02-15T22:52:53.060 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:52:53.067 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:52:53.067 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 9.8 M 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.4 M 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.1 M 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 5.3 M 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 20 M 2024-02-15T22:52:53.068 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 25 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 741 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 498 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 5.1 M 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-15T22:52:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 45 k 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 131 k 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 161 k 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 320 k 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 298 k 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 99 k 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout:Installing weak dependencies: 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:52:53.070 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:52:53.071 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:52:53.071 INFO:teuthology.orchestra.run.smithi133.stdout:Install 30 Packages 2024-02-15T22:52:53.071 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 2 Packages 2024-02-15T22:52:53.071 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:52:53.071 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 58 M 2024-02-15T22:52:53.071 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:52:53.120 INFO:teuthology.orchestra.run.smithi052.stdout:(30/32): librados2-19.0.0-1468.gfddf34c1.el9.x8 8.6 MB/s | 3.4 MB 00:00 2024-02-15T22:52:53.387 INFO:teuthology.orchestra.run.smithi052.stdout:(31/32): ceph-common-19.0.0-1468.gfddf34c1.el9. 5.8 MB/s | 20 MB 00:03 2024-02-15T22:52:53.446 INFO:teuthology.orchestra.run.smithi052.stdout:(32/32): librbd1-19.0.0-1468.gfddf34c1.el9.x86_ 4.9 MB/s | 3.1 MB 00:00 2024-02-15T22:52:53.451 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:52:53.451 INFO:teuthology.orchestra.run.smithi052.stdout:Total 16 MB/s | 58 MB 00:03 2024-02-15T22:52:53.451 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:52:53.490 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:52:53.490 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:52:53.978 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:52:53.979 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:52:54.483 INFO:teuthology.orchestra.run.smithi133.stdout:(1/32): ceph-common-19.0.0-1468.gfddf34c1.el9.x 16 MB/s | 20 MB 00:01 2024-02-15T22:52:54.525 INFO:teuthology.orchestra.run.smithi133.stdout:(2/32): ceph-selinux-19.0.0-1468.gfddf34c1.el9. 605 kB/s | 25 kB 00:00 2024-02-15T22:52:54.617 INFO:teuthology.orchestra.run.smithi133.stdout:(3/32): libcephfs2-19.0.0-1468.gfddf34c1.el9.x8 7.9 MB/s | 741 kB 00:00 2024-02-15T22:52:54.667 INFO:teuthology.orchestra.run.smithi133.stdout:(4/32): libradosstriper1-19.0.0-1468.gfddf34c1. 9.8 MB/s | 498 kB 00:00 2024-02-15T22:52:54.984 INFO:teuthology.orchestra.run.smithi133.stdout:(5/32): librgw2-19.0.0-1468.gfddf34c1.el9.x86_6 16 MB/s | 5.1 MB 00:00 2024-02-15T22:52:55.067 INFO:teuthology.orchestra.run.smithi133.stdout:(6/32): ceph-base-19.0.0-1468.gfddf34c1.el9.x86 2.9 MB/s | 5.3 MB 00:01 2024-02-15T22:52:55.092 INFO:teuthology.orchestra.run.smithi133.stdout:(7/32): python3-ceph-argparse-19.0.0-1468.gfddf 415 kB/s | 45 kB 00:00 2024-02-15T22:52:55.126 INFO:teuthology.orchestra.run.smithi133.stdout:(8/32): python3-ceph-common-19.0.0-1468.gfddf34 2.2 MB/s | 131 kB 00:00 2024-02-15T22:52:55.151 INFO:teuthology.orchestra.run.smithi133.stdout:(9/32): python3-cephfs-19.0.0-1468.gfddf34c1.el 2.7 MB/s | 161 kB 00:00 2024-02-15T22:52:55.227 INFO:teuthology.orchestra.run.smithi133.stdout:(10/32): python3-rbd-19.0.0-1468.gfddf34c1.el9. 3.9 MB/s | 298 kB 00:00 2024-02-15T22:52:55.252 INFO:teuthology.orchestra.run.smithi133.stdout:(11/32): python3-rados-19.0.0-1468.gfddf34c1.el 2.5 MB/s | 320 kB 00:00 2024-02-15T22:52:55.277 INFO:teuthology.orchestra.run.smithi133.stdout:(12/32): python3-rgw-19.0.0-1468.gfddf34c1.el9. 1.9 MB/s | 99 kB 00:00 2024-02-15T22:52:55.444 INFO:teuthology.orchestra.run.smithi133.stdout:(13/32): ceph-radosgw-19.0.0-1468.gfddf34c1.el9 4.4 MB/s | 9.8 MB 00:02 2024-02-15T22:52:55.478 INFO:teuthology.orchestra.run.smithi133.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 469 kB/s | 106 kB 00:00 2024-02-15T22:52:55.499 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:52:55.503 INFO:teuthology.orchestra.run.smithi133.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 44 kB 00:00 2024-02-15T22:52:55.536 INFO:teuthology.orchestra.run.smithi133.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 678 kB/s | 159 kB 00:00 2024-02-15T22:52:55.574 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-02-15T22:52:55.600 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-02-15T22:52:55.620 INFO:teuthology.orchestra.run.smithi133.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 661 kB 00:00 2024-02-15T22:52:55.626 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-02-15T22:52:55.645 INFO:teuthology.orchestra.run.smithi133.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 282 kB 00:00 2024-02-15T22:52:55.648 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-02-15T22:52:55.662 INFO:teuthology.orchestra.run.smithi133.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 329 kB/s | 41 kB 00:00 2024-02-15T22:52:55.665 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-02-15T22:52:55.688 INFO:teuthology.orchestra.run.smithi133.stdout:(20/32): qatlib-23.11.0-1.el9.x86_64.rpm 3.2 MB/s | 215 kB 00:00 2024-02-15T22:52:55.704 INFO:teuthology.orchestra.run.smithi133.stdout:(21/32): qatlib-service-23.11.0-1.el9.x86_64.rp 813 kB/s | 34 kB 00:00 2024-02-15T22:52:55.721 INFO:teuthology.orchestra.run.smithi133.stdout:(22/32): qatzip-libs-1.1.2-2.el9.x86_64.rpm 743 kB/s | 43 kB 00:00 2024-02-15T22:52:55.858 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 5/34 2024-02-15T22:52:55.914 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 5/34 2024-02-15T22:52:56.155 INFO:teuthology.orchestra.run.smithi133.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 60 kB/s | 26 kB 00:00 2024-02-15T22:52:56.260 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-02-15T22:52:56.319 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-15T22:52:56.340 INFO:teuthology.orchestra.run.smithi133.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 262 kB/s | 49 kB 00:00 2024-02-15T22:52:56.391 INFO:teuthology.orchestra.run.smithi133.stdout:(25/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 439 kB/s | 309 kB 00:00 2024-02-15T22:52:56.395 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-15T22:52:56.489 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 8/34 2024-02-15T22:52:56.491 INFO:teuthology.orchestra.run.smithi133.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 448 kB/s | 67 kB 00:00 2024-02-15T22:52:56.521 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 9/34 2024-02-15T22:52:56.584 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 9/34 2024-02-15T22:52:56.612 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-02-15T22:52:56.656 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9. 11/34 2024-02-15T22:52:56.683 INFO:teuthology.orchestra.run.smithi133.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.8 MB/s | 838 kB 00:00 2024-02-15T22:52:56.717 INFO:teuthology.orchestra.run.smithi133.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 851 kB/s | 192 kB 00:00 2024-02-15T22:52:56.726 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 12/34 2024-02-15T22:52:56.748 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 13/34 2024-02-15T22:52:56.792 INFO:teuthology.orchestra.run.smithi133.stdout:(29/32): libarrow-9.0.0-10.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2024-02-15T22:52:56.810 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 13/34 2024-02-15T22:52:56.838 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 14/34 2024-02-15T22:52:56.917 INFO:teuthology.orchestra.run.smithi133.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-02-15T22:52:56.950 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-02-15T22:52:56.992 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-02-15T22:52:57.030 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-02-15T22:52:57.123 INFO:teuthology.orchestra.run.smithi133.stdout:(31/32): librbd1-19.0.0-1468.gfddf34c1.el9.x86_ 11 MB/s | 3.1 MB 00:00 2024-02-15T22:52:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-02-15T22:52:57.123 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-02-15T22:52:57.124 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-02-15T22:52:57.475 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-02-15T22:52:57.484 INFO:teuthology.orchestra.run.smithi133.stdout:(32/32): librados2-19.0.0-1468.gfddf34c1.el9.x8 4.4 MB/s | 3.4 MB 00:00 2024-02-15T22:52:57.491 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:52:57.491 INFO:teuthology.orchestra.run.smithi133.stdout:Total 13 MB/s | 58 MB 00:04 2024-02-15T22:52:57.492 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:52:57.504 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 22/34 2024-02-15T22:52:57.526 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:52:57.527 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:52:57.594 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 22/34 2024-02-15T22:52:57.626 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 23/34 2024-02-15T22:52:57.678 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-02-15T22:52:57.996 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:52:57.996 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:52:58.152 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-02-15T22:52:58.181 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 26/34 2024-02-15T22:52:58.253 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 26/34 2024-02-15T22:52:58.324 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 27/34 2024-02-15T22:52:58.351 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x8 28/34 2024-02-15T22:52:59.440 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:52:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-02-15T22:52:59.607 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-02-15T22:52:59.665 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-02-15T22:52:59.704 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-02-15T22:52:59.721 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-02-15T22:52:59.909 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 5/34 2024-02-15T22:52:59.969 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 5/34 2024-02-15T22:53:00.296 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-02-15T22:53:00.349 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-15T22:53:00.441 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-15T22:53:00.529 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 8/34 2024-02-15T22:53:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 9/34 2024-02-15T22:53:00.568 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-15T22:53:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 9/34 2024-02-15T22:53:00.614 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-15T22:53:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-02-15T22:53:00.677 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9. 11/34 2024-02-15T22:53:00.745 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 12/34 2024-02-15T22:53:00.778 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 13/34 2024-02-15T22:53:00.840 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 13/34 2024-02-15T22:53:00.867 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 14/34 2024-02-15T22:53:00.978 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-02-15T22:53:01.016 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-02-15T22:53:01.060 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-02-15T22:53:01.092 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-02-15T22:53:01.122 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-02-15T22:53:01.154 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-02-15T22:53:01.194 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-15T22:53:01.226 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 30/34 2024-02-15T22:53:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 30/34 2024-02-15T22:53:01.324 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-15T22:53:01.324 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-15T22:53:01.324 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:53:01.360 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-15T22:53:01.478 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-02-15T22:53:01.518 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 22/34 2024-02-15T22:53:01.608 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 22/34 2024-02-15T22:53:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 23/34 2024-02-15T22:53:01.685 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-02-15T22:53:02.168 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-02-15T22:53:02.195 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 26/34 2024-02-15T22:53:02.266 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 26/34 2024-02-15T22:53:02.335 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 27/34 2024-02-15T22:53:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x8 28/34 2024-02-15T22:53:04.525 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-15T22:53:04.568 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-15T22:53:05.140 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-15T22:53:05.172 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 30/34 2024-02-15T22:53:05.269 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 30/34 2024-02-15T22:53:05.269 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-15T22:53:05.269 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-15T22:53:05.269 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:53:05.323 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-15T22:53:11.297 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-15T22:53:11.297 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-02-15T22:53:11.297 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-02-15T22:53:11.297 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-02-15T22:53:11.297 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-02-15T22:53:11.297 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-02-15T22:53:11.297 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-02-15T22:53:11.297 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-02-15T22:53:11.297 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:53:12.243 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/34 2024-02-15T22:53:12.268 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/34 2024-02-15T22:53:12.268 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:53:12.268 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-15T22:53:12.268 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:53:12.268 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:53:12.268 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:53:12.270 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-02-15T22:53:12.354 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-02-15T22:53:12.354 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 3/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 4/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 6/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9. 8/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x8 9/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 10/34 2024-02-15T22:53:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 11/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 12/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 13/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 20/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 21/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 22/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-02-15T22:53:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-02-15T22:53:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-02-15T22:53:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-02-15T22:53:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-02-15T22:53:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-02-15T22:53:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-02-15T22:53:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-15T22:53:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-02-15T22:53:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/34 2024-02-15T22:53:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-02-15T22:53:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:53:14.605 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-02-15T22:53:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.605 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:53:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-15T22:53:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-15T22:53:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-3.el9.x86_64 2024-02-15T22:53:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-15T22:53:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:53:14.608 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:53:14.910 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-15T22:53:14.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2024-02-15T22:53:14.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2024-02-15T22:53:14.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2024-02-15T22:53:14.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2024-02-15T22:53:14.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2024-02-15T22:53:14.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /root 2024-02-15T22:53:14.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2024-02-15T22:53:14.911 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:53:14.945 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-test 2024-02-15T22:53:15.522 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:28 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:53:15.711 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:53:15.712 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:53:15.712 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-02-15T22:53:15.712 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:53:15.712 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:53:15.712 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 47 M 2024-02-15T22:53:15.712 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-02-15T22:53:15.712 INFO:teuthology.orchestra.run.smithi052.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-15T22:53:15.712 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 163 k 2024-02-15T22:53:15.712 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-15T22:53:15.712 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-15T22:53:15.712 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-15T22:53:15.713 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:53:15.713 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:53:15.713 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:53:15.713 INFO:teuthology.orchestra.run.smithi052.stdout:Install 6 Packages 2024-02-15T22:53:15.713 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:53:15.713 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 48 M 2024-02-15T22:53:15.713 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 205 M 2024-02-15T22:53:15.714 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:53:15.827 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/34 2024-02-15T22:53:15.851 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/34 2024-02-15T22:53:15.851 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:53:15.851 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-15T22:53:15.851 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:53:15.851 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:53:15.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:53:15.853 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-02-15T22:53:15.901 INFO:teuthology.orchestra.run.smithi052.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.6 MB/s | 300 kB 00:00 2024-02-15T22:53:15.926 INFO:teuthology.orchestra.run.smithi052.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 63 kB 00:00 2024-02-15T22:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-02-15T22:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-02-15T22:53:15.968 INFO:teuthology.orchestra.run.smithi052.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2024-02-15T22:53:16.010 INFO:teuthology.orchestra.run.smithi052.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2024-02-15T22:53:16.110 INFO:teuthology.orchestra.run.smithi052.stdout:(5/6): libcephsqlite-19.0.0-1468.gfddf34c1.el9. 412 kB/s | 163 kB 00:00 2024-02-15T22:53:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-02-15T22:53:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/34 2024-02-15T22:53:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/34 2024-02-15T22:53:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 3/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 4/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 6/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9. 8/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x8 9/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 10/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 11/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 12/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 13/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-02-15T22:53:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 20/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 21/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 22/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-02-15T22:53:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-02-15T22:53:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-02-15T22:53:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-15T22:53:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-02-15T22:53:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/34 2024-02-15T22:53:18.227 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-15T22:53:18.228 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.229 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-15T22:53:18.230 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.230 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.230 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:18.230 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-15T22:53:18.230 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-15T22:53:18.230 INFO:teuthology.orchestra.run.smithi133.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-15T22:53:18.230 INFO:teuthology.orchestra.run.smithi133.stdout: re2-1:20211101-3.el9.x86_64 2024-02-15T22:53:18.230 INFO:teuthology.orchestra.run.smithi133.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-15T22:53:18.230 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:53:18.230 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:53:18.602 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-test 2024-02-15T22:53:19.179 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:00:29 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:53:19.349 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:53:19.350 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:53:19.350 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 47 M 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 163 k 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:53:19.351 INFO:teuthology.orchestra.run.smithi133.stdout:Install 6 Packages 2024-02-15T22:53:19.352 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:53:19.352 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 48 M 2024-02-15T22:53:19.352 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 205 M 2024-02-15T22:53:19.352 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:53:19.983 INFO:teuthology.orchestra.run.smithi133.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 476 kB/s | 300 kB 00:00 2024-02-15T22:53:20.083 INFO:teuthology.orchestra.run.smithi133.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 627 kB/s | 63 kB 00:00 2024-02-15T22:53:20.266 INFO:teuthology.orchestra.run.smithi133.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 186 kB 00:00 2024-02-15T22:53:20.316 INFO:teuthology.orchestra.run.smithi133.stdout:(4/6): libcephsqlite-19.0.0-1468.gfddf34c1.el9. 169 kB/s | 163 kB 00:00 2024-02-15T22:53:20.416 INFO:teuthology.orchestra.run.smithi133.stdout:(5/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2024-02-15T22:53:45.522 INFO:teuthology.orchestra.run.smithi133.stdout:(6/6): ceph-test-19.0.0-1468.gfddf34c1.el9.x86_ 1.8 MB/s | 47 MB 00:26 2024-02-15T22:53:45.525 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:53:45.525 INFO:teuthology.orchestra.run.smithi133.stdout:Total 1.8 MB/s | 48 MB 00:26 2024-02-15T22:53:45.525 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:53:45.545 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:53:45.545 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:53:45.954 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:53:45.955 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:53:46.529 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:53:46.587 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-15T22:53:46.624 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-15T22:53:46.674 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-15T22:53:46.713 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-15T22:53:46.742 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/6 2024-02-15T22:53:48.259 INFO:teuthology.orchestra.run.smithi052.stdout:(6/6): ceph-test-19.0.0-1468.gfddf34c1.el9.x86_ 1.5 MB/s | 47 MB 00:32 2024-02-15T22:53:48.262 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:53:48.262 INFO:teuthology.orchestra.run.smithi052.stdout:Total 1.5 MB/s | 48 MB 00:32 2024-02-15T22:53:48.262 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:53:48.285 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:53:48.285 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:53:48.697 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:53:48.698 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:53:49.283 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:53:49.340 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-15T22:53:49.384 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-15T22:53:49.434 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-15T22:53:49.484 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-15T22:53:49.511 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/6 2024-02-15T22:53:51.228 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/6 2024-02-15T22:53:51.315 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 6/6 2024-02-15T22:53:53.642 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 6/6 2024-02-15T22:53:53.642 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/6 2024-02-15T22:53:53.642 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/6 2024-02-15T22:53:53.642 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-15T22:53:53.642 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-15T22:53:53.643 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-15T22:53:54.028 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-15T22:53:54.028 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:53:54.028 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:53:54.028 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:54.028 INFO:teuthology.orchestra.run.smithi133.stdout: jq-1.6-16.el9.x86_64 2024-02-15T22:53:54.029 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:54.029 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-15T22:53:54.029 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-15T22:53:54.029 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-15T22:53:54.029 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:53:54.029 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:53:54.246 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/6 2024-02-15T22:53:54.324 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 6/6 2024-02-15T22:53:54.349 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph 2024-02-15T22:53:54.940 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:04 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:53:55.114 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:53:55.116 INFO:teuthology.orchestra.run.smithi133.stdout:========================================================================================= 2024-02-15T22:53:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T22:53:55.116 INFO:teuthology.orchestra.run.smithi133.stdout:========================================================================================= 2024-02-15T22:53:55.116 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:53:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 6.6 k 2024-02-15T22:53:55.116 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 2.1 M 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 1.5 M 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 247 k 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 4.7 M 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 17 M 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-15T22:53:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-15T22:53:55.118 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout:========================================================================================= 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout:Install 36 Packages 2024-02-15T22:53:55.119 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:53:55.120 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 30 M 2024-02-15T22:53:55.120 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 107 M 2024-02-15T22:53:55.120 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:53:56.274 INFO:teuthology.orchestra.run.smithi133.stdout:(1/36): ceph-19.0.0-1468.gfddf34c1.el9.x86_64.r 18 kB/s | 6.6 kB 00:00 2024-02-15T22:53:56.697 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 6/6 2024-02-15T22:53:56.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/6 2024-02-15T22:53:56.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/6 2024-02-15T22:53:56.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-15T22:53:56.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-15T22:53:56.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-15T22:53:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-15T22:53:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:53:57.077 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:53:57.078 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:57.078 INFO:teuthology.orchestra.run.smithi052.stdout: jq-1.6-16.el9.x86_64 2024-02-15T22:53:57.078 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:53:57.078 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-15T22:53:57.078 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-15T22:53:57.078 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-15T22:53:57.078 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:53:57.078 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:53:57.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph 2024-02-15T22:53:57.433 INFO:teuthology.orchestra.run.smithi133.stdout:(2/36): ceph-mgr-19.0.0-1468.gfddf34c1.el9.x86_ 994 kB/s | 1.5 MB 00:01 2024-02-15T22:53:57.930 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:10 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:53:58.108 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout:========================================================================================= 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout:========================================================================================= 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 6.6 k 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 2.1 M 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 1.5 M 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 247 k 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 4.7 M 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 17 M 2024-02-15T22:53:58.111 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-15T22:53:58.112 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-15T22:53:58.113 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-15T22:53:58.114 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-15T22:53:58.114 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-15T22:53:58.114 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:53:58.114 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:53:58.114 INFO:teuthology.orchestra.run.smithi052.stdout:========================================================================================= 2024-02-15T22:53:58.114 INFO:teuthology.orchestra.run.smithi052.stdout:Install 36 Packages 2024-02-15T22:53:58.114 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:53:58.114 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 30 M 2024-02-15T22:53:58.115 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 107 M 2024-02-15T22:53:58.115 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:53:58.912 INFO:teuthology.orchestra.run.smithi052.stdout:(1/36): ceph-19.0.0-1468.gfddf34c1.el9.x86_64.r 43 kB/s | 6.6 kB 00:00 2024-02-15T22:53:59.229 INFO:teuthology.orchestra.run.smithi052.stdout:(2/36): ceph-mds-19.0.0-1468.gfddf34c1.el9.x86_ 4.5 MB/s | 2.1 MB 00:00 2024-02-15T22:53:59.363 INFO:teuthology.orchestra.run.smithi052.stdout:(3/36): ceph-mon-19.0.0-1468.gfddf34c1.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-02-15T22:53:59.413 INFO:teuthology.orchestra.run.smithi052.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1468.gfddf 4.9 MB/s | 247 kB 00:00 2024-02-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi052.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 356 kB/s | 187 kB 00:00 2024-02-15T22:54:00.097 INFO:teuthology.orchestra.run.smithi052.stdout:(6/36): ceph-osd-19.0.0-1468.gfddf34c1.el9.x86_ 19 MB/s | 17 MB 00:00 2024-02-15T22:54:00.139 INFO:teuthology.orchestra.run.smithi052.stdout:(7/36): python3-mako-1.1.4-6.el9.noarch.rpm 721 kB/s | 144 kB 00:00 2024-02-15T22:54:00.172 INFO:teuthology.orchestra.run.smithi052.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 422 kB/s | 32 kB 00:00 2024-02-15T22:54:00.223 INFO:teuthology.orchestra.run.smithi052.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 566 kB/s | 47 kB 00:00 2024-02-15T22:54:00.248 INFO:teuthology.orchestra.run.smithi052.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 513 kB/s | 39 kB 00:00 2024-02-15T22:54:00.365 INFO:teuthology.orchestra.run.smithi052.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 241 kB 00:00 2024-02-15T22:54:00.599 INFO:teuthology.orchestra.run.smithi052.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 3.3 MB/s | 1.1 MB 00:00 2024-02-15T22:54:00.615 INFO:teuthology.orchestra.run.smithi052.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 412 kB/s | 103 kB 00:00 2024-02-15T22:54:00.674 INFO:teuthology.orchestra.run.smithi052.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 1.6 MB/s | 124 kB 00:00 2024-02-15T22:54:00.699 INFO:teuthology.orchestra.run.smithi052.stdout:(15/36): python3-requests-2.25.1-8.el9.noarch.r 1.3 MB/s | 113 kB 00:00 2024-02-15T22:54:00.749 INFO:teuthology.orchestra.run.smithi052.stdout:(16/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.4 MB/s | 187 kB 00:00 2024-02-15T22:54:00.808 INFO:teuthology.orchestra.run.smithi052.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-02-15T22:54:01.017 INFO:teuthology.orchestra.run.smithi052.stdout:(18/36): luarocks-3.9.2-1.el9.noarch.rpm 566 kB/s | 151 kB 00:00 2024-02-15T22:54:01.034 INFO:teuthology.orchestra.run.smithi052.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 219 kB/s | 43 kB 00:00 2024-02-15T22:54:01.084 INFO:teuthology.orchestra.run.smithi052.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-02-15T22:54:01.109 INFO:teuthology.orchestra.run.smithi052.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 4.7 MB/s | 358 kB 00:00 2024-02-15T22:54:01.126 INFO:teuthology.orchestra.run.smithi052.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 261 kB/s | 11 kB 00:00 2024-02-15T22:54:01.143 INFO:teuthology.orchestra.run.smithi052.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 532 kB/s | 18 kB 00:00 2024-02-15T22:54:01.168 INFO:teuthology.orchestra.run.smithi052.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 553 kB/s | 23 kB 00:00 2024-02-15T22:54:01.185 INFO:teuthology.orchestra.run.smithi052.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 463 kB/s | 19 kB 00:00 2024-02-15T22:54:01.211 INFO:teuthology.orchestra.run.smithi052.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 471 kB/s | 20 kB 00:00 2024-02-15T22:54:01.228 INFO:teuthology.orchestra.run.smithi052.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-02-15T22:54:01.253 INFO:teuthology.orchestra.run.smithi052.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 1.9 MB/s | 79 kB 00:00 2024-02-15T22:54:01.287 INFO:teuthology.orchestra.run.smithi052.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-02-15T22:54:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 330 kB/s | 16 kB 00:00 2024-02-15T22:54:01.329 INFO:teuthology.orchestra.run.smithi052.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-02-15T22:54:01.346 INFO:teuthology.orchestra.run.smithi052.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 862 kB/s | 36 kB 00:00 2024-02-15T22:54:01.371 INFO:teuthology.orchestra.run.smithi052.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-02-15T22:54:01.396 INFO:teuthology.orchestra.run.smithi052.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 8.4 MB/s | 427 kB 00:00 2024-02-15T22:54:01.421 INFO:teuthology.orchestra.run.smithi052.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 407 kB/s | 20 kB 00:00 2024-02-15T22:54:02.222 INFO:teuthology.orchestra.run.smithi052.stdout:(36/36): ceph-mgr-19.0.0-1468.gfddf34c1.el9.x86 440 kB/s | 1.5 MB 00:03 2024-02-15T22:54:02.227 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:02.227 INFO:teuthology.orchestra.run.smithi052.stdout:Total 7.2 MB/s | 30 MB 00:04 2024-02-15T22:54:02.248 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:54:02.296 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:54:02.296 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:54:02.733 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:54:02.733 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:54:02.899 INFO:teuthology.orchestra.run.smithi133.stdout:(3/36): ceph-mds-19.0.0-1468.gfddf34c1.el9.x86_ 310 kB/s | 2.1 MB 00:06 2024-02-15T22:54:02.966 INFO:teuthology.orchestra.run.smithi133.stdout:(4/36): ceph-mon-19.0.0-1468.gfddf34c1.el9.x86_ 717 kB/s | 4.7 MB 00:06 2024-02-15T22:54:03.208 INFO:teuthology.orchestra.run.smithi133.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 773 kB/s | 187 kB 00:00 2024-02-15T22:54:03.283 INFO:teuthology.orchestra.run.smithi133.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-02-15T22:54:03.308 INFO:teuthology.orchestra.run.smithi133.stdout:(7/36): ceph-mgr-modules-core-19.0.0-1468.gfddf 605 kB/s | 247 kB 00:00 2024-02-15T22:54:03.333 INFO:teuthology.orchestra.run.smithi133.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 631 kB/s | 32 kB 00:00 2024-02-15T22:54:03.367 INFO:teuthology.orchestra.run.smithi133.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 808 kB/s | 47 kB 00:00 2024-02-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi133.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 657 kB/s | 39 kB 00:00 2024-02-15T22:54:03.451 INFO:teuthology.orchestra.run.smithi133.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-02-15T22:54:03.559 INFO:teuthology.orchestra.run.smithi133.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 6.9 MB/s | 1.1 MB 00:00 2024-02-15T22:54:03.584 INFO:teuthology.orchestra.run.smithi133.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 771 kB/s | 103 kB 00:00 2024-02-15T22:54:03.610 INFO:teuthology.orchestra.run.smithi133.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-02-15T22:54:03.643 INFO:teuthology.orchestra.run.smithi133.stdout:(15/36): python3-requests-2.25.1-8.el9.noarch.r 1.9 MB/s | 113 kB 00:00 2024-02-15T22:54:03.669 INFO:teuthology.orchestra.run.smithi133.stdout:(16/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.1 MB/s | 187 kB 00:00 2024-02-15T22:54:03.986 INFO:teuthology.orchestra.run.smithi133.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 65 kB/s | 22 kB 00:00 2024-02-15T22:54:04.002 INFO:teuthology.orchestra.run.smithi133.stdout:(18/36): luarocks-3.9.2-1.el9.noarch.rpm 453 kB/s | 151 kB 00:00 2024-02-15T22:54:04.061 INFO:teuthology.orchestra.run.smithi133.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 578 kB/s | 43 kB 00:00 2024-02-15T22:54:04.094 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:54:04.166 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-02-15T22:54:04.199 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-02-15T22:54:04.227 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-02-15T22:54:04.237 INFO:teuthology.orchestra.run.smithi133.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.0 MB/s | 358 kB 00:00 2024-02-15T22:54:04.300 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-02-15T22:54:04.303 INFO:teuthology.orchestra.run.smithi133.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 160 kB/s | 11 kB 00:00 2024-02-15T22:54:04.342 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-02-15T22:54:04.362 INFO:teuthology.orchestra.run.smithi133.stdout:(22/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 478 kB/s | 172 kB 00:00 2024-02-15T22:54:04.383 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-02-15T22:54:04.387 INFO:teuthology.orchestra.run.smithi133.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 212 kB/s | 18 kB 00:00 2024-02-15T22:54:04.438 INFO:teuthology.orchestra.run.smithi133.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 308 kB/s | 23 kB 00:00 2024-02-15T22:54:04.463 INFO:teuthology.orchestra.run.smithi133.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 259 kB/s | 19 kB 00:00 2024-02-15T22:54:04.480 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-02-15T22:54:04.522 INFO:teuthology.orchestra.run.smithi133.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 235 kB/s | 20 kB 00:00 2024-02-15T22:54:04.547 INFO:teuthology.orchestra.run.smithi133.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 553 kB/s | 46 kB 00:00 2024-02-15T22:54:04.564 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-02-15T22:54:04.611 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-02-15T22:54:04.622 INFO:teuthology.orchestra.run.smithi133.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 788 kB/s | 79 kB 00:00 2024-02-15T22:54:04.647 INFO:teuthology.orchestra.run.smithi133.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-02-15T22:54:04.685 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-02-15T22:54:04.723 INFO:teuthology.orchestra.run.smithi133.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 164 kB/s | 16 kB 00:00 2024-02-15T22:54:04.737 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-02-15T22:54:04.748 INFO:teuthology.orchestra.run.smithi133.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 896 kB/s | 90 kB 00:00 2024-02-15T22:54:04.775 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-02-15T22:54:04.798 INFO:teuthology.orchestra.run.smithi133.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 475 kB/s | 36 kB 00:00 2024-02-15T22:54:04.825 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-02-15T22:54:04.840 INFO:teuthology.orchestra.run.smithi133.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-02-15T22:54:04.894 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-02-15T22:54:04.924 INFO:teuthology.orchestra.run.smithi133.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 239 kB/s | 20 kB 00:00 2024-02-15T22:54:05.007 INFO:teuthology.orchestra.run.smithi133.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.0 MB/s | 427 kB 00:00 2024-02-15T22:54:05.089 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-02-15T22:54:05.137 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-02-15T22:54:05.184 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-02-15T22:54:05.227 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-02-15T22:54:05.256 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-02-15T22:54:05.335 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-02-15T22:54:05.367 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-15T22:54:05.400 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-02-15T22:54:05.441 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-02-15T22:54:05.476 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-02-15T22:54:05.510 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-02-15T22:54:05.603 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-02-15T22:54:05.640 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-02-15T22:54:05.715 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-02-15T22:54:05.864 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-02-15T22:54:05.987 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-15T22:54:06.164 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9. 31/36 2024-02-15T22:54:06.195 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/36 2024-02-15T22:54:06.221 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/36 2024-02-15T22:54:06.221 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:54:06.221 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-15T22:54:06.221 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:54:06.221 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:54:06.221 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:07.746 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/36 2024-02-15T22:54:07.771 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/36 2024-02-15T22:54:07.771 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:54:07.771 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-15T22:54:07.771 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:54:07.772 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:54:07.772 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:08.238 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 34/36 2024-02-15T22:54:08.261 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 34/36 2024-02-15T22:54:08.261 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:54:08.261 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-15T22:54:08.261 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:54:08.261 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:54:08.261 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:08.480 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 35/36 2024-02-15T22:54:08.503 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 35/36 2024-02-15T22:54:08.503 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:54:08.503 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-15T22:54:08.503 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:54:08.503 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:54:08.503 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:08.563 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 36/36 2024-02-15T22:54:10.419 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 36/36 2024-02-15T22:54:10.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/36 2024-02-15T22:54:10.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/36 2024-02-15T22:54:10.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 3/36 2024-02-15T22:54:10.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 4/36 2024-02-15T22:54:10.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/36 2024-02-15T22:54:10.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9. 6/36 2024-02-15T22:54:10.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-02-15T22:54:10.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-02-15T22:54:10.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-02-15T22:54:10.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-02-15T22:54:10.421 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-02-15T22:54:10.421 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-02-15T22:54:10.421 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-02-15T22:54:10.421 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-02-15T22:54:10.421 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-02-15T22:54:10.421 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/36 2024-02-15T22:54:10.421 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 17/36 2024-02-15T22:54:10.421 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-02-15T22:54:10.421 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-02-15T22:54:10.421 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-02-15T22:54:10.421 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-15T22:54:10.422 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-02-15T22:54:10.422 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-02-15T22:54:10.422 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-02-15T22:54:10.422 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-02-15T22:54:10.422 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-02-15T22:54:10.422 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-02-15T22:54:10.423 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-02-15T22:54:10.423 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-02-15T22:54:10.423 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-15T22:54:10.423 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-02-15T22:54:10.424 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-02-15T22:54:10.424 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-02-15T22:54:10.424 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-02-15T22:54:10.424 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-02-15T22:54:11.399 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-02-15T22:54:11.399 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:11.399 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:54:11.399 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:11.399 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:11.399 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:11.399 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:11.399 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:11.399 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:11.400 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-02-15T22:54:11.400 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-15T22:54:11.400 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-15T22:54:11.400 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-15T22:54:11.400 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-15T22:54:11.400 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-15T22:54:11.400 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-15T22:54:11.400 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-15T22:54:11.400 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-15T22:54:11.401 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-15T22:54:11.402 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-15T22:54:11.402 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-15T22:54:11.402 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-15T22:54:11.402 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-15T22:54:11.402 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-15T22:54:11.402 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-15T22:54:11.402 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-15T22:54:11.402 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-15T22:54:11.402 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-15T22:54:11.402 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:11.402 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:11.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-base 2024-02-15T22:54:12.123 INFO:teuthology.orchestra.run.smithi133.stdout:(36/36): ceph-osd-19.0.0-1468.gfddf34c1.el9.x86 1.1 MB/s | 17 MB 00:14 2024-02-15T22:54:12.127 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:12.127 INFO:teuthology.orchestra.run.smithi133.stdout:Total 1.7 MB/s | 30 MB 00:17 2024-02-15T22:54:12.150 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:54:12.193 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:54:12.194 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:54:12.357 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:25 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:12.474 INFO:teuthology.orchestra.run.smithi052.stdout:Package ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:54:12.528 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:12.529 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-02-15T22:54:12.529 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:12.588 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install cephadm 2024-02-15T22:54:12.614 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:54:12.614 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:54:13.164 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:26 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:13.337 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:13.338 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:13.338 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-02-15T22:54:13.338 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:13.338 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:54:13.338 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 748 k 2024-02-15T22:54:13.338 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:13.338 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:54:13.338 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:13.338 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-02-15T22:54:13.339 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:13.339 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 748 k 2024-02-15T22:54:13.339 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 754 k 2024-02-15T22:54:13.339 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:54:13.712 INFO:teuthology.orchestra.run.smithi052.stdout:cephadm-19.0.0-1468.gfddf34c1.el9.noarch.rpm 2.0 MB/s | 748 kB 00:00 2024-02-15T22:54:13.712 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:13.713 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.0 MB/s | 748 kB 00:00 2024-02-15T22:54:13.713 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:54:13.718 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:54:13.718 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:54:13.724 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:54:13.724 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:54:13.800 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:54:13.943 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:54:14.009 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-02-15T22:54:14.041 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-02-15T22:54:14.069 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-02-15T22:54:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-02-15T22:54:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-02-15T22:54:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-02-15T22:54:14.243 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-15T22:54:14.309 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-02-15T22:54:14.325 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-15T22:54:14.387 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-02-15T22:54:14.437 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-02-15T22:54:14.508 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-02-15T22:54:14.562 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-02-15T22:54:14.601 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-02-15T22:54:14.649 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-02-15T22:54:14.713 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-02-15T22:54:14.735 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-15T22:54:14.897 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-02-15T22:54:14.947 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-02-15T22:54:14.988 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-02-15T22:54:15.022 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-02-15T22:54:15.037 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-15T22:54:15.038 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:15.038 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:54:15.038 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:15.038 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:15.038 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:15.052 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-02-15T22:54:15.128 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-02-15T22:54:15.162 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-15T22:54:15.196 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-02-15T22:54:15.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-immutable-object-cache 2024-02-15T22:54:15.236 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-02-15T22:54:15.271 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-02-15T22:54:15.306 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-02-15T22:54:15.393 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-02-15T22:54:15.428 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-02-15T22:54:15.500 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-02-15T22:54:15.645 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-02-15T22:54:15.770 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-15T22:54:15.800 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:28 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:15.940 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9. 31/36 2024-02-15T22:54:15.966 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/36 2024-02-15T22:54:15.974 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:15.975 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:15.975 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-02-15T22:54:15.975 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:15.975 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:54:15.975 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 145 k 2024-02-15T22:54:15.975 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:15.975 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:54:15.975 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:15.975 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-02-15T22:54:15.975 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:15.976 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 145 k 2024-02-15T22:54:15.976 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 436 k 2024-02-15T22:54:15.976 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:54:15.992 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/36 2024-02-15T22:54:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:54:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-15T22:54:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:54:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:54:15.992 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:16.206 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-immutable-object-cache-19.0.0-1468.gfddf34 631 kB/s | 145 kB 00:00 2024-02-15T22:54:16.207 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:16.207 INFO:teuthology.orchestra.run.smithi052.stdout:Total 627 kB/s | 145 kB 00:00 2024-02-15T22:54:16.207 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:54:16.215 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:54:16.215 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:54:16.274 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:54:16.274 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:54:16.427 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:54:16.482 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-15T22:54:16.505 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-15T22:54:16.505 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:54:16.506 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-15T22:54:16.506 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/36 2024-02-15T22:54:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/36 2024-02-15T22:54:17.460 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:54:17.460 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-15T22:54:17.460 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:54:17.460 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:54:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:17.468 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-15T22:54:17.469 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:17.469 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:54:17.469 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:17.469 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:17.469 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:17.753 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr 2024-02-15T22:54:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 34/36 2024-02-15T22:54:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 34/36 2024-02-15T22:54:17.924 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:54:17.924 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-15T22:54:17.924 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:54:17.924 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:54:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:18.127 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 35/36 2024-02-15T22:54:18.149 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 35/36 2024-02-15T22:54:18.150 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:54:18.150 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-15T22:54:18.150 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:54:18.150 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:54:18.150 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:18.208 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 36/36 2024-02-15T22:54:18.343 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:31 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:18.462 INFO:teuthology.orchestra.run.smithi052.stdout:Package ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:54:18.517 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:18.518 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-02-15T22:54:18.518 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:18.579 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-dashboard 2024-02-15T22:54:19.161 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:32 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:19.334 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 1.8 M 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 31 k 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 15 k 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-15T22:54:19.336 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-15T22:54:19.337 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-15T22:54:19.337 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-15T22:54:19.337 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-15T22:54:19.337 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-15T22:54:19.337 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:19.337 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:54:19.337 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-02-15T22:54:19.337 INFO:teuthology.orchestra.run.smithi052.stdout:Install 12 Packages 2024-02-15T22:54:19.337 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:19.338 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 6.9 M 2024-02-15T22:54:19.338 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 26 M 2024-02-15T22:54:19.338 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:54:19.776 INFO:teuthology.orchestra.run.smithi052.stdout:(1/12): ceph-prometheus-alerts-19.0.0-1468.gfdd 77 kB/s | 15 kB 00:00 2024-02-15T22:54:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:(2/12): ceph-grafana-dashboards-19.0.0-1468.gfd 86 kB/s | 31 kB 00:00 2024-02-15T22:54:19.961 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 36/36 2024-02-15T22:54:19.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/36 2024-02-15T22:54:19.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/36 2024-02-15T22:54:19.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 3/36 2024-02-15T22:54:19.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 4/36 2024-02-15T22:54:19.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/36 2024-02-15T22:54:19.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9. 6/36 2024-02-15T22:54:19.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-02-15T22:54:19.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-02-15T22:54:19.961 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 17/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-02-15T22:54:19.962 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-02-15T22:54:19.963 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-02-15T22:54:19.963 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-02-15T22:54:19.963 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-02-15T22:54:19.963 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-15T22:54:19.963 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-02-15T22:54:19.963 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-02-15T22:54:19.963 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-02-15T22:54:19.963 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-02-15T22:54:19.963 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-02-15T22:54:20.086 INFO:teuthology.orchestra.run.smithi052.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.3 MB/s | 1.0 MB 00:00 2024-02-15T22:54:20.111 INFO:teuthology.orchestra.run.smithi052.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.4 MB/s | 238 kB 00:00 2024-02-15T22:54:20.870 INFO:teuthology.orchestra.run.smithi052.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 723 kB/s | 548 kB 00:00 2024-02-15T22:54:20.961 INFO:teuthology.orchestra.run.smithi052.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 214 kB/s | 19 kB 00:00 2024-02-15T22:54:21.078 INFO:teuthology.orchestra.run.smithi052.stdout:(7/12): ceph-mgr-dashboard-19.0.0-1468.gfddf34c 1.2 MB/s | 1.8 MB 00:01 2024-02-15T22:54:21.111 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-02-15T22:54:21.112 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:21.112 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:54:21.112 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:21.112 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:21.112 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:21.112 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:21.112 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:21.112 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:21.112 INFO:teuthology.orchestra.run.smithi133.stdout: lua-5.4.4-4.el9.x86_64 2024-02-15T22:54:21.112 INFO:teuthology.orchestra.run.smithi133.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-15T22:54:21.113 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply-3.11-14.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-15T22:54:21.114 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-15T22:54:21.115 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-15T22:54:21.115 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-15T22:54:21.115 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:21.115 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:54:21.245 INFO:teuthology.orchestra.run.smithi052.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 745 kB/s | 863 kB 00:01 2024-02-15T22:54:21.454 INFO:teuthology.orchestra.run.smithi052.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 385 kB/s | 144 kB 00:00 2024-02-15T22:54:21.479 INFO:teuthology.orchestra.run.smithi052.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 132 kB/s | 31 kB 00:00 2024-02-15T22:54:21.500 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-base 2024-02-15T22:54:21.604 INFO:teuthology.orchestra.run.smithi052.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.2 MB/s | 188 kB 00:00 2024-02-15T22:54:22.084 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:32 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:54:22.096 INFO:teuthology.orchestra.run.smithi052.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 1.8 MB/s | 2.0 MB 00:01 2024-02-15T22:54:22.100 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:22.100 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.5 MB/s | 6.9 MB 00:02 2024-02-15T22:54:22.119 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:54:22.139 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:54:22.139 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:54:22.198 INFO:teuthology.orchestra.run.smithi133.stdout:Package ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:54:22.249 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:54:22.250 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T22:54:22.250 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:54:22.327 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install cephadm 2024-02-15T22:54:22.335 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:54:22.336 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:54:22.867 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:54:22.927 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:32 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:54:22.956 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-02-15T22:54:22.999 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-02-15T22:54:23.045 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-02-15T22:54:23.075 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-02-15T22:54:23.095 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:54:23.096 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:54:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T22:54:23.096 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:54:23.096 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:54:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 748 k 2024-02-15T22:54:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:23.096 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:54:23.097 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:54:23.097 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T22:54:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:23.097 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 748 k 2024-02-15T22:54:23.097 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 754 k 2024-02-15T22:54:23.097 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:54:23.177 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-02-15T22:54:23.313 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-02-15T22:54:23.405 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-02-15T22:54:23.464 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-02-15T22:54:23.492 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-02-15T22:54:23.523 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9 10/12 2024-02-15T22:54:23.773 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el 11/12 2024-02-15T22:54:23.807 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 12/12 2024-02-15T22:54:23.892 INFO:teuthology.orchestra.run.smithi133.stdout:cephadm-19.0.0-1468.gfddf34c1.el9.noarch.rpm 942 kB/s | 748 kB 00:00 2024-02-15T22:54:23.893 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:23.893 INFO:teuthology.orchestra.run.smithi133.stdout:Total 939 kB/s | 748 kB 00:00 2024-02-15T22:54:23.893 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:54:23.898 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:54:23.899 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:54:23.904 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:54:23.904 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:54:23.974 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:54:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-15T22:54:24.379 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-15T22:54:24.585 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 12/12 2024-02-15T22:54:24.585 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el 1/12 2024-02-15T22:54:24.585 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 2/12 2024-02-15T22:54:24.585 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9 3/12 2024-02-15T22:54:24.585 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-02-15T22:54:24.585 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-02-15T22:54:24.586 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-02-15T22:54:24.586 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-02-15T22:54:24.586 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-02-15T22:54:24.586 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-02-15T22:54:24.586 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-02-15T22:54:24.586 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-02-15T22:54:24.760 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-15T22:54:24.951 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-15T22:54:24.952 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-15T22:54:24.952 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-15T22:54:24.952 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-15T22:54:24.952 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:24.952 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:25.068 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-15T22:54:25.068 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:25.068 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:54:25.068 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:25.068 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:25.068 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:54:25.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-15T22:54:25.272 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-immutable-object-cache 2024-02-15T22:54:25.750 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:38 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:25.855 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:35 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:54:25.922 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:25.923 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================================ 2024-02-15T22:54:25.923 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-02-15T22:54:25.923 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================================ 2024-02-15T22:54:25.923 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:54:25.923 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 7.4 M 2024-02-15T22:54:25.923 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-15T22:54:25.924 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:25.925 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:54:25.925 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================================ 2024-02-15T22:54:25.925 INFO:teuthology.orchestra.run.smithi052.stdout:Install 12 Packages 2024-02-15T22:54:25.925 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:25.925 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 37 M 2024-02-15T22:54:25.925 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 209 M 2024-02-15T22:54:25.925 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:54:26.023 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:54:26.024 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:54:26.024 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repo Size 2024-02-15T22:54:26.024 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:54:26.025 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:54:26.025 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 145 k 2024-02-15T22:54:26.025 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:26.025 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:54:26.025 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:54:26.025 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T22:54:26.025 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:26.025 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 145 k 2024-02-15T22:54:26.025 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 436 k 2024-02-15T22:54:26.025 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:54:26.252 INFO:teuthology.orchestra.run.smithi052.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 174 kB/s | 32 kB 00:00 2024-02-15T22:54:26.294 INFO:teuthology.orchestra.run.smithi052.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 411 kB/s | 17 kB 00:00 2024-02-15T22:54:26.344 INFO:teuthology.orchestra.run.smithi052.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 685 kB/s | 34 kB 00:00 2024-02-15T22:54:26.480 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-immutable-object-cache-19.0.0-1468.gfddf34 319 kB/s | 145 kB 00:00 2024-02-15T22:54:26.481 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:26.481 INFO:teuthology.orchestra.run.smithi133.stdout:Total 318 kB/s | 145 kB 00:00 2024-02-15T22:54:26.481 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:54:26.489 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:54:26.489 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:54:26.519 INFO:teuthology.orchestra.run.smithi052.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.7 MB/s | 3.0 MB 00:00 2024-02-15T22:54:26.545 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:54:26.545 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:54:26.684 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:54:26.748 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-15T22:54:26.753 INFO:teuthology.orchestra.run.smithi052.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2024-02-15T22:54:26.772 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-15T22:54:26.772 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:54:26.772 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-15T22:54:26.772 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:26.837 INFO:teuthology.orchestra.run.smithi052.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 4.8 MB 00:00 2024-02-15T22:54:26.854 INFO:teuthology.orchestra.run.smithi052.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2024-02-15T22:54:27.079 INFO:teuthology.orchestra.run.smithi052.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.5 MB/s | 802 kB 00:00 2024-02-15T22:54:27.163 INFO:teuthology.orchestra.run.smithi052.stdout:(9/12): ceph-mgr-diskprediction-local-19.0.0-14 6.8 MB/s | 7.4 MB 00:01 2024-02-15T22:54:27.379 INFO:teuthology.orchestra.run.smithi052.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-02-15T22:54:27.413 INFO:teuthology.orchestra.run.smithi052.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 586 kB/s | 194 kB 00:00 2024-02-15T22:54:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-15T22:54:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:27.781 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:54:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:27.781 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:54:27.880 INFO:teuthology.orchestra.run.smithi052.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 343 kB/s | 245 kB 00:00 2024-02-15T22:54:27.883 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:27.883 INFO:teuthology.orchestra.run.smithi052.stdout:Total 19 MB/s | 37 MB 00:01 2024-02-15T22:54:27.898 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:54:27.925 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:54:27.926 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:54:27.992 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr 2024-02-15T22:54:28.300 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:54:28.301 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:54:28.584 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:38 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:54:28.699 INFO:teuthology.orchestra.run.smithi133.stdout:Package ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:54:28.750 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:54:28.751 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T22:54:28.752 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:54:28.826 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-dashboard 2024-02-15T22:54:29.030 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:54:29.112 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-15T22:54:29.142 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-15T22:54:29.256 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:54:29.304 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-15T22:54:29.401 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:39 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:54:29.489 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:54:29.511 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:54:29.567 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:54:29.568 INFO:teuthology.orchestra.run.smithi133.stdout:====================================================================================== 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout:====================================================================================== 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 1.8 M 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 31 k 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 15 k 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-15T22:54:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-15T22:54:29.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-15T22:54:29.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-15T22:54:29.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-15T22:54:29.570 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:29.570 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:54:29.570 INFO:teuthology.orchestra.run.smithi133.stdout:====================================================================================== 2024-02-15T22:54:29.570 INFO:teuthology.orchestra.run.smithi133.stdout:Install 12 Packages 2024-02-15T22:54:29.570 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:29.571 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 6.9 M 2024-02-15T22:54:29.571 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 26 M 2024-02-15T22:54:29.571 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:54:29.594 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-15T22:54:30.184 INFO:teuthology.orchestra.run.smithi133.stdout:(1/12): ceph-grafana-dashboards-19.0.0-1468.gfd 154 kB/s | 31 kB 00:00 2024-02-15T22:54:30.277 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-15T22:54:30.317 INFO:teuthology.orchestra.run.smithi133.stdout:(2/12): ceph-prometheus-alerts-19.0.0-1468.gfdd 45 kB/s | 15 kB 00:00 2024-02-15T22:54:30.394 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-15T22:54:30.493 INFO:teuthology.orchestra.run.smithi133.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.3 MB/s | 1.0 MB 00:00 2024-02-15T22:54:30.518 INFO:teuthology.orchestra.run.smithi133.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 238 kB 00:00 2024-02-15T22:54:30.760 INFO:teuthology.orchestra.run.smithi133.stdout:(5/12): ceph-mgr-dashboard-19.0.0-1468.gfddf34c 2.3 MB/s | 1.8 MB 00:00 2024-02-15T22:54:30.843 INFO:teuthology.orchestra.run.smithi133.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.6 MB/s | 548 kB 00:00 2024-02-15T22:54:30.860 INFO:teuthology.orchestra.run.smithi133.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-02-15T22:54:30.910 INFO:teuthology.orchestra.run.smithi133.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.0 MB/s | 863 kB 00:00 2024-02-15T22:54:30.969 INFO:teuthology.orchestra.run.smithi133.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.3 MB/s | 144 kB 00:00 2024-02-15T22:54:31.036 INFO:teuthology.orchestra.run.smithi133.stdout:(10/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-02-15T22:54:31.053 INFO:teuthology.orchestra.run.smithi133.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 217 kB/s | 31 kB 00:00 2024-02-15T22:54:31.078 INFO:teuthology.orchestra.run.smithi133.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2024-02-15T22:54:31.082 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:31.082 INFO:teuthology.orchestra.run.smithi133.stdout:Total 4.5 MB/s | 6.9 MB 00:01 2024-02-15T22:54:31.099 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:54:31.116 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:54:31.116 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:54:31.292 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:54:31.292 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:54:31.691 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-15T22:54:31.800 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:54:31.861 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-02-15T22:54:31.905 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-02-15T22:54:31.952 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-02-15T22:54:31.991 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-02-15T22:54:32.087 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-02-15T22:54:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-02-15T22:54:32.300 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-02-15T22:54:32.382 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-02-15T22:54:32.415 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-02-15T22:54:32.446 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9 10/12 2024-02-15T22:54:32.685 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el 11/12 2024-02-15T22:54:32.722 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 12/12 2024-02-15T22:54:32.754 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-15T22:54:32.784 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 12/12 2024-02-15T22:54:33.484 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 12/12 2024-02-15T22:54:33.485 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el 1/12 2024-02-15T22:54:33.485 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 2/12 2024-02-15T22:54:33.485 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9 3/12 2024-02-15T22:54:33.485 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-02-15T22:54:33.485 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-02-15T22:54:33.485 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-02-15T22:54:33.485 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-02-15T22:54:33.485 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-02-15T22:54:33.485 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-02-15T22:54:33.485 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-02-15T22:54:33.485 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-02-15T22:54:33.838 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-02-15T22:54:33.838 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:33.838 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:33.839 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:54:34.113 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-15T22:54:34.686 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:44 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:54:34.852 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:54:34.853 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 7.4 M 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-15T22:54:34.854 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-15T22:54:34.855 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-15T22:54:34.855 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-15T22:54:34.855 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:34.855 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:54:34.855 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2024-02-15T22:54:34.855 INFO:teuthology.orchestra.run.smithi133.stdout:Install 12 Packages 2024-02-15T22:54:34.855 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:34.855 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 37 M 2024-02-15T22:54:34.856 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 209 M 2024-02-15T22:54:34.856 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:54:35.293 INFO:teuthology.orchestra.run.smithi133.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 157 kB/s | 32 kB 00:00 2024-02-15T22:54:35.339 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 12/12 2024-02-15T22:54:35.339 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 1/12 2024-02-15T22:54:35.339 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-15T22:54:35.339 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:54:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-15T22:54:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:54:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:54:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-15T22:54:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-15T22:54:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-15T22:54:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-15T22:54:35.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-15T22:54:35.384 INFO:teuthology.orchestra.run.smithi133.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 189 kB/s | 17 kB 00:00 2024-02-15T22:54:35.543 INFO:teuthology.orchestra.run.smithi133.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 216 kB/s | 34 kB 00:00 2024-02-15T22:54:35.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-15T22:54:35.777 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:35.778 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:35.843 INFO:teuthology.orchestra.run.smithi133.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.0 MB/s | 3.0 MB 00:00 2024-02-15T22:54:36.094 INFO:teuthology.orchestra.run.smithi133.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 8.6 MB/s | 4.7 MB 00:00 2024-02-15T22:54:36.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-rook 2024-02-15T22:54:36.210 INFO:teuthology.orchestra.run.smithi133.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 4.8 MB 00:00 2024-02-15T22:54:36.236 INFO:teuthology.orchestra.run.smithi133.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.5 MB/s | 217 kB 00:00 2024-02-15T22:54:36.478 INFO:teuthology.orchestra.run.smithi133.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 802 kB 00:00 2024-02-15T22:54:36.728 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:49 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:36.794 INFO:teuthology.orchestra.run.smithi133.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-02-15T22:54:36.820 INFO:teuthology.orchestra.run.smithi133.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 570 kB/s | 194 kB 00:00 2024-02-15T22:54:36.904 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:36.905 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2024-02-15T22:54:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-02-15T22:54:36.905 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2024-02-15T22:54:36.905 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:54:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 52 k 2024-02-15T22:54:36.905 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:36.906 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:54:36.907 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2024-02-15T22:54:36.907 INFO:teuthology.orchestra.run.smithi052.stdout:Install 13 Packages 2024-02-15T22:54:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:36.907 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 2.0 M 2024-02-15T22:54:36.907 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 26 M 2024-02-15T22:54:36.907 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:54:37.162 INFO:teuthology.orchestra.run.smithi133.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 670 kB/s | 245 kB 00:00 2024-02-15T22:54:37.318 INFO:teuthology.orchestra.run.smithi052.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 150 kB/s | 24 kB 00:00 2024-02-15T22:54:37.334 INFO:teuthology.orchestra.run.smithi052.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 101 kB/s | 18 kB 00:00 2024-02-15T22:54:37.351 INFO:teuthology.orchestra.run.smithi052.stdout:(3/13): ceph-mgr-rook-19.0.0-1468.gfddf34c1.el9 266 kB/s | 52 kB 00:00 2024-02-15T22:54:37.444 INFO:teuthology.orchestra.run.smithi052.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 174 kB 00:00 2024-02-15T22:54:37.469 INFO:teuthology.orchestra.run.smithi052.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 985 kB/s | 132 kB 00:00 2024-02-15T22:54:37.494 INFO:teuthology.orchestra.run.smithi052.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 211 kB 00:00 2024-02-15T22:54:37.519 INFO:teuthology.orchestra.run.smithi052.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 566 kB/s | 43 kB 00:00 2024-02-15T22:54:37.903 INFO:teuthology.orchestra.run.smithi052.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 37 kB/s | 15 kB 00:00 2024-02-15T22:54:37.970 INFO:teuthology.orchestra.run.smithi052.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 64 kB/s | 32 kB 00:00 2024-02-15T22:54:38.195 INFO:teuthology.orchestra.run.smithi052.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 262 kB/s | 59 kB 00:00 2024-02-15T22:54:38.254 INFO:teuthology.orchestra.run.smithi052.stdout:(11/13): python3-google-auth-2.27.0-1.el9.noarc 276 kB/s | 203 kB 00:00 2024-02-15T22:54:38.354 INFO:teuthology.orchestra.run.smithi052.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 566 kB/s | 90 kB 00:00 2024-02-15T22:54:38.529 INFO:teuthology.orchestra.run.smithi052.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.6 MB/s | 1.0 MB 00:00 2024-02-15T22:54:38.534 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:38.534 INFO:teuthology.orchestra.run.smithi052.stdout:Total 1.3 MB/s | 2.0 MB 00:01 2024-02-15T22:54:38.535 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:54:38.551 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:54:38.551 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:54:38.663 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:54:38.663 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:54:38.812 INFO:teuthology.orchestra.run.smithi133.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-1 2.0 MB/s | 7.4 MB 00:03 2024-02-15T22:54:38.815 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:38.816 INFO:teuthology.orchestra.run.smithi133.stdout:Total 9.4 MB/s | 37 MB 00:03 2024-02-15T22:54:38.829 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:54:38.857 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:54:38.857 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:54:39.199 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:54:39.214 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:54:39.214 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:54:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-15T22:54:39.448 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-15T22:54:39.504 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-15T22:54:39.539 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-15T22:54:39.590 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-15T22:54:39.686 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-15T22:54:39.812 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-15T22:54:39.866 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-15T22:54:39.940 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:54:40.019 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-15T22:54:40.049 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-15T22:54:40.143 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:54:40.177 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-15T22:54:40.355 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:54:40.384 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:54:40.471 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-15T22:54:40.630 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-15T22:54:40.680 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-15T22:54:40.707 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-15T22:54:40.755 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-15T22:54:40.782 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 13/13 2024-02-15T22:54:41.134 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-15T22:54:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-15T22:54:41.698 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 13/13 2024-02-15T22:54:41.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 1/13 2024-02-15T22:54:41.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-15T22:54:41.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-15T22:54:41.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-15T22:54:41.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-15T22:54:41.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-15T22:54:41.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-15T22:54:41.698 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-15T22:54:41.699 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-15T22:54:41.699 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-15T22:54:41.699 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-15T22:54:41.699 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-15T22:54:42.075 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-15T22:54:42.075 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-15T22:54:42.076 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-15T22:54:42.077 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-15T22:54:42.077 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-15T22:54:42.077 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:42.077 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:42.314 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-cephadm 2024-02-15T22:54:42.503 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-15T22:54:42.899 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:55 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:43.074 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:43.075 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2024-02-15T22:54:43.075 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-02-15T22:54:43.075 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2024-02-15T22:54:43.075 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:54:43.075 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 138 k 2024-02-15T22:54:43.075 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-02-15T22:54:43.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-15T22:54:43.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-15T22:54:43.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-15T22:54:43.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-15T22:54:43.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-15T22:54:43.076 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:43.076 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:54:43.076 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2024-02-15T22:54:43.076 INFO:teuthology.orchestra.run.smithi052.stdout:Install 6 Packages 2024-02-15T22:54:43.076 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:43.076 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 6.8 M 2024-02-15T22:54:43.076 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 33 M 2024-02-15T22:54:43.076 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:54:43.447 INFO:teuthology.orchestra.run.smithi052.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 227 kB 00:00 2024-02-15T22:54:43.526 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-15T22:54:43.558 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 12/12 2024-02-15T22:54:43.589 INFO:teuthology.orchestra.run.smithi052.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2024-02-15T22:54:43.606 INFO:teuthology.orchestra.run.smithi052.stdout:(3/6): ceph-mgr-cephadm-19.0.0-1468.gfddf34c1.e 412 kB/s | 138 kB 00:00 2024-02-15T22:54:43.673 INFO:teuthology.orchestra.run.smithi052.stdout:(4/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 2.4 MB/s | 548 kB 00:00 2024-02-15T22:54:43.698 INFO:teuthology.orchestra.run.smithi052.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 531 kB/s | 58 kB 00:00 2024-02-15T22:54:43.731 INFO:teuthology.orchestra.run.smithi052.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 406 kB/s | 51 kB 00:00 2024-02-15T22:54:43.735 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:43.735 INFO:teuthology.orchestra.run.smithi052.stdout:Total 10 MB/s | 6.8 MB 00:00 2024-02-15T22:54:43.735 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:54:43.744 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:54:43.744 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:54:43.838 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:54:43.839 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:54:44.160 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:54:44.328 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-15T22:54:44.400 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-15T22:54:44.953 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-15T22:54:45.038 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-15T22:54:45.099 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-15T22:54:45.129 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 6/6 2024-02-15T22:54:45.921 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 6/6 2024-02-15T22:54:45.921 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/6 2024-02-15T22:54:45.921 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-15T22:54:45.921 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-15T22:54:45.921 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-15T22:54:45.921 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-15T22:54:46.046 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 12/12 2024-02-15T22:54:46.046 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 1/12 2024-02-15T22:54:46.046 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-15T22:54:46.046 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:54:46.046 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-15T22:54:46.046 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:54:46.046 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:54:46.046 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-15T22:54:46.046 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-15T22:54:46.046 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-15T22:54:46.046 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-15T22:54:46.047 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-15T22:54:46.239 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-15T22:54:46.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:46.239 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:54:46.239 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:46.239 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-15T22:54:46.240 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-15T22:54:46.240 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-15T22:54:46.240 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-15T22:54:46.240 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-15T22:54:46.240 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:46.240 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:46.471 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-fuse 2024-02-15T22:54:46.532 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-15T22:54:46.533 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:46.533 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:54:46.533 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:46.533 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-15T22:54:46.533 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-15T22:54:46.533 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-15T22:54:46.533 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-15T22:54:46.533 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-15T22:54:46.533 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-15T22:54:46.533 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-15T22:54:46.533 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-15T22:54:46.534 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-15T22:54:46.534 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-15T22:54:46.534 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-15T22:54:46.534 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:46.534 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:54:46.886 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-rook 2024-02-15T22:54:47.061 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:00 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:47.237 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:47.237 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:47.238 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-02-15T22:54:47.238 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:47.238 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:54:47.238 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 887 k 2024-02-15T22:54:47.238 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-02-15T22:54:47.238 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-15T22:54:47.238 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:47.238 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:54:47.238 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:47.238 INFO:teuthology.orchestra.run.smithi052.stdout:Install 2 Packages 2024-02-15T22:54:47.238 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:47.239 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 966 k 2024-02-15T22:54:47.239 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 2.8 M 2024-02-15T22:54:47.239 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:54:47.357 INFO:teuthology.orchestra.run.smithi052.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 666 kB/s | 79 kB 00:00 2024-02-15T22:54:47.469 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:57 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:54:47.639 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:54:47.640 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================== 2024-02-15T22:54:47.640 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T22:54:47.640 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================== 2024-02-15T22:54:47.640 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:54:47.640 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 52 k 2024-02-15T22:54:47.640 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T22:54:47.640 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-15T22:54:47.640 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-15T22:54:47.640 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-15T22:54:47.640 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-15T22:54:47.640 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================== 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout:Install 13 Packages 2024-02-15T22:54:47.641 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:47.642 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 2.0 M 2024-02-15T22:54:47.642 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 26 M 2024-02-15T22:54:47.642 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:54:47.665 INFO:teuthology.orchestra.run.smithi052.stdout:(2/2): ceph-fuse-19.0.0-1468.gfddf34c1.el9.x86_ 2.0 MB/s | 887 kB 00:00 2024-02-15T22:54:47.667 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:47.667 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.2 MB/s | 966 kB 00:00 2024-02-15T22:54:47.667 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:54:47.689 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:54:47.689 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:54:47.769 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:54:47.769 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:54:47.816 INFO:teuthology.orchestra.run.smithi133.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 187 kB/s | 24 kB 00:00 2024-02-15T22:54:47.841 INFO:teuthology.orchestra.run.smithi133.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 116 kB/s | 18 kB 00:00 2024-02-15T22:54:47.883 INFO:teuthology.orchestra.run.smithi133.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2024-02-15T22:54:47.908 INFO:teuthology.orchestra.run.smithi133.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-02-15T22:54:47.933 INFO:teuthology.orchestra.run.smithi133.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-02-15T22:54:47.956 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:54:47.958 INFO:teuthology.orchestra.run.smithi133.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 855 kB/s | 43 kB 00:00 2024-02-15T22:54:47.984 INFO:teuthology.orchestra.run.smithi133.stdout:(7/13): ceph-mgr-rook-19.0.0-1468.gfddf34c1.el9 175 kB/s | 52 kB 00:00 2024-02-15T22:54:48.059 INFO:teuthology.orchestra.run.smithi133.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 150 kB/s | 15 kB 00:00 2024-02-15T22:54:48.076 INFO:teuthology.orchestra.run.smithi133.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 226 kB/s | 32 kB 00:00 2024-02-15T22:54:48.105 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:(10/13): python3-google-auth-2.27.0-1.el9.noarc 1.3 MB/s | 203 kB 00:00 2024-02-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi133.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-02-15T22:54:48.176 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/2 2024-02-15T22:54:48.210 INFO:teuthology.orchestra.run.smithi133.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-02-15T22:54:48.260 INFO:teuthology.orchestra.run.smithi133.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.1 MB/s | 1.0 MB 00:00 2024-02-15T22:54:48.263 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:48.263 INFO:teuthology.orchestra.run.smithi133.stdout:Total 3.3 MB/s | 2.0 MB 00:00 2024-02-15T22:54:48.263 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:54:48.276 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:54:48.276 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:54:48.376 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:54:48.376 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:54:48.897 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:54:48.923 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/2 2024-02-15T22:54:48.924 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/2 2024-02-15T22:54:49.075 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-15T22:54:49.136 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-15T22:54:49.191 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-15T22:54:49.229 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-15T22:54:49.258 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-15T22:54:49.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:49.258 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:54:49.258 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-15T22:54:49.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:49.258 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:49.262 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-15T22:54:49.355 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-15T22:54:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-15T22:54:49.512 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-volume 2024-02-15T22:54:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-15T22:54:50.104 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:03 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-15T22:54:50.278 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:50.279 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:50.279 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-02-15T22:54:50.279 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 264 k 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout:Install 2 Packages 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 332 k 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 1.5 M 2024-02-15T22:54:50.280 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:54:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-15T22:54:50.311 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-15T22:54:50.350 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-15T22:54:50.372 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 13/13 2024-02-15T22:54:50.412 INFO:teuthology.orchestra.run.smithi052.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 524 kB/s | 69 kB 00:00 2024-02-15T22:54:50.712 INFO:teuthology.orchestra.run.smithi052.stdout:(2/2): ceph-volume-19.0.0-1468.gfddf34c1.el9.no 612 kB/s | 264 kB 00:00 2024-02-15T22:54:50.713 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:50.713 INFO:teuthology.orchestra.run.smithi052.stdout:Total 766 kB/s | 332 kB 00:00 2024-02-15T22:54:50.713 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:54:50.723 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:54:50.723 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:54:50.767 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:54:50.768 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:54:50.927 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:54:51.126 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-02-15T22:54:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2/2 2024-02-15T22:54:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2/2 2024-02-15T22:54:51.171 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:54:51.172 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-15T22:54:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:51.187 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 13/13 2024-02-15T22:54:51.187 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 1/13 2024-02-15T22:54:51.187 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-15T22:54:51.188 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-15T22:54:51.188 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-15T22:54:51.188 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-15T22:54:51.188 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-15T22:54:51.188 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-15T22:54:51.188 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-15T22:54:51.188 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-15T22:54:51.188 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-15T22:54:51.188 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-15T22:54:51.188 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-15T22:54:51.569 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-15T22:54:51.570 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-15T22:54:51.571 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-15T22:54:51.571 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-15T22:54:51.571 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:51.571 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:54:51.829 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-cephadm 2024-02-15T22:54:51.885 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 1/2 2024-02-15T22:54:52.266 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-02-15T22:54:52.266 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:52.266 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:54:52.267 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:52.267 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-15T22:54:52.267 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:52.267 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:52.420 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:02 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:54:52.591 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados-devel 2024-02-15T22:54:52.600 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:54:52.601 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================== 2024-02-15T22:54:52.601 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T22:54:52.601 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================== 2024-02-15T22:54:52.601 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:54:52.601 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 138 k 2024-02-15T22:54:52.601 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T22:54:52.601 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-15T22:54:52.601 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-15T22:54:52.601 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-15T22:54:52.601 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-15T22:54:52.601 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-15T22:54:52.602 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:52.602 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:54:52.602 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================== 2024-02-15T22:54:52.602 INFO:teuthology.orchestra.run.smithi133.stdout:Install 6 Packages 2024-02-15T22:54:52.602 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:52.602 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 6.8 M 2024-02-15T22:54:52.602 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 33 M 2024-02-15T22:54:52.603 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:54:52.962 INFO:teuthology.orchestra.run.smithi133.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 227 kB 00:00 2024-02-15T22:54:53.029 INFO:teuthology.orchestra.run.smithi133.stdout:(2/6): ceph-mgr-cephadm-19.0.0-1468.gfddf34c1.e 569 kB/s | 138 kB 00:00 2024-02-15T22:54:53.154 INFO:teuthology.orchestra.run.smithi133.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 5.8 MB 00:00 2024-02-15T22:54:53.181 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:06 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:53.355 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:53.356 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:53.356 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-02-15T22:54:53.356 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:53.356 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:54:53.356 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 127 k 2024-02-15T22:54:53.356 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:53.356 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:54:53.356 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:53.357 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-02-15T22:54:53.357 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:53.357 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 127 k 2024-02-15T22:54:53.357 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 456 k 2024-02-15T22:54:53.357 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:54:53.430 INFO:teuthology.orchestra.run.smithi133.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 145 kB/s | 58 kB 00:00 2024-02-15T22:54:53.471 INFO:teuthology.orchestra.run.smithi133.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 175 kB/s | 51 kB 00:00 2024-02-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi133.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2024-02-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:Total 7.5 MB/s | 6.8 MB 00:00 2024-02-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:54:53.518 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:54:53.519 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:54:53.594 INFO:teuthology.orchestra.run.smithi052.stdout:librados-devel-19.0.0-1468.gfddf34c1.el9.x86_64 534 kB/s | 127 kB 00:00 2024-02-15T22:54:53.595 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:53.595 INFO:teuthology.orchestra.run.smithi052.stdout:Total 531 kB/s | 127 kB 00:00 2024-02-15T22:54:53.595 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:54:53.601 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:54:53.603 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:54:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:54:53.609 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:54:53.658 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:54:53.658 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:54:53.822 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:54:53.904 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:54:53.929 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:54:54.062 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-15T22:54:54.115 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-15T22:54:54.410 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:54:54.628 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-15T22:54:54.710 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-15T22:54:54.763 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:54:54.764 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:54.764 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:54:54.764 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:54.764 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:54.764 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-15T22:54:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 6/6 2024-02-15T22:54:55.015 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install libcephfs2 2024-02-15T22:54:55.605 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:08 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:55.623 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 6/6 2024-02-15T22:54:55.623 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/6 2024-02-15T22:54:55.623 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-15T22:54:55.623 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-15T22:54:55.623 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-15T22:54:55.624 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-15T22:54:55.723 INFO:teuthology.orchestra.run.smithi052.stdout:Package libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:54:55.778 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:55.779 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-02-15T22:54:55.779 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:55.849 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install libcephfs-devel 2024-02-15T22:54:55.944 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-15T22:54:55.944 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:55.944 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:54:55.944 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:54:55.944 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-15T22:54:55.944 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-15T22:54:55.944 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-15T22:54:55.944 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-15T22:54:55.945 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-15T22:54:55.945 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:55.945 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:54:56.195 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-fuse 2024-02-15T22:54:56.434 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:09 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:56.605 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:56.606 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:56.606 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-02-15T22:54:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:54:56.607 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 31 k 2024-02-15T22:54:56.607 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:54:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:54:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-02-15T22:54:56.607 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 31 k 2024-02-15T22:54:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 140 k 2024-02-15T22:54:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:54:56.777 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:06 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:54:56.880 INFO:teuthology.orchestra.run.smithi052.stdout:libcephfs-devel-19.0.0-1468.gfddf34c1.el9.x86_6 114 kB/s | 31 kB 00:00 2024-02-15T22:54:56.880 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:56.881 INFO:teuthology.orchestra.run.smithi052.stdout:Total 114 kB/s | 31 kB 00:00 2024-02-15T22:54:56.881 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:54:56.884 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:54:56.884 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:54:56.913 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:54:56.913 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:54:56.945 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:54:56.946 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:54:56.946 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T22:54:56.946 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:54:56.946 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:54:56.946 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 887 k 2024-02-15T22:54:56.946 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T22:54:56.947 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-15T22:54:56.947 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:56.947 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:54:56.947 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:54:56.947 INFO:teuthology.orchestra.run.smithi133.stdout:Install 2 Packages 2024-02-15T22:54:56.947 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:56.947 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 966 k 2024-02-15T22:54:56.947 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 2.8 M 2024-02-15T22:54:56.948 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:54:57.034 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:54:57.081 INFO:teuthology.orchestra.run.smithi133.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 591 kB/s | 79 kB 00:00 2024-02-15T22:54:57.148 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:54:57.534 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:54:57.581 INFO:teuthology.orchestra.run.smithi133.stdout:(2/2): ceph-fuse-19.0.0-1468.gfddf34c1.el9.x86_ 1.4 MB/s | 887 kB 00:00 2024-02-15T22:54:57.582 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:54:57.582 INFO:teuthology.orchestra.run.smithi133.stdout:Total 1.5 MB/s | 966 kB 00:00 2024-02-15T22:54:57.583 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:54:57.603 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:54:57.603 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:54:57.679 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:54:57.680 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:54:57.822 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:54:57.822 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:57.822 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:54:57.822 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:54:57.823 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:54:57.823 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:57.871 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:54:57.982 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados2 2024-02-15T22:54:58.016 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-15T22:54:58.080 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/2 2024-02-15T22:54:58.572 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:11 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:58.692 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-02-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:58.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librbd1 2024-02-15T22:54:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/2 2024-02-15T22:54:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/2 2024-02-15T22:54:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-15T22:54:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:59.153 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:54:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-15T22:54:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:54:59.154 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:54:59.379 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:12 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:54:59.428 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-volume 2024-02-15T22:54:59.499 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:54:59.554 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:54:59.556 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-02-15T22:54:59.556 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:54:59.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rados 2024-02-15T22:55:00.021 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:10 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:00.185 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:13 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:55:00.188 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:00.188 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:00.189 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T22:55:00.189 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:00.189 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:55:00.189 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 264 k 2024-02-15T22:55:00.189 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T22:55:00.189 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-15T22:55:00.189 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:00.189 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:55:00.189 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:00.189 INFO:teuthology.orchestra.run.smithi133.stdout:Install 2 Packages 2024-02-15T22:55:00.189 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:00.190 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 332 k 2024-02-15T22:55:00.190 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 1.5 M 2024-02-15T22:55:00.190 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:55:00.301 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:55:00.335 INFO:teuthology.orchestra.run.smithi133.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 474 kB/s | 69 kB 00:00 2024-02-15T22:55:00.355 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:55:00.359 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-02-15T22:55:00.359 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:55:00.403 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rgw 2024-02-15T22:55:00.610 INFO:teuthology.orchestra.run.smithi133.stdout:(2/2): ceph-volume-19.0.0-1468.gfddf34c1.el9.no 628 kB/s | 264 kB 00:00 2024-02-15T22:55:00.611 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:55:00.612 INFO:teuthology.orchestra.run.smithi133.stdout:Total 786 kB/s | 332 kB 00:00 2024-02-15T22:55:00.612 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:55:00.621 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:55:00.621 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:55:00.668 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:55:00.668 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:55:00.824 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:55:00.990 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:13 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:55:01.015 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-02-15T22:55:01.046 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2/2 2024-02-15T22:55:01.062 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2/2 2024-02-15T22:55:01.062 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:55:01.062 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-15T22:55:01.063 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:01.107 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:55:01.161 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:55:01.162 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-02-15T22:55:01.162 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:55:01.207 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-cephfs 2024-02-15T22:55:01.791 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:14 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:55:01.815 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 1/2 2024-02-15T22:55:01.908 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:55:01.962 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:55:01.963 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-02-15T22:55:01.963 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:55:02.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rbd 2024-02-15T22:55:02.177 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-02-15T22:55:02.177 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:02.177 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:55:02.178 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-15T22:55:02.178 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-15T22:55:02.178 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:02.178 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:02.512 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install librados-devel 2024-02-15T22:55:02.597 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:15 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:55:02.716 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:55:02.770 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:55:02.770 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-02-15T22:55:02.770 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:55:02.819 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-fuse 2024-02-15T22:55:03.110 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:13 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:03.278 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:03.279 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repo Size 2024-02-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 127 k 2024-02-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T22:55:03.281 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:03.281 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 127 k 2024-02-15T22:55:03.281 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 456 k 2024-02-15T22:55:03.281 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:55:03.417 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:16 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:55:03.595 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:55:03.596 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:55:03.596 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-02-15T22:55:03.596 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:55:03.596 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:55:03.597 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 85 k 2024-02-15T22:55:03.597 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:03.597 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:55:03.597 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:55:03.597 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-02-15T22:55:03.597 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:03.597 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 85 k 2024-02-15T22:55:03.597 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 231 k 2024-02-15T22:55:03.597 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:55:03.808 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-fuse-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 404 kB/s | 85 kB 00:00 2024-02-15T22:55:03.809 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:55:03.809 INFO:teuthology.orchestra.run.smithi052.stdout:Total 400 kB/s | 85 kB 00:00 2024-02-15T22:55:03.810 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:55:03.817 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:55:03.817 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:55:03.874 INFO:teuthology.orchestra.run.smithi133.stdout:librados-devel-19.0.0-1468.gfddf34c1.el9.x86_64 213 kB/s | 127 kB 00:00 2024-02-15T22:55:03.874 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:55:03.875 INFO:teuthology.orchestra.run.smithi133.stdout:Total 213 kB/s | 127 kB 00:00 2024-02-15T22:55:03.875 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:55:03.877 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:55:03.877 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:55:03.881 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:55:03.881 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:55:03.938 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:55:03.938 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:55:04.022 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:55:04.090 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:55:04.143 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:04.206 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:04.580 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:04.695 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:04.921 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:04.922 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:04.922 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:55:04.922 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:55:04.922 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:04.922 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:55:04.976 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:04.977 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:04.977 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:55:04.977 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:55:04.977 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:04.977 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:05.170 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-mirror 2024-02-15T22:55:05.226 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install libcephfs2 2024-02-15T22:55:05.761 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:18 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:55:05.816 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:15 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:05.934 INFO:teuthology.orchestra.run.smithi133.stdout:Package libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:55:05.934 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:55:05.935 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:55:05.935 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-02-15T22:55:05.935 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:55:05.935 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:55:05.935 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.1 M 2024-02-15T22:55:05.936 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:05.936 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:55:05.936 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:55:05.936 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-02-15T22:55:05.936 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:05.936 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 3.1 M 2024-02-15T22:55:05.936 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 13 M 2024-02-15T22:55:05.936 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:55:05.987 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:05.988 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T22:55:05.988 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:06.070 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install libcephfs-devel 2024-02-15T22:55:06.645 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:16 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:06.811 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:06.811 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repo Size 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 31 k 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 31 k 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 140 k 2024-02-15T22:55:06.812 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:55:06.992 INFO:teuthology.orchestra.run.smithi133.stdout:libcephfs-devel-19.0.0-1468.gfddf34c1.el9.x86_6 173 kB/s | 31 kB 00:00 2024-02-15T22:55:06.993 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:55:06.993 INFO:teuthology.orchestra.run.smithi133.stdout:Total 172 kB/s | 31 kB 00:00 2024-02-15T22:55:06.993 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:55:06.997 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:55:06.997 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:55:07.030 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:55:07.031 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:55:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:55:07.257 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:07.656 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:07.703 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-mirror-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 1.7 MB/s | 3.1 MB 00:01 2024-02-15T22:55:07.703 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:55:07.704 INFO:teuthology.orchestra.run.smithi052.stdout:Total 1.7 MB/s | 3.1 MB 00:01 2024-02-15T22:55:07.704 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:55:07.715 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:55:07.716 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:55:07.796 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:55:07.796 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:55:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:07.932 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:55:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:55:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:07.932 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:08.102 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install librados2 2024-02-15T22:55:08.243 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:55:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:08.336 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:08.336 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:55:08.336 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-15T22:55:08.336 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:55:08.336 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:55:08.336 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:08.686 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:18 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:08.801 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:55:08.853 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:08.854 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T22:55:08.855 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:08.908 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install librbd1 2024-02-15T22:55:09.492 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:19 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:09.505 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:55:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:55:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:09.505 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:55:09.607 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:55:09.660 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:09.660 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T22:55:09.661 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:09.718 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-nbd 2024-02-15T22:55:09.719 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-rados 2024-02-15T22:55:10.299 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:20 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:10.315 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:23 ago on Thu 15 Feb 2024 10:52:47 PM UTC. 2024-02-15T22:55:10.414 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:55:10.466 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:10.492 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-02-15T22:55:10.492 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:55:10.492 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-02-15T22:55:10.492 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:55:10.492 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-02-15T22:55:10.492 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 171 k 2024-02-15T22:55:10.492 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:10.493 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-02-15T22:55:10.493 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-02-15T22:55:10.493 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-02-15T22:55:10.493 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:10.493 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 171 k 2024-02-15T22:55:10.493 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 494 k 2024-02-15T22:55:10.493 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-02-15T22:55:10.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-rgw 2024-02-15T22:55:10.722 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-nbd-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 747 kB/s | 171 kB 00:00 2024-02-15T22:55:10.723 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:55:10.723 INFO:teuthology.orchestra.run.smithi052.stdout:Total 742 kB/s | 171 kB 00:00 2024-02-15T22:55:10.723 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-02-15T22:55:10.731 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-02-15T22:55:10.731 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-02-15T22:55:10.789 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-02-15T22:55:10.789 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-02-15T22:55:10.942 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-02-15T22:55:11.057 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:11.104 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:21 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:11.218 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:55:11.268 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:11.269 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T22:55:11.269 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:11.313 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-cephfs 2024-02-15T22:55:11.496 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:11.795 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:11.795 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:11.795 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-02-15T22:55:11.795 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:55:11.795 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:11.795 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-02-15T22:55:11.891 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:21 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:12.001 DEBUG:teuthology.parallel:result is None 2024-02-15T22:55:12.006 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:55:12.058 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:12.059 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T22:55:12.059 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:12.110 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-rbd 2024-02-15T22:55:12.688 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:22 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:12.802 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-15T22:55:12.853 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:12.855 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T22:55:12.855 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:12.906 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install rbd-fuse 2024-02-15T22:55:13.494 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:23 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:13.662 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:13.663 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:13.663 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T22:55:13.663 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:13.663 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:55:13.664 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 85 k 2024-02-15T22:55:13.664 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:13.664 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:55:13.664 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:13.664 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T22:55:13.664 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:13.664 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 85 k 2024-02-15T22:55:13.664 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 231 k 2024-02-15T22:55:13.664 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:55:13.879 INFO:teuthology.orchestra.run.smithi133.stdout:rbd-fuse-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 397 kB/s | 85 kB 00:00 2024-02-15T22:55:13.879 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:55:13.879 INFO:teuthology.orchestra.run.smithi133.stdout:Total 395 kB/s | 85 kB 00:00 2024-02-15T22:55:13.880 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:55:13.886 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:55:13.886 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:55:13.941 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:55:13.942 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:55:14.093 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:55:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:14.620 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:14.922 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:14.923 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:14.923 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:55:14.923 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:55:14.923 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:14.923 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:15.113 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install rbd-mirror 2024-02-15T22:55:15.708 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:25 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:15.876 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repo Size 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.1 M 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 3.1 M 2024-02-15T22:55:15.877 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 13 M 2024-02-15T22:55:15.878 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:55:16.548 INFO:teuthology.orchestra.run.smithi133.stdout:rbd-mirror-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 4.6 MB/s | 3.1 MB 00:00 2024-02-15T22:55:16.548 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:55:16.549 INFO:teuthology.orchestra.run.smithi133.stdout:Total 4.6 MB/s | 3.1 MB 00:00 2024-02-15T22:55:16.549 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:55:16.558 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:55:16.558 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:55:16.631 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:55:16.632 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:55:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:55:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:17.140 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:17.140 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:55:17.140 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-15T22:55:17.140 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:55:17.140 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:55:17.140 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:18.298 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:18.298 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:18.298 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:55:18.299 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:55:18.299 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:18.299 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:18.560 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install rbd-nbd 2024-02-15T22:55:19.148 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:29 ago on Thu 15 Feb 2024 10:52:50 PM UTC. 2024-02-15T22:55:19.313 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T22:55:19.314 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:19.314 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T22:55:19.314 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:19.314 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T22:55:19.315 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 171 k 2024-02-15T22:55:19.315 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:19.315 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T22:55:19.315 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T22:55:19.315 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T22:55:19.315 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:19.315 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 171 k 2024-02-15T22:55:19.315 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 494 k 2024-02-15T22:55:19.315 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T22:55:19.545 INFO:teuthology.orchestra.run.smithi133.stdout:rbd-nbd-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 743 kB/s | 171 kB 00:00 2024-02-15T22:55:19.545 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:55:19.546 INFO:teuthology.orchestra.run.smithi133.stdout:Total 739 kB/s | 171 kB 00:00 2024-02-15T22:55:19.546 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T22:55:19.554 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T22:55:19.554 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T22:55:19.608 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T22:55:19.609 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T22:55:19.752 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T22:55:19.868 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:20.347 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:20.664 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-15T22:55:20.665 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:20.665 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T22:55:20.665 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-15T22:55:20.665 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:20.665 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T22:55:20.881 DEBUG:teuthology.parallel:result is None 2024-02-15T22:55:20.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-15T22:55:21.026 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-15T22:55:21.050 INFO:teuthology.orchestra.run.smithi052.stdout:19.0.0-1468.gfddf34c1.el9 2024-02-15T22:55:21.050 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1468.gfddf34c1.el9 2024-02-15T22:55:21.051 INFO:teuthology.task.install:The correct ceph version 19.0.0-1468.gfddf34c1 is installed. 2024-02-15T22:55:21.052 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-15T22:55:21.267 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-15T22:55:21.288 INFO:teuthology.orchestra.run.smithi133.stdout:19.0.0-1468.gfddf34c1.el9 2024-02-15T22:55:21.288 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1468.gfddf34c1.el9 2024-02-15T22:55:21.289 INFO:teuthology.task.install:The correct ceph version 19.0.0-1468.gfddf34c1 is installed. 2024-02-15T22:55:21.290 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-15T22:55:21.291 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:21.291 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T22:55:21.323 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:21.324 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T22:55:21.357 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-15T22:55:21.357 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:21.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T22:55:21.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T22:55:21.463 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:21.463 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T22:55:21.496 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T22:55:21.563 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-15T22:55:21.563 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:21.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T22:55:21.594 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T22:55:21.664 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:21.665 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T22:55:21.692 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T22:55:21.758 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-15T22:55:21.758 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:21.758 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T22:55:21.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T22:55:21.856 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:21.856 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T22:55:21.883 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T22:55:21.950 INFO:teuthology.run_tasks:Running task ceph... 2024-02-15T22:55:22.032 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-15T22:55:22.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-02-15T22:55:22.035 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2024-02-15T22:55:22.062 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-15T22:55:22.063 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-15T22:55:22.105 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-15T22:55:22.132 INFO:tasks.ceph:Creating extra log directories... 2024-02-15T22:55:22.132 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-15T22:55:22.175 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-15T22:55:22.210 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-15T22:55:22.210 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-15T22:55:22.210 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707', 'branch': 'wip-yuri2-testing-2024-02-15-0913-squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7561707', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2024-02-15-0913-squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2024-02-15-0913-squid', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 51, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9739, 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rgw', 'suite_branch': 'wip-yuri2-testing-2024-02-15-0913-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKCk4BwJnZymaHN/ARCzS3eOsR0slziOZuvfx0UsCDD5bj2XIGFF5DrCUAu+9PGI3+TWMx9K5w8XUq/HbPPEea4=', 'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0WhKIadFldsvJzv+uLEq/oD+fbtnukUMhfslv/NPByzWgRcLNvq+Mzt4nxxjSWfDBGCtxrcJLos5hvLNWA7DA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-15_21:10:42', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-15T22:55:22.211 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-15T22:55:22.244 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-15T22:55:22.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-02-15T22:55:22.299 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2024-02-15T22:55:22.327 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:22.327 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T22:55:22.381 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T22:55:22.381 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-02-15T22:55:22.436 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T22:55:22.436 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:55:22.437 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-02-15T22:55:22.437 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:55:22.437 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:55:22.437 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-02-15 22:55:08.589610815 +0000 2024-02-15T22:55:22.437 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-02-15 22:51:58.727493228 +0000 2024-02-15T22:55:22.437 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-02-15 22:51:58.727493228 +0000 2024-02-15T22:55:22.437 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-02-15 22:51:58.727493228 +0000 2024-02-15T22:55:22.437 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T22:55:22.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-02-15T22:55:22.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-02-15T22:55:22.502 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 8.2149e-05 s, 6.2 MB/s 2024-02-15T22:55:22.503 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T22:55:22.559 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-02-15T22:55:22.614 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T22:55:22.614 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:55:22.614 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-02-15T22:55:22.614 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:55:22.614 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:55:22.614 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-02-15 22:55:08.589610815 +0000 2024-02-15T22:55:22.614 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-02-15 22:51:59.052489088 +0000 2024-02-15T22:55:22.614 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-02-15 22:51:59.052489088 +0000 2024-02-15T22:55:22.614 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-02-15 22:51:59.052489088 +0000 2024-02-15T22:55:22.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T22:55:22.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-02-15T22:55:22.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-02-15T22:55:22.680 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000100918 s, 5.1 MB/s 2024-02-15T22:55:22.681 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T22:55:22.737 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-02-15T22:55:22.792 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T22:55:22.792 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:55:22.792 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-02-15T22:55:22.792 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:55:22.792 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:55:22.792 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-02-15 22:55:08.590610802 +0000 2024-02-15T22:55:22.792 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-02-15 22:51:59.387484820 +0000 2024-02-15T22:55:22.793 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-02-15 22:51:59.387484820 +0000 2024-02-15T22:55:22.793 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-02-15 22:51:59.387484820 +0000 2024-02-15T22:55:22.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T22:55:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-02-15T22:55:22.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-02-15T22:55:22.858 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.3415e-05 s, 5.5 MB/s 2024-02-15T22:55:22.859 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T22:55:22.915 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-02-15T22:55:22.970 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T22:55:22.970 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:55:22.971 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-02-15T22:55:22.971 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:55:22.971 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:55:22.971 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-02-15 22:55:08.590610802 +0000 2024-02-15T22:55:22.971 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-02-15 22:51:59.726480501 +0000 2024-02-15T22:55:22.971 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-02-15 22:51:59.726480501 +0000 2024-02-15T22:55:22.971 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-02-15 22:51:59.726480501 +0000 2024-02-15T22:55:22.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T22:55:23.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-02-15T22:55:23.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-02-15T22:55:23.036 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 8.1759e-05 s, 6.3 MB/s 2024-02-15T22:55:23.037 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T22:55:23.093 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-15T22:55:23.093 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:23.093 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T22:55:23.108 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T22:55:23.108 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2024-02-15T22:55:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T22:55:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:55:23.162 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-02-15T22:55:23.162 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:55:23.163 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:55:23.163 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 22:55:17.381129019 +0000 2024-02-15T22:55:23.163 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 22:51:55.766546509 +0000 2024-02-15T22:55:23.163 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 22:51:55.766546509 +0000 2024-02-15T22:55:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-02-15 22:51:55.766546509 +0000 2024-02-15T22:55:23.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T22:55:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T22:55:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T22:55:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000185369 s, 2.8 MB/s 2024-02-15T22:55:23.229 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T22:55:23.284 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2024-02-15T22:55:23.338 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T22:55:23.339 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:55:23.339 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-15T22:55:23.339 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:55:23.339 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:55:23.339 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 22:55:17.382128999 +0000 2024-02-15T22:55:23.339 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 22:51:56.135539361 +0000 2024-02-15T22:55:23.339 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 22:51:56.135539361 +0000 2024-02-15T22:55:23.339 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-02-15 22:51:56.135539361 +0000 2024-02-15T22:55:23.339 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T22:55:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T22:55:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T22:55:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000213284 s, 2.4 MB/s 2024-02-15T22:55:23.406 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T22:55:23.461 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2024-02-15T22:55:23.516 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T22:55:23.517 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:55:23.517 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-02-15T22:55:23.517 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:55:23.517 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:55:23.517 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 22:55:17.382128999 +0000 2024-02-15T22:55:23.517 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 22:51:56.476532756 +0000 2024-02-15T22:55:23.517 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 22:51:56.476532756 +0000 2024-02-15T22:55:23.517 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-02-15 22:51:56.476532756 +0000 2024-02-15T22:55:23.517 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T22:55:23.582 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T22:55:23.582 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T22:55:23.582 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000183968 s, 2.8 MB/s 2024-02-15T22:55:23.583 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T22:55:23.638 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2024-02-15T22:55:23.692 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T22:55:23.692 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:55:23.693 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-02-15T22:55:23.693 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:55:23.693 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:55:23.693 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 22:55:17.382128999 +0000 2024-02-15T22:55:23.693 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 22:51:56.810526286 +0000 2024-02-15T22:55:23.693 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 22:51:56.810526286 +0000 2024-02-15T22:55:23.693 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-02-15 22:51:56.810526286 +0000 2024-02-15T22:55:23.693 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T22:55:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T22:55:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T22:55:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000189456 s, 2.7 MB/s 2024-02-15T22:55:23.759 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T22:55:23.814 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-15T22:55:23.814 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-15T22:55:23.814 INFO:tasks.ceph:Generating config... 2024-02-15T22:55:23.815 INFO:tasks.ceph:[client] debug ms = 1 2024-02-15T22:55:23.815 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-02-15T22:55:23.816 INFO:tasks.ceph:[client] debug rgw = 20 2024-02-15T22:55:23.816 INFO:tasks.ceph:[client] setgroup = ceph 2024-02-15T22:55:23.816 INFO:tasks.ceph:[client] setuser = ceph 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] debug objclass = 20 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-15T22:55:23.816 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-15T22:55:23.817 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-15T22:55:23.817 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-15T22:55:23.817 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-15T22:55:23.817 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-15T22:55:23.817 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-15T22:55:23.817 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-15T22:55:23.817 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-15T22:55:23.817 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-15T22:55:23.817 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-15T22:55:23.817 INFO:tasks.ceph:Setting up mon.a... 2024-02-15T22:55:23.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-15T22:55:23.878 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2024-02-15T22:55:23.880 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-15T22:55:23.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-15T22:55:23.954 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52')] 2024-02-15T22:55:23.954 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-02-15T22:55:23.954 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:23.955 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-15T22:55:24.009 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --print /home/ubuntu/cephtest/ceph.monmap 2024-02-15T22:55:24.087 INFO:teuthology.orchestra.run.smithi052.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:55:24.087 INFO:teuthology.orchestra.run.smithi052.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:55:24.088 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-15T22:55:24.088 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid 81db0e6a-c08b-432e-840e-21ec1a74d746 2024-02-15T22:55:24.088 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = quincy 2024-02-15T22:55:24.088 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2024-02-15T22:55:24.088 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 81db0e6a-c08b-432e-840e-21ec1a74d746 2024-02-15T22:55:24.088 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2024-02-15T22:55:24.086866+0000 2024-02-15T22:55:24.088 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-02-15T22:55:24.086866+0000 2024-02-15T22:55:24.089 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 17 (quincy) 2024-02-15T22:55:24.089 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2024-02-15T22:55:24.089 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-02-15T22:55:24.089 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-02-15T22:55:24.090 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-15T22:55:24.145 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 81db0e6a-c08b-432e-840e-21ec1a74d746... 2024-02-15T22:55:24.145 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-15T22:55:24.188 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-15T22:55:24.235 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-02-15T22:55:24.236 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-02-15T22:55:24.237 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-02-15T22:55:24.238 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = 172.21.15.52 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 81db0e6a-c08b-432e-840e-21ec1a74d746 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.239 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.240 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: debug objclass = 20 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore allocator = bitmap 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-02-15T22:55:24.241 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-02-15T22:55:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-02-15T22:55:24.243 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-02-15T22:55:24.244 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: rgw gc obj min wait = 15 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: debug rgw = 20 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: setgroup = ceph 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout: setuser = ceph 2024-02-15T22:55:24.245 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-02-15T22:55:24.246 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2024-02-15T22:55:24.246 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2024-02-15T22:55:24.246 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-15T22:55:24.246 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2024-02-15T22:55:24.246 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.246 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2024-02-15T22:55:24.246 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.246 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2024-02-15T22:55:24.246 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2024-02-15T22:55:24.247 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2024-02-15T22:55:24.248 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = 172.21.15.52 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 81db0e6a-c08b-432e-840e-21ec1a74d746 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2024-02-15T22:55:24.249 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug trim objects = true 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.250 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: debug objclass = 20 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: bdev async discard = True 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: bdev enable discard = True 2024-02-15T22:55:24.251 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore allocator = bitmap 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 1/20 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 1/20 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 4/10 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2024-02-15T22:55:24.252 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2024-02-15T22:55:24.253 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2024-02-15T22:55:24.254 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.255 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2024-02-15T22:55:24.255 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T22:55:24.255 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2024-02-15T22:55:24.255 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2024-02-15T22:55:24.255 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2024-02-15T22:55:24.255 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2024-02-15T22:55:24.255 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-15T22:55:24.255 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-15T22:55:24.255 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-02-15T22:55:24.255 INFO:teuthology.orchestra.run.smithi133.stdout: rgw gc obj min wait = 15 2024-02-15T22:55:24.255 INFO:teuthology.orchestra.run.smithi133.stdout: debug rgw = 20 2024-02-15T22:55:24.256 INFO:teuthology.orchestra.run.smithi133.stdout: setgroup = ceph 2024-02-15T22:55:24.256 INFO:teuthology.orchestra.run.smithi133.stdout: setuser = ceph 2024-02-15T22:55:24.256 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2024-02-15T22:55:24.257 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-15T22:55:24.257 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-15T22:55:24.352 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-15T22:55:24.353 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:24.353 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-15T22:55:24.367 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:24.367 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-15T22:55:24.421 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-02-15T22:55:24.421 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:24.421 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-15T22:55:24.421 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-15T22:55:24.500 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:24.500 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-15T22:55:24.555 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T22:55:24.555 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:24.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-15T22:55:24.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-15T22:55:24.596 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:24.596 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-15T22:55:24.651 INFO:tasks.ceph:Setting up mon nodes... 2024-02-15T22:55:24.651 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-15T22:55:24.651 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-15T22:55:24.752 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-15T22:55:24.754 INFO:tasks.ceph:Setting up mds nodes... 2024-02-15T22:55:24.754 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-15T22:55:24.755 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-15T22:55:24.796 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-15T22:55:24.812 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-15T22:55:24.812 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-15T22:55:24.812 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-15T22:55:24.838 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-15T22:55:24.838 INFO:tasks.ceph:role: osd.0 2024-02-15T22:55:24.839 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2024-02-15T22:55:24.839 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-15T22:55:24.906 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-15T22:55:24.906 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-15T22:55:24.906 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-15T22:55:24.907 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-15T22:55:24.907 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-15T22:55:24.907 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-02-15T22:55:24.907 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-15T22:55:24.907 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-15T22:55:24.907 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-15T22:55:24.907 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-15T22:55:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-02-15T22:55:24.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-02-15T22:55:24.941 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-15T22:55:25.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-15T22:55:25.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-15T22:55:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:25.183+0000 7ff193ca8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-15T22:55:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:25.183+0000 7ff193ca8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-15T22:55:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:25.183+0000 7ff193ca8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-15T22:55:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:25.183+0000 7ff193ca8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-15T22:55:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:25.183+0000 7ff193ca8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-15T22:55:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:25.183+0000 7ff193ca8640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-15T22:55:28.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T22:55:28.084 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-15T22:55:28.116 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-15T22:55:28.116 INFO:tasks.ceph:role: osd.1 2024-02-15T22:55:28.117 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T22:55:28.117 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-15T22:55:28.193 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-15T22:55:28.194 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-15T22:55:28.194 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-15T22:55:28.194 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-15T22:55:28.194 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-15T22:55:28.194 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-02-15T22:55:28.194 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-15T22:55:28.194 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-15T22:55:28.194 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-15T22:55:28.194 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-15T22:55:28.693 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-02-15T22:55:28.695 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-02-15T22:55:28.695 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-02-15T22:55:28.811 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-15T22:55:28.848 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-15T22:55:28.917 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-15T22:55:28.917 INFO:tasks.ceph:role: osd.2 2024-02-15T22:55:28.918 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T22:55:28.918 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-15T22:55:28.993 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-15T22:55:28.993 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-15T22:55:28.993 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-15T22:55:28.993 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-15T22:55:28.993 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-15T22:55:28.994 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-02-15T22:55:28.994 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-15T22:55:28.994 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-15T22:55:28.994 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-15T22:55:28.994 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-15T22:55:29.455 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-02-15T22:55:29.457 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-02-15T22:55:29.458 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-02-15T22:55:29.560 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-15T22:55:29.593 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-15T22:55:29.661 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-15T22:55:29.661 INFO:tasks.ceph:role: osd.3 2024-02-15T22:55:29.661 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T22:55:29.661 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-15T22:55:29.736 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-15T22:55:29.737 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-15T22:55:29.737 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-15T22:55:29.737 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-15T22:55:29.737 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-15T22:55:29.737 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-02-15T22:55:29.737 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-15T22:55:29.737 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-15T22:55:29.737 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-15T22:55:29.737 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-15T22:55:30.256 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-02-15T22:55:30.258 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-02-15T22:55:30.259 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-02-15T22:55:30.402 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-15T22:55:30.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-15T22:55:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:30.529+0000 7fed6260f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-15T22:55:30.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:30.534+0000 7fed6260f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-15T22:55:30.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:30.534+0000 7fed6260f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-15T22:55:30.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:30.534+0000 7fed6260f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-15T22:55:30.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:30.534+0000 7fed6260f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-15T22:55:30.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:30.538+0000 7fed6260f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-15T22:55:33.392 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T22:55:33.423 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-15T22:55:33.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:33.511+0000 7f9373aac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-15T22:55:33.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:33.512+0000 7f9373aac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-15T22:55:33.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:33.512+0000 7f9373aac640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-15T22:55:33.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:33.512+0000 7f9373aac640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-15T22:55:33.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:33.512+0000 7f9373aac640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-15T22:55:33.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:33.512+0000 7f9373aac640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-15T22:55:36.370 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T22:55:36.401 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-15T22:55:36.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:36.490+0000 7f081d815640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-15T22:55:36.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:36.490+0000 7f081d815640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-15T22:55:36.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:36.490+0000 7f081d815640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-15T22:55:36.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:36.490+0000 7f081d815640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-15T22:55:36.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:36.490+0000 7f081d815640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-15T22:55:36.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:36.491+0000 7f081d815640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-15T22:55:39.356 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T22:55:39.384 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-15T22:55:39.384 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:39.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-15T22:55:39.416 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:39.416 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-15T22:55:39.451 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:39.451 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-15T22:55:39.518 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:39.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-15T22:55:39.584 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:39.585 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-15T22:55:39.651 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:39.651 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-15T22:55:39.707 INFO:tasks.ceph:Adding keys to all mons... 2024-02-15T22:55:39.707 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-15T22:55:39.737 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-02-15T22:55:39.737 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBdls5lg9b8ChAABcSwc5vNhOTo0nqrZ+Z5Bw== 2024-02-15T22:55:39.737 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-02-15T22:55:39.737 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBcls5lS33CLBAAJ+YHkb2abi/UHImK7SLV+w== 2024-02-15T22:55:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-02-15T22:55:39.738 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBils5lmmqZHxAA4kqD0B0gz2AbQAAoNilWNw== 2024-02-15T22:55:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-02-15T22:55:39.738 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBlls5lnVOSHhAAfAI71gK1vBQC7kyQt+jXpg== 2024-02-15T22:55:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2024-02-15T22:55:39.738 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBols5lf1dMHRAAbn2o8Hls0DSS3NjvSr+CrQ== 2024-02-15T22:55:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-02-15T22:55:39.738 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBcls5lgqlqLxAAYs0I+NW/uEQJ6vMw2Xj21g== 2024-02-15T22:55:39.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-15T22:55:39.836 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-15T22:55:39.890 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-15T22:55:39.942 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-15T22:55:39.993 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-15T22:55:40.045 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-15T22:55:40.099 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-15T22:55:40.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-15T22:55:40.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-15T22:55:40.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-15T22:55:40.250 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-15T22:55:40.304 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-15T22:55:40.305 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-15T22:55:40.305 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-15T22:55:40.347 INFO:tasks.ceph.mon.a:Started 2024-02-15T22:55:40.347 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-15T22:55:40.347 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-15T22:55:40.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-15T22:55:40.349 INFO:tasks.ceph.mgr.x:Started 2024-02-15T22:55:40.349 INFO:tasks.ceph:Setting crush tunables to default 2024-02-15T22:55:40.350 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2024-02-15T22:55:40.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f2168e2a640 1 Processor -- start 2024-02-15T22:55:40.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f2168e2a640 1 -- start start 2024-02-15T22:55:40.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f2168e2a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f216409a0b0 0x7f216409a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:40.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f2168e2a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216409beb0 con 0x7f216409a9d0 2024-02-15T22:55:40.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f2168e2a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216409d410 con 0x7f216409a0b0 2024-02-15T22:55:40.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f216259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f216409a0b0 0x7f216409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:40.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f2161d9b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f216409a9d0 0x7f216412bbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59482/0 (socket says 172.21.15.52:59482) 2024-02-15T22:55:40.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f2161d9b640 1 -- 172.21.15.52:0/3335643944 learned_addr learned my addr 172.21.15.52:0/3335643944 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:40.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f216259c640 1 -- 172.21.15.52:0/3335643944 >> v2:172.21.15.52:3300/0 conn(0x7f216409a0b0 msgr2=0x7f216409a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-15T22:55:40.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f216259c640 1 -- 172.21.15.52:0/3335643944 >> v2:172.21.15.52:3300/0 conn(0x7f216409a0b0 msgr2=0x7f216409a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-15T22:55:40.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f216259c640 1 --2- 172.21.15.52:0/3335643944 >> v2:172.21.15.52:3300/0 conn(0x7f216409a0b0 0x7f216409a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-15T22:55:40.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.447+0000 7f216259c640 1 --2- 172.21.15.52:0/3335643944 >> v2:172.21.15.52:3300/0 conn(0x7f216409a0b0 0x7f216409a490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:55:40.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.458+0000 7f216159a640 1 -- 172.21.15.52:0/3335643944 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115810190 0 0) 0x7f216409beb0 con 0x7f216409a9d0 2024-02-15T22:55:40.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.458+0000 7f216159a640 1 -- 172.21.15.52:0/3335643944 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f214c003520 con 0x7f216409a9d0 2024-02-15T22:55:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.458+0000 7f216159a640 1 -- 172.21.15.52:0/3335643944 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3992989806 0 0) 0x7f214c003520 con 0x7f216409a9d0 2024-02-15T22:55:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.458+0000 7f216159a640 1 -- 172.21.15.52:0/3335643944 >> v2:172.21.15.52:3300/0 conn(0x7f216409a0b0 msgr2=0x7f216409a490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-15T22:55:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.458+0000 7f216159a640 1 --2- 172.21.15.52:0/3335643944 >> v2:172.21.15.52:3300/0 conn(0x7f216409a0b0 0x7f216409a490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.458+0000 7f216159a640 1 -- 172.21.15.52:0/3335643944 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216409c6f0 con 0x7f216409a9d0 2024-02-15T22:55:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.458+0000 7f216159a640 1 -- 172.21.15.52:0/3335643944 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 1188439457 0 0) 0x7f21580015a0 con 0x7f216409a9d0 2024-02-15T22:55:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.458+0000 7f216159a640 1 -- 172.21.15.52:0/3335643944 >> v1:172.21.15.52:6789/0 conn(0x7f216409a9d0 legacy=0x7f216412bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.458+0000 7f216159a640 1 --2- 172.21.15.52:0/3335643944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 0x7f214c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.458+0000 7f216159a640 1 -- 172.21.15.52:0/3335643944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216409d410 con 0x7f214c003970 2024-02-15T22:55:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.458+0000 7f216259c640 1 --2- 172.21.15.52:0/3335643944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 0x7f214c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.459+0000 7f216259c640 1 -- 172.21.15.52:0/3335643944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c003520 con 0x7f214c003970 2024-02-15T22:55:40.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.460+0000 7f216259c640 1 --2- 172.21.15.52:0/3335643944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 0x7f214c003d70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f215400b960 tx=0x7f214c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e634d5e9957623 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:40.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.460+0000 7f216159a640 1 -- 172.21.15.52:0/3335643944 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f215402d5d0 con 0x7f214c003970 2024-02-15T22:55:40.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.460+0000 7f216159a640 1 -- 172.21.15.52:0/3335643944 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215402d730 con 0x7f214c003970 2024-02-15T22:55:40.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.460+0000 7f216159a640 1 -- 172.21.15.52:0/3335643944 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f215402da10 con 0x7f214c003970 2024-02-15T22:55:40.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.461+0000 7f2168e2a640 1 -- 172.21.15.52:0/3335643944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 msgr2=0x7f214c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:40.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.461+0000 7f2168e2a640 1 --2- 172.21.15.52:0/3335643944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 0x7f214c003d70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f215400b960 tx=0x7f214c0057f0 comp rx=0 tx=0).stop 2024-02-15T22:55:40.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.461+0000 7f2168e2a640 1 -- 172.21.15.52:0/3335643944 shutdown_connections 2024-02-15T22:55:40.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.461+0000 7f2168e2a640 1 --2- 172.21.15.52:0/3335643944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 0x7f214c003d70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:40.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.461+0000 7f2168e2a640 1 --2- 172.21.15.52:0/3335643944 >> v2:172.21.15.52:3300/0 conn(0x7f216409a0b0 0x7f216409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:40.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.461+0000 7f2168e2a640 1 -- 172.21.15.52:0/3335643944 >> 172.21.15.52:0/3335643944 conn(0x7f216406f520 msgr2=0x7f2164071940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:40.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.461+0000 7f2168e2a640 1 -- 172.21.15.52:0/3335643944 shutdown_connections 2024-02-15T22:55:40.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.461+0000 7f2168e2a640 1 -- 172.21.15.52:0/3335643944 wait complete. 2024-02-15T22:55:40.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.462+0000 7f2168e2a640 1 Processor -- start 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.462+0000 7f2168e2a640 1 -- start start 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.462+0000 7f2168e2a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 0x7f21641c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.462+0000 7f2168e2a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21641b3a30 con 0x7f214c003970 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f216259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 0x7f21641c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f216259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 0x7f21641c06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58140/0 (socket says 172.21.15.52:58140) 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f216259c640 1 -- 172.21.15.52:0/1551283835 learned_addr learned my addr 172.21.15.52:0/1551283835 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f216259c640 1 -- 172.21.15.52:0/1551283835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216411a8e0 con 0x7f214c003970 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f216259c640 1 --2- 172.21.15.52:0/1551283835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 0x7f21641c06a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2154000c00 tx=0x7f2154004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f2152ffd640 1 -- 172.21.15.52:0/1551283835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f215402eb90 con 0x7f214c003970 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f2152ffd640 1 -- 172.21.15.52:0/1551283835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215402ecf0 con 0x7f214c003970 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f2152ffd640 1 -- 172.21.15.52:0/1551283835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f215403a450 con 0x7f214c003970 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f2168e2a640 1 -- 172.21.15.52:0/1551283835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216411c320 con 0x7f214c003970 2024-02-15T22:55:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f2168e2a640 1 -- 172.21.15.52:0/1551283835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216411c5c0 con 0x7f214c003970 2024-02-15T22:55:40.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f2152ffd640 1 -- 172.21.15.52:0/1551283835 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f215403a5b0 con 0x7f214c003970 2024-02-15T22:55:40.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.463+0000 7f2152ffd640 1 -- 172.21.15.52:0/1551283835 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f215404dc20 con 0x7f214c003970 2024-02-15T22:55:40.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.464+0000 7f2168e2a640 1 -- 172.21.15.52:0/1551283835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216411c180 con 0x7f214c003970 2024-02-15T22:55:40.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.466+0000 7f2152ffd640 1 -- 172.21.15.52:0/1551283835 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f216411c180 con 0x7f214c003970 2024-02-15T22:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.533+0000 7f2168e2a640 1 -- 172.21.15.52:0/1551283835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f21640627b0 con 0x7f214c003970 2024-02-15T22:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.534+0000 7f2152ffd640 1 -- 172.21.15.52:0/1551283835 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2154035070 con 0x7f214c003970 2024-02-15T22:55:40.537 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-02-15T22:55:40.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.535+0000 7f2168e2a640 1 -- 172.21.15.52:0/1551283835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 msgr2=0x7f21641c06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.535+0000 7f2168e2a640 1 --2- 172.21.15.52:0/1551283835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 0x7f21641c06a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2154000c00 tx=0x7f2154004730 comp rx=0 tx=0).stop 2024-02-15T22:55:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.535+0000 7f2168e2a640 1 -- 172.21.15.52:0/1551283835 shutdown_connections 2024-02-15T22:55:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.535+0000 7f2168e2a640 1 --2- 172.21.15.52:0/1551283835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f214c003970 0x7f21641c06a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.535+0000 7f2168e2a640 1 -- 172.21.15.52:0/1551283835 >> 172.21.15.52:0/1551283835 conn(0x7f216406f520 msgr2=0x7f21641b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.535+0000 7f2168e2a640 1 -- 172.21.15.52:0/1551283835 shutdown_connections 2024-02-15T22:55:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:40.535+0000 7f2168e2a640 1 -- 172.21.15.52:0/1551283835 wait complete. 2024-02-15T22:55:40.548 INFO:tasks.ceph:check_enable_crimson: False 2024-02-15T22:55:40.548 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-15T22:55:40.548 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-02-15T22:55:40.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-15T22:55:40.574 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:40.574 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-15T22:55:40.601 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:40.601 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-15T22:55:40.668 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T22:55:40.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-15T22:55:40.735 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 257a07e8-165d-4ad0-9cf2-429df58aa049 0 2024-02-15T22:55:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.872+0000 7f46f0831640 1 Processor -- start 2024-02-15T22:55:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.872+0000 7f46f0831640 1 -- start start 2024-02-15T22:55:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.873+0000 7f46f0831640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46ec118190 0x7f46ec11a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.873+0000 7f46f0831640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec11ab50 con 0x7f46ec115400 2024-02-15T22:55:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.873+0000 7f46f0831640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec11bcf0 con 0x7f46ec118190 2024-02-15T22:55:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.873+0000 7f46e3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46ec118190 0x7f46ec11a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.873+0000 7f46e3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46ec118190 0x7f46ec11a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57134/0 (socket says 172.21.15.133:57134) 2024-02-15T22:55:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.873+0000 7f46ea59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f46ec115400 0x7f46ec1157e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:50062/0 (socket says 172.21.15.133:50062) 2024-02-15T22:55:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.873+0000 7f46e3fff640 1 -- 172.21.15.133:0/3923582516 learned_addr learned my addr 172.21.15.133:0/3923582516 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:55:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.873+0000 7f46e3fff640 1 -- 172.21.15.133:0/3923582516 >> v1:172.21.15.52:6789/0 conn(0x7f46ec115400 legacy=0x7f46ec1157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.873+0000 7f46e3fff640 1 -- 172.21.15.133:0/3923582516 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec11be30 con 0x7f46ec118190 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.874+0000 7f46e3fff640 1 --2- 172.21.15.133:0/3923582516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec118190 0x7f46ec11a580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46d40097f0 tx=0x7f46d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210cfe1e33cb73df server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.874+0000 7f46e9d9b640 1 -- 172.21.15.133:0/3923582516 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46d40317a0 con 0x7f46ec118190 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.874+0000 7f46e9d9b640 1 -- 172.21.15.133:0/3923582516 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d4031900 con 0x7f46ec118190 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.874+0000 7f46e9d9b640 1 -- 172.21.15.133:0/3923582516 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46d4031bc0 con 0x7f46ec118190 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.875+0000 7f46f0831640 1 -- 172.21.15.133:0/3923582516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec118190 msgr2=0x7f46ec11a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.875+0000 7f46f0831640 1 --2- 172.21.15.133:0/3923582516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec118190 0x7f46ec11a580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46d40097f0 tx=0x7f46d402b910 comp rx=0 tx=0).stop 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.875+0000 7f46f0831640 1 -- 172.21.15.133:0/3923582516 shutdown_connections 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.875+0000 7f46f0831640 1 --2- 172.21.15.133:0/3923582516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec118190 0x7f46ec11a580 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.875+0000 7f46f0831640 1 -- 172.21.15.133:0/3923582516 >> 172.21.15.133:0/3923582516 conn(0x7f46ec070250 msgr2=0x7f46ec072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.875+0000 7f46f0831640 1 -- 172.21.15.133:0/3923582516 shutdown_connections 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.875+0000 7f46f0831640 1 -- 172.21.15.133:0/3923582516 wait complete. 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.875+0000 7f46f0831640 1 Processor -- start 2024-02-15T22:55:40.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.875+0000 7f46f0831640 1 -- start start 2024-02-15T22:55:40.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46f0831640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec115400 0x7f46ec1abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:40.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46f0831640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec1ac380 con 0x7f46ec115400 2024-02-15T22:55:40.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46ea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec115400 0x7f46ec1abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:40.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46ea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec115400 0x7f46ec1abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57140/0 (socket says 172.21.15.133:57140) 2024-02-15T22:55:40.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46ea59c640 1 -- 172.21.15.133:0/153102617 learned_addr learned my addr 172.21.15.133:0/153102617 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:55:40.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46ea59c640 1 -- 172.21.15.133:0/153102617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d40094d0 con 0x7f46ec115400 2024-02-15T22:55:40.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46ea59c640 1 --2- 172.21.15.133:0/153102617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec115400 0x7f46ec1abdb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00c450 tx=0x7f46dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:40.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46e2ffd640 1 -- 172.21.15.133:0/153102617 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46dc007410 con 0x7f46ec115400 2024-02-15T22:55:40.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46e2ffd640 1 -- 172.21.15.133:0/153102617 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc007570 con 0x7f46ec115400 2024-02-15T22:55:40.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46f0831640 1 -- 172.21.15.133:0/153102617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec1ac580 con 0x7f46ec115400 2024-02-15T22:55:40.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46e2ffd640 1 -- 172.21.15.133:0/153102617 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46dc004910 con 0x7f46ec115400 2024-02-15T22:55:40.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.876+0000 7f46f0831640 1 -- 172.21.15.133:0/153102617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec1a5c30 con 0x7f46ec115400 2024-02-15T22:55:40.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.877+0000 7f46e2ffd640 1 -- 172.21.15.133:0/153102617 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f46dc013400 con 0x7f46ec115400 2024-02-15T22:55:40.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.877+0000 7f46e2ffd640 1 -- 172.21.15.133:0/153102617 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f46dc01c7a0 con 0x7f46ec115400 2024-02-15T22:55:40.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.877+0000 7f46f0831640 1 -- 172.21.15.133:0/153102617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec0627b0 con 0x7f46ec115400 2024-02-15T22:55:40.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.880+0000 7f46e2ffd640 1 -- 172.21.15.133:0/153102617 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f46dc013890 con 0x7f46ec115400 2024-02-15T22:55:40.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.952+0000 7f46f0831640 1 -- 172.21.15.133:0/153102617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "257a07e8-165d-4ad0-9cf2-429df58aa049", "id": 0} v 0) v1 -- 0x7f46ec118190 con 0x7f46ec115400 2024-02-15T22:55:40.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.953+0000 7f46e2ffd640 1 -- 172.21.15.133:0/153102617 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "257a07e8-165d-4ad0-9cf2-429df58aa049", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f46dc013a30 con 0x7f46ec115400 2024-02-15T22:55:40.956 INFO:teuthology.orchestra.run.smithi133.stdout:0 2024-02-15T22:55:40.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.954+0000 7f46f0831640 1 -- 172.21.15.133:0/153102617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec115400 msgr2=0x7f46ec1abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:40.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.954+0000 7f46f0831640 1 --2- 172.21.15.133:0/153102617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec115400 0x7f46ec1abdb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00c450 tx=0x7f46dc00c910 comp rx=0 tx=0).stop 2024-02-15T22:55:40.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.954+0000 7f46f0831640 1 -- 172.21.15.133:0/153102617 shutdown_connections 2024-02-15T22:55:40.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.954+0000 7f46f0831640 1 --2- 172.21.15.133:0/153102617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec115400 0x7f46ec1abdb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:40.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.954+0000 7f46f0831640 1 -- 172.21.15.133:0/153102617 >> 172.21.15.133:0/153102617 conn(0x7f46ec070250 msgr2=0x7f46ec06de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:40.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.954+0000 7f46f0831640 1 -- 172.21.15.133:0/153102617 shutdown_connections 2024-02-15T22:55:40.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:40.954+0000 7f46f0831640 1 -- 172.21.15.133:0/153102617 wait complete. 2024-02-15T22:55:40.967 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 5c3aacaf-92b7-4999-acbc-0104cff9c2bf 1 2024-02-15T22:55:41.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.064+0000 7fefdb663640 1 Processor -- start 2024-02-15T22:55:41.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.065+0000 7fefdb663640 1 -- start start 2024-02-15T22:55:41.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.065+0000 7fefdb663640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fefd41165c0 0x7fefd41169a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:41.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.065+0000 7fefdb663640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd4116f70 con 0x7fefd4115120 2024-02-15T22:55:41.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.065+0000 7fefdb663640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd4115cb0 con 0x7fefd41165c0 2024-02-15T22:55:41.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.065+0000 7fefd93ff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fefd41165c0 0x7fefd41169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:41.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.065+0000 7fefd93ff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fefd41165c0 0x7fefd41169a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57154/0 (socket says 172.21.15.133:57154) 2024-02-15T22:55:41.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.065+0000 7fefd93ff640 1 -- 172.21.15.133:0/162700754 learned_addr learned my addr 172.21.15.133:0/162700754 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:55:41.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.065+0000 7fefd8bfe640 1 --1- 172.21.15.133:0/162700754 >> v1:172.21.15.52:6789/0 conn(0x7fefd4115120 0x7fefd41155a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:50076/0 (socket says 172.21.15.133:50076) 2024-02-15T22:55:41.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.066+0000 7fefd93ff640 1 -- 172.21.15.133:0/162700754 >> v1:172.21.15.52:6789/0 conn(0x7fefd4115120 legacy=0x7fefd41155a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.066+0000 7fefd93ff640 1 -- 172.21.15.133:0/162700754 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4115e20 con 0x7fefd41165c0 2024-02-15T22:55:41.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.066+0000 7fefd93ff640 1 --2- 172.21.15.133:0/162700754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefd41165c0 0x7fefd41169a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fefc40097f0 tx=0x7fefc402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53676da509027cd8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:41.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.067+0000 7fefcbfff640 1 -- 172.21.15.133:0/162700754 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefc40317a0 con 0x7fefd41165c0 2024-02-15T22:55:41.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.067+0000 7fefcbfff640 1 -- 172.21.15.133:0/162700754 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4031900 con 0x7fefd41165c0 2024-02-15T22:55:41.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.067+0000 7fefcbfff640 1 -- 172.21.15.133:0/162700754 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefc4031bc0 con 0x7fefd41165c0 2024-02-15T22:55:41.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.067+0000 7fefdb663640 1 -- 172.21.15.133:0/162700754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefd41165c0 msgr2=0x7fefd41169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.067+0000 7fefdb663640 1 --2- 172.21.15.133:0/162700754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefd41165c0 0x7fefd41169a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fefc40097f0 tx=0x7fefc402b910 comp rx=0 tx=0).stop 2024-02-15T22:55:41.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.067+0000 7fefdb663640 1 -- 172.21.15.133:0/162700754 shutdown_connections 2024-02-15T22:55:41.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.067+0000 7fefdb663640 1 --2- 172.21.15.133:0/162700754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefd41165c0 0x7fefd41169a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.067+0000 7fefdb663640 1 -- 172.21.15.133:0/162700754 >> 172.21.15.133:0/162700754 conn(0x7fefd406db50 msgr2=0x7fefd406df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.067+0000 7fefdb663640 1 -- 172.21.15.133:0/162700754 shutdown_connections 2024-02-15T22:55:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.067+0000 7fefdb663640 1 -- 172.21.15.133:0/162700754 wait complete. 2024-02-15T22:55:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.068+0000 7fefdb663640 1 Processor -- start 2024-02-15T22:55:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.068+0000 7fefdb663640 1 -- start start 2024-02-15T22:55:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.068+0000 7fefdb663640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefd4115120 0x7fefd41abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.068+0000 7fefdb663640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd41ac330 con 0x7fefd4115120 2024-02-15T22:55:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.068+0000 7fefd93ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefd4115120 0x7fefd41abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.068+0000 7fefd93ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefd4115120 0x7fefd41abd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57160/0 (socket says 172.21.15.133:57160) 2024-02-15T22:55:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.069+0000 7fefd93ff640 1 -- 172.21.15.133:0/4062909189 learned_addr learned my addr 172.21.15.133:0/4062909189 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:55:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.069+0000 7fefd93ff640 1 -- 172.21.15.133:0/4062909189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc40094d0 con 0x7fefd4115120 2024-02-15T22:55:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.069+0000 7fefd93ff640 1 --2- 172.21.15.133:0/4062909189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefd4115120 0x7fefd41abd60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fefc40090b0 tx=0x7fefc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.069+0000 7fefc9ffb640 1 -- 172.21.15.133:0/4062909189 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefc4031ba0 con 0x7fefd4115120 2024-02-15T22:55:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.069+0000 7fefc9ffb640 1 -- 172.21.15.133:0/4062909189 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc40443f0 con 0x7fefd4115120 2024-02-15T22:55:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.069+0000 7fefdb663640 1 -- 172.21.15.133:0/4062909189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd41ac4d0 con 0x7fefd4115120 2024-02-15T22:55:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.069+0000 7fefc9ffb640 1 -- 172.21.15.133:0/4062909189 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefc4044690 con 0x7fefd4115120 2024-02-15T22:55:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.069+0000 7fefdb663640 1 -- 172.21.15.133:0/4062909189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd41a5be0 con 0x7fefd4115120 2024-02-15T22:55:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.070+0000 7fefc9ffb640 1 -- 172.21.15.133:0/4062909189 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fefc4044c50 con 0x7fefd4115120 2024-02-15T22:55:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.070+0000 7fefc9ffb640 1 -- 172.21.15.133:0/4062909189 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fefc402d040 con 0x7fefd4115120 2024-02-15T22:55:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.070+0000 7fefdb663640 1 -- 172.21.15.133:0/4062909189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd40627b0 con 0x7fefd4115120 2024-02-15T22:55:41.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.072+0000 7fefc9ffb640 1 -- 172.21.15.133:0/4062909189 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fefc4035020 con 0x7fefd4115120 2024-02-15T22:55:41.106 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:41.104+0000 7fbf3f42c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-15T22:55:41.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.144+0000 7fefdb663640 1 -- 172.21.15.133:0/4062909189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5c3aacaf-92b7-4999-acbc-0104cff9c2bf", "id": 1} v 0) v1 -- 0x7fefd41165c0 con 0x7fefd4115120 2024-02-15T22:55:41.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.145+0000 7fefc9ffb640 1 -- 172.21.15.133:0/4062909189 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5c3aacaf-92b7-4999-acbc-0104cff9c2bf", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fefc404db30 con 0x7fefd4115120 2024-02-15T22:55:41.151 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-02-15T22:55:41.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.146+0000 7fefdb663640 1 -- 172.21.15.133:0/4062909189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefd4115120 msgr2=0x7fefd41abd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.146+0000 7fefdb663640 1 --2- 172.21.15.133:0/4062909189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefd4115120 0x7fefd41abd60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fefc40090b0 tx=0x7fefc40046c0 comp rx=0 tx=0).stop 2024-02-15T22:55:41.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.146+0000 7fefdb663640 1 -- 172.21.15.133:0/4062909189 shutdown_connections 2024-02-15T22:55:41.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.146+0000 7fefdb663640 1 --2- 172.21.15.133:0/4062909189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefd4115120 0x7fefd41abd60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:41.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.146+0000 7fefdb663640 1 -- 172.21.15.133:0/4062909189 >> 172.21.15.133:0/4062909189 conn(0x7fefd406db50 msgr2=0x7fefd41135b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:41.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.146+0000 7fefdb663640 1 -- 172.21.15.133:0/4062909189 shutdown_connections 2024-02-15T22:55:41.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.146+0000 7fefdb663640 1 -- 172.21.15.133:0/4062909189 wait complete. 2024-02-15T22:55:41.159 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 49103408-6b04-4a33-a6ed-5fa50f5ba06d 2 2024-02-15T22:55:41.162 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:41.159+0000 7fbf3f42c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-15T22:55:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.255+0000 7f72ede81640 1 Processor -- start 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.255+0000 7f72ede81640 1 -- start start 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.256+0000 7f72ede81640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72e806c8e0 0x7f72e806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.256+0000 7f72ede81640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e811ccf0 con 0x7f72e806d200 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.256+0000 7f72ede81640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e811deb0 con 0x7f72e806c8e0 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.256+0000 7f72e77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72e806c8e0 0x7f72e806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.256+0000 7f72e6ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f72e806d200 0x7f72e811b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:50088/0 (socket says 172.21.15.133:50088) 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.256+0000 7f72e6ffd640 1 -- 172.21.15.133:0/3377173746 learned_addr learned my addr 172.21.15.133:0/3377173746 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.256+0000 7f72e77fe640 1 -- 172.21.15.133:0/3377173746 >> v1:172.21.15.52:6789/0 conn(0x7f72e806d200 legacy=0x7f72e811b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.256+0000 7f72e77fe640 1 -- 172.21.15.133:0/3377173746 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e811e020 con 0x7f72e806c8e0 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.257+0000 7f72e77fe640 1 --2- 172.21.15.133:0/3377173746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72e806c8e0 0x7f72e806ccc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009d90 tx=0x7f72d802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15a4a56f826c542 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.257+0000 7f72e67fc640 1 -- 172.21.15.133:0/3377173746 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72d802cb10 con 0x7f72e806c8e0 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.257+0000 7f72e67fc640 1 -- 172.21.15.133:0/3377173746 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d802cc70 con 0x7f72e806c8e0 2024-02-15T22:55:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.257+0000 7f72e67fc640 1 -- 172.21.15.133:0/3377173746 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72d8034440 con 0x7f72e806c8e0 2024-02-15T22:55:41.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.258+0000 7f72ede81640 1 -- 172.21.15.133:0/3377173746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72e806c8e0 msgr2=0x7f72e806ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.258+0000 7f72ede81640 1 --2- 172.21.15.133:0/3377173746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72e806c8e0 0x7f72e806ccc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009d90 tx=0x7f72d802beb0 comp rx=0 tx=0).stop 2024-02-15T22:55:41.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.258+0000 7f72ede81640 1 -- 172.21.15.133:0/3377173746 shutdown_connections 2024-02-15T22:55:41.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.258+0000 7f72ede81640 1 --2- 172.21.15.133:0/3377173746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72e806c8e0 0x7f72e806ccc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:41.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.258+0000 7f72ede81640 1 -- 172.21.15.133:0/3377173746 >> 172.21.15.133:0/3377173746 conn(0x7f72e8070250 msgr2=0x7f72e8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:41.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.258+0000 7f72ede81640 1 -- 172.21.15.133:0/3377173746 shutdown_connections 2024-02-15T22:55:41.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.258+0000 7f72ede81640 1 -- 172.21.15.133:0/3377173746 wait complete. 2024-02-15T22:55:41.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.259+0000 7f72ede81640 1 Processor -- start 2024-02-15T22:55:41.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.259+0000 7f72ede81640 1 -- start start 2024-02-15T22:55:41.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.259+0000 7f72ede81640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72e806c8e0 0x7f72e81abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:41.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.259+0000 7f72ede81640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e81ac3c0 con 0x7f72e806c8e0 2024-02-15T22:55:41.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.260+0000 7f72e77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72e806c8e0 0x7f72e81abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:41.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.260+0000 7f72e77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72e806c8e0 0x7f72e81abdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57190/0 (socket says 172.21.15.133:57190) 2024-02-15T22:55:41.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.260+0000 7f72e77fe640 1 -- 172.21.15.133:0/2026637585 learned_addr learned my addr 172.21.15.133:0/2026637585 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:55:41.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.260+0000 7f72e77fe640 1 -- 172.21.15.133:0/2026637585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8009a70 con 0x7f72e806c8e0 2024-02-15T22:55:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.260+0000 7f72e77fe640 1 --2- 172.21.15.133:0/2026637585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72e806c8e0 0x7f72e81abdf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009d90 tx=0x7f72d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.260+0000 7f72dffff640 1 -- 172.21.15.133:0/2026637585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72d803e540 con 0x7f72e806c8e0 2024-02-15T22:55:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.260+0000 7f72dffff640 1 -- 172.21.15.133:0/2026637585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d803e6a0 con 0x7f72e806c8e0 2024-02-15T22:55:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.260+0000 7f72dffff640 1 -- 172.21.15.133:0/2026637585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72d803e960 con 0x7f72e806c8e0 2024-02-15T22:55:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.260+0000 7f72ede81640 1 -- 172.21.15.133:0/2026637585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e81ac560 con 0x7f72e806c8e0 2024-02-15T22:55:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.261+0000 7f72ede81640 1 -- 172.21.15.133:0/2026637585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e81a5c70 con 0x7f72e806c8e0 2024-02-15T22:55:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.261+0000 7f72dffff640 1 -- 172.21.15.133:0/2026637585 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f72d803b050 con 0x7f72e806c8e0 2024-02-15T22:55:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.261+0000 7f72dffff640 1 -- 172.21.15.133:0/2026637585 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f72d8049450 con 0x7f72e806c8e0 2024-02-15T22:55:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.261+0000 7f72ede81640 1 -- 172.21.15.133:0/2026637585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e80627b0 con 0x7f72e806c8e0 2024-02-15T22:55:41.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.264+0000 7f72dffff640 1 -- 172.21.15.133:0/2026637585 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f72d804e060 con 0x7f72e806c8e0 2024-02-15T22:55:41.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.336+0000 7f72ede81640 1 -- 172.21.15.133:0/2026637585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49103408-6b04-4a33-a6ed-5fa50f5ba06d", "id": 2} v 0) v1 -- 0x7f72e806d200 con 0x7f72e806c8e0 2024-02-15T22:55:41.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.338+0000 7f72dffff640 1 -- 172.21.15.133:0/2026637585 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49103408-6b04-4a33-a6ed-5fa50f5ba06d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72d8044070 con 0x7f72e806c8e0 2024-02-15T22:55:41.340 INFO:teuthology.orchestra.run.smithi133.stdout:2 2024-02-15T22:55:41.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.339+0000 7f72ede81640 1 -- 172.21.15.133:0/2026637585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72e806c8e0 msgr2=0x7f72e81abdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.339+0000 7f72ede81640 1 --2- 172.21.15.133:0/2026637585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72e806c8e0 0x7f72e81abdf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009d90 tx=0x7f72d8004a40 comp rx=0 tx=0).stop 2024-02-15T22:55:41.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.339+0000 7f72ede81640 1 -- 172.21.15.133:0/2026637585 shutdown_connections 2024-02-15T22:55:41.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.339+0000 7f72ede81640 1 --2- 172.21.15.133:0/2026637585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72e806c8e0 0x7f72e81abdf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:41.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.339+0000 7f72ede81640 1 -- 172.21.15.133:0/2026637585 >> 172.21.15.133:0/2026637585 conn(0x7f72e8070250 msgr2=0x7f72e8117550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:41.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.339+0000 7f72ede81640 1 -- 172.21.15.133:0/2026637585 shutdown_connections 2024-02-15T22:55:41.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.339+0000 7f72ede81640 1 -- 172.21.15.133:0/2026637585 wait complete. 2024-02-15T22:55:41.351 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 280168c8-d5b8-4549-bbf7-a196e7d0dd9d 3 2024-02-15T22:55:41.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.448+0000 7f6be11a8640 1 Processor -- start 2024-02-15T22:55:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.448+0000 7f6be11a8640 1 -- start start 2024-02-15T22:55:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.448+0000 7f6be11a8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6bdc11a600 0x7f6bdc11c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.448+0000 7f6be11a8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc06c2c0 con 0x7f6bdc06b740 2024-02-15T22:55:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.448+0000 7f6be11a8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc11df40 con 0x7f6bdc11a600 2024-02-15T22:55:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.449+0000 7f6bda59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6bdc11a600 0x7f6bdc11c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.449+0000 7f6bdad9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6bdc06b740 0x7f6bdc06bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:50104/0 (socket says 172.21.15.133:50104) 2024-02-15T22:55:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.449+0000 7f6bda59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6bdc11a600 0x7f6bdc11c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57204/0 (socket says 172.21.15.133:57204) 2024-02-15T22:55:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.449+0000 7f6bdad9d640 1 -- 172.21.15.133:0/2429475130 learned_addr learned my addr 172.21.15.133:0/2429475130 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:55:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.449+0000 7f6bda59c640 1 -- 172.21.15.133:0/2429475130 >> v1:172.21.15.52:6789/0 conn(0x7f6bdc06b740 legacy=0x7f6bdc06bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.449+0000 7f6bda59c640 1 -- 172.21.15.133:0/2429475130 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc11e080 con 0x7f6bdc11a600 2024-02-15T22:55:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.450+0000 7f6bda59c640 1 --2- 172.21.15.133:0/2429475130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bdc11a600 0x7f6bdc11c9f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009720 tx=0x7f6bcc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f4c8179d272892 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:41.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.450+0000 7f6bd9d9b640 1 -- 172.21.15.133:0/2429475130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bcc02e070 con 0x7f6bdc11a600 2024-02-15T22:55:41.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.450+0000 7f6bd9d9b640 1 -- 172.21.15.133:0/2429475130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc0316d0 con 0x7f6bdc11a600 2024-02-15T22:55:41.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.450+0000 7f6bd9d9b640 1 -- 172.21.15.133:0/2429475130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bcc031990 con 0x7f6bdc11a600 2024-02-15T22:55:41.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.450+0000 7f6be11a8640 1 -- 172.21.15.133:0/2429475130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bdc11a600 msgr2=0x7f6bdc11c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.450+0000 7f6be11a8640 1 --2- 172.21.15.133:0/2429475130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bdc11a600 0x7f6bdc11c9f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009720 tx=0x7f6bcc02b840 comp rx=0 tx=0).stop 2024-02-15T22:55:41.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.450+0000 7f6be11a8640 1 -- 172.21.15.133:0/2429475130 shutdown_connections 2024-02-15T22:55:41.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.450+0000 7f6be11a8640 1 --2- 172.21.15.133:0/2429475130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bdc11a600 0x7f6bdc11c9f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:41.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.450+0000 7f6be11a8640 1 -- 172.21.15.133:0/2429475130 >> 172.21.15.133:0/2429475130 conn(0x7f6bdc06f450 msgr2=0x7f6bdc071870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:41.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.450+0000 7f6be11a8640 1 -- 172.21.15.133:0/2429475130 shutdown_connections 2024-02-15T22:55:41.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.450+0000 7f6be11a8640 1 -- 172.21.15.133:0/2429475130 wait complete. 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.451+0000 7f6be11a8640 1 Processor -- start 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.451+0000 7f6be11a8640 1 -- start start 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.452+0000 7f6be11a8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bdc06b740 0x7f6bdc1abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.452+0000 7f6be11a8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc1ac2e0 con 0x7f6bdc06b740 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.452+0000 7f6bdad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bdc06b740 0x7f6bdc1abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.452+0000 7f6bdad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bdc06b740 0x7f6bdc1abd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57218/0 (socket says 172.21.15.133:57218) 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.452+0000 7f6bdad9d640 1 -- 172.21.15.133:0/73852832 learned_addr learned my addr 172.21.15.133:0/73852832 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.452+0000 7f6bdad9d640 1 -- 172.21.15.133:0/73852832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc009400 con 0x7f6bdc06b740 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.452+0000 7f6bdad9d640 1 --2- 172.21.15.133:0/73852832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bdc06b740 0x7f6bdc1abd10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000c4a0 tx=0x7f6bd000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.453+0000 7f6bc37fe640 1 -- 172.21.15.133:0/73852832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bd0005c10 con 0x7f6bdc06b740 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.453+0000 7f6bc37fe640 1 -- 172.21.15.133:0/73852832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd0005d70 con 0x7f6bdc06b740 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.453+0000 7f6bc37fe640 1 -- 172.21.15.133:0/73852832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bd00071a0 con 0x7f6bdc06b740 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.453+0000 7f6be11a8640 1 -- 172.21.15.133:0/73852832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc1ac4e0 con 0x7f6bdc06b740 2024-02-15T22:55:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.453+0000 7f6be11a8640 1 -- 172.21.15.133:0/73852832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc1a5c10 con 0x7f6bdc06b740 2024-02-15T22:55:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.453+0000 7f6bc37fe640 1 -- 172.21.15.133:0/73852832 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6bd0007300 con 0x7f6bdc06b740 2024-02-15T22:55:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.453+0000 7f6bc37fe640 1 -- 172.21.15.133:0/73852832 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6bd00075b0 con 0x7f6bdc06b740 2024-02-15T22:55:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.454+0000 7f6be11a8640 1 -- 172.21.15.133:0/73852832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc0627b0 con 0x7f6bdc06b740 2024-02-15T22:55:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.456+0000 7f6bc37fe640 1 -- 172.21.15.133:0/73852832 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6bd0021060 con 0x7f6bdc06b740 2024-02-15T22:55:41.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.527+0000 7f6be11a8640 1 -- 172.21.15.133:0/73852832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "280168c8-d5b8-4549-bbf7-a196e7d0dd9d", "id": 3} v 0) v1 -- 0x7f6bdc11a600 con 0x7f6bdc06b740 2024-02-15T22:55:41.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.529+0000 7f6bc37fe640 1 -- 172.21.15.133:0/73852832 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "280168c8-d5b8-4549-bbf7-a196e7d0dd9d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6bd0017070 con 0x7f6bdc06b740 2024-02-15T22:55:41.531 INFO:teuthology.orchestra.run.smithi133.stdout:3 2024-02-15T22:55:41.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.530+0000 7f6be11a8640 1 -- 172.21.15.133:0/73852832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bdc06b740 msgr2=0x7f6bdc1abd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.530+0000 7f6be11a8640 1 --2- 172.21.15.133:0/73852832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bdc06b740 0x7f6bdc1abd10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000c4a0 tx=0x7f6bd000c960 comp rx=0 tx=0).stop 2024-02-15T22:55:41.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.530+0000 7f6be11a8640 1 -- 172.21.15.133:0/73852832 shutdown_connections 2024-02-15T22:55:41.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.530+0000 7f6be11a8640 1 --2- 172.21.15.133:0/73852832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bdc06b740 0x7f6bdc1abd10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:41.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.530+0000 7f6be11a8640 1 -- 172.21.15.133:0/73852832 >> 172.21.15.133:0/73852832 conn(0x7f6bdc06f450 msgr2=0x7f6bdc06f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:41.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.530+0000 7f6be11a8640 1 -- 172.21.15.133:0/73852832 shutdown_connections 2024-02-15T22:55:41.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:55:41.530+0000 7f6be11a8640 1 -- 172.21.15.133:0/73852832 wait complete. 2024-02-15T22:55:41.544 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-15T22:55:41.544 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-15T22:55:41.547 INFO:tasks.ceph.osd.0:Started 2024-02-15T22:55:41.547 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-15T22:55:41.547 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-15T22:55:41.549 INFO:tasks.ceph.osd.1:Started 2024-02-15T22:55:41.549 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-15T22:55:41.549 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-15T22:55:41.552 INFO:tasks.ceph.osd.2:Started 2024-02-15T22:55:41.552 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-15T22:55:41.552 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-15T22:55:41.554 INFO:tasks.ceph.osd.3:Started 2024-02-15T22:55:41.554 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T22:55:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.664+0000 7f032320f640 1 Processor -- start 2024-02-15T22:55:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.665+0000 7f032320f640 1 -- start start 2024-02-15T22:55:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.665+0000 7f032320f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f031c0993f0 0x7f031c133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.665+0000 7f032320f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031c09dc90 con 0x7f031c098900 2024-02-15T22:55:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.665+0000 7f032320f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031c09a170 con 0x7f031c0993f0 2024-02-15T22:55:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.665+0000 7f031bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f031c0993f0 0x7f031c133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.665+0000 7f0320fab640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f031c098900 0x7f031c098ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59504/0 (socket says 172.21.15.52:59504) 2024-02-15T22:55:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.665+0000 7f0320fab640 1 -- 172.21.15.52:0/934379681 learned_addr learned my addr 172.21.15.52:0/934379681 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.665+0000 7f031bfff640 1 -- 172.21.15.52:0/934379681 >> v1:172.21.15.52:6789/0 conn(0x7f031c098900 legacy=0x7f031c098ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.665+0000 7f031b7fe640 1 -- 172.21.15.52:0/934379681 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606052624 0 0) 0x7f031c09dc90 con 0x7f031c098900 2024-02-15T22:55:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.665+0000 7f031bfff640 1 -- 172.21.15.52:0/934379681 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c099d30 con 0x7f031c0993f0 2024-02-15T22:55:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.666+0000 7f031bfff640 1 --2- 172.21.15.52:0/934379681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c0993f0 0x7f031c133350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0310009720 tx=0x7f031002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78f9aebebcc4549 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.666+0000 7f031b7fe640 1 -- 172.21.15.52:0/934379681 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f031002e070 con 0x7f031c0993f0 2024-02-15T22:55:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.666+0000 7f031b7fe640 1 -- 172.21.15.52:0/934379681 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03100316d0 con 0x7f031c0993f0 2024-02-15T22:55:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.666+0000 7f031b7fe640 1 -- 172.21.15.52:0/934379681 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0310031990 con 0x7f031c0993f0 2024-02-15T22:55:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.667+0000 7f032320f640 1 -- 172.21.15.52:0/934379681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c0993f0 msgr2=0x7f031c133350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.667+0000 7f032320f640 1 --2- 172.21.15.52:0/934379681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c0993f0 0x7f031c133350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0310009720 tx=0x7f031002b840 comp rx=0 tx=0).stop 2024-02-15T22:55:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.667+0000 7f032320f640 1 -- 172.21.15.52:0/934379681 shutdown_connections 2024-02-15T22:55:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.667+0000 7f032320f640 1 --2- 172.21.15.52:0/934379681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c0993f0 0x7f031c133350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.667+0000 7f032320f640 1 -- 172.21.15.52:0/934379681 >> 172.21.15.52:0/934379681 conn(0x7f031c0a0a20 msgr2=0x7f031c09cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.667+0000 7f032320f640 1 -- 172.21.15.52:0/934379681 shutdown_connections 2024-02-15T22:55:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.667+0000 7f032320f640 1 -- 172.21.15.52:0/934379681 wait complete. 2024-02-15T22:55:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.668+0000 7f032320f640 1 Processor -- start 2024-02-15T22:55:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.668+0000 7f032320f640 1 -- start start 2024-02-15T22:55:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.668+0000 7f032320f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c098900 0x7f031c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.668+0000 7f032320f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c12c2a0 con 0x7f031c098900 2024-02-15T22:55:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.668+0000 7f0320fab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c098900 0x7f031c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.668+0000 7f0320fab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c098900 0x7f031c06fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58162/0 (socket says 172.21.15.52:58162) 2024-02-15T22:55:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.668+0000 7f0320fab640 1 -- 172.21.15.52:0/769752945 learned_addr learned my addr 172.21.15.52:0/769752945 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.669+0000 7f0320fab640 1 -- 172.21.15.52:0/769752945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0310009400 con 0x7f031c098900 2024-02-15T22:55:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.669+0000 7f0320fab640 1 --2- 172.21.15.52:0/769752945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c098900 0x7f031c06fca0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f031400c840 tx=0x7f031400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.669+0000 7f03197fa640 1 -- 172.21.15.52:0/769752945 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0314004ea0 con 0x7f031c098900 2024-02-15T22:55:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.669+0000 7f03197fa640 1 -- 172.21.15.52:0/769752945 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031400a660 con 0x7f031c098900 2024-02-15T22:55:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.669+0000 7f03197fa640 1 -- 172.21.15.52:0/769752945 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f031400a920 con 0x7f031c098900 2024-02-15T22:55:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.669+0000 7f032320f640 1 -- 172.21.15.52:0/769752945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031c12c860 con 0x7f031c098900 2024-02-15T22:55:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.669+0000 7f032320f640 1 -- 172.21.15.52:0/769752945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031c071c90 con 0x7f031c098900 2024-02-15T22:55:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.669+0000 7f03197fa640 1 -- 172.21.15.52:0/769752945 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f031400aa80 con 0x7f031c098900 2024-02-15T22:55:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.669+0000 7f03197fa640 1 -- 172.21.15.52:0/769752945 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f031401c8c0 con 0x7f031c098900 2024-02-15T22:55:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.670+0000 7f032320f640 1 -- 172.21.15.52:0/769752945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031c0627b0 con 0x7f031c098900 2024-02-15T22:55:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.672+0000 7f03197fa640 1 -- 172.21.15.52:0/769752945 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0314018070 con 0x7f031c098900 2024-02-15T22:55:41.731 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:41.728+0000 7fbf3f42c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-15T22:55:41.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.734+0000 7f032320f640 1 -- 172.21.15.52:0/769752945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f031c073050 con 0x7f031c098900 2024-02-15T22:55:41.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.735+0000 7f03197fa640 1 -- 172.21.15.52:0/769752945 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f031401cb50 con 0x7f031c098900 2024-02-15T22:55:41.737 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:41.737 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"fsid":"81db0e6a-c08b-432e-840e-21ec1a74d746","created":"2024-02-15T22:55:40.454080+0000","modified":"2024-02-15T22:55:41.529472+0000","last_up_change":"0.000000","last_in_change":"2024-02-15T22:55:41.529472+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"257a07e8-165d-4ad0-9cf2-429df58aa049","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5c3aacaf-92b7-4999-acbc-0104cff9c2bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"49103408-6b04-4a33-a6ed-5fa50f5ba06d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"280168c8-d5b8-4549-bbf7-a196e7d0dd9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:55:41.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.735+0000 7f032320f640 1 -- 172.21.15.52:0/769752945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c098900 msgr2=0x7f031c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:41.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.735+0000 7f032320f640 1 --2- 172.21.15.52:0/769752945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c098900 0x7f031c06fca0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f031400c840 tx=0x7f031400cd00 comp rx=0 tx=0).stop 2024-02-15T22:55:41.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.735+0000 7f032320f640 1 -- 172.21.15.52:0/769752945 shutdown_connections 2024-02-15T22:55:41.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.735+0000 7f032320f640 1 --2- 172.21.15.52:0/769752945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c098900 0x7f031c06fca0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:41.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.735+0000 7f032320f640 1 -- 172.21.15.52:0/769752945 >> 172.21.15.52:0/769752945 conn(0x7f031c0a0a20 msgr2=0x7f031c09b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:41.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.735+0000 7f032320f640 1 -- 172.21.15.52:0/769752945 shutdown_connections 2024-02-15T22:55:41.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:41.735+0000 7f032320f640 1 -- 172.21.15.52:0/769752945 wait complete. 2024-02-15T22:55:41.748 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-15T22:55:41.748 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-15T22:55:41.784 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:41.782+0000 7fbf3f42c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-15T22:55:41.829 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:41.826+0000 7fbf3f42c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-15T22:55:41.882 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:41.880+0000 7fbf3f42c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-15T22:55:41.926 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:41.923+0000 7fbf3f42c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-15T22:55:42.039 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:42.037+0000 7fbf3f42c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-15T22:55:42.108 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:42.106+0000 7fbf3f42c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-15T22:55:42.142 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-02-15T22:55:42.139+0000 7f8bc16c8640 -1 Falling back to public interface 2024-02-15T22:55:42.145 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-02-15T22:55:42.143+0000 7f0a60489640 -1 Falling back to public interface 2024-02-15T22:55:42.151 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-15T22:55:42.152 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-02-15T22:55:42.150+0000 7fd251e62640 -1 Falling back to public interface 2024-02-15T22:55:42.153 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-02-15T22:55:42.150+0000 7f6fa620d640 -1 Falling back to public interface 2024-02-15T22:55:42.155 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:42.153+0000 7fbf3f42c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-15T22:55:42.209 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:42.207+0000 7fbf3f42c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-15T22:55:42.242 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.239+0000 7f0ad6e14640 1 Processor -- start 2024-02-15T22:55:42.243 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.239+0000 7f0ad6e14640 1 -- start start 2024-02-15T22:55:42.243 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.240+0000 7f0ad6e14640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ad0128490 0x7f0ad0128a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:42.243 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.240+0000 7f0ad6e14640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad01293f0 con 0x7f0ad0128fd0 2024-02-15T22:55:42.243 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.240+0000 7f0ad6e14640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad0096540 con 0x7f0ad0128490 2024-02-15T22:55:42.243 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.240+0000 7f0ad4bb0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ad0128490 0x7f0ad0128a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:42.243 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.240+0000 7f0acffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0ad0128fd0 0x7f0ad012b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59506/0 (socket says 172.21.15.52:59506) 2024-02-15T22:55:42.243 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.240+0000 7f0acffff640 1 -- 172.21.15.52:0/2256935423 learned_addr learned my addr 172.21.15.52:0/2256935423 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:42.243 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.240+0000 7f0ad4bb0640 1 -- 172.21.15.52:0/2256935423 >> v1:172.21.15.52:6789/0 conn(0x7f0ad0128fd0 legacy=0x7f0ad012b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:42.243 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.240+0000 7f0ad4bb0640 1 -- 172.21.15.52:0/2256935423 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00960e0 con 0x7f0ad0128490 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.241+0000 7f0ad4bb0640 1 --2- 172.21.15.52:0/2256935423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad0128490 0x7f0ad0128a90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009720 tx=0x7f0ac402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d15bea52915c7e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.241+0000 7f0acf7fe640 1 -- 172.21.15.52:0/2256935423 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac402e070 con 0x7f0ad0128490 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.241+0000 7f0acf7fe640 1 -- 172.21.15.52:0/2256935423 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac40316d0 con 0x7f0ad0128490 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.241+0000 7f0acf7fe640 1 -- 172.21.15.52:0/2256935423 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac4031990 con 0x7f0ad0128490 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.241+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2256935423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad0128490 msgr2=0x7f0ad0128a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.241+0000 7f0ad6e14640 1 --2- 172.21.15.52:0/2256935423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad0128490 0x7f0ad0128a90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009720 tx=0x7f0ac402b840 comp rx=0 tx=0).stop 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.242+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2256935423 shutdown_connections 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.242+0000 7f0ad6e14640 1 --2- 172.21.15.52:0/2256935423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad0128490 0x7f0ad0128a90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.242+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2256935423 >> 172.21.15.52:0/2256935423 conn(0x7f0ad009a070 msgr2=0x7f0ad009a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.242+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2256935423 shutdown_connections 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.242+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2256935423 wait complete. 2024-02-15T22:55:42.245 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.242+0000 7f0ad6e14640 1 Processor -- start 2024-02-15T22:55:42.246 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.242+0000 7f0ad6e14640 1 -- start start 2024-02-15T22:55:42.247 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.243+0000 7f0ad6e14640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad0128490 0x7f0ad0125650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:42.247 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.243+0000 7f0ad6e14640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad006dcc0 con 0x7f0ad0128490 2024-02-15T22:55:42.247 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.243+0000 7f0ad4bb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad0128490 0x7f0ad0125650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.243+0000 7f0ad4bb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad0128490 0x7f0ad0125650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58178/0 (socket says 172.21.15.52:58178) 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.243+0000 7f0ad4bb0640 1 -- 172.21.15.52:0/2486013115 learned_addr learned my addr 172.21.15.52:0/2486013115 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.243+0000 7f0ad4bb0640 1 -- 172.21.15.52:0/2486013115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac4009400 con 0x7f0ad0128490 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.243+0000 7f0ad4bb0640 1 --2- 172.21.15.52:0/2486013115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad0128490 0x7f0ad0125650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4034040 tx=0x7f0ac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.243+0000 7f0acd7fa640 1 -- 172.21.15.52:0/2486013115 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac4032830 con 0x7f0ad0128490 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.243+0000 7f0acd7fa640 1 -- 172.21.15.52:0/2486013115 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac4032990 con 0x7f0ad0128490 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.243+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2486013115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad0123f30 con 0x7f0ad0128490 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.244+0000 7f0acd7fa640 1 -- 172.21.15.52:0/2486013115 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac4032c50 con 0x7f0ad0128490 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.244+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2486013115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad01232e0 con 0x7f0ad0128490 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.244+0000 7f0acd7fa640 1 -- 172.21.15.52:0/2486013115 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0ac4005d20 con 0x7f0ad0128490 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.244+0000 7f0acd7fa640 1 -- 172.21.15.52:0/2486013115 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0ac403b900 con 0x7f0ad0128490 2024-02-15T22:55:42.248 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.244+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2486013115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad00627b0 con 0x7f0ad0128490 2024-02-15T22:55:42.249 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.246+0000 7f0acd7fa640 1 -- 172.21.15.52:0/2486013115 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0ac403b3f0 con 0x7f0ad0128490 2024-02-15T22:55:42.256 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:42.253+0000 7fbf3f42c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-15T22:55:42.310 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.308+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2486013115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ad0123590 con 0x7f0ad0128490 2024-02-15T22:55:42.310 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.308+0000 7f0acd7fa640 1 -- 172.21.15.52:0/2486013115 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f0ac403b590 con 0x7f0ad0128490 2024-02-15T22:55:42.311 INFO:teuthology.misc.health.smithi052.stdout: 2024-02-15T22:55:42.311 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":6,"fsid":"81db0e6a-c08b-432e-840e-21ec1a74d746","created":"2024-02-15T22:55:40.454080+0000","modified":"2024-02-15T22:55:41.529472+0000","last_up_change":"0.000000","last_in_change":"2024-02-15T22:55:41.529472+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"257a07e8-165d-4ad0-9cf2-429df58aa049","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5c3aacaf-92b7-4999-acbc-0104cff9c2bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"49103408-6b04-4a33-a6ed-5fa50f5ba06d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"280168c8-d5b8-4549-bbf7-a196e7d0dd9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:55:42.312 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.309+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2486013115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad0128490 msgr2=0x7f0ad0125650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:42.312 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.309+0000 7f0ad6e14640 1 --2- 172.21.15.52:0/2486013115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad0128490 0x7f0ad0125650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4034040 tx=0x7f0ac40046c0 comp rx=0 tx=0).stop 2024-02-15T22:55:42.312 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.309+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2486013115 shutdown_connections 2024-02-15T22:55:42.312 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.309+0000 7f0ad6e14640 1 --2- 172.21.15.52:0/2486013115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad0128490 0x7f0ad0125650 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:42.312 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.309+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2486013115 >> 172.21.15.52:0/2486013115 conn(0x7f0ad009a070 msgr2=0x7f0ad01273a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:42.312 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.309+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2486013115 shutdown_connections 2024-02-15T22:55:42.312 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:42.309+0000 7f0ad6e14640 1 -- 172.21.15.52:0/2486013115 wait complete. 2024-02-15T22:55:42.320 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-02-15T22:55:42.637 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:42.634+0000 7fbf3f42c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-15T22:55:42.773 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:42.771+0000 7fbf3f42c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-15T22:55:42.903 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:42.901+0000 7fbf3f42c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-15T22:55:42.949 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:42.947+0000 7fbf3f42c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-15T22:55:43.063 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:43.060+0000 7fbf3f42c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-15T22:55:43.157 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:43.155+0000 7fbf3f42c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-15T22:55:43.313 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:43.310+0000 7fbf3f42c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-15T22:55:43.355 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:43.353+0000 7fbf3f42c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-15T22:55:43.510 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:43.507+0000 7fbf3f42c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-15T22:55:44.337 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:44.335+0000 7fbf3f42c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-15T22:55:44.616 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:44.614+0000 7fbf3f42c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-15T22:55:44.668 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:44.666+0000 7fbf3f42c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-15T22:55:44.783 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:44.781+0000 7fbf3f42c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-15T22:55:45.573 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-02-15T22:55:45.570+0000 7f6fa620d640 -1 osd.0 0 log_to_monitors true 2024-02-15T22:55:45.649 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-02-15T22:55:45.647+0000 7f8bc16c8640 -1 osd.2 0 log_to_monitors true 2024-02-15T22:55:45.654 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-02-15T22:55:45.652+0000 7f0a60489640 -1 osd.1 0 log_to_monitors true 2024-02-15T22:55:45.656 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-02-15T22:55:45.654+0000 7fd251e62640 -1 osd.3 0 log_to_monitors true 2024-02-15T22:55:45.803 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-02-15T22:55:45.801+0000 7fbedf9dc640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-02-15T22:55:47.566 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-02-15T22:55:47.564+0000 7f6fa2bc4640 -1 osd.0 0 waiting for initial osdmap 2024-02-15T22:55:47.577 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-02-15T22:55:47.575+0000 7f6f999be640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:55:48.642 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-02-15T22:55:48.640+0000 7f0a5bbfc640 -1 osd.1 0 waiting for initial osdmap 2024-02-15T22:55:48.643 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-02-15T22:55:48.641+0000 7f8bbce3b640 -1 osd.2 0 waiting for initial osdmap 2024-02-15T22:55:48.644 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-02-15T22:55:48.642+0000 7fd24ee0d640 -1 osd.3 0 waiting for initial osdmap 2024-02-15T22:55:48.650 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-02-15T22:55:48.648+0000 7f0a5422e640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:55:48.654 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-02-15T22:55:48.652+0000 7f8bb546d640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:55:48.660 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-02-15T22:55:48.658+0000 7fd245c07640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:55:48.725 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-15T22:55:48.827 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.823+0000 7f219de9a640 1 Processor -- start 2024-02-15T22:55:48.827 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.823+0000 7f219de9a640 1 -- start start 2024-02-15T22:55:48.827 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.824+0000 7f219de9a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21980934b0 0x7f2198131330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:48.827 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.824+0000 7f219de9a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2198094d80 con 0x7f21980929c0 2024-02-15T22:55:48.827 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.824+0000 7f219de9a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2198094960 con 0x7f21980934b0 2024-02-15T22:55:48.827 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.824+0000 7f2196ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21980934b0 0x7f2198131330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:48.827 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.824+0000 7f21977fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f21980929c0 0x7f2198092da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59512/0 (socket says 172.21.15.52:59512) 2024-02-15T22:55:48.827 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.824+0000 7f21977fe640 1 -- 172.21.15.52:0/3600994053 learned_addr learned my addr 172.21.15.52:0/3600994053 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:48.827 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.824+0000 7f2196ffd640 1 -- 172.21.15.52:0/3600994053 >> v1:172.21.15.52:6789/0 conn(0x7f21980929c0 legacy=0x7f2198092da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:48.827 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.824+0000 7f2196ffd640 1 -- 172.21.15.52:0/3600994053 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21980938c0 con 0x7f21980934b0 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.825+0000 7f2196ffd640 1 --2- 172.21.15.52:0/3600994053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21980934b0 0x7f2198131330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f218c009720 tx=0x7f218c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d328d89cf0bee16 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.825+0000 7f21967fc640 1 -- 172.21.15.52:0/3600994053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f218c02e070 con 0x7f21980934b0 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.825+0000 7f21967fc640 1 -- 172.21.15.52:0/3600994053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c0316d0 con 0x7f21980934b0 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.825+0000 7f21967fc640 1 -- 172.21.15.52:0/3600994053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f218c031990 con 0x7f21980934b0 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.826+0000 7f219de9a640 1 -- 172.21.15.52:0/3600994053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21980934b0 msgr2=0x7f2198131330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.826+0000 7f219de9a640 1 --2- 172.21.15.52:0/3600994053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21980934b0 0x7f2198131330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f218c009720 tx=0x7f218c02b840 comp rx=0 tx=0).stop 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.826+0000 7f219de9a640 1 -- 172.21.15.52:0/3600994053 shutdown_connections 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.826+0000 7f219de9a640 1 --2- 172.21.15.52:0/3600994053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21980934b0 0x7f2198131330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.826+0000 7f219de9a640 1 -- 172.21.15.52:0/3600994053 >> 172.21.15.52:0/3600994053 conn(0x7f219809c4d0 msgr2=0x7f219809c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.826+0000 7f219de9a640 1 -- 172.21.15.52:0/3600994053 shutdown_connections 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.826+0000 7f219de9a640 1 -- 172.21.15.52:0/3600994053 wait complete. 2024-02-15T22:55:48.829 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.826+0000 7f219de9a640 1 Processor -- start 2024-02-15T22:55:48.831 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.827+0000 7f219de9a640 1 -- start start 2024-02-15T22:55:48.831 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.827+0000 7f219de9a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21980929c0 0x7f219806e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.827+0000 7f219de9a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2198070b50 con 0x7f21980929c0 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.827+0000 7f21977fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21980929c0 0x7f219806e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.827+0000 7f21977fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21980929c0 0x7f219806e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58206/0 (socket says 172.21.15.52:58206) 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.827+0000 7f21977fe640 1 -- 172.21.15.52:0/2803290205 learned_addr learned my addr 172.21.15.52:0/2803290205 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.827+0000 7f21977fe640 1 -- 172.21.15.52:0/2803290205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c009400 con 0x7f21980929c0 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.828+0000 7f21977fe640 1 --2- 172.21.15.52:0/2803290205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21980929c0 0x7f219806e460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f218800c4a0 tx=0x7f218800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.828+0000 7f217ffff640 1 -- 172.21.15.52:0/2803290205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2188005c10 con 0x7f21980929c0 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.828+0000 7f217ffff640 1 -- 172.21.15.52:0/2803290205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188005d70 con 0x7f21980929c0 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.828+0000 7f219de9a640 1 -- 172.21.15.52:0/2803290205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2198098270 con 0x7f21980929c0 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.828+0000 7f217ffff640 1 -- 172.21.15.52:0/2803290205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21880071a0 con 0x7f21980929c0 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.828+0000 7f219de9a640 1 -- 172.21.15.52:0/2803290205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2198071690 con 0x7f21980929c0 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.829+0000 7f217ffff640 1 -- 172.21.15.52:0/2803290205 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7f2188007300 con 0x7f21980929c0 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.829+0000 7f217ffff640 1 --2- 172.21.15.52:0/2803290205 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2184037e60 0x7f218403a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:48.832 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.829+0000 7f217ffff640 1 -- 172.21.15.52:0/2803290205 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1903+0+0 (secure 0 0 0) 0x7f21880495f0 con 0x7f21980929c0 2024-02-15T22:55:48.833 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.829+0000 7f219de9a640 1 -- 172.21.15.52:0/2803290205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2198070310 con 0x7f21980929c0 2024-02-15T22:55:48.833 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.829+0000 7f2196ffd640 1 --2- 172.21.15.52:0/2803290205 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2184037e60 0x7f218403a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:48.833 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.830+0000 7f2196ffd640 1 --2- 172.21.15.52:0/2803290205 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2184037e60 0x7f218403a320 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f218c036000 tx=0x7f218c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:48.836 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:48.834+0000 7f217ffff640 1 -- 172.21.15.52:0/2803290205 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2188017070 con 0x7f21980929c0 2024-02-15T22:55:49.019 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.016+0000 7f219de9a640 1 -- 172.21.15.52:0/2803290205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21980711f0 con 0x7f21980929c0 2024-02-15T22:55:49.019 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.017+0000 7f217ffff640 1 -- 172.21.15.52:0/2803290205 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4637 (secure 0 0 0) 0x7f21880104e0 con 0x7f21980929c0 2024-02-15T22:55:49.019 INFO:teuthology.misc.health.smithi052.stdout: 2024-02-15T22:55:49.019 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":9,"fsid":"81db0e6a-c08b-432e-840e-21ec1a74d746","created":"2024-02-15T22:55:40.454080+0000","modified":"2024-02-15T22:55:48.565838+0000","last_up_change":"2024-02-15T22:55:48.565838+0000","last_in_change":"2024-02-15T22:55:41.529472+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"257a07e8-165d-4ad0-9cf2-429df58aa049","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6801","nonce":431200118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6803","nonce":431200118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6807","nonce":431200118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6805","nonce":431200118}]},"public_addr":"172.21.15.52:6801/431200118","cluster_addr":"172.21.15.52:6803/431200118","heartbeat_back_addr":"172.21.15.52:6807/431200118","heartbeat_front_addr":"172.21.15.52:6805/431200118","state":["exists","up"]},{"osd":1,"uuid":"5c3aacaf-92b7-4999-acbc-0104cff9c2bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"49103408-6b04-4a33-a6ed-5fa50f5ba06d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"280168c8-d5b8-4549-bbf7-a196e7d0dd9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:55:49.022 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.019+0000 7f219de9a640 1 -- 172.21.15.52:0/2803290205 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2184037e60 msgr2=0x7f218403a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:49.022 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.019+0000 7f219de9a640 1 --2- 172.21.15.52:0/2803290205 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2184037e60 0x7f218403a320 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f218c036000 tx=0x7f218c008030 comp rx=0 tx=0).stop 2024-02-15T22:55:49.022 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.019+0000 7f219de9a640 1 -- 172.21.15.52:0/2803290205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21980929c0 msgr2=0x7f219806e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:49.022 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.019+0000 7f219de9a640 1 --2- 172.21.15.52:0/2803290205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21980929c0 0x7f219806e460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f218800c4a0 tx=0x7f218800c960 comp rx=0 tx=0).stop 2024-02-15T22:55:49.022 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.019+0000 7f219de9a640 1 -- 172.21.15.52:0/2803290205 shutdown_connections 2024-02-15T22:55:49.022 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.019+0000 7f219de9a640 1 --2- 172.21.15.52:0/2803290205 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2184037e60 0x7f218403a320 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:49.022 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.019+0000 7f219de9a640 1 --2- 172.21.15.52:0/2803290205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21980929c0 0x7f219806e460 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:49.022 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.019+0000 7f219de9a640 1 -- 172.21.15.52:0/2803290205 >> 172.21.15.52:0/2803290205 conn(0x7f219809c4d0 msgr2=0x7f21981307e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:49.022 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.019+0000 7f219de9a640 1 -- 172.21.15.52:0/2803290205 shutdown_connections 2024-02-15T22:55:49.022 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:49.019+0000 7f219de9a640 1 -- 172.21.15.52:0/2803290205 wait complete. 2024-02-15T22:55:49.031 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-02-15T22:55:55.435 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-15T22:55:55.536 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.534+0000 7fd7f10eb640 1 Processor -- start 2024-02-15T22:55:55.537 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.534+0000 7fd7f10eb640 1 -- start start 2024-02-15T22:55:55.537 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.534+0000 7fd7f10eb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7ec071770 0x7fd7ec06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:55.537 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.534+0000 7fd7f10eb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec09d780 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.537 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.534+0000 7fd7f10eb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec09d5b0 con 0x7fd7ec071770 2024-02-15T22:55:55.537 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.535+0000 7fd7ead9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7ec071770 0x7fd7ec06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:55.537 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.535+0000 7fd7ea59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd7ec06cfb0 0x7fd7ec132a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54472/0 (socket says 172.21.15.52:54472) 2024-02-15T22:55:55.537 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.535+0000 7fd7ea59c640 1 -- 172.21.15.52:0/3301177133 learned_addr learned my addr 172.21.15.52:0/3301177133 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:55.537 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.535+0000 7fd7ead9d640 1 -- 172.21.15.52:0/3301177133 >> v1:172.21.15.52:6789/0 conn(0x7fd7ec06cfb0 legacy=0x7fd7ec132a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:55.537 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.535+0000 7fd7ead9d640 1 -- 172.21.15.52:0/3301177133 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec06dec0 con 0x7fd7ec071770 2024-02-15T22:55:55.538 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.536+0000 7fd7ead9d640 1 --2- 172.21.15.52:0/3301177133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7ec071770 0x7fd7ec06ca70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009d90 tx=0x7fd7dc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7439d891342c3d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:55.538 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.536+0000 7fd7e9d9b640 1 -- 172.21.15.52:0/3301177133 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7dc02cb10 con 0x7fd7ec071770 2024-02-15T22:55:55.538 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.536+0000 7fd7e9d9b640 1 -- 172.21.15.52:0/3301177133 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc02cc70 con 0x7fd7ec071770 2024-02-15T22:55:55.538 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.536+0000 7fd7e9d9b640 1 -- 172.21.15.52:0/3301177133 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7dc034440 con 0x7fd7ec071770 2024-02-15T22:55:55.539 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.536+0000 7fd7f10eb640 1 -- 172.21.15.52:0/3301177133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7ec071770 msgr2=0x7fd7ec06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:55.539 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.536+0000 7fd7f10eb640 1 --2- 172.21.15.52:0/3301177133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7ec071770 0x7fd7ec06ca70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009d90 tx=0x7fd7dc02beb0 comp rx=0 tx=0).stop 2024-02-15T22:55:55.539 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.536+0000 7fd7f10eb640 1 -- 172.21.15.52:0/3301177133 shutdown_connections 2024-02-15T22:55:55.539 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.536+0000 7fd7f10eb640 1 --2- 172.21.15.52:0/3301177133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7ec071770 0x7fd7ec06ca70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:55.539 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.536+0000 7fd7f10eb640 1 -- 172.21.15.52:0/3301177133 >> 172.21.15.52:0/3301177133 conn(0x7fd7ec09c880 msgr2=0x7fd7ec09cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:55.539 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.536+0000 7fd7f10eb640 1 -- 172.21.15.52:0/3301177133 shutdown_connections 2024-02-15T22:55:55.539 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.536+0000 7fd7f10eb640 1 -- 172.21.15.52:0/3301177133 wait complete. 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.538+0000 7fd7f10eb640 1 Processor -- start 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.538+0000 7fd7f10eb640 1 -- start start 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.538+0000 7fd7f10eb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7ec06cfb0 0x7fd7ec1bf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.538+0000 7fd7f10eb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec1a8440 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.538+0000 7fd7ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7ec06cfb0 0x7fd7ec1bf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.538+0000 7fd7ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7ec06cfb0 0x7fd7ec1bf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55912/0 (socket says 172.21.15.52:55912) 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.538+0000 7fd7ead9d640 1 -- 172.21.15.52:0/1628508609 learned_addr learned my addr 172.21.15.52:0/1628508609 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.539+0000 7fd7ead9d640 1 -- 172.21.15.52:0/1628508609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc009a70 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.539+0000 7fd7ead9d640 1 --2- 172.21.15.52:0/1628508609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7ec06cfb0 0x7fd7ec1bf3a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc02bef0 tx=0x7fd7dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.539+0000 7fd7e37fe640 1 -- 172.21.15.52:0/1628508609 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7dc03e540 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.539+0000 7fd7e37fe640 1 -- 172.21.15.52:0/1628508609 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc03e6a0 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.539+0000 7fd7f10eb640 1 -- 172.21.15.52:0/1628508609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec1aa630 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.539+0000 7fd7e37fe640 1 -- 172.21.15.52:0/1628508609 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7dc03e980 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.541 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.539+0000 7fd7f10eb640 1 -- 172.21.15.52:0/1628508609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec1a9860 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.542 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.540+0000 7fd7e37fe640 1 -- 172.21.15.52:0/1628508609 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd7dc03b050 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.542 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.540+0000 7fd7f10eb640 1 -- 172.21.15.52:0/1628508609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ec1c00a0 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.542 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.540+0000 7fd7e37fe640 1 --2- 172.21.15.52:0/1628508609 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7cc037ef0 0x7fd7cc03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:55.542 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.540+0000 7fd7e37fe640 1 -- 172.21.15.52:0/1628508609 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3129+0+0 (secure 0 0 0) 0x7fd7dc06d3c0 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.543 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.540+0000 7fd7ea59c640 1 --2- 172.21.15.52:0/1628508609 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7cc037ef0 0x7fd7cc03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:55.543 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.541+0000 7fd7ea59c640 1 --2- 172.21.15.52:0/1628508609 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7cc037ef0 0x7fd7cc03a3b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4007fd0 tx=0x7fd7d4007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:55.546 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.545+0000 7fd7e37fe640 1 -- 172.21.15.52:0/1628508609 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd7ec1c00a0 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.731 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.730+0000 7fd7f10eb640 1 -- 172.21.15.52:0/1628508609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7ec1c00a0 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.732 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.730+0000 7fd7e37fe640 1 -- 172.21.15.52:0/1628508609 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7978 (secure 0 0 0) 0x7fd7ec1c00a0 con 0x7fd7ec06cfb0 2024-02-15T22:55:55.732 INFO:teuthology.misc.health.smithi052.stdout: 2024-02-15T22:55:55.732 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":14,"fsid":"81db0e6a-c08b-432e-840e-21ec1a74d746","created":"2024-02-15T22:55:40.454080+0000","modified":"2024-02-15T22:55:53.653280+0000","last_up_change":"2024-02-15T22:55:49.646698+0000","last_in_change":"2024-02-15T22:55:41.529472+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:55:50.841585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"257a07e8-165d-4ad0-9cf2-429df58aa049","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6801","nonce":431200118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6803","nonce":431200118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6807","nonce":431200118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6805","nonce":431200118}]},"public_addr":"172.21.15.52:6801/431200118","cluster_addr":"172.21.15.52:6803/431200118","heartbeat_back_addr":"172.21.15.52:6807/431200118","heartbeat_front_addr":"172.21.15.52:6805/431200118","state":["exists","up"]},{"osd":1,"uuid":"5c3aacaf-92b7-4999-acbc-0104cff9c2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6809","nonce":2671624067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6811","nonce":2671624067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6815","nonce":2671624067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6813","nonce":2671624067}]},"public_addr":"172.21.15.133:6809/2671624067","cluster_addr":"172.21.15.133:6811/2671624067","heartbeat_back_addr":"172.21.15.133:6815/2671624067","heartbeat_front_addr":"172.21.15.133:6813/2671624067","state":["exists","up"]},{"osd":2,"uuid":"49103408-6b04-4a33-a6ed-5fa50f5ba06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6801","nonce":2073628168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6803","nonce":2073628168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6807","nonce":2073628168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6805","nonce":2073628168}]},"public_addr":"172.21.15.133:6801/2073628168","cluster_addr":"172.21.15.133:6803/2073628168","heartbeat_back_addr":"172.21.15.133:6807/2073628168","heartbeat_front_addr":"172.21.15.133:6805/2073628168","state":["exists","up"]},{"osd":3,"uuid":"280168c8-d5b8-4549-bbf7-a196e7d0dd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6817","nonce":1065500544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6819","nonce":1065500544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6823","nonce":1065500544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6821","nonce":1065500544}]},"public_addr":"172.21.15.133:6817/1065500544","cluster_addr":"172.21.15.133:6819/1065500544","heartbeat_back_addr":"172.21.15.133:6823/1065500544","heartbeat_front_addr":"172.21.15.133:6821/1065500544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.543998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.701390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.655590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.685597+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:55:55.734 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.732+0000 7fd7f10eb640 1 -- 172.21.15.52:0/1628508609 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7cc037ef0 msgr2=0x7fd7cc03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:55.734 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.732+0000 7fd7f10eb640 1 --2- 172.21.15.52:0/1628508609 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7cc037ef0 0x7fd7cc03a3b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4007fd0 tx=0x7fd7d4007ac0 comp rx=0 tx=0).stop 2024-02-15T22:55:55.734 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.732+0000 7fd7f10eb640 1 -- 172.21.15.52:0/1628508609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7ec06cfb0 msgr2=0x7fd7ec1bf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:55.734 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.732+0000 7fd7f10eb640 1 --2- 172.21.15.52:0/1628508609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7ec06cfb0 0x7fd7ec1bf3a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc02bef0 tx=0x7fd7dc004a40 comp rx=0 tx=0).stop 2024-02-15T22:55:55.734 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.732+0000 7fd7f10eb640 1 -- 172.21.15.52:0/1628508609 shutdown_connections 2024-02-15T22:55:55.734 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.732+0000 7fd7f10eb640 1 --2- 172.21.15.52:0/1628508609 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7cc037ef0 0x7fd7cc03a3b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:55.734 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.732+0000 7fd7f10eb640 1 --2- 172.21.15.52:0/1628508609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7ec06cfb0 0x7fd7ec1bf3a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:55.734 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.732+0000 7fd7f10eb640 1 -- 172.21.15.52:0/1628508609 >> 172.21.15.52:0/1628508609 conn(0x7fd7ec09c880 msgr2=0x7fd7ec0903c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:55.734 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.732+0000 7fd7f10eb640 1 -- 172.21.15.52:0/1628508609 shutdown_connections 2024-02-15T22:55:55.734 INFO:teuthology.misc.health.smithi052.stderr:2024-02-15T22:55:55.732+0000 7fd7f10eb640 1 -- 172.21.15.52:0/1628508609 wait complete. 2024-02-15T22:55:55.743 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-02-15T22:55:55.744 INFO:tasks.ceph:Creating RBD pool 2024-02-15T22:55:55.744 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool create rbd 8 2024-02-15T22:55:55.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.842+0000 7fe15b896640 1 Processor -- start 2024-02-15T22:55:55.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.843+0000 7fe15b896640 1 -- start start 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.843+0000 7fe15b896640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe15412d270 0x7fe15412d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.843+0000 7fe15b896640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe154098b00 con 0x7fe15406d130 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.843+0000 7fe15b896640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15409de50 con 0x7fe15412d270 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.843+0000 7fe159632640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe15412d270 0x7fe15412d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.843+0000 7fe158e31640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe15406d130 0x7fe15406d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54488/0 (socket says 172.21.15.52:54488) 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.843+0000 7fe158e31640 1 -- 172.21.15.52:0/2044886353 learned_addr learned my addr 172.21.15.52:0/2044886353 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.843+0000 7fe159632640 1 -- 172.21.15.52:0/2044886353 >> v1:172.21.15.52:6789/0 conn(0x7fe15406d130 legacy=0x7fe15406d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.843+0000 7fe159632640 1 -- 172.21.15.52:0/2044886353 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15409d8a0 con 0x7fe15412d270 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.844+0000 7fe159632640 1 --2- 172.21.15.52:0/2044886353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe15412d270 0x7fe15412d650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe150009720 tx=0x7fe15002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a040b91b7171045f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.844+0000 7fe14bfff640 1 -- 172.21.15.52:0/2044886353 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe15002e070 con 0x7fe15412d270 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.844+0000 7fe14bfff640 1 -- 172.21.15.52:0/2044886353 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1500316d0 con 0x7fe15412d270 2024-02-15T22:55:55.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.844+0000 7fe14bfff640 1 -- 172.21.15.52:0/2044886353 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe150031990 con 0x7fe15412d270 2024-02-15T22:55:55.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.845+0000 7fe15b896640 1 -- 172.21.15.52:0/2044886353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe15412d270 msgr2=0x7fe15412d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:55.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.845+0000 7fe15b896640 1 --2- 172.21.15.52:0/2044886353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe15412d270 0x7fe15412d650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe150009720 tx=0x7fe15002b840 comp rx=0 tx=0).stop 2024-02-15T22:55:55.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.845+0000 7fe15b896640 1 -- 172.21.15.52:0/2044886353 shutdown_connections 2024-02-15T22:55:55.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.845+0000 7fe15b896640 1 --2- 172.21.15.52:0/2044886353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe15412d270 0x7fe15412d650 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:55.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.845+0000 7fe15b896640 1 -- 172.21.15.52:0/2044886353 >> 172.21.15.52:0/2044886353 conn(0x7fe15409c210 msgr2=0x7fe154071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:55.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.845+0000 7fe15b896640 1 -- 172.21.15.52:0/2044886353 shutdown_connections 2024-02-15T22:55:55.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.845+0000 7fe15b896640 1 -- 172.21.15.52:0/2044886353 wait complete. 2024-02-15T22:55:55.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.846+0000 7fe15b896640 1 Processor -- start 2024-02-15T22:55:55.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.846+0000 7fe15b896640 1 -- start start 2024-02-15T22:55:55.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.846+0000 7fe15b896640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe15406d130 0x7fe15411abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.846+0000 7fe15b896640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15411e450 con 0x7fe15406d130 2024-02-15T22:55:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.846+0000 7fe159632640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe15406d130 0x7fe15411abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.846+0000 7fe159632640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe15406d130 0x7fe15411abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55928/0 (socket says 172.21.15.52:55928) 2024-02-15T22:55:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.846+0000 7fe159632640 1 -- 172.21.15.52:0/165698808 learned_addr learned my addr 172.21.15.52:0/165698808 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.847+0000 7fe159632640 1 -- 172.21.15.52:0/165698808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009400 con 0x7fe15406d130 2024-02-15T22:55:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.847+0000 7fe159632640 1 --2- 172.21.15.52:0/165698808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe15406d130 0x7fe15411abf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe150009840 tx=0x7fe1500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.847+0000 7fe149ffb640 1 -- 172.21.15.52:0/165698808 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1500328b0 con 0x7fe15406d130 2024-02-15T22:55:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.847+0000 7fe149ffb640 1 -- 172.21.15.52:0/165698808 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150032a10 con 0x7fe15406d130 2024-02-15T22:55:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.847+0000 7fe15b896640 1 -- 172.21.15.52:0/165698808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15411d3e0 con 0x7fe15406d130 2024-02-15T22:55:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.847+0000 7fe149ffb640 1 -- 172.21.15.52:0/165698808 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe150032cf0 con 0x7fe15406d130 2024-02-15T22:55:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.847+0000 7fe15b896640 1 -- 172.21.15.52:0/165698808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15411e010 con 0x7fe15406d130 2024-02-15T22:55:55.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.848+0000 7fe149ffb640 1 -- 172.21.15.52:0/165698808 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe15004d3f0 con 0x7fe15406d130 2024-02-15T22:55:55.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.848+0000 7fe149ffb640 1 --2- 172.21.15.52:0/165698808 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe138037ef0 0x7fe13803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:55.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.848+0000 7fe149ffb640 1 -- 172.21.15.52:0/165698808 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3129+0+0 (secure 0 0 0) 0x7fe15006c6b0 con 0x7fe15406d130 2024-02-15T22:55:55.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.848+0000 7fe15b896640 1 -- 172.21.15.52:0/165698808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15411e5a0 con 0x7fe15406d130 2024-02-15T22:55:55.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.848+0000 7fe158e31640 1 --2- 172.21.15.52:0/165698808 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe138037ef0 0x7fe13803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:55.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.849+0000 7fe158e31640 1 --2- 172.21.15.52:0/165698808 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe138037ef0 0x7fe13803a3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe144007fd0 tx=0x7fe144007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:55.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:55.853+0000 7fe149ffb640 1 -- 172.21.15.52:0/165698808 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1500308e0 con 0x7fe15406d130 2024-02-15T22:55:56.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.035+0000 7fe15b896640 1 -- 172.21.15.52:0/165698808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fe15411c770 con 0x7fe15406d130 2024-02-15T22:55:56.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.661+0000 7fe149ffb640 1 -- 172.21.15.52:0/165698808 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7fe1500302f0 con 0x7fe15406d130 2024-02-15T22:55:56.664 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'rbd' created 2024-02-15T22:55:56.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.664+0000 7fe15b896640 1 -- 172.21.15.52:0/165698808 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe138037ef0 msgr2=0x7fe13803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:56.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.664+0000 7fe15b896640 1 --2- 172.21.15.52:0/165698808 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe138037ef0 0x7fe13803a3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe144007fd0 tx=0x7fe144007ac0 comp rx=0 tx=0).stop 2024-02-15T22:55:56.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.664+0000 7fe15b896640 1 -- 172.21.15.52:0/165698808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe15406d130 msgr2=0x7fe15411abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:56.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.664+0000 7fe15b896640 1 --2- 172.21.15.52:0/165698808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe15406d130 0x7fe15411abf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe150009840 tx=0x7fe1500046c0 comp rx=0 tx=0).stop 2024-02-15T22:55:56.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.664+0000 7fe15b896640 1 -- 172.21.15.52:0/165698808 shutdown_connections 2024-02-15T22:55:56.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.664+0000 7fe15b896640 1 --2- 172.21.15.52:0/165698808 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe138037ef0 0x7fe13803a3b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:56.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.664+0000 7fe15b896640 1 --2- 172.21.15.52:0/165698808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe15406d130 0x7fe15411abf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:56.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.664+0000 7fe15b896640 1 -- 172.21.15.52:0/165698808 >> 172.21.15.52:0/165698808 conn(0x7fe15409c210 msgr2=0x7fe1541b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:56.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.664+0000 7fe15b896640 1 -- 172.21.15.52:0/165698808 shutdown_connections 2024-02-15T22:55:56.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.664+0000 7fe15b896640 1 -- 172.21.15.52:0/165698808 wait complete. 2024-02-15T22:55:56.681 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-02-15T22:55:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.787+0000 7f84b5f59640 1 Processor -- start 2024-02-15T22:55:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.787+0000 7f84b5f59640 1 -- start start 2024-02-15T22:55:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.787+0000 7f84b5f59640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84b00719c0 0x7f84b006ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.787+0000 7f84b5f59640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b006ea10 con 0x7f84b006d1f0 2024-02-15T22:55:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.787+0000 7f84b5f59640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b0066f70 con 0x7f84b00719c0 2024-02-15T22:55:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.787+0000 7f84af7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84b00719c0 0x7f84b006ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.787+0000 7f84aeffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f84b006d1f0 0x7f84b006d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54502/0 (socket says 172.21.15.52:54502) 2024-02-15T22:55:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.787+0000 7f84aeffd640 1 -- 172.21.15.52:0/1513617550 learned_addr learned my addr 172.21.15.52:0/1513617550 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.788+0000 7f84af7fe640 1 -- 172.21.15.52:0/1513617550 >> v1:172.21.15.52:6789/0 conn(0x7f84b006d1f0 legacy=0x7f84b006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.788+0000 7f84af7fe640 1 -- 172.21.15.52:0/1513617550 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0066b50 con 0x7f84b00719c0 2024-02-15T22:55:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.788+0000 7f84ae7fc640 1 -- 172.21.15.52:0/1513617550 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812392301 0 0) 0x7f84b006ea10 con 0x7f84b006d1f0 2024-02-15T22:55:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.788+0000 7f84af7fe640 1 --2- 172.21.15.52:0/1513617550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b00719c0 0x7f84b006ccb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009720 tx=0x7f84a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2226424c72fcb44b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.789+0000 7f84ae7fc640 1 -- 172.21.15.52:0/1513617550 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a002e070 con 0x7f84b00719c0 2024-02-15T22:55:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.789+0000 7f84ae7fc640 1 -- 172.21.15.52:0/1513617550 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00316d0 con 0x7f84b00719c0 2024-02-15T22:55:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.789+0000 7f84ae7fc640 1 -- 172.21.15.52:0/1513617550 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a0031990 con 0x7f84b00719c0 2024-02-15T22:55:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.789+0000 7f84b5f59640 1 -- 172.21.15.52:0/1513617550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b00719c0 msgr2=0x7f84b006ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.789+0000 7f84b5f59640 1 --2- 172.21.15.52:0/1513617550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b00719c0 0x7f84b006ccb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009720 tx=0x7f84a002b840 comp rx=0 tx=0).stop 2024-02-15T22:55:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.789+0000 7f84b5f59640 1 -- 172.21.15.52:0/1513617550 shutdown_connections 2024-02-15T22:55:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.789+0000 7f84b5f59640 1 --2- 172.21.15.52:0/1513617550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b00719c0 0x7f84b006ccb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.789+0000 7f84b5f59640 1 -- 172.21.15.52:0/1513617550 >> 172.21.15.52:0/1513617550 conn(0x7f84b009cb40 msgr2=0x7f84b009cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.789+0000 7f84b5f59640 1 -- 172.21.15.52:0/1513617550 shutdown_connections 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.789+0000 7f84b5f59640 1 -- 172.21.15.52:0/1513617550 wait complete. 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.790+0000 7f84b5f59640 1 Processor -- start 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.790+0000 7f84b5f59640 1 -- start start 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f84b5f59640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b006d1f0 0x7f84b0092b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f84b5f59640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00962c0 con 0x7f84b006d1f0 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f84af7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b006d1f0 0x7f84b0092b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f84af7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b006d1f0 0x7f84b0092b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55940/0 (socket says 172.21.15.52:55940) 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f84af7fe640 1 -- 172.21.15.52:0/78589681 learned_addr learned my addr 172.21.15.52:0/78589681 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f84af7fe640 1 -- 172.21.15.52:0/78589681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0009400 con 0x7f84b006d1f0 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f84af7fe640 1 --2- 172.21.15.52:0/78589681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b006d1f0 0x7f84b0092b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f84a002b880 tx=0x7f84a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f8497fff640 1 -- 172.21.15.52:0/78589681 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a0004160 con 0x7f84b006d1f0 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f8497fff640 1 -- 172.21.15.52:0/78589681 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00042c0 con 0x7f84b006d1f0 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f84b5f59640 1 -- 172.21.15.52:0/78589681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b0130d10 con 0x7f84b006d1f0 2024-02-15T22:55:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f8497fff640 1 -- 172.21.15.52:0/78589681 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a0032780 con 0x7f84b006d1f0 2024-02-15T22:55:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.791+0000 7f84b5f59640 1 -- 172.21.15.52:0/78589681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b00945e0 con 0x7f84b006d1f0 2024-02-15T22:55:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.792+0000 7f8497fff640 1 -- 172.21.15.52:0/78589681 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f84a00328e0 con 0x7f84b006d1f0 2024-02-15T22:55:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.792+0000 7f84b5f59640 1 -- 172.21.15.52:0/78589681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b00627b0 con 0x7f84b006d1f0 2024-02-15T22:55:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.792+0000 7f8497fff640 1 --2- 172.21.15.52:0/78589681 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f849c037ef0 0x7f849c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.792+0000 7f8497fff640 1 -- 172.21.15.52:0/78589681 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3471+0+0 (secure 0 0 0) 0x7f84a006ccd0 con 0x7f84b006d1f0 2024-02-15T22:55:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.793+0000 7f84aeffd640 1 --2- 172.21.15.52:0/78589681 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f849c037ef0 0x7f849c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.793+0000 7f84aeffd640 1 --2- 172.21.15.52:0/78589681 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f849c037ef0 0x7f849c03a3b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f84a4000c00 tx=0x7f84a4007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:56.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.797+0000 7f8497fff640 1 -- 172.21.15.52:0/78589681 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f84a0032b90 con 0x7f84b006d1f0 2024-02-15T22:55:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:56.977+0000 7f84b5f59640 1 -- 172.21.15.52:0/78589681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f84b0067170 con 0x7f84b006d1f0 2024-02-15T22:55:57.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.664+0000 7f8497fff640 1 -- 172.21.15.52:0/78589681 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f84a0045390 con 0x7f84b006d1f0 2024-02-15T22:55:57.667 INFO:teuthology.orchestra.run.smithi052.stderr:enabled application 'rbd' on pool 'rbd' 2024-02-15T22:55:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.667+0000 7f84b5f59640 1 -- 172.21.15.52:0/78589681 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f849c037ef0 msgr2=0x7f849c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.667+0000 7f84b5f59640 1 --2- 172.21.15.52:0/78589681 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f849c037ef0 0x7f849c03a3b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f84a4000c00 tx=0x7f84a4007910 comp rx=0 tx=0).stop 2024-02-15T22:55:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.667+0000 7f84b5f59640 1 -- 172.21.15.52:0/78589681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b006d1f0 msgr2=0x7f84b0092b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.667+0000 7f84b5f59640 1 --2- 172.21.15.52:0/78589681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b006d1f0 0x7f84b0092b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f84a002b880 tx=0x7f84a00046c0 comp rx=0 tx=0).stop 2024-02-15T22:55:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.667+0000 7f84b5f59640 1 -- 172.21.15.52:0/78589681 shutdown_connections 2024-02-15T22:55:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.667+0000 7f84b5f59640 1 --2- 172.21.15.52:0/78589681 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f849c037ef0 0x7f849c03a3b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:57.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.667+0000 7f84b5f59640 1 --2- 172.21.15.52:0/78589681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b006d1f0 0x7f84b0092b30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:57.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.667+0000 7f84b5f59640 1 -- 172.21.15.52:0/78589681 >> 172.21.15.52:0/78589681 conn(0x7f84b009cb40 msgr2=0x7f84b0132f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:57.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.668+0000 7f84b5f59640 1 -- 172.21.15.52:0/78589681 shutdown_connections 2024-02-15T22:55:57.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.668+0000 7f84b5f59640 1 -- 172.21.15.52:0/78589681 wait complete. 2024-02-15T22:55:57.684 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-15T22:55:57.685 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-15T22:55:57.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-15T22:55:57.685 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-15T22:55:57.686 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-15T22:55:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.789+0000 7f06623b6640 1 Processor -- start 2024-02-15T22:55:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.789+0000 7f06623b6640 1 -- start start 2024-02-15T22:55:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.790+0000 7f06623b6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f065c06c020 0x7f065c06c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.790+0000 7f06623b6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c072220 con 0x7f065c06c940 2024-02-15T22:55:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.790+0000 7f06623b6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c09d050 con 0x7f065c06c020 2024-02-15T22:55:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.790+0000 7f065bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f065c06c020 0x7f065c06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.790+0000 7f065b7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f065c06c940 0x7f065c130380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54504/0 (socket says 172.21.15.52:54504) 2024-02-15T22:55:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.790+0000 7f065b7fe640 1 -- 172.21.15.52:0/4126914736 learned_addr learned my addr 172.21.15.52:0/4126914736 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.790+0000 7f065bfff640 1 -- 172.21.15.52:0/4126914736 >> v1:172.21.15.52:6789/0 conn(0x7f065c06c940 legacy=0x7f065c130380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.790+0000 7f065bfff640 1 -- 172.21.15.52:0/4126914736 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c06ddb0 con 0x7f065c06c020 2024-02-15T22:55:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.791+0000 7f065bfff640 1 --2- 172.21.15.52:0/4126914736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c06c020 0x7f065c06c400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0650009720 tx=0x7f065002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fed04e6841c51a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.791+0000 7f065affd640 1 -- 172.21.15.52:0/4126914736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f065002e070 con 0x7f065c06c020 2024-02-15T22:55:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.791+0000 7f065affd640 1 -- 172.21.15.52:0/4126914736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06500316d0 con 0x7f065c06c020 2024-02-15T22:55:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.791+0000 7f065affd640 1 -- 172.21.15.52:0/4126914736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0650031990 con 0x7f065c06c020 2024-02-15T22:55:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.792+0000 7f06623b6640 1 -- 172.21.15.52:0/4126914736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c06c020 msgr2=0x7f065c06c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.792+0000 7f06623b6640 1 --2- 172.21.15.52:0/4126914736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c06c020 0x7f065c06c400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0650009720 tx=0x7f065002b840 comp rx=0 tx=0).stop 2024-02-15T22:55:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.792+0000 7f06623b6640 1 -- 172.21.15.52:0/4126914736 shutdown_connections 2024-02-15T22:55:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.792+0000 7f06623b6640 1 --2- 172.21.15.52:0/4126914736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c06c020 0x7f065c06c400 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.792+0000 7f06623b6640 1 -- 172.21.15.52:0/4126914736 >> 172.21.15.52:0/4126914736 conn(0x7f065c09b520 msgr2=0x7f065c09b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.792+0000 7f06623b6640 1 -- 172.21.15.52:0/4126914736 shutdown_connections 2024-02-15T22:55:57.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.792+0000 7f06623b6640 1 -- 172.21.15.52:0/4126914736 wait complete. 2024-02-15T22:55:57.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.793+0000 7f06623b6640 1 Processor -- start 2024-02-15T22:55:57.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.793+0000 7f06623b6640 1 -- start start 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.793+0000 7f06623b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c06c020 0x7f065c0910b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.793+0000 7f06623b6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c123280 con 0x7f065c06c020 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.793+0000 7f065bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c06c020 0x7f065c0910b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.793+0000 7f065bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c06c020 0x7f065c0910b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55968/0 (socket says 172.21.15.52:55968) 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.793+0000 7f065bfff640 1 -- 172.21.15.52:0/1025365968 learned_addr learned my addr 172.21.15.52:0/1025365968 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.794+0000 7f065bfff640 1 -- 172.21.15.52:0/1025365968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0650009400 con 0x7f065c06c020 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.794+0000 7f065bfff640 1 --2- 172.21.15.52:0/1025365968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c06c020 0x7f065c0910b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0650034040 tx=0x7f06500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.794+0000 7f0658ff9640 1 -- 172.21.15.52:0/1025365968 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0650032830 con 0x7f065c06c020 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.794+0000 7f0658ff9640 1 -- 172.21.15.52:0/1025365968 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650032990 con 0x7f065c06c020 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.794+0000 7f0658ff9640 1 -- 172.21.15.52:0/1025365968 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0650032c30 con 0x7f065c06c020 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.794+0000 7f06623b6640 1 -- 172.21.15.52:0/1025365968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c131910 con 0x7f065c06c020 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.794+0000 7f06623b6640 1 -- 172.21.15.52:0/1025365968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c071a60 con 0x7f065c06c020 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.795+0000 7f0658ff9640 1 -- 172.21.15.52:0/1025365968 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f065004d3f0 con 0x7f065c06c020 2024-02-15T22:55:57.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.795+0000 7f0658ff9640 1 --2- 172.21.15.52:0/1025365968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0648037ea0 0x7f064803a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:57.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.795+0000 7f0658ff9640 1 -- 172.21.15.52:0/1025365968 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f065006c800 con 0x7f065c06c020 2024-02-15T22:55:57.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.795+0000 7f06623b6640 1 -- 172.21.15.52:0/1025365968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c0928e0 con 0x7f065c06c020 2024-02-15T22:55:57.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.795+0000 7f065b7fe640 1 --2- 172.21.15.52:0/1025365968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0648037ea0 0x7f064803a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:57.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.796+0000 7f065b7fe640 1 --2- 172.21.15.52:0/1025365968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0648037ea0 0x7f064803a360 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f064c007fd0 tx=0x7f064c007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:57.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:57.800+0000 7f0658ff9640 1 -- 172.21.15.52:0/1025365968 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f06500306b0 con 0x7f065c06c020 2024-02-15T22:55:58.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.026+0000 7f06623b6640 1 -- 172.21.15.52:0/1025365968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f065c0627b0 con 0x7f065c06c020 2024-02-15T22:55:58.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.027+0000 7f0658ff9640 1 -- 172.21.15.52:0/1025365968 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+86633 (secure 0 0 0) 0x7f06500302f0 con 0x7f065c06c020 2024-02-15T22:55:58.031 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:58.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.029+0000 7f06623b6640 1 -- 172.21.15.52:0/1025365968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0648037ea0 msgr2=0x7f064803a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.030+0000 7f06623b6640 1 --2- 172.21.15.52:0/1025365968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0648037ea0 0x7f064803a360 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f064c007fd0 tx=0x7f064c007ac0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.030+0000 7f06623b6640 1 -- 172.21.15.52:0/1025365968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c06c020 msgr2=0x7f065c0910b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.030+0000 7f06623b6640 1 --2- 172.21.15.52:0/1025365968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c06c020 0x7f065c0910b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0650034040 tx=0x7f06500046c0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.030+0000 7f06623b6640 1 -- 172.21.15.52:0/1025365968 shutdown_connections 2024-02-15T22:55:58.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.030+0000 7f06623b6640 1 --2- 172.21.15.52:0/1025365968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0648037ea0 0x7f064803a360 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.030+0000 7f06623b6640 1 --2- 172.21.15.52:0/1025365968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c06c020 0x7f065c0910b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.030+0000 7f06623b6640 1 -- 172.21.15.52:0/1025365968 >> 172.21.15.52:0/1025365968 conn(0x7f065c09b520 msgr2=0x7f065c089ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.030+0000 7f06623b6640 1 -- 172.21.15.52:0/1025365968 shutdown_connections 2024-02-15T22:55:58.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.030+0000 7f06623b6640 1 -- 172.21.15.52:0/1025365968 wait complete. 2024-02-15T22:55:58.043 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1517102141},{"type":"v1","addr":"172.21.15.133:6825","nonce":1517102141}]},"active_addr":"172.21.15.133:6825/1517102141","active_change":"2024-02-15T22:55:44.795162+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":302789588}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":723910719}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":3634976290}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":2679171128}]}]} 2024-02-15T22:55:58.045 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-15T22:55:58.045 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-15T22:55:58.045 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T22:55:58.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.143+0000 7ff7ac68d640 1 Processor -- start 2024-02-15T22:55:58.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.143+0000 7ff7ac68d640 1 -- start start 2024-02-15T22:55:58.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.143+0000 7ff7ac68d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7a412dcb0 0x7ff7a41300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.143+0000 7ff7ac68d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a4095270 con 0x7ff7a40956a0 2024-02-15T22:55:58.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.143+0000 7ff7ac68d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a4096190 con 0x7ff7a412dcb0 2024-02-15T22:55:58.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.143+0000 7ff7a9c28640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7a412dcb0 0x7ff7a41300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.143+0000 7ff7aa429640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff7a40956a0 0x7ff7a4095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54506/0 (socket says 172.21.15.52:54506) 2024-02-15T22:55:58.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.143+0000 7ff7aa429640 1 -- 172.21.15.52:0/685404206 learned_addr learned my addr 172.21.15.52:0/685404206 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:58.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.144+0000 7ff7a9c28640 1 -- 172.21.15.52:0/685404206 >> v1:172.21.15.52:6789/0 conn(0x7ff7a40956a0 legacy=0x7ff7a4095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.144+0000 7ff7a9c28640 1 -- 172.21.15.52:0/685404206 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a40954a0 con 0x7ff7a412dcb0 2024-02-15T22:55:58.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.144+0000 7ff7a9c28640 1 --2- 172.21.15.52:0/685404206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a412dcb0 0x7ff7a41300a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff794009720 tx=0x7ff79402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e53f08f9878357 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.144+0000 7ff7a9427640 1 -- 172.21.15.52:0/685404206 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff79402e070 con 0x7ff7a412dcb0 2024-02-15T22:55:58.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.144+0000 7ff7a9427640 1 -- 172.21.15.52:0/685404206 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7940316d0 con 0x7ff7a412dcb0 2024-02-15T22:55:58.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.144+0000 7ff7a9427640 1 -- 172.21.15.52:0/685404206 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff794031990 con 0x7ff7a412dcb0 2024-02-15T22:55:58.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.145+0000 7ff7ac68d640 1 -- 172.21.15.52:0/685404206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a412dcb0 msgr2=0x7ff7a41300a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.145+0000 7ff7ac68d640 1 --2- 172.21.15.52:0/685404206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a412dcb0 0x7ff7a41300a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff794009720 tx=0x7ff79402b840 comp rx=0 tx=0).stop 2024-02-15T22:55:58.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.145+0000 7ff7ac68d640 1 -- 172.21.15.52:0/685404206 shutdown_connections 2024-02-15T22:55:58.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.145+0000 7ff7ac68d640 1 --2- 172.21.15.52:0/685404206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a412dcb0 0x7ff7a41300a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.145+0000 7ff7ac68d640 1 -- 172.21.15.52:0/685404206 >> 172.21.15.52:0/685404206 conn(0x7ff7a409a300 msgr2=0x7ff7a409a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.145+0000 7ff7ac68d640 1 -- 172.21.15.52:0/685404206 shutdown_connections 2024-02-15T22:55:58.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.145+0000 7ff7ac68d640 1 -- 172.21.15.52:0/685404206 wait complete. 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.146+0000 7ff7ac68d640 1 Processor -- start 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.146+0000 7ff7ac68d640 1 -- start start 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.146+0000 7ff7ac68d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a40956a0 0x7ff7a412bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.146+0000 7ff7ac68d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a406e6f0 con 0x7ff7a40956a0 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.146+0000 7ff7aa429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a40956a0 0x7ff7a412bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.146+0000 7ff7aa429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a40956a0 0x7ff7a412bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55982/0 (socket says 172.21.15.52:55982) 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.146+0000 7ff7aa429640 1 -- 172.21.15.52:0/2952422784 learned_addr learned my addr 172.21.15.52:0/2952422784 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.147+0000 7ff7aa429640 1 -- 172.21.15.52:0/2952422784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794009400 con 0x7ff7a40956a0 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.147+0000 7ff7aa429640 1 --2- 172.21.15.52:0/2952422784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a40956a0 0x7ff7a412bad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000c4a0 tx=0x7ff7a000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.147+0000 7ff79affd640 1 -- 172.21.15.52:0/2952422784 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7a0005c10 con 0x7ff7a40956a0 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.147+0000 7ff79affd640 1 -- 172.21.15.52:0/2952422784 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a0005d70 con 0x7ff7a40956a0 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.147+0000 7ff7ac68d640 1 -- 172.21.15.52:0/2952422784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a406e3e0 con 0x7ff7a40956a0 2024-02-15T22:55:58.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.147+0000 7ff79affd640 1 -- 172.21.15.52:0/2952422784 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00071a0 con 0x7ff7a40956a0 2024-02-15T22:55:58.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.147+0000 7ff7ac68d640 1 -- 172.21.15.52:0/2952422784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a406d280 con 0x7ff7a40956a0 2024-02-15T22:55:58.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.148+0000 7ff79affd640 1 -- 172.21.15.52:0/2952422784 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff7a0007300 con 0x7ff7a40956a0 2024-02-15T22:55:58.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.148+0000 7ff7ac68d640 1 -- 172.21.15.52:0/2952422784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a406e240 con 0x7ff7a40956a0 2024-02-15T22:55:58.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.148+0000 7ff79affd640 1 --2- 172.21.15.52:0/2952422784 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff788037ef0 0x7ff78803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.148+0000 7ff79affd640 1 -- 172.21.15.52:0/2952422784 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff7a0049d40 con 0x7ff7a40956a0 2024-02-15T22:55:58.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.148+0000 7ff7a9c28640 1 --2- 172.21.15.52:0/2952422784 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff788037ef0 0x7ff78803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.149+0000 7ff7a9c28640 1 --2- 172.21.15.52:0/2952422784 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff788037ef0 0x7ff78803a3b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff794036000 tx=0x7ff794008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.153+0000 7ff79affd640 1 -- 172.21.15.52:0/2952422784 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7a406e240 con 0x7ff7a40956a0 2024-02-15T22:55:58.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.332+0000 7ff7ac68d640 1 -- 172.21.15.52:0/2952422784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7a406e240 con 0x7ff7a40956a0 2024-02-15T22:55:58.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.333+0000 7ff79affd640 1 -- 172.21.15.52:0/2952422784 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9759 (secure 0 0 0) 0x7ff7a406e240 con 0x7ff7a40956a0 2024-02-15T22:55:58.335 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:58.335 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":16,"fsid":"81db0e6a-c08b-432e-840e-21ec1a74d746","created":"2024-02-15T22:55:40.454080+0000","modified":"2024-02-15T22:55:57.663144+0000","last_up_change":"2024-02-15T22:55:49.646698+0000","last_in_change":"2024-02-15T22:55:41.529472+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:55:50.841585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-15T22:55:56.053677+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"257a07e8-165d-4ad0-9cf2-429df58aa049","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6801","nonce":431200118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6803","nonce":431200118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6807","nonce":431200118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6805","nonce":431200118}]},"public_addr":"172.21.15.52:6801/431200118","cluster_addr":"172.21.15.52:6803/431200118","heartbeat_back_addr":"172.21.15.52:6807/431200118","heartbeat_front_addr":"172.21.15.52:6805/431200118","state":["exists","up"]},{"osd":1,"uuid":"5c3aacaf-92b7-4999-acbc-0104cff9c2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6809","nonce":2671624067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6811","nonce":2671624067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6815","nonce":2671624067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6813","nonce":2671624067}]},"public_addr":"172.21.15.133:6809/2671624067","cluster_addr":"172.21.15.133:6811/2671624067","heartbeat_back_addr":"172.21.15.133:6815/2671624067","heartbeat_front_addr":"172.21.15.133:6813/2671624067","state":["exists","up"]},{"osd":2,"uuid":"49103408-6b04-4a33-a6ed-5fa50f5ba06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6801","nonce":2073628168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6803","nonce":2073628168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6807","nonce":2073628168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6805","nonce":2073628168}]},"public_addr":"172.21.15.133:6801/2073628168","cluster_addr":"172.21.15.133:6803/2073628168","heartbeat_back_addr":"172.21.15.133:6807/2073628168","heartbeat_front_addr":"172.21.15.133:6805/2073628168","state":["exists","up"]},{"osd":3,"uuid":"280168c8-d5b8-4549-bbf7-a196e7d0dd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6817","nonce":1065500544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6819","nonce":1065500544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6823","nonce":1065500544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6821","nonce":1065500544}]},"public_addr":"172.21.15.133:6817/1065500544","cluster_addr":"172.21.15.133:6819/1065500544","heartbeat_back_addr":"172.21.15.133:6823/1065500544","heartbeat_front_addr":"172.21.15.133:6821/1065500544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.543998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.701390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.655590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.685597+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:55:58.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.335+0000 7ff7ac68d640 1 -- 172.21.15.52:0/2952422784 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff788037ef0 msgr2=0x7ff78803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.335+0000 7ff7ac68d640 1 --2- 172.21.15.52:0/2952422784 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff788037ef0 0x7ff78803a3b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff794036000 tx=0x7ff794008030 comp rx=0 tx=0).stop 2024-02-15T22:55:58.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.335+0000 7ff7ac68d640 1 -- 172.21.15.52:0/2952422784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a40956a0 msgr2=0x7ff7a412bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.335+0000 7ff7ac68d640 1 --2- 172.21.15.52:0/2952422784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a40956a0 0x7ff7a412bad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000c4a0 tx=0x7ff7a000c960 comp rx=0 tx=0).stop 2024-02-15T22:55:58.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.335+0000 7ff7ac68d640 1 -- 172.21.15.52:0/2952422784 shutdown_connections 2024-02-15T22:55:58.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.335+0000 7ff7ac68d640 1 --2- 172.21.15.52:0/2952422784 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff788037ef0 0x7ff78803a3b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.335+0000 7ff7ac68d640 1 --2- 172.21.15.52:0/2952422784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7a40956a0 0x7ff7a412bad0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.335+0000 7ff7ac68d640 1 -- 172.21.15.52:0/2952422784 >> 172.21.15.52:0/2952422784 conn(0x7ff7a409a300 msgr2=0x7ff7a40969e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.335+0000 7ff7ac68d640 1 -- 172.21.15.52:0/2952422784 shutdown_connections 2024-02-15T22:55:58.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.335+0000 7ff7ac68d640 1 -- 172.21.15.52:0/2952422784 wait complete. 2024-02-15T22:55:58.348 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-15T22:55:58.348 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T22:55:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.446+0000 7f13a884a640 1 Processor -- start 2024-02-15T22:55:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.446+0000 7f13a884a640 1 -- start start 2024-02-15T22:55:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.446+0000 7f13a884a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13a406d130 0x7f13a406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.446+0000 7f13a884a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a409b170 con 0x7f13a406da50 2024-02-15T22:55:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.446+0000 7f13a884a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a409dd00 con 0x7f13a406d130 2024-02-15T22:55:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.446+0000 7f13a259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13a406d130 0x7f13a406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.447+0000 7f139bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f13a406da50 0x7f13a412de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54512/0 (socket says 172.21.15.52:54512) 2024-02-15T22:55:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.447+0000 7f139bfff640 1 -- 172.21.15.52:0/4097183398 learned_addr learned my addr 172.21.15.52:0/4097183398 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.447+0000 7f13a259c640 1 -- 172.21.15.52:0/4097183398 >> v1:172.21.15.52:6789/0 conn(0x7f13a406da50 legacy=0x7f13a412de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.447+0000 7f13a259c640 1 -- 172.21.15.52:0/4097183398 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a409b510 con 0x7f13a406d130 2024-02-15T22:55:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.447+0000 7f13a259c640 1 --2- 172.21.15.52:0/4097183398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a406d130 0x7f13a406d510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1394009720 tx=0x7f139402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9fb7920d1b7539 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.448+0000 7f13a1d9b640 1 -- 172.21.15.52:0/4097183398 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f139402e070 con 0x7f13a406d130 2024-02-15T22:55:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.448+0000 7f13a1d9b640 1 -- 172.21.15.52:0/4097183398 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13940316d0 con 0x7f13a406d130 2024-02-15T22:55:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.448+0000 7f13a1d9b640 1 -- 172.21.15.52:0/4097183398 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1394031990 con 0x7f13a406d130 2024-02-15T22:55:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.448+0000 7f13a884a640 1 -- 172.21.15.52:0/4097183398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a406d130 msgr2=0x7f13a406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.448+0000 7f13a884a640 1 --2- 172.21.15.52:0/4097183398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a406d130 0x7f13a406d510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1394009720 tx=0x7f139402b840 comp rx=0 tx=0).stop 2024-02-15T22:55:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.448+0000 7f13a884a640 1 -- 172.21.15.52:0/4097183398 shutdown_connections 2024-02-15T22:55:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.448+0000 7f13a884a640 1 --2- 172.21.15.52:0/4097183398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a406d130 0x7f13a406d510 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.448+0000 7f13a884a640 1 -- 172.21.15.52:0/4097183398 >> 172.21.15.52:0/4097183398 conn(0x7f13a409c210 msgr2=0x7f13a4071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.448+0000 7f13a884a640 1 -- 172.21.15.52:0/4097183398 shutdown_connections 2024-02-15T22:55:58.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.448+0000 7f13a884a640 1 -- 172.21.15.52:0/4097183398 wait complete. 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.449+0000 7f13a884a640 1 Processor -- start 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.449+0000 7f13a884a640 1 -- start start 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.449+0000 7f13a884a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a406d130 0x7f13a41a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.450+0000 7f13a884a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a41a94c0 con 0x7f13a406d130 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.450+0000 7f13a259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a406d130 0x7f13a41a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.450+0000 7f13a259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a406d130 0x7f13a41a5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55994/0 (socket says 172.21.15.52:55994) 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.450+0000 7f13a259c640 1 -- 172.21.15.52:0/582215227 learned_addr learned my addr 172.21.15.52:0/582215227 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.450+0000 7f13a259c640 1 -- 172.21.15.52:0/582215227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394009400 con 0x7f13a406d130 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.450+0000 7f13a259c640 1 --2- 172.21.15.52:0/582215227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a406d130 0x7f13a41a5dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1394009840 tx=0x7f13940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.450+0000 7f139affd640 1 -- 172.21.15.52:0/582215227 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13940328b0 con 0x7f13a406d130 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.450+0000 7f139affd640 1 -- 172.21.15.52:0/582215227 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1394032a10 con 0x7f13a406d130 2024-02-15T22:55:58.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.450+0000 7f13a884a640 1 -- 172.21.15.52:0/582215227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a41a6c80 con 0x7f13a406d130 2024-02-15T22:55:58.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.450+0000 7f139affd640 1 -- 172.21.15.52:0/582215227 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1394032cf0 con 0x7f13a406d130 2024-02-15T22:55:58.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.450+0000 7f13a884a640 1 -- 172.21.15.52:0/582215227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a41a8f80 con 0x7f13a406d130 2024-02-15T22:55:58.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.451+0000 7f139affd640 1 -- 172.21.15.52:0/582215227 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f139404d3f0 con 0x7f13a406d130 2024-02-15T22:55:58.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.451+0000 7f139affd640 1 --2- 172.21.15.52:0/582215227 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1384037ef0 0x7f138403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.451+0000 7f139affd640 1 -- 172.21.15.52:0/582215227 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f139406c6c0 con 0x7f13a406d130 2024-02-15T22:55:58.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.451+0000 7f13a884a640 1 -- 172.21.15.52:0/582215227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a40627b0 con 0x7f13a406d130 2024-02-15T22:55:58.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.451+0000 7f139bfff640 1 --2- 172.21.15.52:0/582215227 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1384037ef0 0x7f138403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.452+0000 7f139bfff640 1 --2- 172.21.15.52:0/582215227 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1384037ef0 0x7f138403a3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f138c007fd0 tx=0x7f138c007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.456+0000 7f139affd640 1 -- 172.21.15.52:0/582215227 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f13940308e0 con 0x7f13a406d130 2024-02-15T22:55:58.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.638+0000 7f13a884a640 1 -- 172.21.15.52:0/582215227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13a4073050 con 0x7f13a406d130 2024-02-15T22:55:58.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.638+0000 7f139affd640 1 -- 172.21.15.52:0/582215227 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9759 (secure 0 0 0) 0x7f13940302f0 con 0x7f13a406d130 2024-02-15T22:55:58.641 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:55:58.641 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":16,"fsid":"81db0e6a-c08b-432e-840e-21ec1a74d746","created":"2024-02-15T22:55:40.454080+0000","modified":"2024-02-15T22:55:57.663144+0000","last_up_change":"2024-02-15T22:55:49.646698+0000","last_in_change":"2024-02-15T22:55:41.529472+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:55:50.841585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-15T22:55:56.053677+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"257a07e8-165d-4ad0-9cf2-429df58aa049","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6801","nonce":431200118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6803","nonce":431200118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6807","nonce":431200118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6805","nonce":431200118}]},"public_addr":"172.21.15.52:6801/431200118","cluster_addr":"172.21.15.52:6803/431200118","heartbeat_back_addr":"172.21.15.52:6807/431200118","heartbeat_front_addr":"172.21.15.52:6805/431200118","state":["exists","up"]},{"osd":1,"uuid":"5c3aacaf-92b7-4999-acbc-0104cff9c2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6809","nonce":2671624067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6811","nonce":2671624067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6815","nonce":2671624067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6813","nonce":2671624067}]},"public_addr":"172.21.15.133:6809/2671624067","cluster_addr":"172.21.15.133:6811/2671624067","heartbeat_back_addr":"172.21.15.133:6815/2671624067","heartbeat_front_addr":"172.21.15.133:6813/2671624067","state":["exists","up"]},{"osd":2,"uuid":"49103408-6b04-4a33-a6ed-5fa50f5ba06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6801","nonce":2073628168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6803","nonce":2073628168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6807","nonce":2073628168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6805","nonce":2073628168}]},"public_addr":"172.21.15.133:6801/2073628168","cluster_addr":"172.21.15.133:6803/2073628168","heartbeat_back_addr":"172.21.15.133:6807/2073628168","heartbeat_front_addr":"172.21.15.133:6805/2073628168","state":["exists","up"]},{"osd":3,"uuid":"280168c8-d5b8-4549-bbf7-a196e7d0dd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6817","nonce":1065500544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6819","nonce":1065500544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6823","nonce":1065500544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6821","nonce":1065500544}]},"public_addr":"172.21.15.133:6817/1065500544","cluster_addr":"172.21.15.133:6819/1065500544","heartbeat_back_addr":"172.21.15.133:6823/1065500544","heartbeat_front_addr":"172.21.15.133:6821/1065500544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.543998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.701390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.655590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.685597+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:55:58.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.640+0000 7f13a884a640 1 -- 172.21.15.52:0/582215227 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1384037ef0 msgr2=0x7f138403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.640+0000 7f13a884a640 1 --2- 172.21.15.52:0/582215227 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1384037ef0 0x7f138403a3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f138c007fd0 tx=0x7f138c007ac0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.640+0000 7f13a884a640 1 -- 172.21.15.52:0/582215227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a406d130 msgr2=0x7f13a41a5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.640+0000 7f13a884a640 1 --2- 172.21.15.52:0/582215227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a406d130 0x7f13a41a5dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1394009840 tx=0x7f13940046c0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.640+0000 7f13a884a640 1 -- 172.21.15.52:0/582215227 shutdown_connections 2024-02-15T22:55:58.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.640+0000 7f13a884a640 1 --2- 172.21.15.52:0/582215227 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1384037ef0 0x7f138403a3b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.640+0000 7f13a884a640 1 --2- 172.21.15.52:0/582215227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a406d130 0x7f13a41a5dd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.640+0000 7f13a884a640 1 -- 172.21.15.52:0/582215227 >> 172.21.15.52:0/582215227 conn(0x7f13a409c210 msgr2=0x7f13a406f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.640+0000 7f13a884a640 1 -- 172.21.15.52:0/582215227 shutdown_connections 2024-02-15T22:55:58.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.640+0000 7f13a884a640 1 -- 172.21.15.52:0/582215227 wait complete. 2024-02-15T22:55:58.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-15T22:55:58.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-15T22:55:58.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-15T22:55:58.655 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-15T22:55:58.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.758+0000 7f3d63eaf640 1 Processor -- start 2024-02-15T22:55:58.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.758+0000 7f6db0093640 1 Processor -- start 2024-02-15T22:55:58.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.758+0000 7fc23ddd6640 1 Processor -- start 2024-02-15T22:55:58.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.758+0000 7f741924a640 1 Processor -- start 2024-02-15T22:55:58.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f3d63eaf640 1 -- start start 2024-02-15T22:55:58.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f6db0093640 1 -- start start 2024-02-15T22:55:58.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7fc23ddd6640 1 -- start start 2024-02-15T22:55:58.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f741924a640 1 -- start start 2024-02-15T22:55:58.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7fc23ddd6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc23812af10 0x7fc23812b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7fc23ddd6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc238072220 con 0x7fc238095020 2024-02-15T22:55:58.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7fc23ddd6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23806cc30 con 0x7fc23812af10 2024-02-15T22:55:58.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f741924a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f741412aed0 0x7f741412f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f3d63eaf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3d5c0989f0 0x7f3d5c1331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f741924a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741406f260 con 0x7f741412a3e0 2024-02-15T22:55:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f6db0093640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6da812dc20 0x7f6da8130010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f6db0093640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da806cdf0 con 0x7f6da81278e0 2024-02-15T22:55:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f6db0093640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da8096250 con 0x7f6da812dc20 2024-02-15T22:55:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f6dad62e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6da812dc20 0x7f6da8130010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f3d63eaf640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c06bdf0 con 0x7f3d5c097f00 2024-02-15T22:55:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f3d63eaf640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c0672c0 con 0x7f3d5c0989f0 2024-02-15T22:55:58.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f6dad62e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6da812dc20 0x7f6da8130010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56024/0 (socket says 172.21.15.52:56024) 2024-02-15T22:55:58.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f6dad62e640 1 -- 172.21.15.52:0/145821761 learned_addr learned my addr 172.21.15.52:0/145821761 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f741924a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741409d810 con 0x7f741412aed0 2024-02-15T22:55:58.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7fc236ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc238095020 0x7fc238095440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54544/0 (socket says 172.21.15.52:54544) 2024-02-15T22:55:58.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f741259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f741412aed0 0x7f741412f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7fc236ffd640 1 -- 172.21.15.52:0/1963788650 learned_addr learned my addr 172.21.15.52:0/1963788650 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:58.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f741259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f741412aed0 0x7f741412f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56016/0 (socket says 172.21.15.52:56016) 2024-02-15T22:55:58.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f741259c640 1 -- 172.21.15.52:0/2406807232 learned_addr learned my addr 172.21.15.52:0/2406807232 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7fc2377fe640 1 --2- 172.21.15.52:0/1963788650 >> v2:172.21.15.52:3300/0 conn(0x7fc23812af10 0x7fc23812b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f3d6144a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3d5c0989f0 0x7f3d5c1331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f3d61c4b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3d5c097f00 0x7f3d5c0982e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54530/0 (socket says 172.21.15.52:54530) 2024-02-15T22:55:58.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.759+0000 7f3d61c4b640 1 -- 172.21.15.52:0/540568476 learned_addr learned my addr 172.21.15.52:0/540568476 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:58.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.760+0000 7f6dad62e640 1 -- 172.21.15.52:0/145821761 >> v1:172.21.15.52:6789/0 conn(0x7f6da81278e0 legacy=0x7f6da8127cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.760+0000 7f6dad62e640 1 -- 172.21.15.52:0/145821761 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8093cb0 con 0x7f6da812dc20 2024-02-15T22:55:58.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.760+0000 7fc2377fe640 1 -- 172.21.15.52:0/1963788650 >> v1:172.21.15.52:6789/0 conn(0x7fc238095020 legacy=0x7fc238095440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.760+0000 7fc2377fe640 1 -- 172.21.15.52:0/1963788650 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23812aae0 con 0x7fc23812af10 2024-02-15T22:55:58.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.760+0000 7f741259c640 1 -- 172.21.15.52:0/2406807232 >> v1:172.21.15.52:6789/0 conn(0x7f741412a3e0 legacy=0x7f741412a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.760+0000 7f3d6144a640 1 -- 172.21.15.52:0/540568476 >> v1:172.21.15.52:6789/0 conn(0x7f3d5c097f00 legacy=0x7f3d5c0982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.760+0000 7f3d6144a640 1 -- 172.21.15.52:0/540568476 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c09a5c0 con 0x7f3d5c0989f0 2024-02-15T22:55:58.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.760+0000 7f741259c640 1 -- 172.21.15.52:0/2406807232 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414071bf0 con 0x7f741412aed0 2024-02-15T22:55:58.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f6dad62e640 1 --2- 172.21.15.52:0/145821761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da812dc20 0x7f6da8130010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097f0 tx=0x7f6d9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5da27e9737f71d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f741259c640 1 --2- 172.21.15.52:0/2406807232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f741412aed0 0x7f741412f700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f740800ba80 tx=0x7f740802dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5195001ed423403e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7fc2377fe640 1 --2- 172.21.15.52:0/1963788650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc23812af10 0x7fc23812b2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc228009720 tx=0x7fc22802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a0db4b1cb76c86 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f3d6144a640 1 --2- 172.21.15.52:0/540568476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d5c0989f0 0x7f3d5c1331d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009720 tx=0x7f3d4c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b849ccff093e88ef server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f6dace2d640 1 -- 172.21.15.52:0/145821761 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d980317a0 con 0x7f6da812dc20 2024-02-15T22:55:58.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7fc2367fc640 1 -- 172.21.15.52:0/1963788650 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc22802e070 con 0x7fc23812af10 2024-02-15T22:55:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f7411d9b640 1 -- 172.21.15.52:0/2406807232 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f740802e960 con 0x7f741412aed0 2024-02-15T22:55:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f6dace2d640 1 -- 172.21.15.52:0/145821761 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d98031900 con 0x7f6da812dc20 2024-02-15T22:55:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7fc2367fc640 1 -- 172.21.15.52:0/1963788650 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2280316d0 con 0x7fc23812af10 2024-02-15T22:55:58.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f7411d9b640 1 -- 172.21.15.52:0/2406807232 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7408032070 con 0x7f741412aed0 2024-02-15T22:55:58.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f7411d9b640 1 -- 172.21.15.52:0/2406807232 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f740802ec10 con 0x7f741412aed0 2024-02-15T22:55:58.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f3d60c49640 1 -- 172.21.15.52:0/540568476 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d4c031760 con 0x7f3d5c0989f0 2024-02-15T22:55:58.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7fc2367fc640 1 -- 172.21.15.52:0/1963788650 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc228031990 con 0x7fc23812af10 2024-02-15T22:55:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f3d60c49640 1 -- 172.21.15.52:0/540568476 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c0318c0 con 0x7f3d5c0989f0 2024-02-15T22:55:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f3d60c49640 1 -- 172.21.15.52:0/540568476 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d4c031b80 con 0x7f3d5c0989f0 2024-02-15T22:55:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.761+0000 7f6dace2d640 1 -- 172.21.15.52:0/145821761 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d98031bc0 con 0x7f6da812dc20 2024-02-15T22:55:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f6db0093640 1 -- 172.21.15.52:0/145821761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da812dc20 msgr2=0x7f6da8130010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f3d63eaf640 1 -- 172.21.15.52:0/540568476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d5c0989f0 msgr2=0x7f3d5c1331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f3d63eaf640 1 --2- 172.21.15.52:0/540568476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d5c0989f0 0x7f3d5c1331d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009720 tx=0x7f3d4c02b8d0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f6db0093640 1 --2- 172.21.15.52:0/145821761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da812dc20 0x7f6da8130010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097f0 tx=0x7f6d9802b910 comp rx=0 tx=0).stop 2024-02-15T22:55:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f6db0093640 1 -- 172.21.15.52:0/145821761 shutdown_connections 2024-02-15T22:55:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f6db0093640 1 --2- 172.21.15.52:0/145821761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da812dc20 0x7f6da8130010 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f6db0093640 1 -- 172.21.15.52:0/145821761 >> 172.21.15.52:0/145821761 conn(0x7f6da809a050 msgr2=0x7f6da809a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f3d63eaf640 1 -- 172.21.15.52:0/540568476 shutdown_connections 2024-02-15T22:55:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f3d63eaf640 1 --2- 172.21.15.52:0/540568476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d5c0989f0 0x7f3d5c1331d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f3d63eaf640 1 -- 172.21.15.52:0/540568476 >> 172.21.15.52:0/540568476 conn(0x7f3d5c09e640 msgr2=0x7f3d5c09ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7fc23ddd6640 1 -- 172.21.15.52:0/1963788650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc23812af10 msgr2=0x7fc23812b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7fc23ddd6640 1 --2- 172.21.15.52:0/1963788650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc23812af10 0x7fc23812b2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc228009720 tx=0x7fc22802b840 comp rx=0 tx=0).stop 2024-02-15T22:55:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f741924a640 1 -- 172.21.15.52:0/2406807232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f741412aed0 msgr2=0x7f741412f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f741924a640 1 --2- 172.21.15.52:0/2406807232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f741412aed0 0x7f741412f700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f740800ba80 tx=0x7f740802dd00 comp rx=0 tx=0).stop 2024-02-15T22:55:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f3d63eaf640 1 -- 172.21.15.52:0/540568476 shutdown_connections 2024-02-15T22:55:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f6db0093640 1 -- 172.21.15.52:0/145821761 shutdown_connections 2024-02-15T22:55:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7fc23ddd6640 1 -- 172.21.15.52:0/1963788650 shutdown_connections 2024-02-15T22:55:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7fc23ddd6640 1 --2- 172.21.15.52:0/1963788650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc23812af10 0x7fc23812b2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7fc23ddd6640 1 -- 172.21.15.52:0/1963788650 >> 172.21.15.52:0/1963788650 conn(0x7fc23809a050 msgr2=0x7fc23809a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f6db0093640 1 -- 172.21.15.52:0/145821761 wait complete. 2024-02-15T22:55:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f741924a640 1 -- 172.21.15.52:0/2406807232 shutdown_connections 2024-02-15T22:55:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f741924a640 1 --2- 172.21.15.52:0/2406807232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f741412aed0 0x7f741412f700 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f741924a640 1 -- 172.21.15.52:0/2406807232 >> 172.21.15.52:0/2406807232 conn(0x7f741409ccf0 msgr2=0x7f741409d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f741924a640 1 -- 172.21.15.52:0/2406807232 shutdown_connections 2024-02-15T22:55:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f3d63eaf640 1 -- 172.21.15.52:0/540568476 wait complete. 2024-02-15T22:55:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7fc23ddd6640 1 -- 172.21.15.52:0/1963788650 shutdown_connections 2024-02-15T22:55:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7fc23ddd6640 1 -- 172.21.15.52:0/1963788650 wait complete. 2024-02-15T22:55:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.762+0000 7f741924a640 1 -- 172.21.15.52:0/2406807232 wait complete. 2024-02-15T22:55:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.763+0000 7f3d63eaf640 1 Processor -- start 2024-02-15T22:55:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.763+0000 7fc23ddd6640 1 Processor -- start 2024-02-15T22:55:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f3d63eaf640 1 -- start start 2024-02-15T22:55:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f6db0093640 1 Processor -- start 2024-02-15T22:55:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f6db0093640 1 -- start start 2024-02-15T22:55:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7fc23ddd6640 1 -- start start 2024-02-15T22:55:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f741924a640 1 Processor -- start 2024-02-15T22:55:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f3d63eaf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d5c097f00 0x7f3d5c127780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f3d63eaf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c12f940 con 0x7f3d5c097f00 2024-02-15T22:55:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f741924a640 1 -- start start 2024-02-15T22:55:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7fc23ddd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc238095020 0x7fc238121760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f3d61c4b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d5c097f00 0x7f3d5c127780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f3d61c4b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d5c097f00 0x7f3d5c127780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56046/0 (socket says 172.21.15.52:56046) 2024-02-15T22:55:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7fc23ddd6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc238124bf0 con 0x7fc238095020 2024-02-15T22:55:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f3d61c4b640 1 -- 172.21.15.52:0/1548019538 learned_addr learned my addr 172.21.15.52:0/1548019538 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f6db0093640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81278e0 0x7f6da8092070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7f6db0093640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da8130fe0 con 0x7f6da81278e0 2024-02-15T22:55:58.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc238095020 0x7fc238121760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc238095020 0x7fc238121760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56062/0 (socket says 172.21.15.52:56062) 2024-02-15T22:55:58.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.764+0000 7fc2377fe640 1 -- 172.21.15.52:0/2207022270 learned_addr learned my addr 172.21.15.52:0/2207022270 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f6dade2f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81278e0 0x7f6da8092070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f6dade2f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81278e0 0x7f6da8092070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56064/0 (socket says 172.21.15.52:56064) 2024-02-15T22:55:58.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f6dade2f640 1 -- 172.21.15.52:0/211981155 learned_addr learned my addr 172.21.15.52:0/211981155 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f741924a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f741412a3e0 0x7f7414089ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f741924a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741408c960 con 0x7f741412a3e0 2024-02-15T22:55:58.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7fc2377fe640 1 -- 172.21.15.52:0/2207022270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228009400 con 0x7fc238095020 2024-02-15T22:55:58.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f3d61c4b640 1 -- 172.21.15.52:0/1548019538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c009400 con 0x7f3d5c097f00 2024-02-15T22:55:58.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f7412d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f741412a3e0 0x7f7414089ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f6dade2f640 1 -- 172.21.15.52:0/211981155 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d980094d0 con 0x7f6da81278e0 2024-02-15T22:55:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f7412d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f741412a3e0 0x7f7414089ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56076/0 (socket says 172.21.15.52:56076) 2024-02-15T22:55:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f7412d9d640 1 -- 172.21.15.52:0/1042572053 learned_addr learned my addr 172.21.15.52:0/1042572053 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f3d61c4b640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d5c097f00 0x7f3d5c127780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c4a0 tx=0x7f3d5800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7fc2377fe640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc238095020 0x7fc238121760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc228000c00 tx=0x7fc2280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f6dade2f640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81278e0 0x7f6da8092070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6da400c380 tx=0x7f6da400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7fc21ffff640 1 -- 172.21.15.52:0/2207022270 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc228032b40 con 0x7fc238095020 2024-02-15T22:55:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f7412d9d640 1 -- 172.21.15.52:0/1042572053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740800b760 con 0x7f741412a3e0 2024-02-15T22:55:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7fc21ffff640 1 -- 172.21.15.52:0/2207022270 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc228032ca0 con 0x7fc238095020 2024-02-15T22:55:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f6d9e7fc640 1 -- 172.21.15.52:0/211981155 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6da4005200 con 0x7f6da81278e0 2024-02-15T22:55:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7fc21ffff640 1 -- 172.21.15.52:0/2207022270 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2280453f0 con 0x7fc238095020 2024-02-15T22:55:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f6d9e7fc640 1 -- 172.21.15.52:0/211981155 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da4005380 con 0x7f6da81278e0 2024-02-15T22:55:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.766+0000 7fc23ddd6640 1 -- 172.21.15.52:0/2207022270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc238122850 con 0x7fc238095020 2024-02-15T22:55:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.765+0000 7f6d9e7fc640 1 -- 172.21.15.52:0/211981155 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6da4007020 con 0x7f6da81278e0 2024-02-15T22:55:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.766+0000 7f6db0093640 1 -- 172.21.15.52:0/211981155 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da81247b0 con 0x7f6da81278e0 2024-02-15T22:55:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.766+0000 7fc23ddd6640 1 -- 172.21.15.52:0/2207022270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2381244a0 con 0x7fc238095020 2024-02-15T22:55:58.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.766+0000 7f6db0093640 1 -- 172.21.15.52:0/211981155 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da812afa0 con 0x7f6da81278e0 2024-02-15T22:55:58.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.766+0000 7f7412d9d640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f741412a3e0 0x7f7414089ff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f740400c700 tx=0x7f740400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.766+0000 7f3d527fc640 1 -- 172.21.15.52:0/1548019538 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d58005c10 con 0x7f3d5c097f00 2024-02-15T22:55:58.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.766+0000 7f73fb7fe640 1 -- 172.21.15.52:0/1042572053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74040051a0 con 0x7f741412a3e0 2024-02-15T22:55:58.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.766+0000 7f3d527fc640 1 -- 172.21.15.52:0/1548019538 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d58005d70 con 0x7f3d5c097f00 2024-02-15T22:55:58.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f6db0093640 1 -- 172.21.15.52:0/211981155 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6da8125580 con 0x7f6da81278e0 2024-02-15T22:55:58.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f73fb7fe640 1 -- 172.21.15.52:0/1042572053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7404005300 con 0x7f741412a3e0 2024-02-15T22:55:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.766+0000 7f3d527fc640 1 -- 172.21.15.52:0/1548019538 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d58005c10 con 0x7f3d5c097f00 2024-02-15T22:55:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.766+0000 7f3d63eaf640 1 -- 172.21.15.52:0/1548019538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c130e00 con 0x7f3d5c097f00 2024-02-15T22:55:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f3d63eaf640 1 -- 172.21.15.52:0/1548019538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c12fe20 con 0x7f3d5c097f00 2024-02-15T22:55:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f73fb7fe640 1 -- 172.21.15.52:0/1042572053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f740400a660 con 0x7f741412a3e0 2024-02-15T22:55:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f741924a640 1 -- 172.21.15.52:0/1042572053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741408c410 con 0x7f741412a3e0 2024-02-15T22:55:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f6d9e7fc640 1 -- 172.21.15.52:0/211981155 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6da40071a0 con 0x7f6da81278e0 2024-02-15T22:55:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f6d9e7fc640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6d8c037f40 0x7f6d8c03a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f6d9e7fc640 1 -- 172.21.15.52:0/211981155 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6da4049d70 con 0x7f6da81278e0 2024-02-15T22:55:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f3d527fc640 1 -- 172.21.15.52:0/1548019538 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3d58007070 con 0x7f3d5c097f00 2024-02-15T22:55:58.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f6d9e7fc640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f6d8c03d6c0 0x7f6d8c03fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f6d9e7fc640 1 -- 172.21.15.52:0/211981155 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d8c0401d0 con 0x7f6d8c03d6c0 2024-02-15T22:55:58.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f741924a640 1 -- 172.21.15.52:0/1042572053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741408d040 con 0x7f741412a3e0 2024-02-15T22:55:58.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f3d527fc640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d40037f40 0x7f3d4003a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7fc21ffff640 1 -- 172.21.15.52:0/2207022270 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc22804d3f0 con 0x7fc238095020 2024-02-15T22:55:58.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7fc23ddd6640 1 -- 172.21.15.52:0/2207022270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc23806c250 con 0x7fc238095020 2024-02-15T22:55:58.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.767+0000 7f6d9e7fc640 1 -- 172.21.15.52:0/211981155 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6da40035f0 con 0x7f6da81278e0 2024-02-15T22:55:58.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7fc21ffff640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc224037f40 0x7fc22403a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f3d6144a640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d40037f40 0x7f3d4003a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f3d63eaf640 1 -- 172.21.15.52:0/1548019538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d5c09a9f0 con 0x7f3d5c097f00 2024-02-15T22:55:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f6dae630640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f6d8c03d6c0 0x7f6d8c03fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f6dad62e640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6d8c037f40 0x7f6d8c03a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7fc21ffff640 1 -- 172.21.15.52:0/2207022270 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fc22806c8d0 con 0x7fc238095020 2024-02-15T22:55:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7fc21ffff640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fc22403d6c0 0x7fc22403fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7fc21ffff640 1 -- 172.21.15.52:0/2207022270 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2240401d0 con 0x7fc22403d6c0 2024-02-15T22:55:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7fc21ffff640 1 -- 172.21.15.52:0/2207022270 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc22804d6a0 con 0x7fc238095020 2024-02-15T22:55:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7fc236ffd640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc224037f40 0x7fc22403a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f3d527fc640 1 -- 172.21.15.52:0/1548019538 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f3d58048870 con 0x7f3d5c097f00 2024-02-15T22:55:58.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f3d527fc640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f3d4003d6c0 0x7f3d4003fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f3d527fc640 1 -- 172.21.15.52:0/1548019538 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d400401d0 con 0x7f3d4003d6c0 2024-02-15T22:55:58.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f741924a640 1 -- 172.21.15.52:0/1042572053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f741412b2d0 con 0x7f741412a3e0 2024-02-15T22:55:58.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7fc237fff640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fc22403d6c0 0x7fc22403fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f3d6244c640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f3d4003d6c0 0x7f3d4003fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f3d527fc640 1 -- 172.21.15.52:0/1548019538 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d58005c10 con 0x7f3d5c097f00 2024-02-15T22:55:58.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f3d6144a640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d40037f40 0x7f3d4003a400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c036000 tx=0x7f3d4c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.768+0000 7f6dae630640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f6d8c03d6c0 0x7f6d8c03fb00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f6dad62e640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6d8c037f40 0x7f6d8c03a400 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6d98036000 tx=0x7f6d98008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f73fb7fe640 1 -- 172.21.15.52:0/1042572053 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f740400a7c0 con 0x7f741412a3e0 2024-02-15T22:55:58.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7fc236ffd640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc224037f40 0x7fc22403a400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc22c007fd0 tx=0x7fc22c007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f3d6244c640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f3d4003d6c0 0x7f3d4003fb00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7fc237fff640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fc22403d6c0 0x7fc22403fb00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f73fb7fe640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7400037ef0 0x7f740003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f73fb7fe640 1 -- 172.21.15.52:0/1042572053 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f740404a6d0 con 0x7f741412a3e0 2024-02-15T22:55:58.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f73fb7fe640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f740003d670 0x7f740003fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f741259c640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7400037ef0 0x7f740003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f73fb7fe640 1 -- 172.21.15.52:0/1042572053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7400040180 con 0x7f740003d670 2024-02-15T22:55:58.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f73fb7fe640 1 -- 172.21.15.52:0/1042572053 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f740404aad0 con 0x7f741412a3e0 2024-02-15T22:55:58.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f741359e640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f740003d670 0x7f740003fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f3d527fc640 1 -- 172.21.15.52:0/1548019538 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3d400401d0 con 0x7f3d4003d6c0 2024-02-15T22:55:58.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.769+0000 7f6d9e7fc640 1 -- 172.21.15.52:0/211981155 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6d8c0401d0 con 0x7f6d8c03d6c0 2024-02-15T22:55:58.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.770+0000 7f741259c640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7400037ef0 0x7f740003a3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7408039000 tx=0x7f7408034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.770+0000 7fc21ffff640 1 -- 172.21.15.52:0/2207022270 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc2240401d0 con 0x7fc22403d6c0 2024-02-15T22:55:58.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.770+0000 7f741359e640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f740003d670 0x7f740003fab0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.771+0000 7f73fb7fe640 1 -- 172.21.15.52:0/1042572053 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7400040180 con 0x7f740003d670 2024-02-15T22:55:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.784+0000 7f3d63eaf640 1 -- 172.21.15.52:0/1548019538 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d5c098c40 con 0x7f3d4003d6c0 2024-02-15T22:55:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.784+0000 7f6db0093640 1 -- 172.21.15.52:0/211981155 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6da8127490 con 0x7f6d8c03d6c0 2024-02-15T22:55:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.784+0000 7f3d527fc640 1 -- 172.21.15.52:0/1548019538 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d5c098c40 con 0x7f3d4003d6c0 2024-02-15T22:55:58.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.784+0000 7f6d9e7fc640 1 -- 172.21.15.52:0/211981155 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6da0011040 con 0x7f6d8c03d6c0 2024-02-15T22:55:58.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.784+0000 7f3d63eaf640 1 -- 172.21.15.52:0/1548019538 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f3d4003d6c0 msgr2=0x7f3d4003fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.784+0000 7f3d63eaf640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f3d4003d6c0 0x7f3d4003fb00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 -- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f6d8c03d6c0 msgr2=0x7f6d8c03fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f6d8c03d6c0 0x7f6d8c03fb00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f3d63eaf640 1 -- 172.21.15.52:0/1548019538 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d40037f40 msgr2=0x7f3d4003a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f3d63eaf640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d40037f40 0x7f3d4003a400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c036000 tx=0x7f3d4c008030 comp rx=0 tx=0).stop 2024-02-15T22:55:58.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f3d63eaf640 1 -- 172.21.15.52:0/1548019538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d5c097f00 msgr2=0x7f3d5c127780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f3d63eaf640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d5c097f00 0x7f3d5c127780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c4a0 tx=0x7f3d5800c960 comp rx=0 tx=0).stop 2024-02-15T22:55:58.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 -- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6d8c037f40 msgr2=0x7f6d8c03a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6d8c037f40 0x7f6d8c03a400 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6d98036000 tx=0x7f6d98008030 comp rx=0 tx=0).stop 2024-02-15T22:55:58.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 -- 172.21.15.52:0/211981155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81278e0 msgr2=0x7f6da8092070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81278e0 0x7f6da8092070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6da400c380 tx=0x7f6da400c840 comp rx=0 tx=0).stop 2024-02-15T22:55:58.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 -- 172.21.15.52:0/211981155 shutdown_connections 2024-02-15T22:55:58.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f3d63eaf640 1 -- 172.21.15.52:0/1548019538 shutdown_connections 2024-02-15T22:55:58.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f3d63eaf640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f3d4003d6c0 0x7f3d4003fb00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f3d63eaf640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d40037f40 0x7f3d4003a400 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f3d63eaf640 1 --2- 172.21.15.52:0/1548019538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d5c097f00 0x7f3d5c127780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f3d63eaf640 1 -- 172.21.15.52:0/1548019538 >> 172.21.15.52:0/1548019538 conn(0x7f3d5c09e640 msgr2=0x7f3d5c096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f6d8c03d6c0 0x7f6d8c03fb00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f3d63eaf640 1 -- 172.21.15.52:0/1548019538 shutdown_connections 2024-02-15T22:55:58.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6d8c037f40 0x7f6d8c03a400 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f3d63eaf640 1 -- 172.21.15.52:0/1548019538 wait complete. 2024-02-15T22:55:58.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 --2- 172.21.15.52:0/211981155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81278e0 0x7f6da8092070 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 -- 172.21.15.52:0/211981155 >> 172.21.15.52:0/211981155 conn(0x7f6da809a050 msgr2=0x7f6da812d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 -- 172.21.15.52:0/211981155 shutdown_connections 2024-02-15T22:55:58.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.785+0000 7f6db0093640 1 -- 172.21.15.52:0/211981155 wait complete. 2024-02-15T22:55:58.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.792+0000 7fc23ddd6640 1 -- 172.21.15.52:0/2207022270 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc238123a10 con 0x7fc22403d6c0 2024-02-15T22:55:58.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.792+0000 7f741924a640 1 -- 172.21.15.52:0/1042572053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f741412b2d0 con 0x7f740003d670 2024-02-15T22:55:58.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.793+0000 7fc21ffff640 1 -- 172.21.15.52:0/2207022270 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc238123a10 con 0x7fc22403d6c0 2024-02-15T22:55:58.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.793+0000 7f73fb7fe640 1 -- 172.21.15.52:0/1042572053 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f740c011040 con 0x7f740003d670 2024-02-15T22:55:58.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.793+0000 7fc23ddd6640 1 -- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fc22403d6c0 msgr2=0x7fc22403fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.793+0000 7fc23ddd6640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fc22403d6c0 0x7fc22403fb00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.793+0000 7f741924a640 1 -- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f740003d670 msgr2=0x7f740003fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.793+0000 7f741924a640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f740003d670 0x7f740003fab0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.793+0000 7fc23ddd6640 1 -- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc224037f40 msgr2=0x7fc22403a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.793+0000 7fc23ddd6640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc224037f40 0x7fc22403a400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc22c007fd0 tx=0x7fc22c007ac0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.793+0000 7fc23ddd6640 1 -- 172.21.15.52:0/2207022270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc238095020 msgr2=0x7fc238121760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.793+0000 7fc23ddd6640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc238095020 0x7fc238121760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc228000c00 tx=0x7fc2280046c0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7f741924a640 1 -- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7400037ef0 msgr2=0x7f740003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7f741924a640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7400037ef0 0x7f740003a3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7408039000 tx=0x7f7408034000 comp rx=0 tx=0).stop 2024-02-15T22:55:58.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7f741924a640 1 -- 172.21.15.52:0/1042572053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f741412a3e0 msgr2=0x7f7414089ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7f741924a640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f741412a3e0 0x7f7414089ff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f740400c700 tx=0x7f740400cbc0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7fc23ddd6640 1 -- 172.21.15.52:0/2207022270 shutdown_connections 2024-02-15T22:55:58.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7fc23ddd6640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fc22403d6c0 0x7fc22403fb00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7fc23ddd6640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc224037f40 0x7fc22403a400 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7fc23ddd6640 1 --2- 172.21.15.52:0/2207022270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc238095020 0x7fc238121760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7fc23ddd6640 1 -- 172.21.15.52:0/2207022270 >> 172.21.15.52:0/2207022270 conn(0x7fc23809a050 msgr2=0x7fc238125150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7f741924a640 1 -- 172.21.15.52:0/1042572053 shutdown_connections 2024-02-15T22:55:58.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7f741924a640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f740003d670 0x7f740003fab0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7f741924a640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7400037ef0 0x7f740003a3b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7f741924a640 1 --2- 172.21.15.52:0/1042572053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f741412a3e0 0x7f7414089ff0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7f741924a640 1 -- 172.21.15.52:0/1042572053 >> 172.21.15.52:0/1042572053 conn(0x7f741409ccf0 msgr2=0x7f74140972d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7f741924a640 1 -- 172.21.15.52:0/1042572053 shutdown_connections 2024-02-15T22:55:58.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7f741924a640 1 -- 172.21.15.52:0/1042572053 wait complete. 2024-02-15T22:55:58.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7fc23ddd6640 1 -- 172.21.15.52:0/2207022270 shutdown_connections 2024-02-15T22:55:58.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.794+0000 7fc23ddd6640 1 -- 172.21.15.52:0/2207022270 wait complete. 2024-02-15T22:55:58.817 INFO:teuthology.orchestra.run.smithi052.stdout:38654705668 2024-02-15T22:55:58.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-15T22:55:58.818 INFO:teuthology.orchestra.run.smithi052.stdout:42949672966 2024-02-15T22:55:58.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-15T22:55:58.819 INFO:teuthology.orchestra.run.smithi052.stdout:42949672965 2024-02-15T22:55:58.819 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-15T22:55:58.820 INFO:teuthology.orchestra.run.smithi052.stdout:42949672965 2024-02-15T22:55:58.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-15T22:55:58.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.961+0000 7f987f833640 1 Processor -- start 2024-02-15T22:55:58.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.961+0000 7fe1aa17b640 1 Processor -- start 2024-02-15T22:55:58.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.961+0000 7fb58508d640 1 Processor -- start 2024-02-15T22:55:58.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.961+0000 7efc272ae640 1 Processor -- start 2024-02-15T22:55:58.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.961+0000 7fe1aa17b640 1 -- start start 2024-02-15T22:55:58.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.961+0000 7fb58508d640 1 -- start start 2024-02-15T22:55:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.961+0000 7efc272ae640 1 -- start start 2024-02-15T22:55:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.961+0000 7f987f833640 1 -- start start 2024-02-15T22:55:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fe1aa17b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe1a4097f00 0x7fe1a40982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fe1aa17b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a406bdf0 con 0x7fe1a4098820 2024-02-15T22:55:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fe1aa17b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a40672c0 con 0x7fe1a4097f00 2024-02-15T22:55:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7efc272ae640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc2012dc20 0x7efc20130010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7f987f833640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f98780989f0 0x7f98781331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7f987f833640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987806bdf0 con 0x7f9878097f00 2024-02-15T22:55:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7f987f833640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98780672c0 con 0x7f98780989f0 2024-02-15T22:55:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fb58508d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb580098a60 0x7fb580098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fe1a2ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe1a4098820 0x7fe1a412deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54576/0 (socket says 172.21.15.52:54576) 2024-02-15T22:55:58.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fb58508d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb580099da0 con 0x7fb580099380 2024-02-15T22:55:58.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7efc272ae640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2012a910 con 0x7efc2012acd0 2024-02-15T22:55:58.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7efc272ae640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2009aab0 con 0x7efc2012dc20 2024-02-15T22:55:58.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fb58508d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58009a550 con 0x7fb580098a60 2024-02-15T22:55:58.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fb57ed9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb580098a60 0x7fb580098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fe1a2ffd640 1 -- 172.21.15.52:0/636832226 learned_addr learned my addr 172.21.15.52:0/636832226 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:58.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fe1a37fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe1a4097f00 0x7fe1a40982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fb57ed9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb580098a60 0x7fb580098e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56100/0 (socket says 172.21.15.52:56100) 2024-02-15T22:55:58.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7efc2504a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efc2012acd0 0x7efc2012b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54592/0 (socket says 172.21.15.52:54592) 2024-02-15T22:55:58.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7efc2504a640 1 -- 172.21.15.52:0/1304443874 learned_addr learned my addr 172.21.15.52:0/1304443874 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:58.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fb57ed9d640 1 -- 172.21.15.52:0/745060159 learned_addr learned my addr 172.21.15.52:0/745060159 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7efc24849640 1 --2- 172.21.15.52:0/1304443874 >> v2:172.21.15.52:3300/0 conn(0x7efc2012dc20 0x7efc20130010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7f987cdce640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f98780989f0 0x7f98781331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7fe1a37fe640 1 -- 172.21.15.52:0/636832226 >> v1:172.21.15.52:6789/0 conn(0x7fe1a4098820 legacy=0x7fe1a412deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7fe1a37fe640 1 -- 172.21.15.52:0/636832226 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a409a5c0 con 0x7fe1a4097f00 2024-02-15T22:55:58.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.962+0000 7f987d5cf640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9878097f00 0x7f98780982e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54598/0 (socket says 172.21.15.52:54598) 2024-02-15T22:55:58.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7f987d5cf640 1 -- 172.21.15.52:0/4049159247 learned_addr learned my addr 172.21.15.52:0/4049159247 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:55:58.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7fb57ed9d640 1 -- 172.21.15.52:0/745060159 >> v1:172.21.15.52:6789/0 conn(0x7fb580099380 legacy=0x7fb58012bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-15T22:55:58.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7fb57ed9d640 1 -- 172.21.15.52:0/745060159 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58009ab10 con 0x7fb580098a60 2024-02-15T22:55:58.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7efc17fff640 1 -- 172.21.15.52:0/1304443874 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687780035 0 0) 0x7efc2012a910 con 0x7efc2012acd0 2024-02-15T22:55:58.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7efc17fff640 1 -- 172.21.15.52:0/1304443874 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc0c003520 con 0x7efc2012acd0 2024-02-15T22:55:58.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7efc24849640 1 -- 172.21.15.52:0/1304443874 >> v1:172.21.15.52:6789/0 conn(0x7efc2012acd0 legacy=0x7efc2012b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7efc24849640 1 -- 172.21.15.52:0/1304443874 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2009a5e0 con 0x7efc2012dc20 2024-02-15T22:55:58.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7f986ffff640 1 -- 172.21.15.52:0/4049159247 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141459561 0 0) 0x7f987806bdf0 con 0x7f9878097f00 2024-02-15T22:55:58.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7f986ffff640 1 -- 172.21.15.52:0/4049159247 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9864003520 con 0x7f9878097f00 2024-02-15T22:55:58.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7f987cdce640 1 -- 172.21.15.52:0/4049159247 >> v1:172.21.15.52:6789/0 conn(0x7f9878097f00 legacy=0x7f98780982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7f987cdce640 1 -- 172.21.15.52:0/4049159247 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987809a5c0 con 0x7f98780989f0 2024-02-15T22:55:58.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.963+0000 7fe1a37fe640 1 --2- 172.21.15.52:0/636832226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4097f00 0x7fe1a40982e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe194009720 tx=0x7fe19402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea131b457081cbf server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7fe1a27fc640 1 -- 172.21.15.52:0/636832226 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe19402e070 con 0x7fe1a4097f00 2024-02-15T22:55:58.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7fb57ed9d640 1 --2- 172.21.15.52:0/745060159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb580098a60 0x7fb580098e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb5700097f0 tx=0x7fb57002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a419f5b8bbe23b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7fe1a27fc640 1 -- 172.21.15.52:0/636832226 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1940316d0 con 0x7fe1a4097f00 2024-02-15T22:55:58.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7fe1a27fc640 1 -- 172.21.15.52:0/636832226 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe194031990 con 0x7fe1a4097f00 2024-02-15T22:55:58.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7efc24849640 1 --2- 172.21.15.52:0/1304443874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2012dc20 0x7efc20130010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efc10009720 tx=0x7efc1002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1650e15dda9c73 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7fb57e59c640 1 -- 172.21.15.52:0/745060159 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5700315e0 con 0x7fb580098a60 2024-02-15T22:55:58.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7efc17fff640 1 -- 172.21.15.52:0/1304443874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc1002e070 con 0x7efc2012dc20 2024-02-15T22:55:58.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7fb57e59c640 1 -- 172.21.15.52:0/745060159 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb570031740 con 0x7fb580098a60 2024-02-15T22:55:58.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7fb57e59c640 1 -- 172.21.15.52:0/745060159 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb570031a00 con 0x7fb580098a60 2024-02-15T22:55:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7efc17fff640 1 -- 172.21.15.52:0/1304443874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc100316d0 con 0x7efc2012dc20 2024-02-15T22:55:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7efc17fff640 1 -- 172.21.15.52:0/1304443874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc10031970 con 0x7efc2012dc20 2024-02-15T22:55:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7f987cdce640 1 --2- 172.21.15.52:0/4049159247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98780989f0 0x7f98781331d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9868009720 tx=0x7f986802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e88c0e7ee4306e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7f986ffff640 1 -- 172.21.15.52:0/4049159247 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9868031760 con 0x7f98780989f0 2024-02-15T22:55:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7f986ffff640 1 -- 172.21.15.52:0/4049159247 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98680318c0 con 0x7f98780989f0 2024-02-15T22:55:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.964+0000 7f986ffff640 1 -- 172.21.15.52:0/4049159247 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9868031b60 con 0x7f98780989f0 2024-02-15T22:55:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fe1aa17b640 1 -- 172.21.15.52:0/636832226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4097f00 msgr2=0x7fe1a40982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fe1aa17b640 1 --2- 172.21.15.52:0/636832226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4097f00 0x7fe1a40982e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe194009720 tx=0x7fe19402b840 comp rx=0 tx=0).stop 2024-02-15T22:55:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fe1aa17b640 1 -- 172.21.15.52:0/636832226 shutdown_connections 2024-02-15T22:55:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fe1aa17b640 1 --2- 172.21.15.52:0/636832226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4097f00 0x7fe1a40982e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fe1aa17b640 1 -- 172.21.15.52:0/636832226 >> 172.21.15.52:0/636832226 conn(0x7fe1a409e640 msgr2=0x7fe1a409ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fe1aa17b640 1 -- 172.21.15.52:0/636832226 shutdown_connections 2024-02-15T22:55:58.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fb58508d640 1 -- 172.21.15.52:0/745060159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb580098a60 msgr2=0x7fb580098e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fb58508d640 1 --2- 172.21.15.52:0/745060159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb580098a60 0x7fb580098e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb5700097f0 tx=0x7fb57002b880 comp rx=0 tx=0).stop 2024-02-15T22:55:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fe1aa17b640 1 -- 172.21.15.52:0/636832226 wait complete. 2024-02-15T22:55:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7efc272ae640 1 -- 172.21.15.52:0/1304443874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2012dc20 msgr2=0x7efc20130010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7efc272ae640 1 --2- 172.21.15.52:0/1304443874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2012dc20 0x7efc20130010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efc10009720 tx=0x7efc1002b840 comp rx=0 tx=0).stop 2024-02-15T22:55:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fb58508d640 1 -- 172.21.15.52:0/745060159 shutdown_connections 2024-02-15T22:55:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fb58508d640 1 --2- 172.21.15.52:0/745060159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb580098a60 0x7fb580098e40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fb58508d640 1 -- 172.21.15.52:0/745060159 >> 172.21.15.52:0/745060159 conn(0x7fb58009d350 msgr2=0x7fb580071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7efc272ae640 1 -- 172.21.15.52:0/1304443874 shutdown_connections 2024-02-15T22:55:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7efc272ae640 1 --2- 172.21.15.52:0/1304443874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2012dc20 0x7efc20130010 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7efc272ae640 1 -- 172.21.15.52:0/1304443874 >> 172.21.15.52:0/1304443874 conn(0x7efc2009d790 msgr2=0x7efc20099c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fb58508d640 1 -- 172.21.15.52:0/745060159 shutdown_connections 2024-02-15T22:55:58.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7fb58508d640 1 -- 172.21.15.52:0/745060159 wait complete. 2024-02-15T22:55:58.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7f987f833640 1 -- 172.21.15.52:0/4049159247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98780989f0 msgr2=0x7f98781331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:58.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7f987f833640 1 --2- 172.21.15.52:0/4049159247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98780989f0 0x7f98781331d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9868009720 tx=0x7f986802b8d0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7efc272ae640 1 -- 172.21.15.52:0/1304443874 shutdown_connections 2024-02-15T22:55:58.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7f987f833640 1 -- 172.21.15.52:0/4049159247 shutdown_connections 2024-02-15T22:55:58.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7f987f833640 1 --2- 172.21.15.52:0/4049159247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98780989f0 0x7f98781331d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:58.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7f987f833640 1 -- 172.21.15.52:0/4049159247 >> 172.21.15.52:0/4049159247 conn(0x7f987809e640 msgr2=0x7f987809ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:58.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7f987f833640 1 -- 172.21.15.52:0/4049159247 shutdown_connections 2024-02-15T22:55:58.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7f987f833640 1 -- 172.21.15.52:0/4049159247 wait complete. 2024-02-15T22:55:58.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.965+0000 7efc272ae640 1 -- 172.21.15.52:0/1304443874 wait complete. 2024-02-15T22:55:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.966+0000 7fe1aa17b640 1 Processor -- start 2024-02-15T22:55:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.966+0000 7fe1aa17b640 1 -- start start 2024-02-15T22:55:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.966+0000 7fb58508d640 1 Processor -- start 2024-02-15T22:55:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.966+0000 7f987f833640 1 Processor -- start 2024-02-15T22:55:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.966+0000 7f987f833640 1 -- start start 2024-02-15T22:55:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.966+0000 7efc272ae640 1 Processor -- start 2024-02-15T22:55:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.966+0000 7efc272ae640 1 -- start start 2024-02-15T22:55:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.966+0000 7fb58508d640 1 -- start start 2024-02-15T22:55:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7f987f833640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9878097f00 0x7f987812ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7f987f833640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9878130dd0 con 0x7f9878097f00 2024-02-15T22:55:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7fe1aa17b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4097f00 0x7fe1a408e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7fe1aa17b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4090cc0 con 0x7fe1a4097f00 2024-02-15T22:55:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7fb58508d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb580098a60 0x7fb58019f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7efc272ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2012acd0 0x7efc20131e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7efc272ae640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc200927d0 con 0x7efc2012acd0 2024-02-15T22:55:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7f987d5cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9878097f00 0x7f987812ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7f987d5cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9878097f00 0x7f987812ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56114/0 (socket says 172.21.15.52:56114) 2024-02-15T22:55:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7f987d5cf640 1 -- 172.21.15.52:0/914853464 learned_addr learned my addr 172.21.15.52:0/914853464 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7fe1a37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4097f00 0x7fe1a408e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7fe1a37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4097f00 0x7fe1a408e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56124/0 (socket says 172.21.15.52:56124) 2024-02-15T22:55:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7fe1a37fe640 1 -- 172.21.15.52:0/1669192412 learned_addr learned my addr 172.21.15.52:0/1669192412 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7fb58508d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5801a2930 con 0x7fb580098a60 2024-02-15T22:55:58.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7efc2504a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2012acd0 0x7efc20131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7efc2504a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2012acd0 0x7efc20131e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56140/0 (socket says 172.21.15.52:56140) 2024-02-15T22:55:58.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7efc2504a640 1 -- 172.21.15.52:0/3027672937 learned_addr learned my addr 172.21.15.52:0/3027672937 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7fb57ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb580098a60 0x7fb58019f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7fb57ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb580098a60 0x7fb58019f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56132/0 (socket says 172.21.15.52:56132) 2024-02-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7fb57ed9d640 1 -- 172.21.15.52:0/2049969246 learned_addr learned my addr 172.21.15.52:0/2049969246 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7fe1a37fe640 1 -- 172.21.15.52:0/1669192412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe194009400 con 0x7fe1a4097f00 2024-02-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.967+0000 7efc2504a640 1 -- 172.21.15.52:0/3027672937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc10009400 con 0x7efc2012acd0 2024-02-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7f987d5cf640 1 -- 172.21.15.52:0/914853464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9868009400 con 0x7f9878097f00 2024-02-15T22:55:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7fe1a37fe640 1 --2- 172.21.15.52:0/1669192412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4097f00 0x7fe1a408e400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe194034040 tx=0x7fe1940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7efc2504a640 1 --2- 172.21.15.52:0/3027672937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2012acd0 0x7efc20131e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00c3b0 tx=0x7efc1c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7fb57ed9d640 1 -- 172.21.15.52:0/2049969246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700094d0 con 0x7fb580098a60 2024-02-15T22:55:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7f987d5cf640 1 --2- 172.21.15.52:0/914853464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9878097f00 0x7f987812ef80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f987400c3b0 tx=0x7f987400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7fe18bfff640 1 -- 172.21.15.52:0/1669192412 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe194032a10 con 0x7fe1a4097f00 2024-02-15T22:55:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7fb57ed9d640 1 --2- 172.21.15.52:0/2049969246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb580098a60 0x7fb58019f170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb5700090b0 tx=0x7fb5700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7fe1aa17b640 1 -- 172.21.15.52:0/1669192412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a4099a10 con 0x7fe1a4097f00 2024-02-15T22:55:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7fe1aa17b640 1 -- 172.21.15.52:0/1669192412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a408fad0 con 0x7fe1a4097f00 2024-02-15T22:55:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7efc15ffb640 1 -- 172.21.15.52:0/3027672937 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc1c005c10 con 0x7efc2012acd0 2024-02-15T22:55:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7fe18bfff640 1 -- 172.21.15.52:0/1669192412 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe194032b70 con 0x7fe1a4097f00 2024-02-15T22:55:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7fe18bfff640 1 -- 172.21.15.52:0/1669192412 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe194032a10 con 0x7fe1a4097f00 2024-02-15T22:55:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7efc15ffb640 1 -- 172.21.15.52:0/3027672937 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c005d70 con 0x7efc2012acd0 2024-02-15T22:55:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7efc272ae640 1 -- 172.21.15.52:0/3027672937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc20092c60 con 0x7efc2012acd0 2024-02-15T22:55:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7efc15ffb640 1 -- 172.21.15.52:0/3027672937 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc1c007220 con 0x7efc2012acd0 2024-02-15T22:55:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7efc272ae640 1 -- 172.21.15.52:0/3027672937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc201302b0 con 0x7efc2012acd0 2024-02-15T22:55:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7f986dffb640 1 -- 172.21.15.52:0/914853464 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9874005c10 con 0x7f9878097f00 2024-02-15T22:55:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7fb577fff640 1 -- 172.21.15.52:0/2049969246 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb570032b00 con 0x7fb580098a60 2024-02-15T22:55:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7f986dffb640 1 -- 172.21.15.52:0/914853464 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9874005d70 con 0x7f9878097f00 2024-02-15T22:55:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.968+0000 7f986dffb640 1 -- 172.21.15.52:0/914853464 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9874007220 con 0x7f9878097f00 2024-02-15T22:55:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.969+0000 7fb58508d640 1 -- 172.21.15.52:0/2049969246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5801a10f0 con 0x7fb580098a60 2024-02-15T22:55:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.969+0000 7fb58508d640 1 -- 172.21.15.52:0/2049969246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5801a1d80 con 0x7fb580098a60 2024-02-15T22:55:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.969+0000 7fb577fff640 1 -- 172.21.15.52:0/2049969246 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb570032c60 con 0x7fb580098a60 2024-02-15T22:55:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.969+0000 7f987f833640 1 -- 172.21.15.52:0/914853464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9878127860 con 0x7f9878097f00 2024-02-15T22:55:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.969+0000 7f987f833640 1 -- 172.21.15.52:0/914853464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98781310e0 con 0x7f9878097f00 2024-02-15T22:55:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.969+0000 7fb577fff640 1 -- 172.21.15.52:0/2049969246 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5700453f0 con 0x7fb580098a60 2024-02-15T22:55:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.970+0000 7fe1aa17b640 1 -- 172.21.15.52:0/1669192412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe184005080 con 0x7fe1a4097f00 2024-02-15T22:55:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.970+0000 7f986dffb640 1 -- 172.21.15.52:0/914853464 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9874007380 con 0x7f9878097f00 2024-02-15T22:55:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.970+0000 7efc272ae640 1 -- 172.21.15.52:0/3027672937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc200627b0 con 0x7efc2012acd0 2024-02-15T22:55:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.970+0000 7fb58508d640 1 -- 172.21.15.52:0/2049969246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb564005080 con 0x7fb580098a60 2024-02-15T22:55:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.970+0000 7f987f833640 1 -- 172.21.15.52:0/914853464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9878130490 con 0x7f9878097f00 2024-02-15T22:55:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.970+0000 7efc15ffb640 1 -- 172.21.15.52:0/3027672937 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7efc1c007380 con 0x7efc2012acd0 2024-02-15T22:55:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.970+0000 7fe18bfff640 1 -- 172.21.15.52:0/1669192412 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe194032ce0 con 0x7fe1a4097f00 2024-02-15T22:55:58.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.970+0000 7f986dffb640 1 --2- 172.21.15.52:0/914853464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f985c037f40 0x7f985c03a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.970+0000 7f986dffb640 1 -- 172.21.15.52:0/914853464 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f9874049f90 con 0x7f9878097f00 2024-02-15T22:55:58.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.970+0000 7efc15ffb640 1 --2- 172.21.15.52:0/3027672937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7efc04037ef0 0x7efc0403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7fb577fff640 1 -- 172.21.15.52:0/2049969246 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb570045550 con 0x7fb580098a60 2024-02-15T22:55:58.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7fe18bfff640 1 --2- 172.21.15.52:0/1669192412 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe190037f80 0x7fe19003a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7efc15ffb640 1 -- 172.21.15.52:0/3027672937 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7efc1c049fe0 con 0x7efc2012acd0 2024-02-15T22:55:58.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7fe18bfff640 1 -- 172.21.15.52:0/1669192412 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fe19406cae0 con 0x7fe1a4097f00 2024-02-15T22:55:58.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7f987cdce640 1 --2- 172.21.15.52:0/914853464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f985c037f40 0x7f985c03a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7fe1a2ffd640 1 --2- 172.21.15.52:0/1669192412 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe190037f80 0x7fe19003a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7fb577fff640 1 --2- 172.21.15.52:0/2049969246 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb560037f40 0x7fb56003a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:58.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7efc24849640 1 --2- 172.21.15.52:0/3027672937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7efc04037ef0 0x7efc0403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7fb577fff640 1 -- 172.21.15.52:0/2049969246 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fb57006ccc0 con 0x7fb580098a60 2024-02-15T22:55:58.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7fb57659c640 1 --2- 172.21.15.52:0/2049969246 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb560037f40 0x7fb56003a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:58.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7f987cdce640 1 --2- 172.21.15.52:0/914853464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f985c037f40 0x7f985c03a400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9868036000 tx=0x7f9868008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7fe1a2ffd640 1 --2- 172.21.15.52:0/1669192412 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe190037f80 0x7fe19003a440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe198000f60 tx=0x7fe198007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.971+0000 7efc24849640 1 --2- 172.21.15.52:0/3027672937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7efc04037ef0 0x7efc0403a3b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc10036000 tx=0x7efc10008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.972+0000 7fb57659c640 1 --2- 172.21.15.52:0/2049969246 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb560037f40 0x7fb56003a400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb568003cd0 tx=0x7fb568007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:58.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.976+0000 7fe18bfff640 1 -- 172.21.15.52:0/1669192412 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe19404c940 con 0x7fe1a4097f00 2024-02-15T22:55:58.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.984+0000 7efc15ffb640 1 -- 172.21.15.52:0/3027672937 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc1c019be0 con 0x7efc2012acd0 2024-02-15T22:55:58.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:58.993+0000 7fb577fff640 1 -- 172.21.15.52:0/2049969246 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb570030920 con 0x7fb580098a60 2024-02-15T22:55:59.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.002+0000 7f986dffb640 1 -- 172.21.15.52:0/914853464 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9874019be0 con 0x7f9878097f00 2024-02-15T22:55:59.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.169+0000 7fe1aa17b640 1 -- 172.21.15.52:0/1669192412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe184005330 con 0x7fe1a4097f00 2024-02-15T22:55:59.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.169+0000 7fe18bfff640 1 -- 172.21.15.52:0/1669192412 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe19404c350 con 0x7fe1a4097f00 2024-02-15T22:55:59.172 INFO:teuthology.orchestra.run.smithi052.stdout:42949672964 2024-02-15T22:55:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.171+0000 7fe1aa17b640 1 -- 172.21.15.52:0/1669192412 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe190037f80 msgr2=0x7fe19003a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.171+0000 7fe1aa17b640 1 --2- 172.21.15.52:0/1669192412 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe190037f80 0x7fe19003a440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe198000f60 tx=0x7fe198007a80 comp rx=0 tx=0).stop 2024-02-15T22:55:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.171+0000 7fe1aa17b640 1 -- 172.21.15.52:0/1669192412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4097f00 msgr2=0x7fe1a408e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.171+0000 7fe1aa17b640 1 --2- 172.21.15.52:0/1669192412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4097f00 0x7fe1a408e400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe194034040 tx=0x7fe1940046c0 comp rx=0 tx=0).stop 2024-02-15T22:55:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.171+0000 7fe1aa17b640 1 -- 172.21.15.52:0/1669192412 shutdown_connections 2024-02-15T22:55:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.171+0000 7fe1aa17b640 1 --2- 172.21.15.52:0/1669192412 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe190037f80 0x7fe19003a440 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.171+0000 7fe1aa17b640 1 --2- 172.21.15.52:0/1669192412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4097f00 0x7fe1a408e400 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.171+0000 7fe1aa17b640 1 -- 172.21.15.52:0/1669192412 >> 172.21.15.52:0/1669192412 conn(0x7fe1a409e640 msgr2=0x7fe1a409b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.171+0000 7fe1aa17b640 1 -- 172.21.15.52:0/1669192412 shutdown_connections 2024-02-15T22:55:59.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.171+0000 7fe1aa17b640 1 -- 172.21.15.52:0/1669192412 wait complete. 2024-02-15T22:55:59.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.3 2024-02-15T22:55:59.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.184+0000 7f987f833640 1 -- 172.21.15.52:0/914853464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98780627b0 con 0x7f9878097f00 2024-02-15T22:55:59.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.184+0000 7f986dffb640 1 -- 172.21.15.52:0/914853464 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9874017070 con 0x7f9878097f00 2024-02-15T22:55:59.187 INFO:teuthology.orchestra.run.smithi052.stdout:42949672965 2024-02-15T22:55:59.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.186+0000 7f987f833640 1 -- 172.21.15.52:0/914853464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f985c037f40 msgr2=0x7f985c03a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.186+0000 7f987f833640 1 --2- 172.21.15.52:0/914853464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f985c037f40 0x7f985c03a400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9868036000 tx=0x7f9868008030 comp rx=0 tx=0).stop 2024-02-15T22:55:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.186+0000 7f987f833640 1 -- 172.21.15.52:0/914853464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9878097f00 msgr2=0x7f987812ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.186+0000 7f987f833640 1 --2- 172.21.15.52:0/914853464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9878097f00 0x7f987812ef80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f987400c3b0 tx=0x7f987400c870 comp rx=0 tx=0).stop 2024-02-15T22:55:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.187+0000 7f987f833640 1 -- 172.21.15.52:0/914853464 shutdown_connections 2024-02-15T22:55:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.187+0000 7f987f833640 1 --2- 172.21.15.52:0/914853464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f985c037f40 0x7f985c03a400 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.187+0000 7f987f833640 1 --2- 172.21.15.52:0/914853464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9878097f00 0x7f987812ef80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.187+0000 7f987f833640 1 -- 172.21.15.52:0/914853464 >> 172.21.15.52:0/914853464 conn(0x7f987809e640 msgr2=0x7f9878096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.187+0000 7f987f833640 1 -- 172.21.15.52:0/914853464 shutdown_connections 2024-02-15T22:55:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.187+0000 7f987f833640 1 -- 172.21.15.52:0/914853464 wait complete. 2024-02-15T22:55:59.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.194+0000 7efc272ae640 1 -- 172.21.15.52:0/3027672937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efc20073050 con 0x7efc2012acd0 2024-02-15T22:55:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.195+0000 7efc15ffb640 1 -- 172.21.15.52:0/3027672937 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc1c017070 con 0x7efc2012acd0 2024-02-15T22:55:59.197 INFO:teuthology.orchestra.run.smithi052.stdout:42949672964 2024-02-15T22:55:59.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.197+0000 7efc272ae640 1 -- 172.21.15.52:0/3027672937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7efc04037ef0 msgr2=0x7efc0403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.197+0000 7efc272ae640 1 --2- 172.21.15.52:0/3027672937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7efc04037ef0 0x7efc0403a3b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc10036000 tx=0x7efc10008030 comp rx=0 tx=0).stop 2024-02-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.197+0000 7efc272ae640 1 -- 172.21.15.52:0/3027672937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2012acd0 msgr2=0x7efc20131e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.197+0000 7efc272ae640 1 --2- 172.21.15.52:0/3027672937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2012acd0 0x7efc20131e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00c3b0 tx=0x7efc1c00c870 comp rx=0 tx=0).stop 2024-02-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.197+0000 7efc272ae640 1 -- 172.21.15.52:0/3027672937 shutdown_connections 2024-02-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.197+0000 7efc272ae640 1 --2- 172.21.15.52:0/3027672937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7efc04037ef0 0x7efc0403a3b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.197+0000 7efc272ae640 1 --2- 172.21.15.52:0/3027672937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2012acd0 0x7efc20131e50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.197+0000 7efc272ae640 1 -- 172.21.15.52:0/3027672937 >> 172.21.15.52:0/3027672937 conn(0x7efc2009d790 msgr2=0x7efc200990a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.197+0000 7efc272ae640 1 -- 172.21.15.52:0/3027672937 shutdown_connections 2024-02-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.197+0000 7efc272ae640 1 -- 172.21.15.52:0/3027672937 wait complete. 2024-02-15T22:55:59.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.2 2024-02-15T22:55:59.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.200+0000 7fb58508d640 1 -- 172.21.15.52:0/2049969246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb564005330 con 0x7fb580098a60 2024-02-15T22:55:59.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.201+0000 7fb577fff640 1 -- 172.21.15.52:0/2049969246 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5700443a0 con 0x7fb580098a60 2024-02-15T22:55:59.203 INFO:teuthology.orchestra.run.smithi052.stdout:38654705667 2024-02-15T22:55:59.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.203+0000 7fb58508d640 1 -- 172.21.15.52:0/2049969246 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb560037f40 msgr2=0x7fb56003a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:59.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.203+0000 7fb58508d640 1 --2- 172.21.15.52:0/2049969246 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb560037f40 0x7fb56003a400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb568003cd0 tx=0x7fb568007a30 comp rx=0 tx=0).stop 2024-02-15T22:55:59.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.203+0000 7fb58508d640 1 -- 172.21.15.52:0/2049969246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb580098a60 msgr2=0x7fb58019f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:59.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.203+0000 7fb58508d640 1 --2- 172.21.15.52:0/2049969246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb580098a60 0x7fb58019f170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb5700090b0 tx=0x7fb5700046c0 comp rx=0 tx=0).stop 2024-02-15T22:55:59.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.203+0000 7fb58508d640 1 -- 172.21.15.52:0/2049969246 shutdown_connections 2024-02-15T22:55:59.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.203+0000 7fb58508d640 1 --2- 172.21.15.52:0/2049969246 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb560037f40 0x7fb56003a400 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:59.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.203+0000 7fb58508d640 1 --2- 172.21.15.52:0/2049969246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb580098a60 0x7fb58019f170 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:59.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.203+0000 7fb58508d640 1 -- 172.21.15.52:0/2049969246 >> 172.21.15.52:0/2049969246 conn(0x7fb58009d350 msgr2=0x7fb5800701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:59.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.203+0000 7fb58508d640 1 -- 172.21.15.52:0/2049969246 shutdown_connections 2024-02-15T22:55:59.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:55:59.203+0000 7fb58508d640 1 -- 172.21.15.52:0/2049969246 wait complete. 2024-02-15T22:55:59.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-02-15T22:55:59.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-02-15T22:56:00.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-15T22:56:00.202 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-15T22:56:00.211 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-15T22:56:00.220 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-15T22:56:00.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.301+0000 7f45a784a640 1 Processor -- start 2024-02-15T22:56:00.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.301+0000 7f45a784a640 1 -- start start 2024-02-15T22:56:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.301+0000 7f45a784a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f45a0098a60 0x7f45a0098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.301+0000 7f45a784a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a0099cc0 con 0x7f45a0099380 2024-02-15T22:56:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.301+0000 7f45a784a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a009a470 con 0x7f45a0098a60 2024-02-15T22:56:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f45a4de5640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f45a0099380 0x7f45a012bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54616/0 (socket says 172.21.15.52:54616) 2024-02-15T22:56:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f45a4de5640 1 -- 172.21.15.52:0/847686649 learned_addr learned my addr 172.21.15.52:0/847686649 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:56:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f45a55e6640 1 --2- 172.21.15.52:0/847686649 >> v2:172.21.15.52:3300/0 conn(0x7f45a0098a60 0x7f45a0098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f4597fff640 1 -- 172.21.15.52:0/847686649 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547845650 0 0) 0x7f45a0099cc0 con 0x7f45a0099380 2024-02-15T22:56:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f4597fff640 1 -- 172.21.15.52:0/847686649 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f458c003520 con 0x7f45a0099380 2024-02-15T22:56:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f4597fff640 1 -- 172.21.15.52:0/847686649 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 474644929 0 0) 0x7f458c003520 con 0x7f45a0099380 2024-02-15T22:56:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f4597fff640 1 -- 172.21.15.52:0/847686649 >> v2:172.21.15.52:3300/0 conn(0x7f45a0098a60 msgr2=0x7f45a0098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-15T22:56:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f4597fff640 1 --2- 172.21.15.52:0/847686649 >> v2:172.21.15.52:3300/0 conn(0x7f45a0098a60 0x7f45a0098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f4597fff640 1 -- 172.21.15.52:0/847686649 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a009aa30 con 0x7f45a0099380 2024-02-15T22:56:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f4597fff640 1 -- 172.21.15.52:0/847686649 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 1188439457 0 0) 0x7f45900015a0 con 0x7f45a0099380 2024-02-15T22:56:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f4597fff640 1 -- 172.21.15.52:0/847686649 >> v1:172.21.15.52:6789/0 conn(0x7f45a0099380 legacy=0x7f45a012bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f4597fff640 1 --2- 172.21.15.52:0/847686649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 0x7f458c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f4597fff640 1 -- 172.21.15.52:0/847686649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c004460 con 0x7f458c0039a0 2024-02-15T22:56:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.302+0000 7f45a55e6640 1 --2- 172.21.15.52:0/847686649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 0x7f458c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.303+0000 7f45a55e6640 1 -- 172.21.15.52:0/847686649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c003520 con 0x7f458c0039a0 2024-02-15T22:56:00.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.303+0000 7f45a55e6640 1 --2- 172.21.15.52:0/847686649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 0x7f458c003da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f459c009a40 tx=0x7f458c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808cda59bc7539c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.304+0000 7f4597fff640 1 -- 172.21.15.52:0/847686649 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f459c02c9a0 con 0x7f458c0039a0 2024-02-15T22:56:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.304+0000 7f4597fff640 1 -- 172.21.15.52:0/847686649 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c02cb00 con 0x7f458c0039a0 2024-02-15T22:56:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.304+0000 7f4597fff640 1 -- 172.21.15.52:0/847686649 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f459c02cdc0 con 0x7f458c0039a0 2024-02-15T22:56:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.305+0000 7f45a784a640 1 -- 172.21.15.52:0/847686649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 msgr2=0x7f458c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.305+0000 7f45a784a640 1 --2- 172.21.15.52:0/847686649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 0x7f458c003da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f459c009a40 tx=0x7f458c0057f0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.305+0000 7f45a784a640 1 -- 172.21.15.52:0/847686649 shutdown_connections 2024-02-15T22:56:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.305+0000 7f45a784a640 1 --2- 172.21.15.52:0/847686649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 0x7f458c003da0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.305+0000 7f45a784a640 1 --2- 172.21.15.52:0/847686649 >> v2:172.21.15.52:3300/0 conn(0x7f45a0098a60 0x7f45a0098e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.305+0000 7f45a784a640 1 -- 172.21.15.52:0/847686649 >> 172.21.15.52:0/847686649 conn(0x7f45a009c500 msgr2=0x7f45a0071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.305+0000 7f45a784a640 1 -- 172.21.15.52:0/847686649 shutdown_connections 2024-02-15T22:56:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.305+0000 7f45a784a640 1 -- 172.21.15.52:0/847686649 wait complete. 2024-02-15T22:56:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.306+0000 7f45a784a640 1 Processor -- start 2024-02-15T22:56:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.306+0000 7f45a784a640 1 -- start start 2024-02-15T22:56:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.306+0000 7f45a784a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 0x7f45a006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.306+0000 7f45a784a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a006ed30 con 0x7f458c0039a0 2024-02-15T22:56:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.306+0000 7f45a55e6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 0x7f45a006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.306+0000 7f45a55e6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 0x7f45a006d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56154/0 (socket says 172.21.15.52:56154) 2024-02-15T22:56:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.306+0000 7f45a55e6640 1 -- 172.21.15.52:0/2549923376 learned_addr learned my addr 172.21.15.52:0/2549923376 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:56:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.307+0000 7f45a55e6640 1 -- 172.21.15.52:0/2549923376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a01a3340 con 0x7f458c0039a0 2024-02-15T22:56:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.307+0000 7f45a55e6640 1 --2- 172.21.15.52:0/2549923376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 0x7f45a006d160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f459c02c490 tx=0x7f459c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.307+0000 7f4595ffb640 1 -- 172.21.15.52:0/2549923376 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f459c003950 con 0x7f458c0039a0 2024-02-15T22:56:00.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.307+0000 7f4595ffb640 1 -- 172.21.15.52:0/2549923376 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c003ab0 con 0x7f458c0039a0 2024-02-15T22:56:00.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.307+0000 7f45a784a640 1 -- 172.21.15.52:0/2549923376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a01adc90 con 0x7f458c0039a0 2024-02-15T22:56:00.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.307+0000 7f4595ffb640 1 -- 172.21.15.52:0/2549923376 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f459c003d50 con 0x7f458c0039a0 2024-02-15T22:56:00.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.308+0000 7f45a784a640 1 -- 172.21.15.52:0/2549923376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a01a2ca0 con 0x7f458c0039a0 2024-02-15T22:56:00.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.310+0000 7f45a784a640 1 -- 172.21.15.52:0/2549923376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a00627b0 con 0x7f458c0039a0 2024-02-15T22:56:00.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.310+0000 7f4595ffb640 1 -- 172.21.15.52:0/2549923376 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f459c034440 con 0x7f458c0039a0 2024-02-15T22:56:00.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.310+0000 7f4595ffb640 1 --2- 172.21.15.52:0/2549923376 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4584037ef0 0x7f458403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.310+0000 7f4595ffb640 1 -- 172.21.15.52:0/2549923376 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f459c06d020 con 0x7f458c0039a0 2024-02-15T22:56:00.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.310+0000 7f45a4de5640 1 --2- 172.21.15.52:0/2549923376 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4584037ef0 0x7f458403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.311+0000 7f45a4de5640 1 --2- 172.21.15.52:0/2549923376 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4584037ef0 0x7f458403a3b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4590001eb0 tx=0x7f4590001430 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.319+0000 7f4595ffb640 1 -- 172.21.15.52:0/2549923376 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f459c04f9c0 con 0x7f458c0039a0 2024-02-15T22:56:00.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.341+0000 7f7f47016640 1 Processor -- start 2024-02-15T22:56:00.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.341+0000 7f7f47016640 1 -- start start 2024-02-15T22:56:00.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.341+0000 7f7f47016640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f40097f00 0x7f7f400982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.341+0000 7f7f47016640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4006bdf0 con 0x7f7f40098820 2024-02-15T22:56:00.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.341+0000 7f7f47016640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f400672c0 con 0x7f7f40097f00 2024-02-15T22:56:00.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.341+0000 7f7f3ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7f40098820 0x7f7f4012deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54618/0 (socket says 172.21.15.52:54618) 2024-02-15T22:56:00.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.341+0000 7f7f3ffff640 1 -- 172.21.15.52:0/1577919381 learned_addr learned my addr 172.21.15.52:0/1577919381 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:56:00.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.341+0000 7f7f44db2640 1 --2- 172.21.15.52:0/1577919381 >> v2:172.21.15.52:3300/0 conn(0x7f7f40097f00 0x7f7f400982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.342+0000 7f7f3f7fe640 1 -- 172.21.15.52:0/1577919381 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782888033 0 0) 0x7f7f4006bdf0 con 0x7f7f40098820 2024-02-15T22:56:00.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.342+0000 7f7f3f7fe640 1 -- 172.21.15.52:0/1577919381 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f30003520 con 0x7f7f40098820 2024-02-15T22:56:00.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.342+0000 7f7f3f7fe640 1 -- 172.21.15.52:0/1577919381 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2937032323 0 0) 0x7f7f30003520 con 0x7f7f40098820 2024-02-15T22:56:00.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.342+0000 7f7f3f7fe640 1 -- 172.21.15.52:0/1577919381 >> v2:172.21.15.52:3300/0 conn(0x7f7f40097f00 msgr2=0x7f7f400982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-15T22:56:00.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.342+0000 7f7f3f7fe640 1 --2- 172.21.15.52:0/1577919381 >> v2:172.21.15.52:3300/0 conn(0x7f7f40097f00 0x7f7f400982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.342+0000 7f7f3f7fe640 1 -- 172.21.15.52:0/1577919381 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4009a5c0 con 0x7f7f40098820 2024-02-15T22:56:00.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.342+0000 7f7f3f7fe640 1 -- 172.21.15.52:0/1577919381 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 1188439457 0 0) 0x7f7f2c0015a0 con 0x7f7f40098820 2024-02-15T22:56:00.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.342+0000 7f7f3f7fe640 1 -- 172.21.15.52:0/1577919381 >> v1:172.21.15.52:6789/0 conn(0x7f7f40098820 legacy=0x7f7f4012deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.342+0000 7f7f3f7fe640 1 --2- 172.21.15.52:0/1577919381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 0x7f7f30003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.342+0000 7f7f3f7fe640 1 -- 172.21.15.52:0/1577919381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f30004480 con 0x7f7f300039c0 2024-02-15T22:56:00.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.342+0000 7f7f44db2640 1 --2- 172.21.15.52:0/1577919381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 0x7f7f30003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.343+0000 7f7f44db2640 1 -- 172.21.15.52:0/1577919381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30003520 con 0x7f7f300039c0 2024-02-15T22:56:00.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.343+0000 7f6b28033640 1 Processor -- start 2024-02-15T22:56:00.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.343+0000 7f6b28033640 1 -- start start 2024-02-15T22:56:00.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f7f44db2640 1 --2- 172.21.15.52:0/1577919381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 0x7f7f30003dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009a20 tx=0x7f7f300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b466aa1faebe537d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f7f3f7fe640 1 -- 172.21.15.52:0/1577919381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3402c9a0 con 0x7f7f300039c0 2024-02-15T22:56:00.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f7f3f7fe640 1 -- 172.21.15.52:0/1577919381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3402cb00 con 0x7f7f300039c0 2024-02-15T22:56:00.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f7f3f7fe640 1 -- 172.21.15.52:0/1577919381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3402cde0 con 0x7f7f300039c0 2024-02-15T22:56:00.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f6b28033640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b20071800 0x7f6b20071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f6b28033640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2006c4f0 con 0x7f6b20072120 2024-02-15T22:56:00.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f6b28033640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2006d060 con 0x7f6b20071800 2024-02-15T22:56:00.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f6b25dcf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b20071800 0x7f6b20071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f6b25dcf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b20071800 0x7f6b20071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56178/0 (socket says 172.21.15.52:56178) 2024-02-15T22:56:00.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f6b25dcf640 1 -- 172.21.15.52:0/3406879803 learned_addr learned my addr 172.21.15.52:0/3406879803 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:56:00.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f6b25dcf640 1 -- 172.21.15.52:0/3406879803 >> v1:172.21.15.52:6789/0 conn(0x7f6b20072120 legacy=0x7f6b20090050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-15T22:56:00.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.344+0000 7f6b25dcf640 1 -- 172.21.15.52:0/3406879803 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2009a5e0 con 0x7f6b20071800 2024-02-15T22:56:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.345+0000 7f7f47016640 1 -- 172.21.15.52:0/1577919381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 msgr2=0x7f7f30003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.345+0000 7f7f47016640 1 --2- 172.21.15.52:0/1577919381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 0x7f7f30003dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009a20 tx=0x7f7f300057f0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.345+0000 7f7f47016640 1 -- 172.21.15.52:0/1577919381 shutdown_connections 2024-02-15T22:56:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.345+0000 7f7f47016640 1 --2- 172.21.15.52:0/1577919381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 0x7f7f30003dc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.345+0000 7f7f47016640 1 --2- 172.21.15.52:0/1577919381 >> v2:172.21.15.52:3300/0 conn(0x7f7f40097f00 0x7f7f400982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.345+0000 7f7f47016640 1 -- 172.21.15.52:0/1577919381 >> 172.21.15.52:0/1577919381 conn(0x7f7f4009e640 msgr2=0x7f7f4009ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.345+0000 7f7f47016640 1 -- 172.21.15.52:0/1577919381 shutdown_connections 2024-02-15T22:56:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.345+0000 7f7f47016640 1 -- 172.21.15.52:0/1577919381 wait complete. 2024-02-15T22:56:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.345+0000 7f6b25dcf640 1 --2- 172.21.15.52:0/3406879803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b20071800 0x7f6b20071be0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0097f0 tx=0x7f6b1c034120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46565a3f8525e39a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f7f47016640 1 Processor -- start 2024-02-15T22:56:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f6b24dcd640 1 -- 172.21.15.52:0/3406879803 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b1c034e00 con 0x7f6b20071800 2024-02-15T22:56:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f6b24dcd640 1 -- 172.21.15.52:0/3406879803 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c03c440 con 0x7f6b20071800 2024-02-15T22:56:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f6b24dcd640 1 -- 172.21.15.52:0/3406879803 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b1c03c700 con 0x7f6b20071800 2024-02-15T22:56:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f7f47016640 1 -- start start 2024-02-15T22:56:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f6b28033640 1 -- 172.21.15.52:0/3406879803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b20071800 msgr2=0x7f6b20071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f6b28033640 1 --2- 172.21.15.52:0/3406879803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b20071800 0x7f6b20071be0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0097f0 tx=0x7f6b1c034120 comp rx=0 tx=0).stop 2024-02-15T22:56:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f7f47016640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 0x7f7f40126d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f7f47016640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400961e0 con 0x7f7f300039c0 2024-02-15T22:56:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f6b28033640 1 -- 172.21.15.52:0/3406879803 shutdown_connections 2024-02-15T22:56:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f6b28033640 1 --2- 172.21.15.52:0/3406879803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b20071800 0x7f6b20071be0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f7f44db2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 0x7f7f40126d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f7f44db2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 0x7f7f40126d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56186/0 (socket says 172.21.15.52:56186) 2024-02-15T22:56:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f7f44db2640 1 -- 172.21.15.52:0/4271463385 learned_addr learned my addr 172.21.15.52:0/4271463385 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:56:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.346+0000 7f6b28033640 1 -- 172.21.15.52:0/3406879803 >> 172.21.15.52:0/3406879803 conn(0x7f6b2009d790 msgr2=0x7f6b20099c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f6b28033640 1 -- 172.21.15.52:0/3406879803 shutdown_connections 2024-02-15T22:56:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f6b28033640 1 -- 172.21.15.52:0/3406879803 wait complete. 2024-02-15T22:56:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f7f44db2640 1 -- 172.21.15.52:0/4271463385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40099a10 con 0x7f7f300039c0 2024-02-15T22:56:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f7f44db2640 1 --2- 172.21.15.52:0/4271463385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 0x7f7f40126d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009a20 tx=0x7f7f34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f7f3d7fa640 1 -- 172.21.15.52:0/4271463385 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3403e650 con 0x7f7f300039c0 2024-02-15T22:56:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f7f3d7fa640 1 -- 172.21.15.52:0/4271463385 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3403e7b0 con 0x7f7f300039c0 2024-02-15T22:56:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f7f3d7fa640 1 -- 172.21.15.52:0/4271463385 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3403ea70 con 0x7f7f300039c0 2024-02-15T22:56:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f7f47016640 1 -- 172.21.15.52:0/4271463385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f40094c20 con 0x7f7f300039c0 2024-02-15T22:56:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.347+0000 7f7f47016640 1 -- 172.21.15.52:0/4271463385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f40095100 con 0x7f7f300039c0 2024-02-15T22:56:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.348+0000 7f6b28033640 1 Processor -- start 2024-02-15T22:56:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.348+0000 7f6b28033640 1 -- start start 2024-02-15T22:56:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.348+0000 7f6b28033640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b20071800 0x7f6b200928f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.348+0000 7f6b25dcf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b20071800 0x7f6b200928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.348+0000 7f6b25dcf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b20071800 0x7f6b200928f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56192/0 (socket says 172.21.15.52:56192) 2024-02-15T22:56:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.348+0000 7f6b25dcf640 1 -- 172.21.15.52:0/2439286259 learned_addr learned my addr 172.21.15.52:0/2439286259 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:56:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.348+0000 7f6b28033640 1 -- 172.21.15.52:0/2439286259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2006efb0 con 0x7f6b20071800 2024-02-15T22:56:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.348+0000 7f7f3d7fa640 1 -- 172.21.15.52:0/4271463385 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7f3403ebd0 con 0x7f7f300039c0 2024-02-15T22:56:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.349+0000 7f7f47016640 1 -- 172.21.15.52:0/4271463385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f40099870 con 0x7f7f300039c0 2024-02-15T22:56:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.349+0000 7f7f3d7fa640 1 --2- 172.21.15.52:0/4271463385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7f24037ef0 0x7f7f2403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.349+0000 7f6b25dcf640 1 -- 172.21.15.52:0/2439286259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c0094d0 con 0x7f6b20071800 2024-02-15T22:56:00.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.349+0000 7f7f3d7fa640 1 -- 172.21.15.52:0/4271463385 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f7f3406cc90 con 0x7f7f300039c0 2024-02-15T22:56:00.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.349+0000 7f6b25dcf640 1 --2- 172.21.15.52:0/2439286259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b20071800 0x7f6b200928f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c03f040 tx=0x7f6b1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.349+0000 7f7f3ffff640 1 --2- 172.21.15.52:0/4271463385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7f24037ef0 0x7f7f2403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.349+0000 7f383784a640 1 Processor -- start 2024-02-15T22:56:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.350+0000 7f7f3ffff640 1 --2- 172.21.15.52:0/4271463385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7f24037ef0 0x7f7f2403a3b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c007810 tx=0x7f7f2c001140 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.350+0000 7f383784a640 1 -- start start 2024-02-15T22:56:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.350+0000 7f383784a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38300989f0 0x7f38301331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.350+0000 7f383784a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383006bdf0 con 0x7f3830097f00 2024-02-15T22:56:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.350+0000 7f383784a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38300672c0 con 0x7f38300989f0 2024-02-15T22:56:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.350+0000 7f3834de5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38300989f0 0x7f38301331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.350+0000 7f3834de5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38300989f0 0x7f38301331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56194/0 (socket says 172.21.15.52:56194) 2024-02-15T22:56:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.350+0000 7f3834de5640 1 -- 172.21.15.52:0/885254646 learned_addr learned my addr 172.21.15.52:0/885254646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:56:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.350+0000 7f3834de5640 1 -- 172.21.15.52:0/885254646 >> v1:172.21.15.52:6789/0 conn(0x7f3830097f00 legacy=0x7f38300982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.350+0000 7f3834de5640 1 -- 172.21.15.52:0/885254646 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383009a5c0 con 0x7f38300989f0 2024-02-15T22:56:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.351+0000 7f3834de5640 1 --2- 172.21.15.52:0/885254646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38300989f0 0x7f38301331d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f38200097f0 tx=0x7f382002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e2904be1586b66 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.358+0000 7f7f3d7fa640 1 -- 172.21.15.52:0/4271463385 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7f40099870 con 0x7f7f300039c0 2024-02-15T22:56:00.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.358+0000 7f6b167fc640 1 -- 172.21.15.52:0/2439286259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b1c03a950 con 0x7f6b20071800 2024-02-15T22:56:00.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.358+0000 7f3827fff640 1 -- 172.21.15.52:0/885254646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3820030790 con 0x7f38300989f0 2024-02-15T22:56:00.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.358+0000 7f3827fff640 1 -- 172.21.15.52:0/885254646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38200308f0 con 0x7f38300989f0 2024-02-15T22:56:00.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.358+0000 7f3827fff640 1 -- 172.21.15.52:0/885254646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3820030bb0 con 0x7f38300989f0 2024-02-15T22:56:00.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.358+0000 7f6b167fc640 1 -- 172.21.15.52:0/2439286259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c03aab0 con 0x7f6b20071800 2024-02-15T22:56:00.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.358+0000 7f6b167fc640 1 -- 172.21.15.52:0/2439286259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b1c03ad90 con 0x7f6b20071800 2024-02-15T22:56:00.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.358+0000 7f6b28033640 1 -- 172.21.15.52:0/2439286259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b20093930 con 0x7f6b20071800 2024-02-15T22:56:00.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.359+0000 7f6b28033640 1 -- 172.21.15.52:0/2439286259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2006eae0 con 0x7f6b20071800 2024-02-15T22:56:00.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.359+0000 7f383784a640 1 -- 172.21.15.52:0/885254646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38300989f0 msgr2=0x7f38301331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.359+0000 7f383784a640 1 --2- 172.21.15.52:0/885254646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38300989f0 0x7f38301331d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f38200097f0 tx=0x7f382002b9a0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.360+0000 7f383784a640 1 -- 172.21.15.52:0/885254646 shutdown_connections 2024-02-15T22:56:00.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.360+0000 7f383784a640 1 --2- 172.21.15.52:0/885254646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38300989f0 0x7f38301331d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.360+0000 7f383784a640 1 -- 172.21.15.52:0/885254646 >> 172.21.15.52:0/885254646 conn(0x7f383009e640 msgr2=0x7f383009ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:00.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.360+0000 7f6b167fc640 1 -- 172.21.15.52:0/2439286259 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6b1c043040 con 0x7f6b20071800 2024-02-15T22:56:00.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.360+0000 7f383784a640 1 -- 172.21.15.52:0/885254646 shutdown_connections 2024-02-15T22:56:00.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.360+0000 7f383784a640 1 -- 172.21.15.52:0/885254646 wait complete. 2024-02-15T22:56:00.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.360+0000 7f6b167fc640 1 --2- 172.21.15.52:0/2439286259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6b04037f40 0x7f6b0403a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.360+0000 7f6b167fc640 1 -- 172.21.15.52:0/2439286259 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6b1c075320 con 0x7f6b20071800 2024-02-15T22:56:00.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.360+0000 7f6b28033640 1 -- 172.21.15.52:0/2439286259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2006da40 con 0x7f6b20071800 2024-02-15T22:56:00.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.361+0000 7f383784a640 1 Processor -- start 2024-02-15T22:56:00.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.361+0000 7f383784a640 1 -- start start 2024-02-15T22:56:00.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.361+0000 7f383784a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3830097f00 0x7f383012ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.361+0000 7f383784a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3830130fc0 con 0x7f3830097f00 2024-02-15T22:56:00.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.362+0000 7f38355e6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3830097f00 0x7f383012ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.362+0000 7f38355e6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3830097f00 0x7f383012ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56204/0 (socket says 172.21.15.52:56204) 2024-02-15T22:56:00.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.362+0000 7f38355e6640 1 -- 172.21.15.52:0/461778109 learned_addr learned my addr 172.21.15.52:0/461778109 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:56:00.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.362+0000 7f6b255ce640 1 --2- 172.21.15.52:0/2439286259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6b04037f40 0x7f6b0403a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.362+0000 7f38355e6640 1 -- 172.21.15.52:0/461778109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200094d0 con 0x7f3830097f00 2024-02-15T22:56:00.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.362+0000 7f38355e6640 1 --2- 172.21.15.52:0/461778109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3830097f00 0x7f383012ef80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f382c00c450 tx=0x7f382c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.362+0000 7f6b255ce640 1 --2- 172.21.15.52:0/2439286259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6b04037f40 0x7f6b0403a400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6b100015c0 tx=0x7f6b10007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.369+0000 7f3825ffb640 1 -- 172.21.15.52:0/461778109 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f382c005200 con 0x7f3830097f00 2024-02-15T22:56:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.369+0000 7f3825ffb640 1 -- 172.21.15.52:0/461778109 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c005380 con 0x7f3830097f00 2024-02-15T22:56:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.369+0000 7f3825ffb640 1 -- 172.21.15.52:0/461778109 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f382c0035f0 con 0x7f3830097f00 2024-02-15T22:56:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.369+0000 7f383784a640 1 -- 172.21.15.52:0/461778109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383012b7d0 con 0x7f3830097f00 2024-02-15T22:56:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.369+0000 7f6b167fc640 1 -- 172.21.15.52:0/2439286259 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6b1c041070 con 0x7f6b20071800 2024-02-15T22:56:00.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.370+0000 7f383784a640 1 -- 172.21.15.52:0/461778109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38301312a0 con 0x7f3830097f00 2024-02-15T22:56:00.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.371+0000 7f3825ffb640 1 -- 172.21.15.52:0/461778109 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f382c003750 con 0x7f3830097f00 2024-02-15T22:56:00.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.371+0000 7f383784a640 1 -- 172.21.15.52:0/461778109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38301301b0 con 0x7f3830097f00 2024-02-15T22:56:00.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.371+0000 7f3825ffb640 1 --2- 172.21.15.52:0/461778109 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3814037ef0 0x7f381403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.371+0000 7f3825ffb640 1 -- 172.21.15.52:0/461778109 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f382c04d220 con 0x7f3830097f00 2024-02-15T22:56:00.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.371+0000 7f3834de5640 1 --2- 172.21.15.52:0/461778109 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3814037ef0 0x7f381403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.372+0000 7f3834de5640 1 --2- 172.21.15.52:0/461778109 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3814037ef0 0x7f381403a3b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3820036000 tx=0x7f382003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.380+0000 7f3825ffb640 1 -- 172.21.15.52:0/461778109 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f382c0198b0 con 0x7f3830097f00 2024-02-15T22:56:00.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.528+0000 7f45a784a640 1 -- 172.21.15.52:0/2549923376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f45a0073050 con 0x7f458c0039a0 2024-02-15T22:56:00.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.529+0000 7f4595ffb640 1 -- 172.21.15.52:0/2549923376 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f459c04c020 con 0x7f458c0039a0 2024-02-15T22:56:00.531 INFO:teuthology.orchestra.run.smithi052.stdout:42949672965 2024-02-15T22:56:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.531+0000 7f45a784a640 1 -- 172.21.15.52:0/2549923376 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4584037ef0 msgr2=0x7f458403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.531+0000 7f45a784a640 1 --2- 172.21.15.52:0/2549923376 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4584037ef0 0x7f458403a3b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4590001eb0 tx=0x7f4590001430 comp rx=0 tx=0).stop 2024-02-15T22:56:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.531+0000 7f45a784a640 1 -- 172.21.15.52:0/2549923376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 msgr2=0x7f45a006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.531+0000 7f45a784a640 1 --2- 172.21.15.52:0/2549923376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 0x7f45a006d160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f459c02c490 tx=0x7f459c004730 comp rx=0 tx=0).stop 2024-02-15T22:56:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.531+0000 7f45a784a640 1 -- 172.21.15.52:0/2549923376 shutdown_connections 2024-02-15T22:56:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.531+0000 7f45a784a640 1 --2- 172.21.15.52:0/2549923376 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4584037ef0 0x7f458403a3b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.531+0000 7f45a784a640 1 --2- 172.21.15.52:0/2549923376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f458c0039a0 0x7f45a006d160 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.531+0000 7f45a784a640 1 -- 172.21.15.52:0/2549923376 >> 172.21.15.52:0/2549923376 conn(0x7f45a009c500 msgr2=0x7f45a01b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.531+0000 7f45a784a640 1 -- 172.21.15.52:0/2549923376 shutdown_connections 2024-02-15T22:56:00.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.531+0000 7f45a784a640 1 -- 172.21.15.52:0/2549923376 wait complete. 2024-02-15T22:56:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.541+0000 7f7f47016640 1 -- 172.21.15.52:0/4271463385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f40099870 con 0x7f7f300039c0 2024-02-15T22:56:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.541+0000 7f7f3d7fa640 1 -- 172.21.15.52:0/4271463385 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f40099870 con 0x7f7f300039c0 2024-02-15T22:56:00.544 INFO:teuthology.orchestra.run.smithi052.stdout:42949672966 2024-02-15T22:56:00.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.3 2024-02-15T22:56:00.545 DEBUG:teuthology.parallel:result is None 2024-02-15T22:56:00.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.543+0000 7f7f47016640 1 -- 172.21.15.52:0/4271463385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7f24037ef0 msgr2=0x7f7f2403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.543+0000 7f7f47016640 1 --2- 172.21.15.52:0/4271463385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7f24037ef0 0x7f7f2403a3b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c007810 tx=0x7f7f2c001140 comp rx=0 tx=0).stop 2024-02-15T22:56:00.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.543+0000 7f7f47016640 1 -- 172.21.15.52:0/4271463385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 msgr2=0x7f7f40126d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.543+0000 7f7f47016640 1 --2- 172.21.15.52:0/4271463385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 0x7f7f40126d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009a20 tx=0x7f7f34004730 comp rx=0 tx=0).stop 2024-02-15T22:56:00.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.543+0000 7f7f47016640 1 -- 172.21.15.52:0/4271463385 shutdown_connections 2024-02-15T22:56:00.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.543+0000 7f7f47016640 1 --2- 172.21.15.52:0/4271463385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7f24037ef0 0x7f7f2403a3b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.543+0000 7f7f47016640 1 --2- 172.21.15.52:0/4271463385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f300039c0 0x7f7f40126d40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.543+0000 7f7f47016640 1 -- 172.21.15.52:0/4271463385 >> 172.21.15.52:0/4271463385 conn(0x7f7f4009e640 msgr2=0x7f7f4012d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:00.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.543+0000 7f7f47016640 1 -- 172.21.15.52:0/4271463385 shutdown_connections 2024-02-15T22:56:00.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.543+0000 7f7f47016640 1 -- 172.21.15.52:0/4271463385 wait complete. 2024-02-15T22:56:00.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.2 2024-02-15T22:56:00.557 DEBUG:teuthology.parallel:result is None 2024-02-15T22:56:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.586+0000 7f6b28033640 1 -- 172.21.15.52:0/2439286259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b200627b0 con 0x7f6b20071800 2024-02-15T22:56:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.587+0000 7f6b167fc640 1 -- 172.21.15.52:0/2439286259 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b1c05f090 con 0x7f6b20071800 2024-02-15T22:56:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:38654705668 2024-02-15T22:56:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.589+0000 7f6b28033640 1 -- 172.21.15.52:0/2439286259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6b04037f40 msgr2=0x7f6b0403a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.589+0000 7f6b28033640 1 --2- 172.21.15.52:0/2439286259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6b04037f40 0x7f6b0403a400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6b100015c0 tx=0x7f6b10007a10 comp rx=0 tx=0).stop 2024-02-15T22:56:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.589+0000 7f6b28033640 1 -- 172.21.15.52:0/2439286259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b20071800 msgr2=0x7f6b200928f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.589+0000 7f6b28033640 1 --2- 172.21.15.52:0/2439286259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b20071800 0x7f6b200928f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c03f040 tx=0x7f6b1c0046c0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.589+0000 7f6b28033640 1 -- 172.21.15.52:0/2439286259 shutdown_connections 2024-02-15T22:56:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.589+0000 7f6b28033640 1 --2- 172.21.15.52:0/2439286259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6b04037f40 0x7f6b0403a400 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.589+0000 7f6b28033640 1 --2- 172.21.15.52:0/2439286259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b20071800 0x7f6b200928f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.589+0000 7f6b28033640 1 -- 172.21.15.52:0/2439286259 >> 172.21.15.52:0/2439286259 conn(0x7f6b2009d790 msgr2=0x7f6b20122220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.589+0000 7f6b28033640 1 -- 172.21.15.52:0/2439286259 shutdown_connections 2024-02-15T22:56:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.589+0000 7f6b28033640 1 -- 172.21.15.52:0/2439286259 wait complete. 2024-02-15T22:56:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.596+0000 7f383784a640 1 -- 172.21.15.52:0/461778109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f383012b7d0 con 0x7f3830097f00 2024-02-15T22:56:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.596+0000 7f3825ffb640 1 -- 172.21.15.52:0/461778109 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f383012b7d0 con 0x7f3830097f00 2024-02-15T22:56:00.599 INFO:teuthology.orchestra.run.smithi052.stdout:42949672965 2024-02-15T22:56:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.598+0000 7f383784a640 1 -- 172.21.15.52:0/461778109 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3814037ef0 msgr2=0x7f381403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.598+0000 7f383784a640 1 --2- 172.21.15.52:0/461778109 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3814037ef0 0x7f381403a3b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3820036000 tx=0x7f382003b040 comp rx=0 tx=0).stop 2024-02-15T22:56:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.598+0000 7f383784a640 1 -- 172.21.15.52:0/461778109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3830097f00 msgr2=0x7f383012ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.598+0000 7f383784a640 1 --2- 172.21.15.52:0/461778109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3830097f00 0x7f383012ef80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f382c00c450 tx=0x7f382c00c910 comp rx=0 tx=0).stop 2024-02-15T22:56:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.598+0000 7f383784a640 1 -- 172.21.15.52:0/461778109 shutdown_connections 2024-02-15T22:56:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.598+0000 7f383784a640 1 --2- 172.21.15.52:0/461778109 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3814037ef0 0x7f381403a3b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.598+0000 7f383784a640 1 --2- 172.21.15.52:0/461778109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3830097f00 0x7f383012ef80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.598+0000 7f383784a640 1 -- 172.21.15.52:0/461778109 >> 172.21.15.52:0/461778109 conn(0x7f383009e640 msgr2=0x7f3830096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.598+0000 7f383784a640 1 -- 172.21.15.52:0/461778109 shutdown_connections 2024-02-15T22:56:00.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.598+0000 7f383784a640 1 -- 172.21.15.52:0/461778109 wait complete. 2024-02-15T22:56:00.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-02-15T22:56:00.602 DEBUG:teuthology.parallel:result is None 2024-02-15T22:56:00.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.1 2024-02-15T22:56:00.611 DEBUG:teuthology.parallel:result is None 2024-02-15T22:56:00.611 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-15T22:56:00.611 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T22:56:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.749+0000 7fe292f90640 1 Processor -- start 2024-02-15T22:56:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.749+0000 7fe292f90640 1 -- start start 2024-02-15T22:56:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.750+0000 7fe292f90640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe28c0993f0 0x7fe28c133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.750+0000 7fe292f90640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28c09dc90 con 0x7fe28c098900 2024-02-15T22:56:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.750+0000 7fe292f90640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c09a170 con 0x7fe28c0993f0 2024-02-15T22:56:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.750+0000 7fe28bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe28c0993f0 0x7fe28c133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.750+0000 7fe290d2c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe28c098900 0x7fe28c098ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54422/0 (socket says 172.21.15.52:54422) 2024-02-15T22:56:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.750+0000 7fe290d2c640 1 -- 172.21.15.52:0/3828811835 learned_addr learned my addr 172.21.15.52:0/3828811835 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:56:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.750+0000 7fe28bfff640 1 -- 172.21.15.52:0/3828811835 >> v1:172.21.15.52:6789/0 conn(0x7fe28c098900 legacy=0x7fe28c098ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.750+0000 7fe28b7fe640 1 -- 172.21.15.52:0/3828811835 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804748349 0 0) 0x7fe28c09dc90 con 0x7fe28c098900 2024-02-15T22:56:00.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.750+0000 7fe28bfff640 1 -- 172.21.15.52:0/3828811835 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c099d30 con 0x7fe28c0993f0 2024-02-15T22:56:00.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.751+0000 7fe28bfff640 1 --2- 172.21.15.52:0/3828811835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c0993f0 0x7fe28c133350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe278009720 tx=0x7fe27802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5d00e5aa5a0e5c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.751+0000 7fe28b7fe640 1 -- 172.21.15.52:0/3828811835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe27802e070 con 0x7fe28c0993f0 2024-02-15T22:56:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.751+0000 7fe28b7fe640 1 -- 172.21.15.52:0/3828811835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2780316d0 con 0x7fe28c0993f0 2024-02-15T22:56:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.751+0000 7fe28b7fe640 1 -- 172.21.15.52:0/3828811835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe278031990 con 0x7fe28c0993f0 2024-02-15T22:56:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.751+0000 7fe292f90640 1 -- 172.21.15.52:0/3828811835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c0993f0 msgr2=0x7fe28c133350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.751+0000 7fe292f90640 1 --2- 172.21.15.52:0/3828811835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c0993f0 0x7fe28c133350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe278009720 tx=0x7fe27802b840 comp rx=0 tx=0).stop 2024-02-15T22:56:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.751+0000 7fe292f90640 1 -- 172.21.15.52:0/3828811835 shutdown_connections 2024-02-15T22:56:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.752+0000 7fe292f90640 1 --2- 172.21.15.52:0/3828811835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c0993f0 0x7fe28c133350 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.752+0000 7fe292f90640 1 -- 172.21.15.52:0/3828811835 >> 172.21.15.52:0/3828811835 conn(0x7fe28c0a0a20 msgr2=0x7fe28c09cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.752+0000 7fe292f90640 1 -- 172.21.15.52:0/3828811835 shutdown_connections 2024-02-15T22:56:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.752+0000 7fe292f90640 1 -- 172.21.15.52:0/3828811835 wait complete. 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.752+0000 7fe292f90640 1 Processor -- start 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.752+0000 7fe292f90640 1 -- start start 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.753+0000 7fe292f90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c098900 0x7fe28c128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.753+0000 7fe292f90640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c129d80 con 0x7fe28c098900 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.753+0000 7fe290d2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c098900 0x7fe28c128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.753+0000 7fe290d2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c098900 0x7fe28c128640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49620/0 (socket says 172.21.15.52:49620) 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.753+0000 7fe290d2c640 1 -- 172.21.15.52:0/2962867067 learned_addr learned my addr 172.21.15.52:0/2962867067 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.753+0000 7fe290d2c640 1 -- 172.21.15.52:0/2962867067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278009400 con 0x7fe28c098900 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.753+0000 7fe290d2c640 1 --2- 172.21.15.52:0/2962867067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c098900 0x7fe28c128640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c420 tx=0x7fe28000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.753+0000 7fe2897fa640 1 -- 172.21.15.52:0/2962867067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2800074d0 con 0x7fe28c098900 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.753+0000 7fe2897fa640 1 -- 172.21.15.52:0/2962867067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280007630 con 0x7fe28c098900 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.753+0000 7fe292f90640 1 -- 172.21.15.52:0/2962867067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c12ac40 con 0x7fe28c098900 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.753+0000 7fe2897fa640 1 -- 172.21.15.52:0/2962867067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe280004950 con 0x7fe28c098900 2024-02-15T22:56:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.754+0000 7fe292f90640 1 -- 172.21.15.52:0/2962867067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c1298c0 con 0x7fe28c098900 2024-02-15T22:56:00.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.754+0000 7fe2897fa640 1 -- 172.21.15.52:0/2962867067 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe280004b70 con 0x7fe28c098900 2024-02-15T22:56:00.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.754+0000 7fe2897fa640 1 --2- 172.21.15.52:0/2962867067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe270037ea0 0x7fe27003a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:00.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.754+0000 7fe2897fa640 1 -- 172.21.15.52:0/2962867067 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fe280049ec0 con 0x7fe28c098900 2024-02-15T22:56:00.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.755+0000 7fe292f90640 1 -- 172.21.15.52:0/2962867067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c0627b0 con 0x7fe28c098900 2024-02-15T22:56:00.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.755+0000 7fe28bfff640 1 --2- 172.21.15.52:0/2962867067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe270037ea0 0x7fe27003a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:00.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.755+0000 7fe28bfff640 1 --2- 172.21.15.52:0/2962867067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe270037ea0 0x7fe27003a360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe278036000 tx=0x7fe278008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:00.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.759+0000 7fe2897fa640 1 -- 172.21.15.52:0/2962867067 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe280018070 con 0x7fe28c098900 2024-02-15T22:56:00.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.934+0000 7fe292f90640 1 -- 172.21.15.52:0/2962867067 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe28c099a20 con 0x7fe270037ea0 2024-02-15T22:56:00.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.935+0000 7fe2897fa640 1 -- 172.21.15.52:0/2962867067 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34604 (secure 0 0 0) 0x7fe278031b40 con 0x7fe270037ea0 2024-02-15T22:56:00.938 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:56:00.938 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-02-15T22:56:00.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.937+0000 7fe292f90640 1 -- 172.21.15.52:0/2962867067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe270037ea0 msgr2=0x7fe27003a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.937+0000 7fe292f90640 1 --2- 172.21.15.52:0/2962867067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe270037ea0 0x7fe27003a360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe278036000 tx=0x7fe278008030 comp rx=0 tx=0).stop 2024-02-15T22:56:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.937+0000 7fe292f90640 1 -- 172.21.15.52:0/2962867067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c098900 msgr2=0x7fe28c128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.937+0000 7fe292f90640 1 --2- 172.21.15.52:0/2962867067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c098900 0x7fe28c128640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c420 tx=0x7fe28000c8e0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.937+0000 7fe292f90640 1 -- 172.21.15.52:0/2962867067 shutdown_connections 2024-02-15T22:56:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.937+0000 7fe292f90640 1 --2- 172.21.15.52:0/2962867067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe270037ea0 0x7fe27003a360 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.937+0000 7fe292f90640 1 --2- 172.21.15.52:0/2962867067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c098900 0x7fe28c128640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.937+0000 7fe292f90640 1 -- 172.21.15.52:0/2962867067 >> 172.21.15.52:0/2962867067 conn(0x7fe28c0a0a20 msgr2=0x7fe28c0937f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.938+0000 7fe292f90640 1 -- 172.21.15.52:0/2962867067 shutdown_connections 2024-02-15T22:56:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:00.938+0000 7fe292f90640 1 -- 172.21.15.52:0/2962867067 wait complete. 2024-02-15T22:56:00.950 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-02-15T22:56:00.801585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118120,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369240,"statfs":{"total":386547056640,"available":386426101760,"internally_reserved":0,"allocated":1753088,"data_stored":1353012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.138354"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.854623+0000","last_change":"2024-02-15T22:55:57.854108+0000","last_active":"2024-02-15T22:55:57.854623+0000","last_peered":"2024-02-15T22:55:57.854623+0000","last_clean":"2024-02-15T22:55:57.854623+0000","last_became_active":"2024-02-15T22:55:57.853714+0000","last_became_peered":"2024-02-15T22:55:57.853714+0000","last_unstale":"2024-02-15T22:55:57.854623+0000","last_undegraded":"2024-02-15T22:55:57.854623+0000","last_fullsized":"2024-02-15T22:55:57.854623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:04.954542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.672742+0000","last_change":"2024-02-15T22:55:57.671686+0000","last_active":"2024-02-15T22:55:57.672742+0000","last_peered":"2024-02-15T22:55:57.672742+0000","last_clean":"2024-02-15T22:55:57.672742+0000","last_became_active":"2024-02-15T22:55:57.671257+0000","last_became_peered":"2024-02-15T22:55:57.671257+0000","last_unstale":"2024-02-15T22:55:57.672742+0000","last_undegraded":"2024-02-15T22:55:57.672742+0000","last_fullsized":"2024-02-15T22:55:57.672742+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:31.318438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.673708+0000","last_change":"2024-02-15T22:55:57.672438+0000","last_active":"2024-02-15T22:55:57.673708+0000","last_peered":"2024-02-15T22:55:57.673708+0000","last_clean":"2024-02-15T22:55:57.673708+0000","last_became_active":"2024-02-15T22:55:57.672053+0000","last_became_peered":"2024-02-15T22:55:57.672053+0000","last_unstale":"2024-02-15T22:55:57.673708+0000","last_undegraded":"2024-02-15T22:55:57.673708+0000","last_fullsized":"2024-02-15T22:55:57.673708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:31.318438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.672756+0000","last_change":"2024-02-15T22:55:57.671879+0000","last_active":"2024-02-15T22:55:57.672756+0000","last_peered":"2024-02-15T22:55:57.672756+0000","last_clean":"2024-02-15T22:55:57.672756+0000","last_became_active":"2024-02-15T22:55:57.671524+0000","last_became_peered":"2024-02-15T22:55:57.671524+0000","last_unstale":"2024-02-15T22:55:57.672756+0000","last_undegraded":"2024-02-15T22:55:57.672756+0000","last_fullsized":"2024-02-15T22:55:57.672756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:19:46.103875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.673700+0000","last_change":"2024-02-15T22:55:57.672717+0000","last_active":"2024-02-15T22:55:57.673700+0000","last_peered":"2024-02-15T22:55:57.673700+0000","last_clean":"2024-02-15T22:55:57.673700+0000","last_became_active":"2024-02-15T22:55:57.672268+0000","last_became_peered":"2024-02-15T22:55:57.672268+0000","last_unstale":"2024-02-15T22:55:57.673700+0000","last_undegraded":"2024-02-15T22:55:57.673700+0000","last_fullsized":"2024-02-15T22:55:57.673700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:19:46.103875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.672747+0000","last_change":"2024-02-15T22:55:57.671425+0000","last_active":"2024-02-15T22:55:57.672747+0000","last_peered":"2024-02-15T22:55:57.672747+0000","last_clean":"2024-02-15T22:55:57.672747+0000","last_became_active":"2024-02-15T22:55:57.671130+0000","last_became_peered":"2024-02-15T22:55:57.671130+0000","last_unstale":"2024-02-15T22:55:57.672747+0000","last_undegraded":"2024-02-15T22:55:57.672747+0000","last_fullsized":"2024-02-15T22:55:57.672747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:31.318438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.673766+0000","last_change":"2024-02-15T22:55:57.673021+0000","last_active":"2024-02-15T22:55:57.673766+0000","last_peered":"2024-02-15T22:55:57.673766+0000","last_clean":"2024-02-15T22:55:57.673766+0000","last_became_active":"2024-02-15T22:55:57.672705+0000","last_became_peered":"2024-02-15T22:55:57.672705+0000","last_unstale":"2024-02-15T22:55:57.673766+0000","last_undegraded":"2024-02-15T22:55:57.673766+0000","last_fullsized":"2024-02-15T22:55:57.673766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:09:17.624102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.673712+0000","last_change":"2024-02-15T22:55:57.672733+0000","last_active":"2024-02-15T22:55:57.673712+0000","last_peered":"2024-02-15T22:55:57.673712+0000","last_clean":"2024-02-15T22:55:57.673712+0000","last_became_active":"2024-02-15T22:55:57.672281+0000","last_became_peered":"2024-02-15T22:55:57.672281+0000","last_unstale":"2024-02-15T22:55:57.673712+0000","last_undegraded":"2024-02-15T22:55:57.673712+0000","last_fullsized":"2024-02-15T22:55:57.673712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:07:19.263513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-15T22:55:58.668009+0000","last_change":"2024-02-15T22:55:52.658778+0000","last_active":"2024-02-15T22:55:58.668009+0000","last_peered":"2024-02-15T22:55:58.668009+0000","last_clean":"2024-02-15T22:55:58.668009+0000","last_became_active":"2024-02-15T22:55:52.657750+0000","last_became_peered":"2024-02-15T22:55:52.657750+0000","last_unstale":"2024-02-15T22:55:58.668009+0000","last_undegraded":"2024-02-15T22:55:58.668009+0000","last_fullsized":"2024-02-15T22:55:58.668009+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_clean_scrub_stamp":"2024-02-15T22:55:51.648340+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:26.306952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":42064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]}]},{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":632432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]}]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":636452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35480,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336360,"statfs":{"total":96636764160,"available":96600432640,"internally_reserved":0,"allocated":139264,"data_stored":42064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:56:00.951 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T22:56:01.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfd6ed9640 1 Processor -- start 2024-02-15T22:56:01.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfd6ed9640 1 -- start start 2024-02-15T22:56:01.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfd6ed9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcfd006dc20 0x7fcfd01332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:01.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfd6ed9640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd009b170 con 0x7fcfd006d130 2024-02-15T22:56:01.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfd6ed9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd009dd00 con 0x7fcfd006dc20 2024-02-15T22:56:01.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfd4c75640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcfd006d130 0x7fcfd006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54430/0 (socket says 172.21.15.52:54430) 2024-02-15T22:56:01.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfd4c75640 1 -- 172.21.15.52:0/1813918537 learned_addr learned my addr 172.21.15.52:0/1813918537 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:56:01.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfcffff640 1 --2- 172.21.15.52:0/1813918537 >> v2:172.21.15.52:3300/0 conn(0x7fcfd006dc20 0x7fcfd01332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/1813918537 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191608139 0 0) 0x7fcfd009b170 con 0x7fcfd006d130 2024-02-15T22:56:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/1813918537 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc0003520 con 0x7fcfd006d130 2024-02-15T22:56:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfcffff640 1 -- 172.21.15.52:0/1813918537 >> v1:172.21.15.52:6789/0 conn(0x7fcfd006d130 legacy=0x7fcfd006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.049+0000 7fcfcffff640 1 -- 172.21.15.52:0/1813918537 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd009b510 con 0x7fcfd006dc20 2024-02-15T22:56:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.050+0000 7fcfcffff640 1 --2- 172.21.15.52:0/1813918537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006dc20 0x7fcfd01332a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc009720 tx=0x7fcfbc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24760b24f1d3d065 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.050+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/1813918537 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc02e070 con 0x7fcfd006dc20 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.050+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/1813918537 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc0316d0 con 0x7fcfd006dc20 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.050+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/1813918537 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc031990 con 0x7fcfd006dc20 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.051+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/1813918537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006dc20 msgr2=0x7fcfd01332a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.051+0000 7fcfd6ed9640 1 --2- 172.21.15.52:0/1813918537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006dc20 0x7fcfd01332a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc009720 tx=0x7fcfbc02b840 comp rx=0 tx=0).stop 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.051+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/1813918537 shutdown_connections 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.051+0000 7fcfd6ed9640 1 --2- 172.21.15.52:0/1813918537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006dc20 0x7fcfd01332a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.051+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/1813918537 >> 172.21.15.52:0/1813918537 conn(0x7fcfd009c210 msgr2=0x7fcfd0071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.051+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/1813918537 shutdown_connections 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.051+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/1813918537 wait complete. 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.052+0000 7fcfd6ed9640 1 Processor -- start 2024-02-15T22:56:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.052+0000 7fcfd6ed9640 1 -- start start 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.052+0000 7fcfd6ed9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006d130 0x7fcfd012f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.052+0000 7fcfd6ed9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0122c00 con 0x7fcfd006d130 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.052+0000 7fcfd4c75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006d130 0x7fcfd012f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.052+0000 7fcfd4c75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006d130 0x7fcfd012f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49638/0 (socket says 172.21.15.52:49638) 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.052+0000 7fcfd4c75640 1 -- 172.21.15.52:0/539766732 learned_addr learned my addr 172.21.15.52:0/539766732 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.053+0000 7fcfd4c75640 1 -- 172.21.15.52:0/539766732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc009400 con 0x7fcfd006d130 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.053+0000 7fcfd4c75640 1 --2- 172.21.15.52:0/539766732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006d130 0x7fcfd012f7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c480 tx=0x7fcfc400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.053+0000 7fcfcd7fa640 1 -- 172.21.15.52:0/539766732 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcfc4005c10 con 0x7fcfd006d130 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.053+0000 7fcfcd7fa640 1 -- 172.21.15.52:0/539766732 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc4005d70 con 0x7fcfd006d130 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.053+0000 7fcfcd7fa640 1 -- 172.21.15.52:0/539766732 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcfc40071e0 con 0x7fcfd006d130 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.053+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/539766732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd01213f0 con 0x7fcfd006d130 2024-02-15T22:56:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.053+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/539766732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd0121fd0 con 0x7fcfd006d130 2024-02-15T22:56:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.054+0000 7fcfcd7fa640 1 -- 172.21.15.52:0/539766732 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcfc4007340 con 0x7fcfd006d130 2024-02-15T22:56:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.054+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/539766732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd009a7d0 con 0x7fcfd006d130 2024-02-15T22:56:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.054+0000 7fcfcd7fa640 1 --2- 172.21.15.52:0/539766732 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcfb4037ef0 0x7fcfb403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.054+0000 7fcfcd7fa640 1 -- 172.21.15.52:0/539766732 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fcfc4049e30 con 0x7fcfd006d130 2024-02-15T22:56:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.054+0000 7fcfcffff640 1 --2- 172.21.15.52:0/539766732 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcfb4037ef0 0x7fcfb403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:01.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.055+0000 7fcfcffff640 1 --2- 172.21.15.52:0/539766732 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcfb4037ef0 0x7fcfb403a3b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc036000 tx=0x7fcfbc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:01.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.058+0000 7fcfcd7fa640 1 -- 172.21.15.52:0/539766732 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfc4019d70 con 0x7fcfd006d130 2024-02-15T22:56:01.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.233+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/539766732 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfd006eb70 con 0x7fcfb4037ef0 2024-02-15T22:56:01.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.234+0000 7fcfcd7fa640 1 -- 172.21.15.52:0/539766732 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34604 (secure 0 0 0) 0x7fcfbc031b40 con 0x7fcfb4037ef0 2024-02-15T22:56:01.237 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:56:01.237 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-02-15T22:56:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.236+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/539766732 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcfb4037ef0 msgr2=0x7fcfb403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.236+0000 7fcfd6ed9640 1 --2- 172.21.15.52:0/539766732 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcfb4037ef0 0x7fcfb403a3b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc036000 tx=0x7fcfbc008030 comp rx=0 tx=0).stop 2024-02-15T22:56:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.236+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/539766732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006d130 msgr2=0x7fcfd012f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.236+0000 7fcfd6ed9640 1 --2- 172.21.15.52:0/539766732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006d130 0x7fcfd012f7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c480 tx=0x7fcfc400c940 comp rx=0 tx=0).stop 2024-02-15T22:56:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.236+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/539766732 shutdown_connections 2024-02-15T22:56:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.236+0000 7fcfd6ed9640 1 --2- 172.21.15.52:0/539766732 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcfb4037ef0 0x7fcfb403a3b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.236+0000 7fcfd6ed9640 1 --2- 172.21.15.52:0/539766732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006d130 0x7fcfd012f7a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.236+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/539766732 >> 172.21.15.52:0/539766732 conn(0x7fcfd009c210 msgr2=0x7fcfd006fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.236+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/539766732 shutdown_connections 2024-02-15T22:56:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.236+0000 7fcfd6ed9640 1 -- 172.21.15.52:0/539766732 wait complete. 2024-02-15T22:56:01.249 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-02-15T22:56:00.801585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118120,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369240,"statfs":{"total":386547056640,"available":386426101760,"internally_reserved":0,"allocated":1753088,"data_stored":1353012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.138354"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.854623+0000","last_change":"2024-02-15T22:55:57.854108+0000","last_active":"2024-02-15T22:55:57.854623+0000","last_peered":"2024-02-15T22:55:57.854623+0000","last_clean":"2024-02-15T22:55:57.854623+0000","last_became_active":"2024-02-15T22:55:57.853714+0000","last_became_peered":"2024-02-15T22:55:57.853714+0000","last_unstale":"2024-02-15T22:55:57.854623+0000","last_undegraded":"2024-02-15T22:55:57.854623+0000","last_fullsized":"2024-02-15T22:55:57.854623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:04.954542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.672742+0000","last_change":"2024-02-15T22:55:57.671686+0000","last_active":"2024-02-15T22:55:57.672742+0000","last_peered":"2024-02-15T22:55:57.672742+0000","last_clean":"2024-02-15T22:55:57.672742+0000","last_became_active":"2024-02-15T22:55:57.671257+0000","last_became_peered":"2024-02-15T22:55:57.671257+0000","last_unstale":"2024-02-15T22:55:57.672742+0000","last_undegraded":"2024-02-15T22:55:57.672742+0000","last_fullsized":"2024-02-15T22:55:57.672742+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:31.318438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.673708+0000","last_change":"2024-02-15T22:55:57.672438+0000","last_active":"2024-02-15T22:55:57.673708+0000","last_peered":"2024-02-15T22:55:57.673708+0000","last_clean":"2024-02-15T22:55:57.673708+0000","last_became_active":"2024-02-15T22:55:57.672053+0000","last_became_peered":"2024-02-15T22:55:57.672053+0000","last_unstale":"2024-02-15T22:55:57.673708+0000","last_undegraded":"2024-02-15T22:55:57.673708+0000","last_fullsized":"2024-02-15T22:55:57.673708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:31.318438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.672756+0000","last_change":"2024-02-15T22:55:57.671879+0000","last_active":"2024-02-15T22:55:57.672756+0000","last_peered":"2024-02-15T22:55:57.672756+0000","last_clean":"2024-02-15T22:55:57.672756+0000","last_became_active":"2024-02-15T22:55:57.671524+0000","last_became_peered":"2024-02-15T22:55:57.671524+0000","last_unstale":"2024-02-15T22:55:57.672756+0000","last_undegraded":"2024-02-15T22:55:57.672756+0000","last_fullsized":"2024-02-15T22:55:57.672756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:19:46.103875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.673700+0000","last_change":"2024-02-15T22:55:57.672717+0000","last_active":"2024-02-15T22:55:57.673700+0000","last_peered":"2024-02-15T22:55:57.673700+0000","last_clean":"2024-02-15T22:55:57.673700+0000","last_became_active":"2024-02-15T22:55:57.672268+0000","last_became_peered":"2024-02-15T22:55:57.672268+0000","last_unstale":"2024-02-15T22:55:57.673700+0000","last_undegraded":"2024-02-15T22:55:57.673700+0000","last_fullsized":"2024-02-15T22:55:57.673700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:19:46.103875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.672747+0000","last_change":"2024-02-15T22:55:57.671425+0000","last_active":"2024-02-15T22:55:57.672747+0000","last_peered":"2024-02-15T22:55:57.672747+0000","last_clean":"2024-02-15T22:55:57.672747+0000","last_became_active":"2024-02-15T22:55:57.671130+0000","last_became_peered":"2024-02-15T22:55:57.671130+0000","last_unstale":"2024-02-15T22:55:57.672747+0000","last_undegraded":"2024-02-15T22:55:57.672747+0000","last_fullsized":"2024-02-15T22:55:57.672747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:31.318438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.673766+0000","last_change":"2024-02-15T22:55:57.673021+0000","last_active":"2024-02-15T22:55:57.673766+0000","last_peered":"2024-02-15T22:55:57.673766+0000","last_clean":"2024-02-15T22:55:57.673766+0000","last_became_active":"2024-02-15T22:55:57.672705+0000","last_became_peered":"2024-02-15T22:55:57.672705+0000","last_unstale":"2024-02-15T22:55:57.673766+0000","last_undegraded":"2024-02-15T22:55:57.673766+0000","last_fullsized":"2024-02-15T22:55:57.673766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:09:17.624102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-15T22:55:57.673712+0000","last_change":"2024-02-15T22:55:57.672733+0000","last_active":"2024-02-15T22:55:57.673712+0000","last_peered":"2024-02-15T22:55:57.673712+0000","last_clean":"2024-02-15T22:55:57.673712+0000","last_became_active":"2024-02-15T22:55:57.672281+0000","last_became_peered":"2024-02-15T22:55:57.672281+0000","last_unstale":"2024-02-15T22:55:57.673712+0000","last_undegraded":"2024-02-15T22:55:57.673712+0000","last_fullsized":"2024-02-15T22:55:57.673712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:07:19.263513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-02-15T22:55:58.668009+0000","last_change":"2024-02-15T22:55:52.658778+0000","last_active":"2024-02-15T22:55:58.668009+0000","last_peered":"2024-02-15T22:55:58.668009+0000","last_clean":"2024-02-15T22:55:58.668009+0000","last_became_active":"2024-02-15T22:55:52.657750+0000","last_became_peered":"2024-02-15T22:55:52.657750+0000","last_unstale":"2024-02-15T22:55:58.668009+0000","last_undegraded":"2024-02-15T22:55:58.668009+0000","last_fullsized":"2024-02-15T22:55:58.668009+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_clean_scrub_stamp":"2024-02-15T22:55:51.648340+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:26.306952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":42064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]}]},{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":632432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]}]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":636452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35480,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336360,"statfs":{"total":96636764160,"available":96600432640,"internally_reserved":0,"allocated":139264,"data_stored":42064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:56:01.250 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-15T22:56:01.250 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-15T22:56:01.250 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-15T22:56:01.250 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-15T22:56:01.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.347+0000 7f6e8764e640 1 Processor -- start 2024-02-15T22:56:01.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.348+0000 7f6e8764e640 1 -- start start 2024-02-15T22:56:01.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.348+0000 7f6e8764e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6e800943d0 0x7f6e800947b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:01.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.348+0000 7f6e8764e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e80095990 con 0x7f6e80094cf0 2024-02-15T22:56:01.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.348+0000 7f6e8764e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e80095ef0 con 0x7f6e800943d0 2024-02-15T22:56:01.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.348+0000 7f6e853ea640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6e800943d0 0x7f6e800947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:01.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.348+0000 7f6e84be9640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6e80094cf0 0x7f6e8012a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54442/0 (socket says 172.21.15.52:54442) 2024-02-15T22:56:01.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.348+0000 7f6e84be9640 1 -- 172.21.15.52:0/3829611462 learned_addr learned my addr 172.21.15.52:0/3829611462 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.348+0000 7f6e853ea640 1 -- 172.21.15.52:0/3829611462 >> v1:172.21.15.52:6789/0 conn(0x7f6e80094cf0 legacy=0x7f6e8012a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.348+0000 7f6e853ea640 1 -- 172.21.15.52:0/3829611462 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8006c400 con 0x7f6e800943d0 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.349+0000 7f6e853ea640 1 --2- 172.21.15.52:0/3829611462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e800943d0 0x7f6e800947b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009720 tx=0x7f6e7802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916f48e17c78d668 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.349+0000 7f6e7ffff640 1 -- 172.21.15.52:0/3829611462 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e7802e070 con 0x7f6e800943d0 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.349+0000 7f6e7ffff640 1 -- 172.21.15.52:0/3829611462 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e780316d0 con 0x7f6e800943d0 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.349+0000 7f6e7ffff640 1 -- 172.21.15.52:0/3829611462 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e78031990 con 0x7f6e800943d0 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.350+0000 7f6e8764e640 1 -- 172.21.15.52:0/3829611462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e800943d0 msgr2=0x7f6e800947b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.350+0000 7f6e8764e640 1 --2- 172.21.15.52:0/3829611462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e800943d0 0x7f6e800947b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009720 tx=0x7f6e7802b840 comp rx=0 tx=0).stop 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.350+0000 7f6e8764e640 1 -- 172.21.15.52:0/3829611462 shutdown_connections 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.350+0000 7f6e8764e640 1 --2- 172.21.15.52:0/3829611462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e800943d0 0x7f6e800947b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.350+0000 7f6e8764e640 1 -- 172.21.15.52:0/3829611462 >> 172.21.15.52:0/3829611462 conn(0x7f6e8009a300 msgr2=0x7f6e8009a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.350+0000 7f6e8764e640 1 -- 172.21.15.52:0/3829611462 shutdown_connections 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.350+0000 7f6e8764e640 1 -- 172.21.15.52:0/3829611462 wait complete. 2024-02-15T22:56:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.351+0000 7f6e8764e640 1 Processor -- start 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.351+0000 7f6e8764e640 1 -- start start 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.351+0000 7f6e8764e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e800943d0 0x7f6e801c0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.351+0000 7f6e8764e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e801222f0 con 0x7f6e800943d0 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.351+0000 7f6e853ea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e800943d0 0x7f6e801c0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.351+0000 7f6e853ea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e800943d0 0x7f6e801c0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49654/0 (socket says 172.21.15.52:49654) 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.351+0000 7f6e853ea640 1 -- 172.21.15.52:0/3348009429 learned_addr learned my addr 172.21.15.52:0/3348009429 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.351+0000 7f6e853ea640 1 -- 172.21.15.52:0/3348009429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78009400 con 0x7f6e800943d0 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.352+0000 7f6e853ea640 1 --2- 172.21.15.52:0/3348009429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e800943d0 0x7f6e801c0600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e7802b880 tx=0x7f6e780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.352+0000 7f6e7dffb640 1 -- 172.21.15.52:0/3348009429 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e780328b0 con 0x7f6e800943d0 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.352+0000 7f6e7dffb640 1 -- 172.21.15.52:0/3348009429 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e78032a10 con 0x7f6e800943d0 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.352+0000 7f6e8764e640 1 -- 172.21.15.52:0/3348009429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e800716b0 con 0x7f6e800943d0 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.352+0000 7f6e7dffb640 1 -- 172.21.15.52:0/3348009429 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e78032cd0 con 0x7f6e800943d0 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.352+0000 7f6e8764e640 1 -- 172.21.15.52:0/3348009429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e80092db0 con 0x7f6e800943d0 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.353+0000 7f6e7dffb640 1 -- 172.21.15.52:0/3348009429 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6e7804d3f0 con 0x7f6e800943d0 2024-02-15T22:56:01.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.353+0000 7f6e7dffb640 1 --2- 172.21.15.52:0/3348009429 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6e6c037ef0 0x7f6e6c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:01.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.353+0000 7f6e8764e640 1 -- 172.21.15.52:0/3348009429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e801224e0 con 0x7f6e800943d0 2024-02-15T22:56:01.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.353+0000 7f6e7dffb640 1 -- 172.21.15.52:0/3348009429 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6e7806c780 con 0x7f6e800943d0 2024-02-15T22:56:01.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.353+0000 7f6e84be9640 1 --2- 172.21.15.52:0/3348009429 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6e6c037ef0 0x7f6e6c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:01.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.354+0000 7f6e84be9640 1 --2- 172.21.15.52:0/3348009429 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6e6c037ef0 0x7f6e6c03a3b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e74007fd0 tx=0x7f6e74007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:01.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.358+0000 7f6e7dffb640 1 -- 172.21.15.52:0/3348009429 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6e780308e0 con 0x7f6e800943d0 2024-02-15T22:56:01.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.576+0000 7f6e8764e640 1 -- 172.21.15.52:0/3348009429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6e8006ee50 con 0x7f6e800943d0 2024-02-15T22:56:01.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.577+0000 7f6e7dffb640 1 -- 172.21.15.52:0/3348009429 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6e780302f0 con 0x7f6e800943d0 2024-02-15T22:56:01.579 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:56:01.579 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-15T22:56:01.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.578+0000 7f6e8764e640 1 -- 172.21.15.52:0/3348009429 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6e6c037ef0 msgr2=0x7f6e6c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:01.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.578+0000 7f6e8764e640 1 --2- 172.21.15.52:0/3348009429 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6e6c037ef0 0x7f6e6c03a3b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e74007fd0 tx=0x7f6e74007ac0 comp rx=0 tx=0).stop 2024-02-15T22:56:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.578+0000 7f6e8764e640 1 -- 172.21.15.52:0/3348009429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e800943d0 msgr2=0x7f6e801c0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.578+0000 7f6e8764e640 1 --2- 172.21.15.52:0/3348009429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e800943d0 0x7f6e801c0600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e7802b880 tx=0x7f6e780046c0 comp rx=0 tx=0).stop 2024-02-15T22:56:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.578+0000 7f6e8764e640 1 -- 172.21.15.52:0/3348009429 shutdown_connections 2024-02-15T22:56:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.578+0000 7f6e8764e640 1 --2- 172.21.15.52:0/3348009429 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6e6c037ef0 0x7f6e6c03a3b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.578+0000 7f6e8764e640 1 --2- 172.21.15.52:0/3348009429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e800943d0 0x7f6e801c0600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.578+0000 7f6e8764e640 1 -- 172.21.15.52:0/3348009429 >> 172.21.15.52:0/3348009429 conn(0x7f6e8009a300 msgr2=0x7f6e800969e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.579+0000 7f6e8764e640 1 -- 172.21.15.52:0/3348009429 shutdown_connections 2024-02-15T22:56:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:56:01.579+0000 7f6e8764e640 1 -- 172.21.15.52:0/3348009429 wait complete. 2024-02-15T22:56:01.591 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-15T22:56:01.592 INFO:teuthology.run_tasks:Running task rgw... 2024-02-15T22:56:01.608 DEBUG:tasks.rgw:config is {'client.0': None} 2024-02-15T22:56:01.608 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-02-15T22:56:01.608 INFO:tasks.rgw:Creating data pools 2024-02-15T22:56:01.608 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-02-15T22:56:01.608 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-02-15T22:56:01.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.719+0000 7f1951d9f640 1 Processor -- start 2024-02-15T22:56:01.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.719+0000 7f1951d9f640 1 -- start start 2024-02-15T22:56:01.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.719+0000 7f1951d9f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f194c11a1d0 0x7f194c11c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:01.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.719+0000 7f1951d9f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c11cb90 con 0x7f194c117440 2024-02-15T22:56:01.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.719+0000 7f1951d9f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c11dd30 con 0x7f194c11a1d0 2024-02-15T22:56:01.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.719+0000 7f194bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f194c11a1d0 0x7f194c11c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.719+0000 7f194bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f194c11a1d0 0x7f194c11c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:42218/0 (socket says 172.21.15.133:42218) 2024-02-15T22:56:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.719+0000 7f194bfff640 1 -- 172.21.15.133:0/1297944298 learned_addr learned my addr 172.21.15.133:0/1297944298 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.719+0000 7f194bfff640 1 -- 172.21.15.133:0/1297944298 >> v1:172.21.15.52:6789/0 conn(0x7f194c117440 legacy=0x7f194c117820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.719+0000 7f194b7fe640 1 -- 172.21.15.133:0/1297944298 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519812197 0 0) 0x7f194c11cb90 con 0x7f194c117440 2024-02-15T22:56:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.719+0000 7f194bfff640 1 -- 172.21.15.133:0/1297944298 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c11de70 con 0x7f194c11a1d0 2024-02-15T22:56:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.720+0000 7f194bfff640 1 --2- 172.21.15.133:0/1297944298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f194c11a1d0 0x7f194c11c5c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f19400097f0 tx=0x7f194002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92784d25e677b2c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.720+0000 7f194b7fe640 1 -- 172.21.15.133:0/1297944298 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19400317a0 con 0x7f194c11a1d0 2024-02-15T22:56:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.720+0000 7f194b7fe640 1 -- 172.21.15.133:0/1297944298 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1940031900 con 0x7f194c11a1d0 2024-02-15T22:56:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.720+0000 7f194b7fe640 1 -- 172.21.15.133:0/1297944298 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1940031bc0 con 0x7f194c11a1d0 2024-02-15T22:56:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.721+0000 7f1951d9f640 1 -- 172.21.15.133:0/1297944298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f194c11a1d0 msgr2=0x7f194c11c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.721+0000 7f1951d9f640 1 --2- 172.21.15.133:0/1297944298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f194c11a1d0 0x7f194c11c5c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f19400097f0 tx=0x7f194002b910 comp rx=0 tx=0).stop 2024-02-15T22:56:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.721+0000 7f1951d9f640 1 -- 172.21.15.133:0/1297944298 shutdown_connections 2024-02-15T22:56:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.721+0000 7f1951d9f640 1 --2- 172.21.15.133:0/1297944298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f194c11a1d0 0x7f194c11c5c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.721+0000 7f1951d9f640 1 -- 172.21.15.133:0/1297944298 >> 172.21.15.133:0/1297944298 conn(0x7f194c06d990 msgr2=0x7f194c06dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.721+0000 7f1951d9f640 1 -- 172.21.15.133:0/1297944298 shutdown_connections 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.721+0000 7f1951d9f640 1 -- 172.21.15.133:0/1297944298 wait complete. 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.722+0000 7f1951d9f640 1 Processor -- start 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.722+0000 7f1951d9f640 1 -- start start 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.722+0000 7f1951d9f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f194c117440 0x7f194c1a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.722+0000 7f1951d9f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c1a6250 con 0x7f194c117440 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.723+0000 7f1950d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f194c117440 0x7f194c1a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.723+0000 7f1950d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f194c117440 0x7f194c1a5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:42230/0 (socket says 172.21.15.133:42230) 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.723+0000 7f1950d9d640 1 -- 172.21.15.133:0/4231156068 learned_addr learned my addr 172.21.15.133:0/4231156068 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.723+0000 7f1950d9d640 1 -- 172.21.15.133:0/4231156068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19400094d0 con 0x7f194c117440 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.723+0000 7f1950d9d640 1 --2- 172.21.15.133:0/4231156068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f194c117440 0x7f194c1a5d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f193c00c3e0 tx=0x7f193c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.723+0000 7f19497fa640 1 -- 172.21.15.133:0/4231156068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f193c005410 con 0x7f194c117440 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.723+0000 7f19497fa640 1 -- 172.21.15.133:0/4231156068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c0035f0 con 0x7f194c117440 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.723+0000 7f1951d9f640 1 -- 172.21.15.133:0/4231156068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c1a64b0 con 0x7f194c117440 2024-02-15T22:56:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.723+0000 7f19497fa640 1 -- 172.21.15.133:0/4231156068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f193c0038d0 con 0x7f194c117440 2024-02-15T22:56:01.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.723+0000 7f1951d9f640 1 -- 172.21.15.133:0/4231156068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c1aa590 con 0x7f194c117440 2024-02-15T22:56:01.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.724+0000 7f19497fa640 1 -- 172.21.15.133:0/4231156068 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f193c003a30 con 0x7f194c117440 2024-02-15T22:56:01.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.724+0000 7f19497fa640 1 --2- 172.21.15.133:0/4231156068 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1938037ef0 0x7f193803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:01.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.725+0000 7f19497fa640 1 -- 172.21.15.133:0/4231156068 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f193c049f00 con 0x7f194c117440 2024-02-15T22:56:01.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.725+0000 7f1951d9f640 1 -- 172.21.15.133:0/4231156068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194c0627b0 con 0x7f194c117440 2024-02-15T22:56:01.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.725+0000 7f194bfff640 1 --2- 172.21.15.133:0/4231156068 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1938037ef0 0x7f193803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:01.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.725+0000 7f194bfff640 1 --2- 172.21.15.133:0/4231156068 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1938037ef0 0x7f193803a3b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1940036000 tx=0x7f1940008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:01.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.730+0000 7f19497fa640 1 -- 172.21.15.133:0/4231156068 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f193c017020 con 0x7f194c117440 2024-02-15T22:56:01.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:01.900+0000 7f1951d9f640 1 -- 172.21.15.133:0/4231156068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f194c067570 con 0x7f194c117440 2024-02-15T22:56:02.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.676+0000 7f19497fa640 1 -- 172.21.15.133:0/4231156068 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v18) v1 ==== 167+0+0 (secure 0 0 0) 0x7f193c019d70 con 0x7f194c117440 2024-02-15T22:56:02.679 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'default.rgw.buckets.data' created 2024-02-15T22:56:02.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.680+0000 7f1951d9f640 1 -- 172.21.15.133:0/4231156068 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1938037ef0 msgr2=0x7f193803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:02.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.680+0000 7f1951d9f640 1 --2- 172.21.15.133:0/4231156068 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1938037ef0 0x7f193803a3b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1940036000 tx=0x7f1940008030 comp rx=0 tx=0).stop 2024-02-15T22:56:02.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.680+0000 7f1951d9f640 1 -- 172.21.15.133:0/4231156068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f194c117440 msgr2=0x7f194c1a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:02.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.680+0000 7f1951d9f640 1 --2- 172.21.15.133:0/4231156068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f194c117440 0x7f194c1a5d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f193c00c3e0 tx=0x7f193c00c8a0 comp rx=0 tx=0).stop 2024-02-15T22:56:02.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.680+0000 7f1951d9f640 1 -- 172.21.15.133:0/4231156068 shutdown_connections 2024-02-15T22:56:02.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.680+0000 7f1951d9f640 1 --2- 172.21.15.133:0/4231156068 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1938037ef0 0x7f193803a3b0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1940036000 tx=0x7f1940008030 comp rx=0 tx=0).stop 2024-02-15T22:56:02.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.680+0000 7f1951d9f640 1 --2- 172.21.15.133:0/4231156068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f194c117440 0x7f194c1a5d10 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f193c00c3e0 tx=0x7f193c00c8a0 comp rx=0 tx=0).stop 2024-02-15T22:56:02.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.680+0000 7f1951d9f640 1 -- 172.21.15.133:0/4231156068 >> 172.21.15.133:0/4231156068 conn(0x7f194c06d990 msgr2=0x7f194c10fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:02.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.681+0000 7f1951d9f640 1 -- 172.21.15.133:0/4231156068 shutdown_connections 2024-02-15T22:56:02.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.681+0000 7f1951d9f640 1 -- 172.21.15.133:0/4231156068 wait complete. 2024-02-15T22:56:02.702 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-02-15T22:56:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.805+0000 7f1fedf6d640 1 Processor -- start 2024-02-15T22:56:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.805+0000 7f1fedf6d640 1 -- start start 2024-02-15T22:56:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.805+0000 7f1fedf6d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1fe810f270 0x7f1fe810ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.806+0000 7f1fedf6d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe810e830 con 0x7f1fe810e2f0 2024-02-15T22:56:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.806+0000 7f1fedf6d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe810e9c0 con 0x7f1fe810f270 2024-02-15T22:56:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.806+0000 7f1fe77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1fe810f270 0x7f1fe810ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.806+0000 7f1fe77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1fe810f270 0x7f1fe810ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:42242/0 (socket says 172.21.15.133:42242) 2024-02-15T22:56:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.806+0000 7f1fe77fe640 1 -- 172.21.15.133:0/218765001 learned_addr learned my addr 172.21.15.133:0/218765001 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.806+0000 7f1fe77fe640 1 -- 172.21.15.133:0/218765001 >> v1:172.21.15.52:6789/0 conn(0x7f1fe810e2f0 legacy=0x7f1fe81199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.806+0000 7f1fe77fe640 1 -- 172.21.15.133:0/218765001 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe810eb30 con 0x7f1fe810f270 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.807+0000 7f1fe77fe640 1 --2- 172.21.15.133:0/218765001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe810f270 0x7f1fe810ddb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80097f0 tx=0x7f1fd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241379a0e4def232 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.807+0000 7f1fe67fc640 1 -- 172.21.15.133:0/218765001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fd80317a0 con 0x7f1fe810f270 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.807+0000 7f1fe67fc640 1 -- 172.21.15.133:0/218765001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd8031900 con 0x7f1fe810f270 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.807+0000 7f1fe67fc640 1 -- 172.21.15.133:0/218765001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fd8031bc0 con 0x7f1fe810f270 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.808+0000 7f1fedf6d640 1 -- 172.21.15.133:0/218765001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe810f270 msgr2=0x7f1fe810ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.808+0000 7f1fedf6d640 1 --2- 172.21.15.133:0/218765001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe810f270 0x7f1fe810ddb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80097f0 tx=0x7f1fd802b910 comp rx=0 tx=0).stop 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.808+0000 7f1fedf6d640 1 -- 172.21.15.133:0/218765001 shutdown_connections 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.808+0000 7f1fedf6d640 1 --2- 172.21.15.133:0/218765001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe810f270 0x7f1fe810ddb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.808+0000 7f1fedf6d640 1 -- 172.21.15.133:0/218765001 >> 172.21.15.133:0/218765001 conn(0x7f1fe806ea90 msgr2=0x7f1fe8070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.808+0000 7f1fedf6d640 1 -- 172.21.15.133:0/218765001 shutdown_connections 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.808+0000 7f1fedf6d640 1 -- 172.21.15.133:0/218765001 wait complete. 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.808+0000 7f1fedf6d640 1 Processor -- start 2024-02-15T22:56:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.809+0000 7f1fedf6d640 1 -- start start 2024-02-15T22:56:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.809+0000 7f1fedf6d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe810e2f0 0x7f1fe81a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.809+0000 7f1fedf6d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe81aa1e0 con 0x7f1fe810e2f0 2024-02-15T22:56:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.809+0000 7f1fe77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe810e2f0 0x7f1fe81a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.809+0000 7f1fe77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe810e2f0 0x7f1fe81a9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:42250/0 (socket says 172.21.15.133:42250) 2024-02-15T22:56:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.809+0000 7f1fe77fe640 1 -- 172.21.15.133:0/2490449595 learned_addr learned my addr 172.21.15.133:0/2490449595 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.809+0000 7f1fe77fe640 1 -- 172.21.15.133:0/2490449595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd80094d0 con 0x7f1fe810e2f0 2024-02-15T22:56:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.810+0000 7f1fe77fe640 1 --2- 172.21.15.133:0/2490449595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe810e2f0 0x7f1fe81a9c10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1fd802b950 tx=0x7f1fd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.810+0000 7f1fcffff640 1 -- 172.21.15.133:0/2490449595 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fd80443f0 con 0x7f1fe810e2f0 2024-02-15T22:56:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.810+0000 7f1fcffff640 1 -- 172.21.15.133:0/2490449595 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd8044550 con 0x7f1fe810e2f0 2024-02-15T22:56:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.810+0000 7f1fcffff640 1 -- 172.21.15.133:0/2490449595 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fd8044830 con 0x7f1fe810e2f0 2024-02-15T22:56:02.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.810+0000 7f1fedf6d640 1 -- 172.21.15.133:0/2490449595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe81aa3e0 con 0x7f1fe810e2f0 2024-02-15T22:56:02.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.810+0000 7f1fedf6d640 1 -- 172.21.15.133:0/2490449595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe81a3aa0 con 0x7f1fe810e2f0 2024-02-15T22:56:02.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.811+0000 7f1fcffff640 1 -- 172.21.15.133:0/2490449595 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1fd804d450 con 0x7f1fe810e2f0 2024-02-15T22:56:02.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.811+0000 7f1fedf6d640 1 -- 172.21.15.133:0/2490449595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe80627b0 con 0x7f1fe810e2f0 2024-02-15T22:56:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.811+0000 7f1fcffff640 1 --2- 172.21.15.133:0/2490449595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1fd4037ef0 0x7f1fd403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.811+0000 7f1fcffff640 1 -- 172.21.15.133:0/2490449595 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3845+0+0 (secure 0 0 0) 0x7f1fd802d040 con 0x7f1fe810e2f0 2024-02-15T22:56:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.811+0000 7f1fe6ffd640 1 --2- 172.21.15.133:0/2490449595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1fd4037ef0 0x7f1fd403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.812+0000 7f1fe6ffd640 1 --2- 172.21.15.133:0/2490449595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1fd4037ef0 0x7f1fd403a3b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc001560 tx=0x7f1fdc007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:02.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.816+0000 7f1fcffff640 1 -- 172.21.15.133:0/2490449595 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1fd804b920 con 0x7f1fe810e2f0 2024-02-15T22:56:02.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:02.988+0000 7f1fedf6d640 1 -- 172.21.15.133:0/2490449595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7f1fe8067570 con 0x7f1fe810e2f0 2024-02-15T22:56:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.679+0000 7f1fcffff640 1 -- 172.21.15.133:0/2490449595 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) v1 ==== 185+0+0 (secure 0 0 0) 0x7f1fd804b350 con 0x7f1fe810e2f0 2024-02-15T22:56:03.681 INFO:teuthology.orchestra.run.smithi133.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-02-15T22:56:03.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.682+0000 7f1fedf6d640 1 -- 172.21.15.133:0/2490449595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1fd4037ef0 msgr2=0x7f1fd403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:03.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.682+0000 7f1fedf6d640 1 --2- 172.21.15.133:0/2490449595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1fd4037ef0 0x7f1fd403a3b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc001560 tx=0x7f1fdc007a50 comp rx=0 tx=0).stop 2024-02-15T22:56:03.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.682+0000 7f1fedf6d640 1 -- 172.21.15.133:0/2490449595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe810e2f0 msgr2=0x7f1fe81a9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:03.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.682+0000 7f1fedf6d640 1 --2- 172.21.15.133:0/2490449595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe810e2f0 0x7f1fe81a9c10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1fd802b950 tx=0x7f1fd80046c0 comp rx=0 tx=0).stop 2024-02-15T22:56:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.688+0000 7f1fedf6d640 1 -- 172.21.15.133:0/2490449595 shutdown_connections 2024-02-15T22:56:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.688+0000 7f1fedf6d640 1 --2- 172.21.15.133:0/2490449595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1fd4037ef0 0x7f1fd403a3b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.688+0000 7f1fedf6d640 1 --2- 172.21.15.133:0/2490449595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe810e2f0 0x7f1fe81a9c10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.688+0000 7f1fedf6d640 1 -- 172.21.15.133:0/2490449595 >> 172.21.15.133:0/2490449595 conn(0x7f1fe806ea90 msgr2=0x7f1fe811a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.690+0000 7f1fedf6d640 1 -- 172.21.15.133:0/2490449595 shutdown_connections 2024-02-15T22:56:03.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.690+0000 7f1fedf6d640 1 -- 172.21.15.133:0/2490449595 wait complete. 2024-02-15T22:56:03.714 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-02-15T22:56:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.815+0000 7f5f65b3b640 1 Processor -- start 2024-02-15T22:56:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.816+0000 7f5f65b3b640 1 -- start start 2024-02-15T22:56:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.816+0000 7f5f65b3b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5f6010fe60 0x7f5f601197d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.816+0000 7f5f65b3b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f601103b0 con 0x7f5f6010e180 2024-02-15T22:56:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.816+0000 7f5f65b3b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f60110540 con 0x7f5f6010fe60 2024-02-15T22:56:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.816+0000 7f5f5effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5f6010fe60 0x7f5f601197d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.816+0000 7f5f5f7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5f6010e180 0x7f5f6010f750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:47024/0 (socket says 172.21.15.133:47024) 2024-02-15T22:56:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.816+0000 7f5f5f7fe640 1 -- 172.21.15.133:0/3535612175 learned_addr learned my addr 172.21.15.133:0/3535612175 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.817+0000 7f5f5effd640 1 -- 172.21.15.133:0/3535612175 >> v1:172.21.15.52:6789/0 conn(0x7f5f6010e180 legacy=0x7f5f6010f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.817+0000 7f5f5effd640 1 -- 172.21.15.133:0/3535612175 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6011ad20 con 0x7f5f6010fe60 2024-02-15T22:56:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.817+0000 7f5f5effd640 1 --2- 172.21.15.133:0/3535612175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f6010fe60 0x7f5f601197d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009720 tx=0x7f5f5402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12f33ecbf39ba63 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.817+0000 7f5f5e7fc640 1 -- 172.21.15.133:0/3535612175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f5402e070 con 0x7f5f6010fe60 2024-02-15T22:56:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.817+0000 7f5f5e7fc640 1 -- 172.21.15.133:0/3535612175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f540316d0 con 0x7f5f6010fe60 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.817+0000 7f5f5e7fc640 1 -- 172.21.15.133:0/3535612175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f54031990 con 0x7f5f6010fe60 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.818+0000 7f5f65b3b640 1 -- 172.21.15.133:0/3535612175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f6010fe60 msgr2=0x7f5f601197d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.818+0000 7f5f65b3b640 1 --2- 172.21.15.133:0/3535612175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f6010fe60 0x7f5f601197d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009720 tx=0x7f5f5402b840 comp rx=0 tx=0).stop 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.818+0000 7f5f65b3b640 1 -- 172.21.15.133:0/3535612175 shutdown_connections 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.818+0000 7f5f65b3b640 1 --2- 172.21.15.133:0/3535612175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f6010fe60 0x7f5f601197d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.818+0000 7f5f65b3b640 1 -- 172.21.15.133:0/3535612175 >> 172.21.15.133:0/3535612175 conn(0x7f5f6006e9f0 msgr2=0x7f5f60070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.818+0000 7f5f65b3b640 1 -- 172.21.15.133:0/3535612175 shutdown_connections 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.818+0000 7f5f65b3b640 1 -- 172.21.15.133:0/3535612175 wait complete. 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.819+0000 7f5f65b3b640 1 Processor -- start 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.819+0000 7f5f65b3b640 1 -- start start 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.819+0000 7f5f65b3b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f6010e180 0x7f5f601a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.819+0000 7f5f65b3b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f601a21a0 con 0x7f5f6010e180 2024-02-15T22:56:03.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.819+0000 7f5f5f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f6010e180 0x7f5f601a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:03.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.819+0000 7f5f5f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f6010e180 0x7f5f601a1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:42412/0 (socket says 172.21.15.133:42412) 2024-02-15T22:56:03.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.819+0000 7f5f5f7fe640 1 -- 172.21.15.133:0/1198021101 learned_addr learned my addr 172.21.15.133:0/1198021101 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:03.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.820+0000 7f5f5f7fe640 1 -- 172.21.15.133:0/1198021101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f54009400 con 0x7f5f6010e180 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.820+0000 7f5f5f7fe640 1 --2- 172.21.15.133:0/1198021101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f6010e180 0x7f5f601a1c60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000c340 tx=0x7f5f50001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.820+0000 7f5f47fff640 1 -- 172.21.15.133:0/1198021101 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f50005c10 con 0x7f5f6010e180 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.820+0000 7f5f47fff640 1 -- 172.21.15.133:0/1198021101 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f50005d70 con 0x7f5f6010e180 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.820+0000 7f5f65b3b640 1 -- 172.21.15.133:0/1198021101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f601a23a0 con 0x7f5f6010e180 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.820+0000 7f5f47fff640 1 -- 172.21.15.133:0/1198021101 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f50004930 con 0x7f5f6010e180 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.820+0000 7f5f65b3b640 1 -- 172.21.15.133:0/1198021101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f601a64e0 con 0x7f5f6010e180 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.821+0000 7f5f47fff640 1 -- 172.21.15.133:0/1198021101 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5f50004ba0 con 0x7f5f6010e180 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.821+0000 7f5f65b3b640 1 -- 172.21.15.133:0/1198021101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f600627b0 con 0x7f5f6010e180 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.821+0000 7f5f47fff640 1 --2- 172.21.15.133:0/1198021101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f4c037ea0 0x7f5f4c03a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.821+0000 7f5f47fff640 1 -- 172.21.15.133:0/1198021101 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3856+0+0 (secure 0 0 0) 0x7f5f5004a430 con 0x7f5f6010e180 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.821+0000 7f5f5effd640 1 --2- 172.21.15.133:0/1198021101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f4c037ea0 0x7f5f4c03a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:03.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.822+0000 7f5f5effd640 1 --2- 172.21.15.133:0/1198021101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f4c037ea0 0x7f5f4c03a360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f54036000 tx=0x7f5f54008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:03.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.826+0000 7f5f47fff640 1 -- 172.21.15.133:0/1198021101 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5f5001a310 con 0x7f5f6010e180 2024-02-15T22:56:04.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:03.999+0000 7f5f65b3b640 1 -- 172.21.15.133:0/1198021101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f5f60067570 con 0x7f5f6010e180 2024-02-15T22:56:04.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.682+0000 7f5f47fff640 1 -- 172.21.15.133:0/1198021101 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5f50011bf0 con 0x7f5f6010e180 2024-02-15T22:56:04.685 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'default.rgw.buckets.index' created 2024-02-15T22:56:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.686+0000 7f5f65b3b640 1 -- 172.21.15.133:0/1198021101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f4c037ea0 msgr2=0x7f5f4c03a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.686+0000 7f5f65b3b640 1 --2- 172.21.15.133:0/1198021101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f4c037ea0 0x7f5f4c03a360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f54036000 tx=0x7f5f54008030 comp rx=0 tx=0).stop 2024-02-15T22:56:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.686+0000 7f5f65b3b640 1 -- 172.21.15.133:0/1198021101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f6010e180 msgr2=0x7f5f601a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.686+0000 7f5f65b3b640 1 --2- 172.21.15.133:0/1198021101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f6010e180 0x7f5f601a1c60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000c340 tx=0x7f5f50001e70 comp rx=0 tx=0).stop 2024-02-15T22:56:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.686+0000 7f5f65b3b640 1 -- 172.21.15.133:0/1198021101 shutdown_connections 2024-02-15T22:56:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.686+0000 7f5f65b3b640 1 --2- 172.21.15.133:0/1198021101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f4c037ea0 0x7f5f4c03a360 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.686+0000 7f5f65b3b640 1 --2- 172.21.15.133:0/1198021101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f6010e180 0x7f5f601a1c60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.686+0000 7f5f65b3b640 1 -- 172.21.15.133:0/1198021101 >> 172.21.15.133:0/1198021101 conn(0x7f5f6006e9f0 msgr2=0x7f5f60112750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.686+0000 7f5f65b3b640 1 -- 172.21.15.133:0/1198021101 shutdown_connections 2024-02-15T22:56:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.687+0000 7f5f65b3b640 1 -- 172.21.15.133:0/1198021101 wait complete. 2024-02-15T22:56:04.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-02-15T22:56:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.811+0000 7f6f57d8d640 1 Processor -- start 2024-02-15T22:56:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.811+0000 7f6f57d8d640 1 -- start start 2024-02-15T22:56:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.812+0000 7f6f57d8d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f5011a330 0x7f6f5011c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.812+0000 7f6f57d8d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5011ccf0 con 0x7f6f50117640 2024-02-15T22:56:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.812+0000 7f6f57d8d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5011de90 con 0x7f6f5011a330 2024-02-15T22:56:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.812+0000 7f6f55328640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f5011a330 0x7f6f5011c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.812+0000 7f6f55328640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f5011a330 0x7f6f5011c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:42422/0 (socket says 172.21.15.133:42422) 2024-02-15T22:56:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.812+0000 7f6f55328640 1 -- 172.21.15.133:0/1527869602 learned_addr learned my addr 172.21.15.133:0/1527869602 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.812+0000 7f6f55b29640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6f50117640 0x7f6f50117a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:47036/0 (socket says 172.21.15.133:47036) 2024-02-15T22:56:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.812+0000 7f6f55328640 1 -- 172.21.15.133:0/1527869602 >> v1:172.21.15.52:6789/0 conn(0x7f6f50117640 legacy=0x7f6f50117a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.812+0000 7f6f55328640 1 -- 172.21.15.133:0/1527869602 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5011dfd0 con 0x7f6f5011a330 2024-02-15T22:56:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.813+0000 7f6f55328640 1 --2- 172.21.15.133:0/1527869602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f5011a330 0x7f6f5011c720 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6f400097f0 tx=0x7f6f4002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64391b91319ed9f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.813+0000 7f6f54b27640 1 -- 172.21.15.133:0/1527869602 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f400317a0 con 0x7f6f5011a330 2024-02-15T22:56:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.813+0000 7f6f54b27640 1 -- 172.21.15.133:0/1527869602 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40031900 con 0x7f6f5011a330 2024-02-15T22:56:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.813+0000 7f6f54b27640 1 -- 172.21.15.133:0/1527869602 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f40031bc0 con 0x7f6f5011a330 2024-02-15T22:56:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.814+0000 7f6f57d8d640 1 -- 172.21.15.133:0/1527869602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f5011a330 msgr2=0x7f6f5011c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.814+0000 7f6f57d8d640 1 --2- 172.21.15.133:0/1527869602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f5011a330 0x7f6f5011c720 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6f400097f0 tx=0x7f6f4002b910 comp rx=0 tx=0).stop 2024-02-15T22:56:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.814+0000 7f6f57d8d640 1 -- 172.21.15.133:0/1527869602 shutdown_connections 2024-02-15T22:56:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.814+0000 7f6f57d8d640 1 --2- 172.21.15.133:0/1527869602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f5011a330 0x7f6f5011c720 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.814+0000 7f6f57d8d640 1 -- 172.21.15.133:0/1527869602 >> 172.21.15.133:0/1527869602 conn(0x7f6f5006db10 msgr2=0x7f6f5006df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.814+0000 7f6f57d8d640 1 -- 172.21.15.133:0/1527869602 shutdown_connections 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.814+0000 7f6f57d8d640 1 -- 172.21.15.133:0/1527869602 wait complete. 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.815+0000 7f6f57d8d640 1 Processor -- start 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.815+0000 7f6f57d8d640 1 -- start start 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.815+0000 7f6f57d8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50117640 0x7f6f501abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.815+0000 7f6f57d8d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f501ac3b0 con 0x7f6f50117640 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.815+0000 7f6f55b29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50117640 0x7f6f501abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.815+0000 7f6f55b29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50117640 0x7f6f501abde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:42432/0 (socket says 172.21.15.133:42432) 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.815+0000 7f6f55b29640 1 -- 172.21.15.133:0/2056817829 learned_addr learned my addr 172.21.15.133:0/2056817829 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.815+0000 7f6f55b29640 1 -- 172.21.15.133:0/2056817829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400094d0 con 0x7f6f50117640 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.816+0000 7f6f55b29640 1 --2- 172.21.15.133:0/2056817829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50117640 0x7f6f501abde0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c450 tx=0x7f6f4c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.816+0000 7f6f467fc640 1 -- 172.21.15.133:0/2056817829 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c007410 con 0x7f6f50117640 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.816+0000 7f6f467fc640 1 -- 172.21.15.133:0/2056817829 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c007570 con 0x7f6f50117640 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.816+0000 7f6f57d8d640 1 -- 172.21.15.133:0/2056817829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f501ac5b0 con 0x7f6f50117640 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.816+0000 7f6f467fc640 1 -- 172.21.15.133:0/2056817829 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c004910 con 0x7f6f50117640 2024-02-15T22:56:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.816+0000 7f6f57d8d640 1 -- 172.21.15.133:0/2056817829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f501a5c60 con 0x7f6f50117640 2024-02-15T22:56:04.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.817+0000 7f6f57d8d640 1 -- 172.21.15.133:0/2056817829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f50067570 con 0x7f6f50117640 2024-02-15T22:56:04.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.817+0000 7f6f467fc640 1 -- 172.21.15.133:0/2056817829 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6f4c004b80 con 0x7f6f50117640 2024-02-15T22:56:04.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.817+0000 7f6f467fc640 1 --2- 172.21.15.133:0/2056817829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f34037ea0 0x7f6f3403a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.817+0000 7f6f467fc640 1 -- 172.21.15.133:0/2056817829 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4220+0+0 (secure 0 0 0) 0x7f6f4c04a600 con 0x7f6f50117640 2024-02-15T22:56:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.817+0000 7f6f55328640 1 --2- 172.21.15.133:0/2056817829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f34037ea0 0x7f6f3403a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.817+0000 7f6f55328640 1 --2- 172.21.15.133:0/2056817829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f34037ea0 0x7f6f3403a360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6f40036000 tx=0x7f6f40008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:04.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.822+0000 7f6f467fc640 1 -- 172.21.15.133:0/2056817829 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6f4c013e40 con 0x7f6f50117640 2024-02-15T22:56:04.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:04.995+0000 7f6f57d8d640 1 -- 172.21.15.133:0/2056817829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7f6f5011a330 con 0x7f6f50117640 2024-02-15T22:56:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:05.686+0000 7f6f467fc640 1 -- 172.21.15.133:0/2056817829 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) v1 ==== 187+0+0 (secure 0 0 0) 0x7f6f4c01a310 con 0x7f6f50117640 2024-02-15T22:56:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-02-15T22:56:05.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:05.689+0000 7f6f57d8d640 1 -- 172.21.15.133:0/2056817829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f34037ea0 msgr2=0x7f6f3403a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:05.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:05.689+0000 7f6f57d8d640 1 --2- 172.21.15.133:0/2056817829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f34037ea0 0x7f6f3403a360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6f40036000 tx=0x7f6f40008030 comp rx=0 tx=0).stop 2024-02-15T22:56:05.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:05.689+0000 7f6f57d8d640 1 -- 172.21.15.133:0/2056817829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50117640 msgr2=0x7f6f501abde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:05.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:05.689+0000 7f6f57d8d640 1 --2- 172.21.15.133:0/2056817829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50117640 0x7f6f501abde0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c450 tx=0x7f6f4c00c910 comp rx=0 tx=0).stop 2024-02-15T22:56:05.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:05.691+0000 7f6f57d8d640 1 -- 172.21.15.133:0/2056817829 shutdown_connections 2024-02-15T22:56:05.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:05.691+0000 7f6f57d8d640 1 --2- 172.21.15.133:0/2056817829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f34037ea0 0x7f6f3403a360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:05.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:05.691+0000 7f6f57d8d640 1 --2- 172.21.15.133:0/2056817829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50117640 0x7f6f501abde0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:05.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:05.691+0000 7f6f57d8d640 1 -- 172.21.15.133:0/2056817829 >> 172.21.15.133:0/2056817829 conn(0x7f6f5006db10 msgr2=0x7f6f5010fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:05.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:05.692+0000 7f6f57d8d640 1 -- 172.21.15.133:0/2056817829 shutdown_connections 2024-02-15T22:56:05.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:05.692+0000 7f6f57d8d640 1 -- 172.21.15.133:0/2056817829 wait complete. 2024-02-15T22:56:05.721 DEBUG:tasks.rgw:Pools created 2024-02-15T22:56:05.721 INFO:tasks.rgw:Starting rgw... 2024-02-15T22:56:05.721 INFO:tasks.rgw:rgw client.0 config is {} 2024-02-15T22:56:05.721 INFO:tasks.rgw:Using beast as radosgw frontend 2024-02-15T22:56:05.721 DEBUG:teuthology.orchestra.run.smithi133:> sudo echo -n http://smithi133.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-02-15T22:56:05.751 INFO:teuthology.orchestra.run.smithi133.stdout:http://smithi133.front.sepia.ceph.com:80 2024-02-15T22:56:05.751 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-02-15T22:56:05.820 INFO:tasks.rgw.client.0:Restarting daemon 2024-02-15T22:56:05.820 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-02-15T22:56:05.862 INFO:tasks.rgw.client.0:Started 2024-02-15T22:56:05.862 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T22:56:05.863 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T22:56:05.882 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-15T22:56:05.882 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-02-15T22:56:05.883 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-15T22:56:05.884 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-15T22:56:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80: Connection refused 2024-02-15T22:56:06.885 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T22:56:06.908 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-15T22:56:06.908 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-02-15T22:56:06.908 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-15T22:56:06.910 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-15T22:56:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80: Connection refused 2024-02-15T22:56:08.911 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T22:56:08.935 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-15T22:56:08.935 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-02-15T22:56:08.935 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-15T22:56:08.936 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-15T22:56:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80: Connection refused 2024-02-15T22:56:12.937 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T22:56:12.960 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-15T22:56:12.960 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-02-15T22:56:12.960 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-15T22:56:12.961 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-15T22:56:12.961 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80: Connection refused 2024-02-15T22:56:20.962 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-02-15T22:56:20.984 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-15T22:56:20.984 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-02-15T22:56:20.986 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2024-02-15T22:56:20.986 INFO:teuthology.orchestra.run.smithi133.stdout:anonymous 2024-02-15T22:56:20.987 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-02-15T22:56:22.496 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-02-15T22:56:22.496 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-15T22:56:22.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-15T22:56:22.496 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-15T22:56:22.544 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:22.544 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:22.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.542+0000 7f65be520800 1 Processor -- start 2024-02-15T22:56:22.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.542+0000 7f65be520800 1 -- start start 2024-02-15T22:56:22.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.542+0000 7f65be520800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55fd9935e2f0 0x55fd993606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.542+0000 7f65be520800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fd992a5ba0 con 0x55fd99359e60 2024-02-15T22:56:22.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.542+0000 7f65be520800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fd9925d450 con 0x55fd9935e2f0 2024-02-15T22:56:22.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.543+0000 7f65b9a7c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55fd9935e2f0 0x55fd993606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.543+0000 7f65b9a7c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55fd9935e2f0 0x55fd993606e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48064/0 (socket says 172.21.15.133:48064) 2024-02-15T22:56:22.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.543+0000 7f65b9a7c640 1 -- 172.21.15.133:0/485756463 learned_addr learned my addr 172.21.15.133:0/485756463 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.543+0000 7f65ba27d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55fd99359e60 0x55fd9935a280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:51048/0 (socket says 172.21.15.133:51048) 2024-02-15T22:56:22.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.543+0000 7f65b9a7c640 1 -- 172.21.15.133:0/485756463 >> v1:172.21.15.52:6789/0 conn(0x55fd99359e60 legacy=0x55fd9935a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.543+0000 7f65b9a7c640 1 -- 172.21.15.133:0/485756463 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd99361d10 con 0x55fd9935e2f0 2024-02-15T22:56:22.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.545+0000 7f65b9a7c640 1 --2- 172.21.15.133:0/485756463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd9935e2f0 0x55fd993606e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f65b000a520 tx=0x7f65b001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca544072195856fb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.545+0000 7f65b927b640 1 -- 172.21.15.133:0/485756463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65b0052570 con 0x55fd9935e2f0 2024-02-15T22:56:22.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.545+0000 7f65b927b640 1 -- 172.21.15.133:0/485756463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b00526d0 con 0x55fd9935e2f0 2024-02-15T22:56:22.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.545+0000 7f65b927b640 1 -- 172.21.15.133:0/485756463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65b0052990 con 0x55fd9935e2f0 2024-02-15T22:56:22.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.546+0000 7f65be520800 1 -- 172.21.15.133:0/485756463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd9935e2f0 msgr2=0x55fd993606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.546+0000 7f65be520800 1 --2- 172.21.15.133:0/485756463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd9935e2f0 0x55fd993606e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f65b000a520 tx=0x7f65b001cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.546+0000 7f65be520800 1 -- 172.21.15.133:0/485756463 shutdown_connections 2024-02-15T22:56:22.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.546+0000 7f65be520800 1 --2- 172.21.15.133:0/485756463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd9935e2f0 0x55fd993606e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.546+0000 7f65be520800 1 -- 172.21.15.133:0/485756463 >> 172.21.15.133:0/485756463 conn(0x55fd993554c0 msgr2=0x55fd993578e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.546+0000 7f65be520800 1 -- 172.21.15.133:0/485756463 shutdown_connections 2024-02-15T22:56:22.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.546+0000 7f65be520800 1 -- 172.21.15.133:0/485756463 wait complete. 2024-02-15T22:56:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.560+0000 7f65be520800 1 Processor -- start 2024-02-15T22:56:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.560+0000 7f65be520800 1 -- start start 2024-02-15T22:56:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.560+0000 7f65be520800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99449ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.560+0000 7f65be520800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd9925a980 con 0x55fd99359e60 2024-02-15T22:56:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.561+0000 7f65ba27d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99449ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.561+0000 7f65ba27d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99449ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48076/0 (socket says 172.21.15.133:48076) 2024-02-15T22:56:22.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.561+0000 7f65ba27d640 1 -- 172.21.15.133:0/2099872692 learned_addr learned my addr 172.21.15.133:0/2099872692 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.561+0000 7f65ba27d640 1 -- 172.21.15.133:0/2099872692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b0005de0 con 0x55fd99359e60 2024-02-15T22:56:22.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.561+0000 7f65ba27d640 1 --2- 172.21.15.133:0/2099872692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99449ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f65ac006fb0 tx=0x7f65ac0019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9774801265766f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.561+0000 7f64a8608640 1 -- 172.21.15.133:0/2099872692 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65ac013420 con 0x55fd99359e60 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.561+0000 7f64a8608640 1 -- 172.21.15.133:0/2099872692 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac013580 con 0x55fd99359e60 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.561+0000 7f64a8608640 1 -- 172.21.15.133:0/2099872692 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65ac013860 con 0x55fd99359e60 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.562+0000 7f65be520800 1 -- 172.21.15.133:0/2099872692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 msgr2=0x55fd99449ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.562+0000 7f65be520800 1 --2- 172.21.15.133:0/2099872692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99449ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f65ac006fb0 tx=0x7f65ac0019a0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.562+0000 7f65be520800 1 -- 172.21.15.133:0/2099872692 shutdown_connections 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.562+0000 7f65be520800 1 --2- 172.21.15.133:0/2099872692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99449ee0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.562+0000 7f65be520800 1 -- 172.21.15.133:0/2099872692 >> 172.21.15.133:0/2099872692 conn(0x55fd993554c0 msgr2=0x55fd99445800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.562+0000 7f65be520800 1 -- 172.21.15.133:0/2099872692 shutdown_connections 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.562+0000 7f65be520800 1 -- 172.21.15.133:0/2099872692 wait complete. 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.563+0000 7f65be520800 1 Processor -- start 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.563+0000 7f65be520800 1 -- start start 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.563+0000 7f65be520800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99455250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.563+0000 7f65be520800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd99256160 con 0x55fd99359e60 2024-02-15T22:56:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.563+0000 7f65ba27d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99455250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.563+0000 7f65ba27d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99455250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48078/0 (socket says 172.21.15.133:48078) 2024-02-15T22:56:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.563+0000 7f65ba27d640 1 -- 172.21.15.133:0/2238937117 learned_addr learned my addr 172.21.15.133:0/2238937117 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.563+0000 7f65ba27d640 1 -- 172.21.15.133:0/2238937117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd992a5ba0 con 0x55fd99359e60 2024-02-15T22:56:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.564+0000 7f65ba27d640 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99455250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f65ac001350 tx=0x7f65ac001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.564+0000 7f64a6e05640 1 -- 172.21.15.133:0/2238937117 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65ac006830 con 0x55fd99359e60 2024-02-15T22:56:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.564+0000 7f64a6e05640 1 -- 172.21.15.133:0/2238937117 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac0049c0 con 0x55fd99359e60 2024-02-15T22:56:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.564+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fd992ce000 con 0x55fd99359e60 2024-02-15T22:56:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.564+0000 7f64a6e05640 1 -- 172.21.15.133:0/2238937117 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65ac004ca0 con 0x55fd99359e60 2024-02-15T22:56:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.564+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd99455790 con 0x55fd99359e60 2024-02-15T22:56:22.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.565+0000 7f64a6e05640 1 -- 172.21.15.133:0/2238937117 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f65ac01e420 con 0x55fd99359e60 2024-02-15T22:56:22.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.565+0000 7f64a6e05640 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64a00367e0 0x7f64a0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.565+0000 7f64a6e05640 1 -- 172.21.15.133:0/2238937117 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f65ac04bfc0 con 0x55fd99359e60 2024-02-15T22:56:22.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.565+0000 7f65b9a7c640 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64a00367e0 0x7f64a0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.565+0000 7f65be520800 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fd9935e2f0 0x55fd99459380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.565+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99459980 con 0x55fd9935e2f0 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.565+0000 7f65baa7e640 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fd9935e2f0 0x55fd99459380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.566+0000 7f65b9a7c640 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64a00367e0 0x7f64a0038ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65b0054000 tx=0x7f65b004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.566+0000 7f65baa7e640 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fd9935e2f0 0x55fd99459380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.566+0000 7f65baa7e640 1 -- 172.21.15.133:0/2238937117 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65b40083e0 con 0x55fd9935e2f0 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.566+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99456920 con 0x55fd9935e2f0 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.566+0000 7f65baa7e640 1 -- 172.21.15.133:0/2238937117 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f65b40083e0 con 0x55fd9935e2f0 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.566+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9945b6b0 con 0x55fd9935e2f0 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.567+0000 7f65baa7e640 1 -- 172.21.15.133:0/2238937117 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f65b40083e0 con 0x55fd9935e2f0 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.567+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9945a9c0 con 0x55fd9935e2f0 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.567+0000 7f65baa7e640 1 -- 172.21.15.133:0/2238937117 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f65b40083e0 con 0x55fd9935e2f0 2024-02-15T22:56:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.567+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9945add0 con 0x55fd9935e2f0 2024-02-15T22:56:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.567+0000 7f65baa7e640 1 -- 172.21.15.133:0/2238937117 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f65b4012040 con 0x55fd9935e2f0 2024-02-15T22:56:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.568+0000 7f65be520800 1 Processor -- start 2024-02-15T22:56:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.568+0000 7f65be520800 1 -- start start 2024-02-15T22:56:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.568+0000 7f65be520800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd9946a150 0x55fd9946a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.568+0000 7f65be520800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd991f8e80 con 0x55fd9946a150 2024-02-15T22:56:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.568+0000 7f65b9a7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd9946a150 0x55fd9946a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.568+0000 7f65b9a7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd9946a150 0x55fd9946a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48086/0 (socket says 172.21.15.133:48086) 2024-02-15T22:56:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.568+0000 7f65b9a7c640 1 -- 172.21.15.133:0/711083318 learned_addr learned my addr 172.21.15.133:0/711083318 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.569+0000 7f65b9a7c640 1 -- 172.21.15.133:0/711083318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd9946aab0 con 0x55fd9946a150 2024-02-15T22:56:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.569+0000 7f65b9a7c640 1 --2- 172.21.15.133:0/711083318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd9946a150 0x55fd9946a570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f65b0000c00 tx=0x7f65b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.569+0000 7f649ffff640 1 -- 172.21.15.133:0/711083318 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65b005dcb0 con 0x55fd9946a150 2024-02-15T22:56:22.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.569+0000 7f649ffff640 1 -- 172.21.15.133:0/711083318 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b005de10 con 0x55fd9946a150 2024-02-15T22:56:22.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.569+0000 7f65be520800 1 -- 172.21.15.133:0/711083318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fd9946aca0 con 0x55fd9946a150 2024-02-15T22:56:22.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.569+0000 7f649ffff640 1 -- 172.21.15.133:0/711083318 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65b0069530 con 0x55fd9946a150 2024-02-15T22:56:22.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.569+0000 7f65be520800 1 -- 172.21.15.133:0/711083318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd9946b7f0 con 0x55fd9946a150 2024-02-15T22:56:22.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.570+0000 7f649ffff640 1 -- 172.21.15.133:0/711083318 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f65b0059040 con 0x55fd9946a150 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.570+0000 7f649ffff640 1 --2- 172.21.15.133:0/711083318 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64940367d0 0x7f6494038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.570+0000 7f649ffff640 1 -- 172.21.15.133:0/711083318 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f65b008f4a0 con 0x55fd9946a150 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.570+0000 7f65baa7e640 1 --2- 172.21.15.133:0/711083318 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64940367d0 0x7f6494038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.571+0000 7f65be520800 1 Processor -- start 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.571+0000 7f65be520800 1 -- start start 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.571+0000 7f65baa7e640 1 --2- 172.21.15.133:0/711083318 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64940367d0 0x7f6494038c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55fd9945a400 tx=0x7f65b4000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.571+0000 7f65be520800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 0x55fd99477770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.571+0000 7f65be520800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd991ce5d0 con 0x55fd99477350 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.571+0000 7f65b9a7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 0x55fd99477770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.571+0000 7f65b9a7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 0x55fd99477770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48102/0 (socket says 172.21.15.133:48102) 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.571+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2348687040 learned_addr learned my addr 172.21.15.133:0/2348687040 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.571+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2348687040 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd99477d40 con 0x55fd99477350 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.572+0000 7f65b9a7c640 1 --2- 172.21.15.133:0/2348687040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 0x55fd99477770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f65b000a3f0 tx=0x7f65b0006870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ee7055f269f66 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.572+0000 7f649dffb640 1 -- 172.21.15.133:0/2348687040 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65b00727e0 con 0x55fd99477350 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.572+0000 7f649dffb640 1 -- 172.21.15.133:0/2348687040 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b0073460 con 0x55fd99477350 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.572+0000 7f649dffb640 1 -- 172.21.15.133:0/2348687040 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65b0068360 con 0x55fd99477350 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.572+0000 7f65be520800 1 -- 172.21.15.133:0/2348687040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 msgr2=0x55fd99477770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.572+0000 7f65be520800 1 --2- 172.21.15.133:0/2348687040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 0x55fd99477770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f65b000a3f0 tx=0x7f65b0006870 comp rx=0 tx=0).stop 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.572+0000 7f65be520800 1 -- 172.21.15.133:0/2348687040 shutdown_connections 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.572+0000 7f65be520800 1 --2- 172.21.15.133:0/2348687040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 0x55fd99477770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.572+0000 7f65be520800 1 -- 172.21.15.133:0/2348687040 >> 172.21.15.133:0/2348687040 conn(0x55fd99473670 msgr2=0x55fd994716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.572+0000 7f65be520800 1 -- 172.21.15.133:0/2348687040 shutdown_connections 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.572+0000 7f65be520800 1 -- 172.21.15.133:0/2348687040 wait complete. 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.573+0000 7f65be520800 1 Processor -- start 2024-02-15T22:56:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.573+0000 7f65be520800 1 -- start start 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.573+0000 7f65be520800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 0x55fd9947e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.573+0000 7f65be520800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd9947e8d0 con 0x55fd99477350 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.573+0000 7f65b9a7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 0x55fd9947e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.573+0000 7f65b9a7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 0x55fd9947e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48104/0 (socket says 172.21.15.133:48104) 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.573+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 learned_addr learned my addr 172.21.15.133:0/2117688123 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.573+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd9946b7f0 con 0x55fd99477350 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.574+0000 7f65b9a7c640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 0x55fd9947e390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f65b0006900 tx=0x7f65b008d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.574+0000 7f648bfff640 1 -- 172.21.15.133:0/2117688123 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65b00735d0 con 0x55fd99477350 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.574+0000 7f648bfff640 1 -- 172.21.15.133:0/2117688123 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b008db80 con 0x55fd99477350 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.574+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fd9947ead0 con 0x55fd99477350 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.574+0000 7f648bfff640 1 -- 172.21.15.133:0/2117688123 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65b0072de0 con 0x55fd99477350 2024-02-15T22:56:22.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.574+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd9947ead0 con 0x55fd99477350 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.575+0000 7f648bfff640 1 -- 172.21.15.133:0/2117688123 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f65b006a030 con 0x55fd99477350 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.575+0000 7f65be520800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.575+0000 7f648bfff640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6484036790 0x7f6484038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.575+0000 7f648bfff640 1 -- 172.21.15.133:0/2117688123 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f65b009aac0 con 0x55fd99477350 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.575+0000 7f65baa7e640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6484036790 0x7f6484038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.575+0000 7f65be520800 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fd99489d50 0x55fd9948c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.575+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948c910 con 0x55fd99489d50 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.575+0000 7f65ba27d640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fd99489d50 0x55fd9948c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65baa7e640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6484036790 0x7f6484038c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55fd9945a4c0 tx=0x7f65b400c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65ba27d640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fd99489d50 0x55fd9948c1c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65be520800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65be520800 20 realm 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65be520800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948cce0 con 0x55fd99489d50 2024-02-15T22:56:22.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65be520800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65be520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65be520800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948d560 con 0x55fd99489d50 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65be520800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65be520800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.576+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948d8c0 con 0x55fd99489d50 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.577+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.577+0000 7f65be520800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.577+0000 7f65be520800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.577+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948d1c0 con 0x55fd99489d50 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.577+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.577+0000 7f65be520800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:22.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.577+0000 7f65be520800 20 searching for the correct realm 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.577+0000 7f65be520800 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55fd9948fc40 0x55fd99492050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.577+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.577+0000 7f65b9a7c640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55fd9948fc40 0x55fd99492050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.577+0000 7f65b9a7c640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55fd9948fc40 0x55fd99492050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.578+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b0096070 con 0x55fd9948fc40 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.578+0000 7f65b9a7c640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f65b008f700 0x7f65b005c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.578+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b008f700 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.578+0000 7f65baa7e640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f65b008f700 0x7f65b005c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.578+0000 7f65baa7e640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f65b008f700 0x7f65b005c750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.579+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b402c040 con 0x7f65b008f700 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.579+0000 7f65baa7e640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f65b4027940 0x7f65b40333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.579+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.579+0000 7f65ba27d640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f65b4027940 0x7f65b40333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.579+0000 7f65ba27d640 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f65b4027940 0x7f65b40333c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.580+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.580+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.580+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.580+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.581+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.581+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.581+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.581+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.581+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.581+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b008f700 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.582+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b402c040 con 0x7f65b008f700 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.582+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.582+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.582+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.582+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.582+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.582+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.582+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.583+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.583+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b008f700 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.583+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f65b402c040 con 0x7f65b008f700 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.583+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.583+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.583+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.583+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.583+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.584+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.584+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.584+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.584+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.584+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.584+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.584+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.584+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.584+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.585+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.585+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.585+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.585+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.585+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b008f700 2024-02-15T22:56:22.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.585+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b402c040 con 0x7f65b008f700 2024-02-15T22:56:22.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.585+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.586+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.586+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.586+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.586+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.586+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.586+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.587+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.587+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b008f700 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.587+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b402c040 con 0x7f65b008f700 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.587+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.587+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.587+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b008f700 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b402c040 con 0x7f65b008f700 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65be520800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65be520800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65be520800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65be520800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65be520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65be520800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65be520800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948e6b0 con 0x55fd99489d50 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65be520800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65be520800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.588+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948e330 con 0x55fd99489d50 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948ef80 con 0x55fd99489d50 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 20 zone default found 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 4 Realm: () 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 20 zonegroup default 2024-02-15T22:56:22.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948ef80 con 0x7f65b4027940 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99494590 con 0x55fd9948fc40 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.589+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.590+0000 7f65be520800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.590+0000 7f65be520800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.590+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994948f0 con 0x55fd9948fc40 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.590+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.590+0000 7f65be520800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.590+0000 7f65be520800 20 started sync module instance, tier type = 2024-02-15T22:56:22.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.590+0000 7f65be520800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.590+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99493e70 con 0x7f65b008f700 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.591+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.591+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94547686799824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99493df0 con 0x7f65b008f700 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.591+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99495600 con 0x55fd99489d50 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.592+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94547686799824] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.593+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.593+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94547686804672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99495580 con 0x55fd99489d50 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.593+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99495f30 con 0x55fd9948fc40 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.594+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94547686804672] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.595+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.595+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94547686805728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99495500 con 0x55fd9948fc40 2024-02-15T22:56:22.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.595+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99496d90 con 0x7f65b008f700 2024-02-15T22:56:22.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.598+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94547686805728] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.598+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.598+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94547686811888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994971b0 con 0x7f65b008f700 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.598+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99497b20 con 0x55fd99489d50 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.600+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94547686811888] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.601+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.601+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94547686815840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994971b0 con 0x55fd99489d50 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.601+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99498520 con 0x7f65b4027940 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.602+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.602+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94547686817856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994984a0 con 0x7f65b4027940 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.602+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99499460 con 0x7f65b4027940 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.602+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94547686815840] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.603+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94547686817856] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.605+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.605+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94547686821696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99498880 con 0x7f65b4027940 2024-02-15T22:56:22.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.605+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99499a30 con 0x7f65b4027940 2024-02-15T22:56:22.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.606+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.606+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94547686823312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99499e50 con 0x7f65b4027940 2024-02-15T22:56:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.606+0000 7f65be520800 20 add_watcher() i=0 2024-02-15T22:56:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.606+0000 7f65be520800 20 add_watcher() i=1 2024-02-15T22:56:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.606+0000 7f65be520800 20 add_watcher() i=2 2024-02-15T22:56:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.606+0000 7f65be520800 20 add_watcher() i=3 2024-02-15T22:56:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.606+0000 7f65be520800 20 add_watcher() i=4 2024-02-15T22:56:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.606+0000 7f65be520800 20 add_watcher() i=5 2024-02-15T22:56:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.607+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94547686823312] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.607+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94547686821696] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.608+0000 7f65be520800 20 add_watcher() i=6 2024-02-15T22:56:22.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.608+0000 7f65be520800 20 add_watcher() i=7 2024-02-15T22:56:22.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.608+0000 7f65be520800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:22.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.608+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99499e50 con 0x55fd99489d50 2024-02-15T22:56:22.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.608+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.608+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94547686824368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9949a710 con 0x55fd99489d50 2024-02-15T22:56:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.610+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94547686824368] v30'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.610+0000 7f6470fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.610+0000 7f65be520800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.610+0000 7f65be520800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.610+0000 7f65be520800 5 note: GC not initialized 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.610+0000 7f63eb7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.610+0000 7f65be520800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.610+0000 7f65be520800 20 Filter name: none 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.610+0000 7f63e97fa640 20 reqs_thread_entry: start 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.611+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994ce4c0 con 0x55fd9948fc40 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.611+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.611+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994ce4c0 con 0x55fd9948fc40 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.611+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.611+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994ce4c0 con 0x55fd99489d50 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.611+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.611+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948e6b0 con 0x55fd99489d50 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.612+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.612+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948e6b0 con 0x7f65b008f700 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.612+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.612+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.612+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.612+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.612+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.612+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.613+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.613+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b008f700 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.613+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.613+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.613+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.613+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.613+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.614+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.614+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.614+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.614+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.614+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.615+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.615+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.615+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.615+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.615+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.615+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.615+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.616+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.616+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.616+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b008f700 2024-02-15T22:56:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.616+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.616+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.616+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.616+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.616+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.616+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.617+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.617+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b008f700 2024-02-15T22:56:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.617+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.617+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.617+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.617+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.618+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.618+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.618+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.618+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.619+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.619+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b008f700 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.619+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.619+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b4027940 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.619+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.619+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd99489d50 2024-02-15T22:56:22.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.620+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.620+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x55fd9948fc40 2024-02-15T22:56:22.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.620+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.620+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99492720 con 0x7f65b008f700 2024-02-15T22:56:22.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.620+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.621+0000 7f6470fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:22.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.621+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94547686824368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd9948e6b0 con 0x55fd99489d50 2024-02-15T22:56:22.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.622+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94547686824368] v30'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.622+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94547686799824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994ce4c0 con 0x7f65b008f700 2024-02-15T22:56:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.625+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94547686799824] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.625+0000 7f65be520800 20 remove_watcher() i=0 2024-02-15T22:56:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.625+0000 7f65be520800 2 removed watcher, disabling cache 2024-02-15T22:56:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.625+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94547686804672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994ce4c0 con 0x55fd99489d50 2024-02-15T22:56:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.626+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94547686804672] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.626+0000 7f65be520800 20 remove_watcher() i=1 2024-02-15T22:56:22.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.626+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94547686805728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994ce4c0 con 0x55fd9948fc40 2024-02-15T22:56:22.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.627+0000 7f65b9a7c640 1 -- 172.21.15.133:0/2117688123 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94547686805728] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65b00ab040 con 0x55fd9948fc40 2024-02-15T22:56:22.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.627+0000 7f65be520800 20 remove_watcher() i=2 2024-02-15T22:56:22.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.627+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94547686811888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994939d0 con 0x7f65b008f700 2024-02-15T22:56:22.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.628+0000 7f65baa7e640 1 -- 172.21.15.133:0/2117688123 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94547686811888] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65b403f040 con 0x7f65b008f700 2024-02-15T22:56:22.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.628+0000 7f65be520800 20 remove_watcher() i=3 2024-02-15T22:56:22.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.628+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94547686815840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994968f0 con 0x55fd99489d50 2024-02-15T22:56:22.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.630+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94547686815840] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x55fd99489d50 2024-02-15T22:56:22.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.630+0000 7f65be520800 20 remove_watcher() i=4 2024-02-15T22:56:22.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.630+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94547686817856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994939d0 con 0x7f65b4027940 2024-02-15T22:56:22.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.632+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94547686817856] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.632+0000 7f65be520800 20 remove_watcher() i=5 2024-02-15T22:56:22.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.632+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94547686821696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd99497860 con 0x7f65b4027940 2024-02-15T22:56:22.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.634+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94547686821696] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.635+0000 7f65be520800 20 remove_watcher() i=6 2024-02-15T22:56:22.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.635+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94547686823312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fd994968f0 con 0x7f65b4027940 2024-02-15T22:56:22.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94547686823312] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65ac024070 con 0x7f65b4027940 2024-02-15T22:56:22.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 20 remove_watcher() i=7 2024-02-15T22:56:22.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f65b4027940 msgr2=0x7f65b40333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f65b4027940 0x7f65b40333c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fd99489d50 msgr2=0x55fd9948c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fd99489d50 0x55fd9948c1c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f65b008f700 msgr2=0x7f65b005c750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f65b008f700 0x7f65b005c750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55fd9948fc40 msgr2=0x55fd99492050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55fd9948fc40 0x55fd99492050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6484036790 msgr2=0x7f6484038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6484036790 0x7f6484038c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55fd9945a4c0 tx=0x7f65b400c040 comp rx=0 tx=0).stop 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 msgr2=0x55fd9947e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 --2- 172.21.15.133:0/2117688123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99477350 0x55fd9947e390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f65b0006900 tx=0x7f65b008d910 comp rx=0 tx=0).stop 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 reap_dead start 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65ba27d640 1 -- 172.21.15.133:0/2117688123 reap_dead start 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 shutdown_connections 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 >> 172.21.15.133:0/2117688123 conn(0x55fd99473670 msgr2=0x55fd99470cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 shutdown_connections 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/2117688123 wait complete. 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/711083318 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64940367d0 msgr2=0x7f6494038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 --2- 172.21.15.133:0/711083318 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64940367d0 0x7f6494038c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55fd9945a400 tx=0x7f65b4000f90 comp rx=0 tx=0).stop 2024-02-15T22:56:22.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/711083318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd9946a150 msgr2=0x55fd9946a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 --2- 172.21.15.133:0/711083318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd9946a150 0x55fd9946a570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f65b0000c00 tx=0x7f65b0002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/711083318 shutdown_connections 2024-02-15T22:56:22.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 --2- 172.21.15.133:0/711083318 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64940367d0 0x7f6494038c90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 --2- 172.21.15.133:0/711083318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd9946a150 0x55fd9946a570 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/711083318 >> 172.21.15.133:0/711083318 conn(0x55fd9945e1f0 msgr2=0x55fd9945e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/711083318 shutdown_connections 2024-02-15T22:56:22.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.636+0000 7f65be520800 1 -- 172.21.15.133:0/711083318 wait complete. 2024-02-15T22:56:22.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fd9935e2f0 msgr2=0x55fd99459380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fd9935e2f0 0x55fd99459380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64a00367e0 msgr2=0x7f64a0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64a00367e0 0x7f64a0038ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65b0054000 tx=0x7f65b004e000 comp rx=0 tx=0).stop 2024-02-15T22:56:22.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 msgr2=0x55fd99455250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99455250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f65ac001350 tx=0x7f65ac001250 comp rx=0 tx=0).stop 2024-02-15T22:56:22.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 shutdown_connections 2024-02-15T22:56:22.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fd9935e2f0 0x55fd99459380 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f64a00367e0 0x7f64a0038ca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 --2- 172.21.15.133:0/2238937117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd99359e60 0x55fd99455250 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 >> 172.21.15.133:0/2238937117 conn(0x55fd993554c0 msgr2=0x55fd99444080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 shutdown_connections 2024-02-15T22:56:22.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.637+0000 7f65be520800 1 -- 172.21.15.133:0/2238937117 wait complete. 2024-02-15T22:56:22.649 INFO:teuthology.orchestra.run.smithi133.stdout:[] 2024-02-15T22:56:22.649 DEBUG:tasks.util.rgw: json result: [] 2024-02-15T22:56:22.649 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-02-15T22:56:22.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-02-15T22:56:22.649 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-02-15T22:56:22.692 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:22.692 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:22.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.690+0000 7f4e4192f800 1 Processor -- start 2024-02-15T22:56:22.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.690+0000 7f4e4192f800 1 -- start start 2024-02-15T22:56:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.690+0000 7f4e4192f800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562b19c6be70 0x562b19c6c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.690+0000 7f4e4192f800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562b19bb7bb0 con 0x562b19c6d0d0 2024-02-15T22:56:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.690+0000 7f4e4192f800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x562b19b6f450 con 0x562b19c6be70 2024-02-15T22:56:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.691+0000 7f4e3d6f2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562b19c6be70 0x562b19c6c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.691+0000 7f4e3cef1640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x562b19c6d0d0 0x562b19c6d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:51050/0 (socket says 172.21.15.133:51050) 2024-02-15T22:56:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.691+0000 7f4e3cef1640 1 -- 172.21.15.133:0/2842908068 learned_addr learned my addr 172.21.15.133:0/2842908068 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.691+0000 7f4e3d6f2640 1 --2- 172.21.15.133:0/2842908068 >> v2:172.21.15.52:3300/0 conn(0x562b19c6be70 0x562b19c6c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48114/0 (socket says 172.21.15.133:48114) 2024-02-15T22:56:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.691+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/2842908068 >> v1:172.21.15.52:6789/0 conn(0x562b19c6d0d0 legacy=0x562b19c6d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.691+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/2842908068 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b19c6c960 con 0x562b19c6be70 2024-02-15T22:56:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.691+0000 7f4e2ffff640 1 -- 172.21.15.133:0/2842908068 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354747915 0 0) 0x562b19bb7bb0 con 0x562b19c6d0d0 2024-02-15T22:56:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.693+0000 7f4e3d6f2640 1 --2- 172.21.15.133:0/2842908068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19c6c290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000a470 tx=0x7f4e3001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383738f3021b8c34 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.693+0000 7f4e2ffff640 1 -- 172.21.15.133:0/2842908068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e30052570 con 0x562b19c6be70 2024-02-15T22:56:22.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.693+0000 7f4e2ffff640 1 -- 172.21.15.133:0/2842908068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e300526d0 con 0x562b19c6be70 2024-02-15T22:56:22.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.693+0000 7f4e2ffff640 1 -- 172.21.15.133:0/2842908068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e30052990 con 0x562b19c6be70 2024-02-15T22:56:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.694+0000 7f4e4192f800 1 -- 172.21.15.133:0/2842908068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 msgr2=0x562b19c6c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.694+0000 7f4e4192f800 1 --2- 172.21.15.133:0/2842908068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19c6c290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000a470 tx=0x7f4e3001cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.694+0000 7f4e4192f800 1 -- 172.21.15.133:0/2842908068 shutdown_connections 2024-02-15T22:56:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.694+0000 7f4e4192f800 1 --2- 172.21.15.133:0/2842908068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19c6c290 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.694+0000 7f4e4192f800 1 -- 172.21.15.133:0/2842908068 >> 172.21.15.133:0/2842908068 conn(0x562b19c674d0 msgr2=0x562b19c698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.694+0000 7f4e4192f800 1 -- 172.21.15.133:0/2842908068 shutdown_connections 2024-02-15T22:56:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.694+0000 7f4e4192f800 1 -- 172.21.15.133:0/2842908068 wait complete. 2024-02-15T22:56:22.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.705+0000 7f4e4192f800 1 Processor -- start 2024-02-15T22:56:22.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.705+0000 7f4e4192f800 1 -- start start 2024-02-15T22:56:22.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.705+0000 7f4e4192f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19bdff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.705+0000 7f4e4192f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b19b6c980 con 0x562b19c6be70 2024-02-15T22:56:22.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.705+0000 7f4e3d6f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19bdff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.705+0000 7f4e3d6f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19bdff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48128/0 (socket says 172.21.15.133:48128) 2024-02-15T22:56:22.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.705+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/2391276560 learned_addr learned my addr 172.21.15.133:0/2391276560 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.706+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/2391276560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30005d20 con 0x562b19c6be70 2024-02-15T22:56:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.706+0000 7f4e3d6f2640 1 --2- 172.21.15.133:0/2391276560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19bdff30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e30055040 tx=0x7f4e3004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ab5dbdc08363e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.706+0000 7f4d2b606640 1 -- 172.21.15.133:0/2391276560 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e3000a170 con 0x562b19c6be70 2024-02-15T22:56:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.706+0000 7f4d2b606640 1 -- 172.21.15.133:0/2391276560 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3000a2d0 con 0x562b19c6be70 2024-02-15T22:56:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.706+0000 7f4d2b606640 1 -- 172.21.15.133:0/2391276560 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e30052990 con 0x562b19c6be70 2024-02-15T22:56:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.707+0000 7f4e4192f800 1 -- 172.21.15.133:0/2391276560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 msgr2=0x562b19bdff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.707+0000 7f4e4192f800 1 --2- 172.21.15.133:0/2391276560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19bdff30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e30055040 tx=0x7f4e3004c000 comp rx=0 tx=0).stop 2024-02-15T22:56:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.707+0000 7f4e4192f800 1 -- 172.21.15.133:0/2391276560 shutdown_connections 2024-02-15T22:56:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.707+0000 7f4e4192f800 1 --2- 172.21.15.133:0/2391276560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19bdff30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.707+0000 7f4e4192f800 1 -- 172.21.15.133:0/2391276560 >> 172.21.15.133:0/2391276560 conn(0x562b19c674d0 msgr2=0x562b19d57970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.707+0000 7f4e4192f800 1 -- 172.21.15.133:0/2391276560 shutdown_connections 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.707+0000 7f4e4192f800 1 -- 172.21.15.133:0/2391276560 wait complete. 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.707+0000 7f4e4192f800 1 Processor -- start 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.707+0000 7f4e4192f800 1 -- start start 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.707+0000 7f4e4192f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19d64650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.707+0000 7f4e4192f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b19b68160 con 0x562b19c6be70 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.708+0000 7f4e3d6f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19d64650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.708+0000 7f4e3d6f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19d64650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48132/0 (socket says 172.21.15.133:48132) 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.708+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/346547180 learned_addr learned my addr 172.21.15.133:0/346547180 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.708+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/346547180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3004e070 con 0x562b19c6be70 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.708+0000 7f4e3d6f2640 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19d64650 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e30000c00 tx=0x7f4e30002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.708+0000 7f4d29e03640 1 -- 172.21.15.133:0/346547180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e30072440 con 0x562b19c6be70 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.708+0000 7f4d29e03640 1 -- 172.21.15.133:0/346547180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e300725c0 con 0x562b19c6be70 2024-02-15T22:56:22.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.708+0000 7f4d29e03640 1 -- 172.21.15.133:0/346547180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e300728a0 con 0x562b19c6be70 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.708+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562b19d64b90 con 0x562b19c6be70 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.708+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b19d650d0 con 0x562b19c6be70 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.709+0000 7f4d29e03640 1 -- 172.21.15.133:0/346547180 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4e30068440 con 0x562b19c6be70 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.709+0000 7f4d29e03640 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d24036790 0x7f4d24038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.709+0000 7f4d29e03640 1 -- 172.21.15.133:0/346547180 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4e3008dc60 con 0x562b19c6be70 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.709+0000 7f4e3cef1640 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d24036790 0x7f4d24038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.709+0000 7f4e4192f800 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562b19c6d0d0 0x562b19d6b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.709+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19d6b800 con 0x562b19c6d0d0 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.710+0000 7f4e3def3640 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562b19c6d0d0 0x562b19d6b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.710+0000 7f4e3cef1640 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d24036790 0x7f4d24038c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e34000c00 tx=0x7f4e340013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.710+0000 7f4e3def3640 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562b19c6d0d0 0x562b19d6b2c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.710+0000 7f4e3def3640 1 -- 172.21.15.133:0/346547180 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4e3800a4a0 con 0x562b19c6d0d0 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.710+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19d68990 con 0x562b19c6d0d0 2024-02-15T22:56:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.710+0000 7f4e3def3640 1 -- 172.21.15.133:0/346547180 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4e3800a4a0 con 0x562b19c6d0d0 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.711+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19d6d180 con 0x562b19c6d0d0 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.711+0000 7f4e3def3640 1 -- 172.21.15.133:0/346547180 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4e3800a4a0 con 0x562b19c6d0d0 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.711+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19d6c030 con 0x562b19c6d0d0 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.711+0000 7f4e3def3640 1 -- 172.21.15.133:0/346547180 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4e3800a4a0 con 0x562b19c6d0d0 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.711+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19d6c440 con 0x562b19c6d0d0 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.711+0000 7f4e3def3640 1 -- 172.21.15.133:0/346547180 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4e3800a4a0 con 0x562b19c6d0d0 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.712+0000 7f4e4192f800 1 Processor -- start 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.712+0000 7f4e4192f800 1 -- start start 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.712+0000 7f4e4192f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d7bf10 0x562b19d7c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.712+0000 7f4e4192f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b19b0ae80 con 0x562b19d7bf10 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.712+0000 7f4e3cef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d7bf10 0x562b19d7c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.712+0000 7f4e3cef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d7bf10 0x562b19d7c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48142/0 (socket says 172.21.15.133:48142) 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.712+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3911971254 learned_addr learned my addr 172.21.15.133:0/3911971254 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.712+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3911971254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b19d7c870 con 0x562b19d7bf10 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.713+0000 7f4e3cef1640 1 --2- 172.21.15.133:0/3911971254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d7bf10 0x562b19d7c330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400e610 tx=0x7f4e3400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.713+0000 7f4d22ffd640 1 -- 172.21.15.133:0/3911971254 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e3400bea0 con 0x562b19d7bf10 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.713+0000 7f4d22ffd640 1 -- 172.21.15.133:0/3911971254 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3400d500 con 0x562b19d7bf10 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.713+0000 7f4e4192f800 1 -- 172.21.15.133:0/3911971254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562b19d7d2e0 con 0x562b19d7bf10 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.713+0000 7f4d22ffd640 1 -- 172.21.15.133:0/3911971254 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e3400d7a0 con 0x562b19d7bf10 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.713+0000 7f4e4192f800 1 -- 172.21.15.133:0/3911971254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b19d7d7a0 con 0x562b19d7bf10 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.713+0000 7f4d22ffd640 1 -- 172.21.15.133:0/3911971254 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4e3401a070 con 0x562b19d7bf10 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.714+0000 7f4d22ffd640 1 --2- 172.21.15.133:0/3911971254 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d18036790 0x7f4d18038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.714+0000 7f4d22ffd640 1 -- 172.21.15.133:0/3911971254 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4e34017050 con 0x562b19d7bf10 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.714+0000 7f4e3def3640 1 --2- 172.21.15.133:0/3911971254 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d18036790 0x7f4d18038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.714+0000 7f4e4192f800 1 Processor -- start 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.714+0000 7f4e4192f800 1 -- start start 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.714+0000 7f4e3def3640 1 --2- 172.21.15.133:0/3911971254 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d18036790 0x7f4d18038c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x562b19d68d70 tx=0x7f4e38005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.714+0000 7f4e4192f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 0x562b19d895f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.714+0000 7f4e4192f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b19ae05d0 con 0x562b19d891d0 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.714+0000 7f4e3cef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 0x562b19d895f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.714+0000 7f4e3cef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 0x562b19d895f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48154/0 (socket says 172.21.15.133:48154) 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.714+0000 7f4e3cef1640 1 -- 172.21.15.133:0/992778112 learned_addr learned my addr 172.21.15.133:0/992778112 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4e3cef1640 1 -- 172.21.15.133:0/992778112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b19d89bc0 con 0x562b19d891d0 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4e3cef1640 1 --2- 172.21.15.133:0/992778112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 0x562b19d895f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e34026fd0 tx=0x7f4e3404bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c618a0e9e1d32 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4d20ff9640 1 -- 172.21.15.133:0/992778112 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e3401ac40 con 0x562b19d891d0 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4d20ff9640 1 -- 172.21.15.133:0/992778112 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3401ada0 con 0x562b19d891d0 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4d20ff9640 1 -- 172.21.15.133:0/992778112 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e3404d200 con 0x562b19d891d0 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4e4192f800 1 -- 172.21.15.133:0/992778112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 msgr2=0x562b19d895f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4e4192f800 1 --2- 172.21.15.133:0/992778112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 0x562b19d895f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e34026fd0 tx=0x7f4e3404bcd0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4e4192f800 1 -- 172.21.15.133:0/992778112 shutdown_connections 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4e4192f800 1 --2- 172.21.15.133:0/992778112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 0x562b19d895f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4e4192f800 1 -- 172.21.15.133:0/992778112 >> 172.21.15.133:0/992778112 conn(0x562b19d854f0 msgr2=0x562b19d83550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4e4192f800 1 -- 172.21.15.133:0/992778112 shutdown_connections 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.715+0000 7f4e4192f800 1 -- 172.21.15.133:0/992778112 wait complete. 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.716+0000 7f4e4192f800 1 Processor -- start 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.716+0000 7f4e4192f800 1 -- start start 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.716+0000 7f4e4192f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 0x562b19d90170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.716+0000 7f4e4192f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b19d906b0 con 0x562b19d891d0 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.716+0000 7f4e3cef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 0x562b19d90170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.716+0000 7f4e3cef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 0x562b19d90170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48156/0 (socket says 172.21.15.133:48156) 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.716+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 learned_addr learned my addr 172.21.15.133:0/3071613424 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.716+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b19d7d7a0 con 0x562b19d891d0 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.717+0000 7f4e3cef1640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 0x562b19d90170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400ee30 tx=0x7f4e3404b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.717+0000 7f4d0effd640 1 -- 172.21.15.133:0/3071613424 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e34024680 con 0x562b19d891d0 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.717+0000 7f4d0effd640 1 -- 172.21.15.133:0/3071613424 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3404a260 con 0x562b19d891d0 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.717+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562b19d908b0 con 0x562b19d891d0 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.717+0000 7f4d0effd640 1 -- 172.21.15.133:0/3071613424 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e3404a580 con 0x562b19d891d0 2024-02-15T22:56:22.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.717+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b19d90d70 con 0x562b19d891d0 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.717+0000 7f4d0effd640 1 -- 172.21.15.133:0/3071613424 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4e3400d040 con 0x562b19d891d0 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.718+0000 7f4d0effd640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d080367e0 0x7f4d08038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.718+0000 7f4d0effd640 1 -- 172.21.15.133:0/3071613424 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4e3400a040 con 0x562b19d891d0 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.718+0000 7f4e3def3640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d080367e0 0x7f4d08038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.718+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.718+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562b19d9bd20 0x562b19d9e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.718+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19d9e930 con 0x562b19d9bd20 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.718+0000 7f4e3def3640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d080367e0 0x7f4d08038ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800b010 tx=0x7f4e38020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.718+0000 7f4e3d6f2640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562b19d9bd20 0x562b19d9e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.718+0000 7f4e3d6f2640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562b19d9bd20 0x562b19d9e1e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 20 realm 2024-02-15T22:56:22.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19d9ed00 con 0x562b19d9bd20 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19d9f580 con 0x562b19d9bd20 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19d9f8e0 con 0x562b19d9bd20 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.719+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da00e0 con 0x562b19d9bd20 2024-02-15T22:56:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.720+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.720+0000 7f4e4192f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.720+0000 7f4e4192f800 20 searching for the correct realm 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.720+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562b19da2000 0x562b19da44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.720+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19da2000 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.720+0000 7f4e3cef1640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562b19da2000 0x562b19da44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.720+0000 7f4e3cef1640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562b19da2000 0x562b19da44a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.720+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.720+0000 7f4e3cef1640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4e34036070 0x7f4e3403a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.720+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e34036070 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.721+0000 7f4e3def3640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4e34036070 0x7f4e3403a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.721+0000 7f4e3def3640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4e34036070 0x7f4e3403a620 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.721+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3800a4a0 con 0x7f4e34036070 2024-02-15T22:56:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.721+0000 7f4e3def3640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4e380141d0 0x7f4e38015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.721+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e380141d0 2024-02-15T22:56:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.721+0000 7f4e3d6f2640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4e380141d0 0x7f4e38015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.722+0000 7f4e3d6f2640 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4e380141d0 0x7f4e38015940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.722+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.722+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19d9bd20 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.722+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.722+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19d9bd20 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.722+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.722+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e380141d0 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.723+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.723+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e380141d0 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.723+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.723+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e34036070 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.723+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3800a4a0 con 0x7f4e34036070 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.723+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19da2000 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.723+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.723+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19d9bd20 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.724+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.724+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e380141d0 2024-02-15T22:56:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.724+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.724+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19d9bd20 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.724+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.724+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e34036070 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.724+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.724+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19da2000 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.725+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.725+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19da2000 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.725+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.725+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e380141d0 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.725+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.725+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19da2000 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.725+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.725+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19da2000 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.726+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.726+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19d9bd20 2024-02-15T22:56:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.726+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.726+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19d9bd20 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.726+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.726+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e380141d0 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.726+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.726+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19da2000 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.727+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.727+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e34036070 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.727+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.727+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19d9bd20 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.727+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.727+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e380141d0 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.727+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.727+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19da2000 2024-02-15T22:56:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.728+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.728+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e380141d0 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.728+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.728+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e34036070 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.728+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.728+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19da2000 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.728+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e380141d0 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x562b19d9bd20 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4b70 con 0x7f4e34036070 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e4192f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e4192f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e4192f800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:22.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e4192f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e4192f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e4192f800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.729+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da1610 con 0x562b19d9bd20 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da0e30 con 0x562b19d9bd20 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da4fb0 con 0x562b19d9bd20 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 20 zone default found 2024-02-15T22:56:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 4 Realm: () 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 20 zonegroup default 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da5310 con 0x7f4e380141d0 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.730+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da7190 con 0x562b19da2000 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.731+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.731+0000 7f4e4192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.731+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.731+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da74f0 con 0x562b19da2000 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.731+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.731+0000 7f4e4192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.731+0000 7f4e4192f800 20 started sync module instance, tier type = 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.731+0000 7f4e4192f800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.731+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da6760 con 0x7f4e34036070 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.735+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.735+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94743117327424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da6760 con 0x7f4e34036070 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.735+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da7ec0 con 0x562b19d9bd20 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.736+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94743117327424] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.737+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.737+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94743117330880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da7ec0 con 0x562b19d9bd20 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.737+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da8970 con 0x562b19da2000 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.739+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94743117330880] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.739+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.739+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94743117333616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da8d20 con 0x562b19da2000 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.739+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da96f0 con 0x7f4e34036070 2024-02-15T22:56:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.742+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94743117333616] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.742+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.742+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94743117337072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19da9ad0 con 0x7f4e34036070 2024-02-15T22:56:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.742+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19daa4b0 con 0x562b19d9bd20 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.744+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94743117337072] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.747+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.747+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94743117324992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19daa470 con 0x562b19d9bd20 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.747+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19daaf00 con 0x7f4e380141d0 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.750+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94743117324992] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.750+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.750+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94743117343264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19daa470 con 0x7f4e380141d0 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.750+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dab900 con 0x7f4e380141d0 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.751+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94743117343264] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.751+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.751+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94743117345824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dabae0 con 0x7f4e380141d0 2024-02-15T22:56:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.751+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dac2e0 con 0x7f4e380141d0 2024-02-15T22:56:22.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.752+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.752+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94743117348032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dac720 con 0x7f4e380141d0 2024-02-15T22:56:22.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.752+0000 7f4e4192f800 20 add_watcher() i=0 2024-02-15T22:56:22.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.752+0000 7f4e4192f800 20 add_watcher() i=1 2024-02-15T22:56:22.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.752+0000 7f4e4192f800 20 add_watcher() i=2 2024-02-15T22:56:22.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.752+0000 7f4e4192f800 20 add_watcher() i=3 2024-02-15T22:56:22.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.752+0000 7f4e4192f800 20 add_watcher() i=4 2024-02-15T22:56:22.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.752+0000 7f4e4192f800 20 add_watcher() i=5 2024-02-15T22:56:22.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.752+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94743117345824] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.752+0000 7f4e4192f800 20 add_watcher() i=6 2024-02-15T22:56:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.753+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94743117348032] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.753+0000 7f4e4192f800 20 add_watcher() i=7 2024-02-15T22:56:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.753+0000 7f4e4192f800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.753+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19daa120 con 0x562b19d9bd20 2024-02-15T22:56:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.753+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.753+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94743117349312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dad090 con 0x562b19d9bd20 2024-02-15T22:56:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.755+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94743117349312] v30'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.755+0000 7f4cf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.755+0000 7f4e4192f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.755+0000 7f4e4192f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.755+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19db8180 con 0x562b19d9bd20 2024-02-15T22:56:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.757+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.757+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19db8770 con 0x7f4e380141d0 2024-02-15T22:56:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.758+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.758+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19db8ca0 con 0x562b19da2000 2024-02-15T22:56:22.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.759+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.759+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19db9670 con 0x562b19d9bd20 2024-02-15T22:56:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.761+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.761+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19db4050 con 0x7f4e34036070 2024-02-15T22:56:22.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.763+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.763+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19db4050 con 0x562b19da2000 2024-02-15T22:56:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.764+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'13 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.764+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dba850 con 0x562b19d9bd20 2024-02-15T22:56:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.766+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.766+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dba850 con 0x7f4e380141d0 2024-02-15T22:56:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.767+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'13 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.767+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dba850 con 0x7f4e34036070 2024-02-15T22:56:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.768+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.768+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19db9890 con 0x562b19da2000 2024-02-15T22:56:22.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.769+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.769+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbb3c0 con 0x7f4e34036070 2024-02-15T22:56:22.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.770+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.770+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbb8f0 con 0x7f4e380141d0 2024-02-15T22:56:22.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.771+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.771+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbb8f0 con 0x7f4e34036070 2024-02-15T22:56:22.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.773+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.773+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x7f4e380141d0 2024-02-15T22:56:22.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.776+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'19 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.776+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19d9bd20 2024-02-15T22:56:22.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.777+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.777+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19da2000 2024-02-15T22:56:22.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.778+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'14 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.778+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x7f4e34036070 2024-02-15T22:56:22.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.780+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'22 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.780+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19da2000 2024-02-15T22:56:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.783+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.783+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19d9bd20 2024-02-15T22:56:22.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.784+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.784+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19d9bd20 2024-02-15T22:56:22.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.786+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'29 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.786+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19da2000 2024-02-15T22:56:22.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.788+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'15 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.788+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x7f4e34036070 2024-02-15T22:56:22.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.789+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.790+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19da2000 2024-02-15T22:56:22.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.791+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.791+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19da2000 2024-02-15T22:56:22.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.794+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.794+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19da2000 2024-02-15T22:56:22.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.797+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.797+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19da2000 2024-02-15T22:56:22.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.798+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'14 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.798+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x7f4e380141d0 2024-02-15T22:56:22.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.799+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.799+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19da2000 2024-02-15T22:56:22.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.800+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.800+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x7f4e380141d0 2024-02-15T22:56:22.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.801+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'14 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.801+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x562b19da2000 2024-02-15T22:56:22.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.802+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.802+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x7f4e380141d0 2024-02-15T22:56:22.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.803+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.803+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19dbbe80 con 0x7f4e34036070 2024-02-15T22:56:22.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.804+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.804+0000 7f4cf27e4640 20 reqs_thread_entry: start 2024-02-15T22:56:22.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.804+0000 7f4e4192f800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.804+0000 7f4e4192f800 20 Filter name: none 2024-02-15T22:56:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.805+0000 7f4c63fff640 20 reqs_thread_entry: start 2024-02-15T22:56:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.805+0000 7f4e4192f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-15T22:56:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.805+0000 7f4e4192f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.805+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19de58a0 con 0x7f4e34036070 2024-02-15T22:56:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.805+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.805+0000 7f4e4192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.805+0000 7f4e4192f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-02-15T22:56:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.805+0000 7f4e4192f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T22:56:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, user does not exist 2024-02-15T22:56:22.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.806+0000 7f4cf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:22.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.806+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94743117349312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19de58a0 con 0x562b19d9bd20 2024-02-15T22:56:22.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.807+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94743117349312] v30'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.807+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94743117327424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19de58a0 con 0x7f4e34036070 2024-02-15T22:56:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.808+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94743117327424] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.808+0000 7f4e4192f800 20 remove_watcher() i=0 2024-02-15T22:56:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.808+0000 7f4e4192f800 2 removed watcher, disabling cache 2024-02-15T22:56:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.808+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94743117330880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19de5860 con 0x562b19d9bd20 2024-02-15T22:56:22.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.809+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94743117330880] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.809+0000 7f4e4192f800 20 remove_watcher() i=1 2024-02-15T22:56:22.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.809+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94743117333616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19de5860 con 0x562b19da2000 2024-02-15T22:56:22.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.810+0000 7f4e3cef1640 1 -- 172.21.15.133:0/3071613424 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94743117333616] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e3401bd70 con 0x562b19da2000 2024-02-15T22:56:22.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.810+0000 7f4e4192f800 20 remove_watcher() i=2 2024-02-15T22:56:22.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.810+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94743117337072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19de5860 con 0x7f4e34036070 2024-02-15T22:56:22.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.811+0000 7f4e3def3640 1 -- 172.21.15.133:0/3071613424 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94743117337072] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e3803a040 con 0x7f4e34036070 2024-02-15T22:56:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.811+0000 7f4e4192f800 20 remove_watcher() i=3 2024-02-15T22:56:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.811+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94743117324992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19de5860 con 0x562b19d9bd20 2024-02-15T22:56:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.812+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94743117324992] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x562b19d9bd20 2024-02-15T22:56:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.812+0000 7f4e4192f800 20 remove_watcher() i=4 2024-02-15T22:56:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.812+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94743117343264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19de5860 con 0x7f4e380141d0 2024-02-15T22:56:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.813+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94743117343264] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.813+0000 7f4e4192f800 20 remove_watcher() i=5 2024-02-15T22:56:22.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.813+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94743117345824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19de5860 con 0x7f4e380141d0 2024-02-15T22:56:22.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.814+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94743117345824] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.814+0000 7f4e4192f800 20 remove_watcher() i=6 2024-02-15T22:56:22.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.814+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94743117348032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b19de5860 con 0x7f4e380141d0 2024-02-15T22:56:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94743117348032] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4e30063070 con 0x7f4e380141d0 2024-02-15T22:56:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 20 remove_watcher() i=7 2024-02-15T22:56:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4e380141d0 msgr2=0x7f4e38015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4e380141d0 0x7f4e38015940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562b19d9bd20 msgr2=0x562b19d9e1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562b19d9bd20 0x562b19d9e1e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4e34036070 msgr2=0x7f4e3403a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4e34036070 0x7f4e3403a620 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562b19da2000 msgr2=0x562b19da44a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562b19da2000 0x562b19da44a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d080367e0 msgr2=0x7f4d08038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d080367e0 0x7f4d08038ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800b010 tx=0x7f4e38020000 comp rx=0 tx=0).stop 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 msgr2=0x562b19d90170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3071613424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d891d0 0x562b19d90170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400ee30 tx=0x7f4e3404b980 comp rx=0 tx=0).stop 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 reap_dead start 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.815+0000 7f4e3d6f2640 1 -- 172.21.15.133:0/3071613424 reap_dead start 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 shutdown_connections 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 >> 172.21.15.133:0/3071613424 conn(0x562b19d854f0 msgr2=0x562b19d82b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 shutdown_connections 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/3071613424 wait complete. 2024-02-15T22:56:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/3911971254 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d18036790 msgr2=0x7f4d18038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3911971254 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d18036790 0x7f4d18038c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x562b19d68d70 tx=0x7f4e38005840 comp rx=0 tx=0).stop 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/3911971254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d7bf10 msgr2=0x562b19d7c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3911971254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d7bf10 0x562b19d7c330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400e610 tx=0x7f4e3400ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/3911971254 shutdown_connections 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3911971254 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d18036790 0x7f4d18038c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 --2- 172.21.15.133:0/3911971254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19d7bf10 0x562b19d7c330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/3911971254 >> 172.21.15.133:0/3911971254 conn(0x562b19d6ffb0 msgr2=0x562b19d703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/3911971254 shutdown_connections 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/3911971254 wait complete. 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562b19c6d0d0 msgr2=0x562b19d6b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562b19c6d0d0 0x562b19d6b2c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d24036790 msgr2=0x7f4d24038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d24036790 0x7f4d24038c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e34000c00 tx=0x7f4e340013b0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 msgr2=0x562b19d64650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19d64650 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e30000c00 tx=0x7f4e30002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 shutdown_connections 2024-02-15T22:56:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562b19c6d0d0 0x562b19d6b2c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4d24036790 0x7f4d24038c50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 --2- 172.21.15.133:0/346547180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b19c6be70 0x562b19d64650 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 >> 172.21.15.133:0/346547180 conn(0x562b19c674d0 msgr2=0x562b19d561b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 shutdown_connections 2024-02-15T22:56:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.816+0000 7f4e4192f800 1 -- 172.21.15.133:0/346547180 wait complete. 2024-02-15T22:56:22.826 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-15T22:56:22.827 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-02-15T22:56:22.827 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-02-15T22:56:22.827 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-02-15T22:56:22.909 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:22.910 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.908+0000 7f21dd575800 1 Processor -- start 2024-02-15T22:56:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.908+0000 7f21dd575800 1 -- start start 2024-02-15T22:56:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.908+0000 7f21dd575800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55660e935e70 0x55660e936290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.908+0000 7f21dd575800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55660e881bb0 con 0x55660e9370d0 2024-02-15T22:56:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.908+0000 7f21dd575800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55660e839450 con 0x55660e935e70 2024-02-15T22:56:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.908+0000 7f21db07b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55660e935e70 0x55660e936290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.908+0000 7f21db07b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55660e935e70 0x55660e936290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48162/0 (socket says 172.21.15.133:48162) 2024-02-15T22:56:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.908+0000 7f21da87a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55660e9370d0 0x55660e937550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:51054/0 (socket says 172.21.15.133:51054) 2024-02-15T22:56:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.908+0000 7f21db07b640 1 -- 172.21.15.133:0/2560899709 learned_addr learned my addr 172.21.15.133:0/2560899709 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.909+0000 7f21db07b640 1 -- 172.21.15.133:0/2560899709 >> v1:172.21.15.52:6789/0 conn(0x55660e9370d0 legacy=0x55660e937550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.909+0000 7f21db07b640 1 -- 172.21.15.133:0/2560899709 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55660e936960 con 0x55660e935e70 2024-02-15T22:56:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.910+0000 7f21db07b640 1 --2- 172.21.15.133:0/2560899709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660e936290 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00a6b0 tx=0x7f21cc01eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eef354e396eb0b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.911+0000 7f21da079640 1 -- 172.21.15.133:0/2560899709 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21cc00a200 con 0x55660e935e70 2024-02-15T22:56:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.911+0000 7f21da079640 1 -- 172.21.15.133:0/2560899709 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc00a360 con 0x55660e935e70 2024-02-15T22:56:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.911+0000 7f21da079640 1 -- 172.21.15.133:0/2560899709 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21cc0086e0 con 0x55660e935e70 2024-02-15T22:56:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.911+0000 7f21dd575800 1 -- 172.21.15.133:0/2560899709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 msgr2=0x55660e936290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.911+0000 7f21dd575800 1 --2- 172.21.15.133:0/2560899709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660e936290 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00a6b0 tx=0x7f21cc01eda0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.911+0000 7f21dd575800 1 -- 172.21.15.133:0/2560899709 shutdown_connections 2024-02-15T22:56:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.911+0000 7f21dd575800 1 --2- 172.21.15.133:0/2560899709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660e936290 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.911+0000 7f21dd575800 1 -- 172.21.15.133:0/2560899709 >> 172.21.15.133:0/2560899709 conn(0x55660e9314d0 msgr2=0x55660e9338f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.911+0000 7f21dd575800 1 -- 172.21.15.133:0/2560899709 shutdown_connections 2024-02-15T22:56:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.911+0000 7f21dd575800 1 -- 172.21.15.133:0/2560899709 wait complete. 2024-02-15T22:56:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.923+0000 7f21dd575800 1 Processor -- start 2024-02-15T22:56:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.923+0000 7f21dd575800 1 -- start start 2024-02-15T22:56:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.923+0000 7f21dd575800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea251b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.923+0000 7f21dd575800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55660e836980 con 0x55660e935e70 2024-02-15T22:56:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.923+0000 7f21db07b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea251b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.923+0000 7f21db07b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea251b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48170/0 (socket says 172.21.15.133:48170) 2024-02-15T22:56:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.923+0000 7f21db07b640 1 -- 172.21.15.133:0/990625340 learned_addr learned my addr 172.21.15.133:0/990625340 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.923+0000 7f21db07b640 1 -- 172.21.15.133:0/990625340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc005de0 con 0x55660e935e70 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.924+0000 7f21db07b640 1 --2- 172.21.15.133:0/990625340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea251b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f21cc056040 tx=0x7f21cc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e26bf4d2b1865e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.924+0000 7f20c960a640 1 -- 172.21.15.133:0/990625340 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21cc00a200 con 0x55660e935e70 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.924+0000 7f20c960a640 1 -- 172.21.15.133:0/990625340 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc008590 con 0x55660e935e70 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.924+0000 7f20c960a640 1 -- 172.21.15.133:0/990625340 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21cc008870 con 0x55660e935e70 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.924+0000 7f21dd575800 1 -- 172.21.15.133:0/990625340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 msgr2=0x55660ea251b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.924+0000 7f21dd575800 1 --2- 172.21.15.133:0/990625340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea251b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f21cc056040 tx=0x7f21cc04e000 comp rx=0 tx=0).stop 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21dd575800 1 -- 172.21.15.133:0/990625340 shutdown_connections 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21dd575800 1 --2- 172.21.15.133:0/990625340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea251b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21dd575800 1 -- 172.21.15.133:0/990625340 >> 172.21.15.133:0/990625340 conn(0x55660e9314d0 msgr2=0x55660ea20ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21dd575800 1 -- 172.21.15.133:0/990625340 shutdown_connections 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21dd575800 1 -- 172.21.15.133:0/990625340 wait complete. 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21dd575800 1 Processor -- start 2024-02-15T22:56:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21dd575800 1 -- start start 2024-02-15T22:56:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21dd575800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea30be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21dd575800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55660e832160 con 0x55660e935e70 2024-02-15T22:56:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21db07b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea30be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21db07b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea30be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48186/0 (socket says 172.21.15.133:48186) 2024-02-15T22:56:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.925+0000 7f21db07b640 1 -- 172.21.15.133:0/1919003837 learned_addr learned my addr 172.21.15.133:0/1919003837 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.926+0000 7f21db07b640 1 -- 172.21.15.133:0/1919003837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc050070 con 0x55660e935e70 2024-02-15T22:56:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.926+0000 7f21db07b640 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea30be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f21cc01f610 tx=0x7f21cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.926+0000 7f20c7e07640 1 -- 172.21.15.133:0/1919003837 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21cc06d070 con 0x55660e935e70 2024-02-15T22:56:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.926+0000 7f20c7e07640 1 -- 172.21.15.133:0/1919003837 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc008400 con 0x55660e935e70 2024-02-15T22:56:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.926+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55660ea31120 con 0x55660e935e70 2024-02-15T22:56:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.926+0000 7f20c7e07640 1 -- 172.21.15.133:0/1919003837 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21cc008830 con 0x55660e935e70 2024-02-15T22:56:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.926+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55660ea31660 con 0x55660e935e70 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.927+0000 7f20c7e07640 1 -- 172.21.15.133:0/1919003837 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f21cc005020 con 0x55660e935e70 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.927+0000 7f20c7e07640 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20c0036790 0x7f20c0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.927+0000 7f20c7e07640 1 -- 172.21.15.133:0/1919003837 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f21cc08ca10 con 0x55660e935e70 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.927+0000 7f21da87a640 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20c0036790 0x7f20c0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.927+0000 7f21dd575800 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55660e9370d0 0x55660ea378a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.927+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea37de0 con 0x55660e9370d0 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.927+0000 7f21db87c640 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55660e9370d0 0x55660ea378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.928+0000 7f21da87a640 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20c0036790 0x7f20c0038c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f21d0001e40 tx=0x7f21d00013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.928+0000 7f21db87c640 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55660e9370d0 0x55660ea378a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.928+0000 7f21db87c640 1 -- 172.21.15.133:0/1919003837 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21d400a4a0 con 0x55660e9370d0 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.928+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea34fb0 con 0x55660e9370d0 2024-02-15T22:56:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.928+0000 7f21db87c640 1 -- 172.21.15.133:0/1919003837 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f21d400a4a0 con 0x55660e9370d0 2024-02-15T22:56:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.928+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea39b10 con 0x55660e9370d0 2024-02-15T22:56:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.929+0000 7f21db87c640 1 -- 172.21.15.133:0/1919003837 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f21d400a4a0 con 0x55660e9370d0 2024-02-15T22:56:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.929+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea38d10 con 0x55660e9370d0 2024-02-15T22:56:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.929+0000 7f21db87c640 1 -- 172.21.15.133:0/1919003837 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f21d400a4a0 con 0x55660e9370d0 2024-02-15T22:56:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.929+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea39120 con 0x55660e9370d0 2024-02-15T22:56:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.929+0000 7f21db87c640 1 -- 172.21.15.133:0/1919003837 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f21d400a4a0 con 0x55660e9370d0 2024-02-15T22:56:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.929+0000 7f21dd575800 1 Processor -- start 2024-02-15T22:56:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.930+0000 7f21dd575800 1 -- start start 2024-02-15T22:56:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.930+0000 7f21dd575800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea48540 0x55660ea48960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.930+0000 7f21dd575800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55660e7d4e80 con 0x55660ea48540 2024-02-15T22:56:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.930+0000 7f21da87a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea48540 0x55660ea48960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.930+0000 7f21da87a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea48540 0x55660ea48960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48200/0 (socket says 172.21.15.133:48200) 2024-02-15T22:56:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.930+0000 7f21da87a640 1 -- 172.21.15.133:0/4281731945 learned_addr learned my addr 172.21.15.133:0/4281731945 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.930+0000 7f21da87a640 1 -- 172.21.15.133:0/4281731945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55660ea48ea0 con 0x55660ea48540 2024-02-15T22:56:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.931+0000 7f21da87a640 1 --2- 172.21.15.133:0/4281731945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea48540 0x55660ea48960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21d000e630 tx=0x7f21d000ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.931+0000 7f20c5602640 1 -- 172.21.15.133:0/4281731945 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21d000bec0 con 0x55660ea48540 2024-02-15T22:56:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.931+0000 7f20c5602640 1 -- 172.21.15.133:0/4281731945 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d000d520 con 0x55660ea48540 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.931+0000 7f21dd575800 1 -- 172.21.15.133:0/4281731945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55660ea49910 con 0x55660ea48540 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.931+0000 7f20c5602640 1 -- 172.21.15.133:0/4281731945 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21d000d7e0 con 0x55660ea48540 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.931+0000 7f21dd575800 1 -- 172.21.15.133:0/4281731945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55660ea49dd0 con 0x55660ea48540 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.931+0000 7f20c5602640 1 -- 172.21.15.133:0/4281731945 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f21d001a070 con 0x55660ea48540 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.932+0000 7f20c5602640 1 --2- 172.21.15.133:0/4281731945 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 0x7f20b4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.932+0000 7f20c5602640 1 -- 172.21.15.133:0/4281731945 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f21d0017050 con 0x55660ea48540 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.932+0000 7f21db87c640 1 --2- 172.21.15.133:0/4281731945 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 0x7f20b4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.932+0000 7f21dd575800 1 Processor -- start 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.932+0000 7f21dd575800 1 -- start start 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.932+0000 7f21db87c640 1 --2- 172.21.15.133:0/4281731945 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 0x7f20b4038ca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55660ea38750 tx=0x7f21d4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.932+0000 7f21dd575800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea55bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.932+0000 7f21dd575800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55660e7aa5d0 con 0x55660ea557f0 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.932+0000 7f21da87a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea55bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.932+0000 7f21da87a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea55bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48204/0 (socket says 172.21.15.133:48204) 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.932+0000 7f21da87a640 1 -- 172.21.15.133:0/1117575102 learned_addr learned my addr 172.21.15.133:0/1117575102 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f21da87a640 1 -- 172.21.15.133:0/1117575102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55660ea561a0 con 0x55660ea557f0 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f21da87a640 1 --2- 172.21.15.133:0/1117575102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea55bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21d004bab0 tx=0x7f21d004bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffe3a83376f4b84 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f20beffd640 1 -- 172.21.15.133:0/1117575102 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21d000dcc0 con 0x55660ea557f0 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f20beffd640 1 -- 172.21.15.133:0/1117575102 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d000de20 con 0x55660ea557f0 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f20beffd640 1 -- 172.21.15.133:0/1117575102 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21d001a320 con 0x55660ea557f0 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f21dd575800 1 -- 172.21.15.133:0/1117575102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 msgr2=0x55660ea55bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f21dd575800 1 --2- 172.21.15.133:0/1117575102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea55bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21d004bab0 tx=0x7f21d004bd90 comp rx=0 tx=0).stop 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f21dd575800 1 -- 172.21.15.133:0/1117575102 shutdown_connections 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f21dd575800 1 --2- 172.21.15.133:0/1117575102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea55bd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f21dd575800 1 -- 172.21.15.133:0/1117575102 >> 172.21.15.133:0/1117575102 conn(0x55660ea51ac0 msgr2=0x55660ea4fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f21dd575800 1 -- 172.21.15.133:0/1117575102 shutdown_connections 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.933+0000 7f21dd575800 1 -- 172.21.15.133:0/1117575102 wait complete. 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.934+0000 7f21dd575800 1 Processor -- start 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.934+0000 7f21dd575800 1 -- start start 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.934+0000 7f21dd575800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea5c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.934+0000 7f21dd575800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55660ea5cca0 con 0x55660ea557f0 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.934+0000 7f21da87a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea5c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.934+0000 7f21da87a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea5c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48206/0 (socket says 172.21.15.133:48206) 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.934+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 learned_addr learned my addr 172.21.15.133:0/784885652 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.934+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55660ea49dd0 con 0x55660ea557f0 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.934+0000 7f21da87a640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea5c760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21d004aa20 tx=0x7f21d004ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.935+0000 7f20bd7fa640 1 -- 172.21.15.133:0/784885652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21d000dcc0 con 0x55660ea557f0 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.935+0000 7f20bd7fa640 1 -- 172.21.15.133:0/784885652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d001ae70 con 0x55660ea557f0 2024-02-15T22:56:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.935+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55660ea5cea0 con 0x55660ea557f0 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.935+0000 7f20bd7fa640 1 -- 172.21.15.133:0/784885652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21d001aa10 con 0x55660ea557f0 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.935+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55660ea5d300 con 0x55660ea557f0 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.935+0000 7f20bd7fa640 1 -- 172.21.15.133:0/784885652 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f21d0025a20 con 0x55660ea557f0 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.936+0000 7f20bd7fa640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20a4036740 0x7f20a4038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.936+0000 7f20bd7fa640 1 -- 172.21.15.133:0/784885652 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f21d004e020 con 0x55660ea557f0 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.936+0000 7f21db87c640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20a4036740 0x7f20a4038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.936+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.936+0000 7f21db87c640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20a4036740 0x7f20a4038c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f21d400b010 tx=0x7f21d4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.936+0000 7f21dd575800 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55660ea68350 0x55660ea6a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.936+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea6af60 con 0x55660ea68350 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.936+0000 7f21db07b640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55660ea68350 0x55660ea6a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.936+0000 7f21db07b640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55660ea68350 0x55660ea6a810 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 20 realm 2024-02-15T22:56:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea6b330 con 0x55660ea68350 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea6bbb0 con 0x55660ea68350 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea6bf10 con 0x55660ea68350 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.937+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea6c710 con 0x55660ea68350 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.938+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.938+0000 7f21dd575800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.938+0000 7f21dd575800 20 searching for the correct realm 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.938+0000 7f21dd575800 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55660ea6e600 0x55660ea70aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.938+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea6e600 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.938+0000 7f21da87a640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55660ea6e600 0x55660ea70aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.938+0000 7f21da87a640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55660ea6e600 0x55660ea70aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.938+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d0040070 con 0x55660ea6e600 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.938+0000 7f21da87a640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f21d0025360 0x7f21d004d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.938+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d0025360 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.939+0000 7f21db87c640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f21d0025360 0x7f21d004d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.939+0000 7f21db87c640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f21d0025360 0x7f21d004d620 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.939+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d400a4a0 con 0x7f21d0025360 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.939+0000 7f21db87c640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21d40141d0 0x7f21d4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.939+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d40141d0 2024-02-15T22:56:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.939+0000 7f21db07b640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21d40141d0 0x7f21d4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:22.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.940+0000 7f21db07b640 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21d40141d0 0x7f21d4015940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.940+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.940+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea68350 2024-02-15T22:56:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.940+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.940+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea68350 2024-02-15T22:56:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.941+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.941+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d40141d0 2024-02-15T22:56:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.941+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.941+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d40141d0 2024-02-15T22:56:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.941+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.941+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d0025360 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.941+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d400a4a0 con 0x7f21d0025360 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.941+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea6e600 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.942+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d0040070 con 0x55660ea6e600 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.942+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea68350 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.942+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.942+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d40141d0 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.942+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.942+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea68350 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.942+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.942+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d0025360 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.943+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.943+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea6e600 2024-02-15T22:56:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.943+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d0040070 con 0x55660ea6e600 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.943+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea6e600 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.943+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d0040070 con 0x55660ea6e600 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.943+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d40141d0 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.943+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.943+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea6e600 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.943+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d0040070 con 0x55660ea6e600 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.944+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea6e600 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.944+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d0040070 con 0x55660ea6e600 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.944+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea68350 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.944+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.944+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea68350 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.944+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.944+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d40141d0 2024-02-15T22:56:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.945+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.945+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea6e600 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.945+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d0040070 con 0x55660ea6e600 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.945+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d0025360 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.945+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.945+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea68350 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.945+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.945+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d40141d0 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.946+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.946+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea6e600 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.946+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.946+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d40141d0 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.946+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.946+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d0025360 2024-02-15T22:56:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.946+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.946+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea6e600 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d40141d0 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x55660ea68350 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea71170 con 0x7f21d0025360 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21dd575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21dd575800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21dd575800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21dd575800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21dd575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21dd575800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.947+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea6cf40 con 0x55660ea68350 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea6d2f0 con 0x55660ea68350 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea6d2f0 con 0x55660ea68350 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 20 zone default found 2024-02-15T22:56:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 4 Realm: () 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 20 zonegroup default 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.948+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea6d6d0 con 0x7f21d40141d0 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21dd575800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea72f90 con 0x55660ea6e600 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21dd575800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea73320 con 0x55660ea6e600 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21dd575800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21dd575800 20 started sync module instance, tier type = 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21dd575800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.949+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea72870 con 0x7f21d0025360 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.950+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.950+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93896820859856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea72c20 con 0x7f21d0025360 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.950+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea74060 con 0x55660ea68350 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.951+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93896820859856] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.951+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.951+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93896820865072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea741b0 con 0x55660ea68350 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.951+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea74c80 con 0x55660ea6e600 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.952+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93896820865072] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.953+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.953+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93896820868960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea75030 con 0x55660ea6e600 2024-02-15T22:56:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.953+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea75a20 con 0x7f21d0025360 2024-02-15T22:56:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.954+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93896820868960] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.954+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.954+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93896820872448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea75dd0 con 0x7f21d0025360 2024-02-15T22:56:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.954+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea76800 con 0x55660ea68350 2024-02-15T22:56:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.955+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.955+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93896820876032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea767c0 con 0x55660ea68350 2024-02-15T22:56:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.955+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea77780 con 0x7f21d40141d0 2024-02-15T22:56:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.956+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93896820872448] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.956+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.956+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93896820880032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea77780 con 0x7f21d40141d0 2024-02-15T22:56:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.956+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea78180 con 0x7f21d40141d0 2024-02-15T22:56:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.957+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93896820876032] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.957+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.957+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93896820878208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea78140 con 0x7f21d40141d0 2024-02-15T22:56:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.957+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea78b10 con 0x7f21d40141d0 2024-02-15T22:56:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.958+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93896820880032] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.958+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93896820878208] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.958+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.958+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93896820866128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea78140 con 0x7f21d40141d0 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.958+0000 7f21dd575800 20 add_watcher() i=0 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.958+0000 7f21dd575800 20 add_watcher() i=1 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.958+0000 7f21dd575800 20 add_watcher() i=2 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.958+0000 7f21dd575800 20 add_watcher() i=3 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.958+0000 7f21dd575800 20 add_watcher() i=4 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.959+0000 7f21dd575800 20 add_watcher() i=5 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.959+0000 7f21dd575800 20 add_watcher() i=6 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.960+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93896820866128] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.960+0000 7f21dd575800 20 add_watcher() i=7 2024-02-15T22:56:22.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.960+0000 7f21dd575800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.960+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea78040 con 0x55660ea68350 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.960+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.960+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93896820886224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea79390 con 0x55660ea68350 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.961+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93896820886224] v30'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.961+0000 7f2091fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.961+0000 7f21dd575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.961+0000 7f21dd575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.961+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea84450 con 0x55660ea68350 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.962+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.962+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea84ae0 con 0x7f21d40141d0 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.963+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.963+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea84ee0 con 0x55660ea6e600 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.964+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.964+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea858b0 con 0x55660ea68350 2024-02-15T22:56:22.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.965+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'32 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.965+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea80390 con 0x7f21d0025360 2024-02-15T22:56:22.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.966+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.966+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea80390 con 0x55660ea6e600 2024-02-15T22:56:22.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.967+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'15 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.967+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea86a90 con 0x55660ea68350 2024-02-15T22:56:22.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.968+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.968+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea86a90 con 0x7f21d40141d0 2024-02-15T22:56:22.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.969+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'15 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.970+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea86a90 con 0x7f21d0025360 2024-02-15T22:56:22.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.971+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.971+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea82510 con 0x55660ea6e600 2024-02-15T22:56:22.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.972+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.972+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea87430 con 0x7f21d0025360 2024-02-15T22:56:22.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.973+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.973+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea878d0 con 0x7f21d40141d0 2024-02-15T22:56:22.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.974+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.974+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea878d0 con 0x7f21d0025360 2024-02-15T22:56:22.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.975+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.975+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea87960 con 0x7f21d40141d0 2024-02-15T22:56:22.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.976+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'21 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.976+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea87960 con 0x55660ea68350 2024-02-15T22:56:22.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.977+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'33 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.977+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea87960 con 0x55660ea6e600 2024-02-15T22:56:22.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.978+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.978+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea87960 con 0x7f21d0025360 2024-02-15T22:56:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.979+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'25 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.979+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x55660ea6e600 2024-02-15T22:56:22.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.980+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.980+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x55660ea68350 2024-02-15T22:56:22.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.981+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.981+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x55660ea68350 2024-02-15T22:56:22.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.982+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'34 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:22.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.982+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x55660ea6e600 2024-02-15T22:56:22.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.983+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'18 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.983+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x7f21d0025360 2024-02-15T22:56:22.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.984+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:22.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.984+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea87a80 con 0x55660ea6e600 2024-02-15T22:56:22.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.985+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.985+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea87a80 con 0x55660ea6e600 2024-02-15T22:56:22.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.986+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.986+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea87a80 con 0x55660ea6e600 2024-02-15T22:56:22.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.987+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.987+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x55660ea6e600 2024-02-15T22:56:22.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.988+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.988+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x7f21d40141d0 2024-02-15T22:56:22.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.989+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.989+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x55660ea6e600 2024-02-15T22:56:22.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.992+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.992+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x7f21d40141d0 2024-02-15T22:56:22.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.995+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:22.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.995+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x55660ea6e600 2024-02-15T22:56:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.997+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.997+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x7f21d40141d0 2024-02-15T22:56:23.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.998+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:23.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.998+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea879f0 con 0x7f21d0025360 2024-02-15T22:56:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.999+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.999+0000 7f2090fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.999+0000 7f21dd575800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.999+0000 7f21dd575800 20 Filter name: none 2024-02-15T22:56:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.999+0000 7f200a7fc640 20 reqs_thread_entry: start 2024-02-15T22:56:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.999+0000 7f21dd575800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-15T22:56:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.999+0000 7f21dd575800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:22.999+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660eab1a40 con 0x7f21d40141d0 2024-02-15T22:56:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.000+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.000+0000 7f21dd575800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.000+0000 7f21dd575800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-15T22:56:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.000+0000 7f21dd575800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-15T22:56:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, user does not exist 2024-02-15T22:56:23.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.000+0000 7f2091fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:23.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.000+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93896820886224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea7b5e0 con 0x55660ea68350 2024-02-15T22:56:23.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.001+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93896820886224] v30'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:23.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.001+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93896820859856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea78ad0 con 0x7f21d0025360 2024-02-15T22:56:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.002+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93896820859856] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.002+0000 7f21dd575800 20 remove_watcher() i=0 2024-02-15T22:56:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.002+0000 7f21dd575800 2 removed watcher, disabling cache 2024-02-15T22:56:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.002+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93896820865072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea78ad0 con 0x55660ea68350 2024-02-15T22:56:23.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.004+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93896820865072] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:23.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.004+0000 7f21dd575800 20 remove_watcher() i=1 2024-02-15T22:56:23.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.004+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93896820868960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea73830 con 0x55660ea6e600 2024-02-15T22:56:23.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.005+0000 7f21da87a640 1 -- 172.21.15.133:0/784885652 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93896820868960] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21d0064040 con 0x55660ea6e600 2024-02-15T22:56:23.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.005+0000 7f21dd575800 20 remove_watcher() i=2 2024-02-15T22:56:23.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.005+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93896820872448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea78ad0 con 0x7f21d0025360 2024-02-15T22:56:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.006+0000 7f21db87c640 1 -- 172.21.15.133:0/784885652 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93896820872448] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21d403a040 con 0x7f21d0025360 2024-02-15T22:56:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.006+0000 7f21dd575800 20 remove_watcher() i=3 2024-02-15T22:56:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.006+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93896820876032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea73830 con 0x55660ea68350 2024-02-15T22:56:23.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.007+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93896820876032] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x55660ea68350 2024-02-15T22:56:23.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.007+0000 7f21dd575800 20 remove_watcher() i=4 2024-02-15T22:56:23.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.007+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93896820880032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea75500 con 0x7f21d40141d0 2024-02-15T22:56:23.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.008+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93896820880032] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:23.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.008+0000 7f21dd575800 20 remove_watcher() i=5 2024-02-15T22:56:23.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.008+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93896820878208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea78ad0 con 0x7f21d40141d0 2024-02-15T22:56:23.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.009+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93896820878208] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:23.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.009+0000 7f21dd575800 20 remove_watcher() i=6 2024-02-15T22:56:23.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.009+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93896820866128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55660ea76300 con 0x7f21d40141d0 2024-02-15T22:56:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93896820866128] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21cc06f070 con 0x7f21d40141d0 2024-02-15T22:56:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 20 remove_watcher() i=7 2024-02-15T22:56:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21d40141d0 msgr2=0x7f21d4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21d40141d0 0x7f21d4015940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55660ea68350 msgr2=0x55660ea6a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55660ea68350 0x55660ea6a810 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f21d0025360 msgr2=0x7f21d004d620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f21d0025360 0x7f21d004d620 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55660ea6e600 msgr2=0x55660ea70aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55660ea6e600 0x55660ea70aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20a4036740 msgr2=0x7f20a4038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20a4036740 0x7f20a4038c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f21d400b010 tx=0x7f21d4020000 comp rx=0 tx=0).stop 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 msgr2=0x55660ea5c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea5c760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21d004aa20 tx=0x7f21d004ba40 comp rx=0 tx=0).stop 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21db07b640 1 -- 172.21.15.133:0/784885652 reap_dead start 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 shutdown_connections 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 --2- 172.21.15.133:0/784885652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea557f0 0x55660ea5c760 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 >> 172.21.15.133:0/784885652 conn(0x55660ea51ac0 msgr2=0x55660ea4f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 shutdown_connections 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/784885652 wait complete. 2024-02-15T22:56:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/4281731945 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 msgr2=0x7f20b4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 --2- 172.21.15.133:0/4281731945 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 0x7f20b4038ca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55660ea38750 tx=0x7f21d4005840 comp rx=0 tx=0).stop 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/4281731945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea48540 msgr2=0x55660ea48960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 --2- 172.21.15.133:0/4281731945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea48540 0x55660ea48960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21d000e630 tx=0x7f21d000ea30 comp rx=0 tx=0).stop 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/4281731945 shutdown_connections 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 --2- 172.21.15.133:0/4281731945 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 0x7f20b4038ca0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 --2- 172.21.15.133:0/4281731945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660ea48540 0x55660ea48960 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/4281731945 >> 172.21.15.133:0/4281731945 conn(0x55660ea3c5e0 msgr2=0x55660ea3c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/4281731945 shutdown_connections 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.011+0000 7f21dd575800 1 -- 172.21.15.133:0/4281731945 wait complete. 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55660e9370d0 msgr2=0x55660ea378a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55660e9370d0 0x55660ea378a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20c0036790 msgr2=0x7f20c0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20c0036790 0x7f20c0038c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f21d0001e40 tx=0x7f21d00013a0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 msgr2=0x55660ea30be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea30be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f21cc01f610 tx=0x7f21cc002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 shutdown_connections 2024-02-15T22:56:23.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55660e9370d0 0x55660ea378a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20c0036790 0x7f20c0038c50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 --2- 172.21.15.133:0/1919003837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660e935e70 0x55660ea30be0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 >> 172.21.15.133:0/1919003837 conn(0x55660e9314d0 msgr2=0x55660ea1f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 shutdown_connections 2024-02-15T22:56:23.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.012+0000 7f21dd575800 1 -- 172.21.15.133:0/1919003837 wait complete. 2024-02-15T22:56:23.022 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-15T22:56:23.022 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-15T22:56:23.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-15T22:56:23.023 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-15T22:56:23.107 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:23.107 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.105+0000 7f0823216800 1 Processor -- start 2024-02-15T22:56:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.105+0000 7f0823216800 1 -- start start 2024-02-15T22:56:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.105+0000 7f0823216800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55bc7a3d83d0 0x55bc7a3e0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.105+0000 7f0823216800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bc7a322bb0 con 0x55bc7a3d6890 2024-02-15T22:56:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.105+0000 7f0823216800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bc7a2da450 con 0x55bc7a3d83d0 2024-02-15T22:56:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.105+0000 7f081e160640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55bc7a3d83d0 0x55bc7a3e0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.105+0000 7f081e961640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55bc7a3d6890 0x55bc7a3d6cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:51056/0 (socket says 172.21.15.133:51056) 2024-02-15T22:56:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.105+0000 7f081e961640 1 -- 172.21.15.133:0/835693019 learned_addr learned my addr 172.21.15.133:0/835693019 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.105+0000 7f081e160640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55bc7a3d83d0 0x55bc7a3e0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48220/0 (socket says 172.21.15.133:48220) 2024-02-15T22:56:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.106+0000 7f081e160640 1 -- 172.21.15.133:0/835693019 >> v1:172.21.15.52:6789/0 conn(0x55bc7a3d6890 legacy=0x55bc7a3d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.106+0000 7f081e160640 1 -- 172.21.15.133:0/835693019 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc7a34b180 con 0x55bc7a3d83d0 2024-02-15T22:56:23.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.107+0000 7f081e160640 1 --2- 172.21.15.133:0/835693019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d83d0 0x55bc7a3e0ed0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f080800a470 tx=0x7f080801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2568be5569da4f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.108+0000 7f081d95f640 1 -- 172.21.15.133:0/835693019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f080804ad40 con 0x55bc7a3d83d0 2024-02-15T22:56:23.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.108+0000 7f081d95f640 1 -- 172.21.15.133:0/835693019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0808052440 con 0x55bc7a3d83d0 2024-02-15T22:56:23.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.108+0000 7f081d95f640 1 -- 172.21.15.133:0/835693019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f080804aea0 con 0x55bc7a3d83d0 2024-02-15T22:56:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.108+0000 7f0823216800 1 -- 172.21.15.133:0/835693019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d83d0 msgr2=0x55bc7a3e0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.108+0000 7f0823216800 1 --2- 172.21.15.133:0/835693019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d83d0 0x55bc7a3e0ed0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f080800a470 tx=0x7f080801cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.108+0000 7f0823216800 1 -- 172.21.15.133:0/835693019 shutdown_connections 2024-02-15T22:56:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.108+0000 7f0823216800 1 --2- 172.21.15.133:0/835693019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d83d0 0x55bc7a3e0ed0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.108+0000 7f0823216800 1 -- 172.21.15.133:0/835693019 >> 172.21.15.133:0/835693019 conn(0x55bc7a3d24d0 msgr2=0x55bc7a3d48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.108+0000 7f0823216800 1 -- 172.21.15.133:0/835693019 shutdown_connections 2024-02-15T22:56:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.108+0000 7f0823216800 1 -- 172.21.15.133:0/835693019 wait complete. 2024-02-15T22:56:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.119+0000 7f0823216800 1 Processor -- start 2024-02-15T22:56:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.120+0000 7f0823216800 1 -- start start 2024-02-15T22:56:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.120+0000 7f0823216800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.120+0000 7f0823216800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a2d7980 con 0x55bc7a3d6890 2024-02-15T22:56:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.120+0000 7f081e961640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.120+0000 7f081e961640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48234/0 (socket says 172.21.15.133:48234) 2024-02-15T22:56:23.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.120+0000 7f081e961640 1 -- 172.21.15.133:0/786890373 learned_addr learned my addr 172.21.15.133:0/786890373 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.120+0000 7f081e961640 1 -- 172.21.15.133:0/786890373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0808005d20 con 0x55bc7a3d6890 2024-02-15T22:56:23.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.120+0000 7f081e961640 1 --2- 172.21.15.133:0/786890373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4ca440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0818001c40 tx=0x7f081800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96697a7e742e89e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.120+0000 7f070ce09640 1 -- 172.21.15.133:0/786890373 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f081800e470 con 0x55bc7a3d6890 2024-02-15T22:56:23.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.121+0000 7f070ce09640 1 -- 172.21.15.133:0/786890373 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081800e5d0 con 0x55bc7a3d6890 2024-02-15T22:56:23.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.121+0000 7f070ce09640 1 -- 172.21.15.133:0/786890373 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f081800e8d0 con 0x55bc7a3d6890 2024-02-15T22:56:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.121+0000 7f0823216800 1 -- 172.21.15.133:0/786890373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 msgr2=0x55bc7a4ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.121+0000 7f0823216800 1 --2- 172.21.15.133:0/786890373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4ca440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0818001c40 tx=0x7f081800b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.121+0000 7f0823216800 1 -- 172.21.15.133:0/786890373 shutdown_connections 2024-02-15T22:56:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.121+0000 7f0823216800 1 --2- 172.21.15.133:0/786890373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4ca440 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.121+0000 7f0823216800 1 -- 172.21.15.133:0/786890373 >> 172.21.15.133:0/786890373 conn(0x55bc7a3d24d0 msgr2=0x55bc7a4c5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.121+0000 7f0823216800 1 -- 172.21.15.133:0/786890373 shutdown_connections 2024-02-15T22:56:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.121+0000 7f0823216800 1 -- 172.21.15.133:0/786890373 wait complete. 2024-02-15T22:56:23.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.122+0000 7f0823216800 1 Processor -- start 2024-02-15T22:56:23.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.122+0000 7f0823216800 1 -- start start 2024-02-15T22:56:23.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.122+0000 7f0823216800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.122+0000 7f0823216800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a2d3160 con 0x55bc7a3d6890 2024-02-15T22:56:23.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.122+0000 7f081e961640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.122+0000 7f081e961640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4d1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48240/0 (socket says 172.21.15.133:48240) 2024-02-15T22:56:23.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.122+0000 7f081e961640 1 -- 172.21.15.133:0/2195559312 learned_addr learned my addr 172.21.15.133:0/2195559312 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.122+0000 7f081e961640 1 -- 172.21.15.133:0/2195559312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc7a322bb0 con 0x55bc7a3d6890 2024-02-15T22:56:23.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.123+0000 7f081e961640 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4d1b90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f081800b700 tx=0x7f0818000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.123+0000 7f070b606640 1 -- 172.21.15.133:0/2195559312 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f081801f070 con 0x55bc7a3d6890 2024-02-15T22:56:23.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.123+0000 7f070b606640 1 -- 172.21.15.133:0/2195559312 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818018770 con 0x55bc7a3d6890 2024-02-15T22:56:23.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.123+0000 7f070b606640 1 -- 172.21.15.133:0/2195559312 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0818018a10 con 0x55bc7a3d6890 2024-02-15T22:56:23.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.123+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc7a4d20d0 con 0x55bc7a3d6890 2024-02-15T22:56:23.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.123+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc7a4d25b0 con 0x55bc7a3d6890 2024-02-15T22:56:23.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.124+0000 7f070b606640 1 -- 172.21.15.133:0/2195559312 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0818018c80 con 0x55bc7a3d6890 2024-02-15T22:56:23.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.124+0000 7f070b606640 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0704036790 0x7f0704038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.124+0000 7f070b606640 1 -- 172.21.15.133:0/2195559312 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f081804c0b0 con 0x55bc7a3d6890 2024-02-15T22:56:23.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.124+0000 7f081e160640 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0704036790 0x7f0704038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.124+0000 7f0823216800 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55bc7a4d67f0 0x55bc7a4d8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.124+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a4d91d0 con 0x55bc7a4d67f0 2024-02-15T22:56:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.124+0000 7f081f162640 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55bc7a4d67f0 0x55bc7a4d8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.124+0000 7f081e160640 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0704036790 0x7f0704038c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0808054000 tx=0x7f080804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.124+0000 7f081f162640 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55bc7a4d67f0 0x55bc7a4d8c00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.125+0000 7f081f162640 1 -- 172.21.15.133:0/2195559312 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f081000a4a0 con 0x55bc7a4d67f0 2024-02-15T22:56:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.125+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a4d5f50 con 0x55bc7a4d67f0 2024-02-15T22:56:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.125+0000 7f081f162640 1 -- 172.21.15.133:0/2195559312 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f081000a4a0 con 0x55bc7a4d67f0 2024-02-15T22:56:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.125+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a4daf30 con 0x55bc7a4d67f0 2024-02-15T22:56:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.125+0000 7f081f162640 1 -- 172.21.15.133:0/2195559312 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f081000a4a0 con 0x55bc7a4d67f0 2024-02-15T22:56:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.125+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a4da240 con 0x55bc7a4d67f0 2024-02-15T22:56:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.125+0000 7f081f162640 1 -- 172.21.15.133:0/2195559312 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f081000a4a0 con 0x55bc7a4d67f0 2024-02-15T22:56:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.125+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a4da650 con 0x55bc7a4d67f0 2024-02-15T22:56:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.126+0000 7f081f162640 1 -- 172.21.15.133:0/2195559312 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f081000a4a0 con 0x55bc7a4d67f0 2024-02-15T22:56:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.126+0000 7f0823216800 1 Processor -- start 2024-02-15T22:56:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.126+0000 7f0823216800 1 -- start start 2024-02-15T22:56:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.126+0000 7f0823216800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4e9930 0x55bc7a4e9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.126+0000 7f0823216800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a275e80 con 0x55bc7a4e9930 2024-02-15T22:56:23.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.126+0000 7f081e160640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4e9930 0x55bc7a4e9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.127+0000 7f081e160640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4e9930 0x55bc7a4e9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48248/0 (socket says 172.21.15.133:48248) 2024-02-15T22:56:23.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.127+0000 7f081e160640 1 -- 172.21.15.133:0/350616311 learned_addr learned my addr 172.21.15.133:0/350616311 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.127+0000 7f081e160640 1 -- 172.21.15.133:0/350616311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc7a4ea290 con 0x55bc7a4e9930 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.127+0000 7f081e160640 1 --2- 172.21.15.133:0/350616311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4e9930 0x55bc7a4e9d50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0808055040 tx=0x7f0808002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.127+0000 7f0708e01640 1 -- 172.21.15.133:0/350616311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f080805c410 con 0x55bc7a4e9930 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.127+0000 7f0708e01640 1 -- 172.21.15.133:0/350616311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0808063040 con 0x55bc7a4e9930 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.127+0000 7f0823216800 1 -- 172.21.15.133:0/350616311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc7a4ea480 con 0x55bc7a4e9930 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.127+0000 7f0708e01640 1 -- 172.21.15.133:0/350616311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f080805c6a0 con 0x55bc7a4e9930 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.127+0000 7f0823216800 1 -- 172.21.15.133:0/350616311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc7a4eb030 con 0x55bc7a4e9930 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.128+0000 7f0708e01640 1 -- 172.21.15.133:0/350616311 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f080805c800 con 0x55bc7a4e9930 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.128+0000 7f0708e01640 1 --2- 172.21.15.133:0/350616311 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06f8036790 0x7f06f8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.128+0000 7f0708e01640 1 -- 172.21.15.133:0/350616311 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f080808e430 con 0x55bc7a4e9930 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.128+0000 7f081f162640 1 --2- 172.21.15.133:0/350616311 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06f8036790 0x7f06f8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.128+0000 7f0823216800 1 Processor -- start 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.128+0000 7f0823216800 1 -- start start 2024-02-15T22:56:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.128+0000 7f081f162640 1 --2- 172.21.15.133:0/350616311 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06f8036790 0x7f06f8038c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x55bc7a4d9c80 tx=0x7f0810005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.129+0000 7f0823216800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.129+0000 7f0823216800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a24b5d0 con 0x55bc7a4f6b20 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.129+0000 7f081e160640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.129+0000 7f081e160640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4f6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48258/0 (socket says 172.21.15.133:48258) 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.129+0000 7f081e160640 1 -- 172.21.15.133:0/2900717227 learned_addr learned my addr 172.21.15.133:0/2900717227 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.129+0000 7f081e160640 1 -- 172.21.15.133:0/2900717227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc7a4f7510 con 0x55bc7a4f6b20 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.129+0000 7f081e160640 1 --2- 172.21.15.133:0/2900717227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4f6f40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f080800a010 tx=0x7f0808066480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491ff4c27d7d9954 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.129+0000 7f07027fc640 1 -- 172.21.15.133:0/2900717227 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f080808b070 con 0x55bc7a4f6b20 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.129+0000 7f07027fc640 1 -- 172.21.15.133:0/2900717227 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0808009540 con 0x55bc7a4f6b20 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.129+0000 7f07027fc640 1 -- 172.21.15.133:0/2900717227 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f080806fd90 con 0x55bc7a4f6b20 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f0823216800 1 -- 172.21.15.133:0/2900717227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 msgr2=0x55bc7a4f6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f0823216800 1 --2- 172.21.15.133:0/2900717227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4f6f40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f080800a010 tx=0x7f0808066480 comp rx=0 tx=0).stop 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f0823216800 1 -- 172.21.15.133:0/2900717227 shutdown_connections 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f0823216800 1 --2- 172.21.15.133:0/2900717227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4f6f40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f0823216800 1 -- 172.21.15.133:0/2900717227 >> 172.21.15.133:0/2900717227 conn(0x55bc7a4f2e80 msgr2=0x55bc7a4f0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f0823216800 1 -- 172.21.15.133:0/2900717227 shutdown_connections 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f0823216800 1 -- 172.21.15.133:0/2900717227 wait complete. 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f0823216800 1 Processor -- start 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f0823216800 1 -- start start 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f0823216800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4fdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f0823216800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a4fe030 con 0x55bc7a4f6b20 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f081e160640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4fdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f081e160640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4fdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48266/0 (socket says 172.21.15.133:48266) 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.130+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 learned_addr learned my addr 172.21.15.133:0/1368381674 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.131+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc7a4eb030 con 0x55bc7a4f6b20 2024-02-15T22:56:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.131+0000 7f081e160640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4fdaf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f080808e3a0 tx=0x7f080808c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.131+0000 7f0700ff9640 1 -- 172.21.15.133:0/1368381674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f080808b070 con 0x55bc7a4f6b20 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.131+0000 7f0700ff9640 1 -- 172.21.15.133:0/1368381674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080808b1d0 con 0x55bc7a4f6b20 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.131+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc7a4fe230 con 0x55bc7a4f6b20 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.131+0000 7f0700ff9640 1 -- 172.21.15.133:0/1368381674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f080808b470 con 0x55bc7a4f6b20 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.131+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc7a4fe230 con 0x55bc7a4f6b20 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.132+0000 7f0700ff9640 1 -- 172.21.15.133:0/1368381674 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f080806f360 con 0x55bc7a4f6b20 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.132+0000 7f0700ff9640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06e8036790 0x7f06e8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.132+0000 7f0700ff9640 1 -- 172.21.15.133:0/1368381674 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f080808fdf0 con 0x55bc7a4f6b20 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.132+0000 7f081f162640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06e8036790 0x7f06e8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.132+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.132+0000 7f0823216800 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55bc7a5095f0 0x55bc7a50bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.132+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a50c200 con 0x55bc7a5095f0 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f081f162640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06e8036790 0x7f06e8038c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f081000b010 tx=0x7f0810020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f081e961640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55bc7a5095f0 0x55bc7a50bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f081e961640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55bc7a5095f0 0x55bc7a50bab0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f0823216800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f0823216800 20 realm 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a50c5d0 con 0x55bc7a5095f0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f0823216800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f0823216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.133+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a50ce50 con 0x55bc7a5095f0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f0823216800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a50d1b0 con 0x55bc7a5095f0 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f0823216800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a50d9b0 con 0x55bc7a5095f0 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f0823216800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f0823216800 20 searching for the correct realm 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f0823216800 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55bc7a50f8d0 0x55bc7a511d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a50f8d0 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f081e160640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55bc7a50f8d0 0x55bc7a511d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.134+0000 7f081e160640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55bc7a50f8d0 0x55bc7a511d70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.135+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.135+0000 7f081e160640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0808097070 0x7f080808da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.135+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f0808097070 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.135+0000 7f081f162640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0808097070 0x7f080808da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.135+0000 7f081f162640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0808097070 0x7f080808da70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.135+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f081000a4a0 con 0x7f0808097070 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.135+0000 7f081f162640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f08100141d0 0x7f0810015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.135+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f08100141d0 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.136+0000 7f081e961640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f08100141d0 0x7f0810015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.136+0000 7f081e961640 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f08100141d0 0x7f0810015940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.136+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.136+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a5095f0 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.137+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.137+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a5095f0 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.137+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.137+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f08100141d0 2024-02-15T22:56:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.137+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.137+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f08100141d0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.137+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.137+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f0808097070 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.137+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f081000a4a0 con 0x7f0808097070 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.137+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a50f8d0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.138+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.138+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a5095f0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.138+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.138+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f08100141d0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.138+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.138+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a5095f0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.138+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.138+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f0808097070 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.139+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.139+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a50f8d0 2024-02-15T22:56:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.139+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.139+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a50f8d0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.139+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.139+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f08100141d0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.139+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.139+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a50f8d0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.140+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.140+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a50f8d0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.140+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.140+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a5095f0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.140+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.140+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a5095f0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.140+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.140+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f08100141d0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.141+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.141+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a50f8d0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.141+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.141+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f0808097070 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.141+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.141+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a5095f0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.141+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.141+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f08100141d0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.142+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.142+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a50f8d0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.142+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.142+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f08100141d0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.142+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.142+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f0808097070 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.142+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.142+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a50f8d0 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f08100141d0 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x55bc7a5095f0 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512440 con 0x7f0808097070 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f0823216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f0823216800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f0823216800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f0823216800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f0823216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f0823216800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.143+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a50eeb0 con 0x55bc7a5095f0 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a50de90 con 0x55bc7a5095f0 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a50e800 con 0x55bc7a5095f0 2024-02-15T22:56:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 20 zone default found 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 4 Realm: () 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 20 zonegroup default 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.144+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a512880 con 0x7f08100141d0 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f0823216800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a514700 con 0x55bc7a50f8d0 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f0823216800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a514a60 con 0x55bc7a50f8d0 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f0823216800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f0823216800 20 started sync module instance, tier type = 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f0823216800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.145+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a513b90 con 0x7f0808097070 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.146+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.146+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94267994357920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a513b90 con 0x7f0808097070 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.146+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5153d0 con 0x55bc7a5095f0 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.147+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94267994357920] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.147+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.147+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94267994362128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a513b90 con 0x55bc7a5095f0 2024-02-15T22:56:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.147+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a515e60 con 0x55bc7a50f8d0 2024-02-15T22:56:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.149+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.149+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94267994364240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5166b0 con 0x55bc7a50f8d0 2024-02-15T22:56:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.149+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a517130 con 0x7f0808097070 2024-02-15T22:56:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.150+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94267994362128] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.151+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94267994364240] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.153+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.153+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94267994366480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5136f0 con 0x7f0808097070 2024-02-15T22:56:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.153+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a517af0 con 0x55bc7a5095f0 2024-02-15T22:56:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.156+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94267994366480] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.159+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.159+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94267994369072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a517af0 con 0x55bc7a5095f0 2024-02-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.159+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a518460 con 0x7f08100141d0 2024-02-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.162+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94267994369072] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.162+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.162+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94267994374560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a517af0 con 0x7f08100141d0 2024-02-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.162+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a518e60 con 0x7f08100141d0 2024-02-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.163+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.163+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94267994376576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5192c0 con 0x7f08100141d0 2024-02-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.163+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a519d90 con 0x7f08100141d0 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.163+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94267994374560] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.164+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.164+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94267994376576] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.164+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94267994380400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a519d50 con 0x7f08100141d0 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.164+0000 7f0823216800 20 add_watcher() i=0 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.164+0000 7f0823216800 20 add_watcher() i=1 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.164+0000 7f0823216800 20 add_watcher() i=2 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.164+0000 7f0823216800 20 add_watcher() i=3 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.164+0000 7f0823216800 20 add_watcher() i=4 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.164+0000 7f0823216800 20 add_watcher() i=5 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.164+0000 7f0823216800 20 add_watcher() i=6 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.165+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94267994380400] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.165+0000 7f0823216800 20 add_watcher() i=7 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.165+0000 7f0823216800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.165+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a51d170 con 0x55bc7a5095f0 2024-02-15T22:56:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.165+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.165+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94267994371664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a51a590 con 0x55bc7a5095f0 2024-02-15T22:56:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.166+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94267994371664] v30'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.166+0000 7f06d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.166+0000 7f0823216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.166+0000 7f0823216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.166+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5256d0 con 0x55bc7a5095f0 2024-02-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.169+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.169+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a525ce0 con 0x7f08100141d0 2024-02-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.170+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.170+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a526210 con 0x55bc7a50f8d0 2024-02-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.172+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.172+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a526be0 con 0x55bc7a5095f0 2024-02-15T22:56:23.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.175+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.175+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a526be0 con 0x7f0808097070 2024-02-15T22:56:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.177+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.177+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a527110 con 0x55bc7a50f8d0 2024-02-15T22:56:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.179+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'17 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.179+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a527ae0 con 0x55bc7a5095f0 2024-02-15T22:56:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.180+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.180+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a527ae0 con 0x7f08100141d0 2024-02-15T22:56:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.181+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'17 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.181+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a527b70 con 0x7f0808097070 2024-02-15T22:56:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.182+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.182+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5280a0 con 0x55bc7a50f8d0 2024-02-15T22:56:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.185+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.185+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a528a70 con 0x7f0808097070 2024-02-15T22:56:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.188+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.188+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a521680 con 0x7f08100141d0 2024-02-15T22:56:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.189+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.189+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a521680 con 0x7f0808097070 2024-02-15T22:56:23.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.191+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.191+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a521620 con 0x7f08100141d0 2024-02-15T22:56:23.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.194+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'23 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.194+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5217f0 con 0x55bc7a5095f0 2024-02-15T22:56:23.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.196+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'38 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.196+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5217f0 con 0x55bc7a50f8d0 2024-02-15T22:56:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.199+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.199+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x7f0808097070 2024-02-15T22:56:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.201+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.201+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x55bc7a50f8d0 2024-02-15T22:56:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.202+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.202+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x55bc7a5095f0 2024-02-15T22:56:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.205+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.205+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x55bc7a5095f0 2024-02-15T22:56:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.208+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'39 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.208+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x55bc7a50f8d0 2024-02-15T22:56:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.209+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.209+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x7f0808097070 2024-02-15T22:56:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.210+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.210+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x55bc7a50f8d0 2024-02-15T22:56:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.213+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.213+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x55bc7a50f8d0 2024-02-15T22:56:23.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.214+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.214+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x55bc7a50f8d0 2024-02-15T22:56:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.215+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.215+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x55bc7a50f8d0 2024-02-15T22:56:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.217+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.217+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x7f08100141d0 2024-02-15T22:56:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.218+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.218+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x55bc7a50f8d0 2024-02-15T22:56:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.219+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.219+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x7f08100141d0 2024-02-15T22:56:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.220+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.220+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x55bc7a50f8d0 2024-02-15T22:56:23.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.221+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.221+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x7f08100141d0 2024-02-15T22:56:23.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.223+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.223+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5295e0 con 0x7f0808097070 2024-02-15T22:56:23.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.224+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.224+0000 7f064ffff640 20 reqs_thread_entry: start 2024-02-15T22:56:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.224+0000 7f0823216800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.224+0000 7f0823216800 20 Filter name: none 2024-02-15T22:56:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.224+0000 7f064dffb640 20 reqs_thread_entry: start 2024-02-15T22:56:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.224+0000 7f0823216800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T22:56:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.224+0000 7f0823216800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.224+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a552e90 con 0x7f08100141d0 2024-02-15T22:56:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.225+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.225+0000 7f0823216800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.225+0000 7f0823216800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-15T22:56:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.225+0000 7f0823216800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:56:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, user does not exist 2024-02-15T22:56:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.225+0000 7f06d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.225+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94267994371664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a522530 con 0x55bc7a5095f0 2024-02-15T22:56:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.227+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94267994371664] v30'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.227+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94267994357920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a522090 con 0x7f0808097070 2024-02-15T22:56:23.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.229+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94267994357920] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.229+0000 7f0823216800 20 remove_watcher() i=0 2024-02-15T22:56:23.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.229+0000 7f0823216800 2 removed watcher, disabling cache 2024-02-15T22:56:23.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.229+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94267994362128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a514080 con 0x55bc7a5095f0 2024-02-15T22:56:23.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.230+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94267994362128] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.230+0000 7f0823216800 20 remove_watcher() i=1 2024-02-15T22:56:23.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.230+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94267994364240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a515110 con 0x55bc7a50f8d0 2024-02-15T22:56:23.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.232+0000 7f081e160640 1 -- 172.21.15.133:0/1368381674 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94267994364240] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0808094070 con 0x55bc7a50f8d0 2024-02-15T22:56:23.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.232+0000 7f0823216800 20 remove_watcher() i=2 2024-02-15T22:56:23.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.232+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94267994366480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a515110 con 0x7f0808097070 2024-02-15T22:56:23.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.233+0000 7f081f162640 1 -- 172.21.15.133:0/1368381674 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94267994366480] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f081003a040 con 0x7f0808097070 2024-02-15T22:56:23.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.233+0000 7f0823216800 20 remove_watcher() i=3 2024-02-15T22:56:23.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.233+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94267994369072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a516210 con 0x55bc7a5095f0 2024-02-15T22:56:23.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.235+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94267994369072] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x55bc7a5095f0 2024-02-15T22:56:23.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.235+0000 7f0823216800 20 remove_watcher() i=4 2024-02-15T22:56:23.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.235+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94267994374560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a515110 con 0x7f08100141d0 2024-02-15T22:56:23.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.236+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94267994374560] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.236+0000 7f0823216800 20 remove_watcher() i=5 2024-02-15T22:56:23.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.236+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94267994376576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a516210 con 0x7f08100141d0 2024-02-15T22:56:23.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.238+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94267994376576] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.238+0000 7f0823216800 20 remove_watcher() i=6 2024-02-15T22:56:23.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.238+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94267994380400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc7a5181a0 con 0x7f08100141d0 2024-02-15T22:56:23.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.239+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94267994380400] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0818014070 con 0x7f08100141d0 2024-02-15T22:56:23.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.239+0000 7f0823216800 20 remove_watcher() i=7 2024-02-15T22:56:23.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f08100141d0 msgr2=0x7f0810015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f08100141d0 0x7f0810015940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55bc7a5095f0 msgr2=0x55bc7a50bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55bc7a5095f0 0x55bc7a50bab0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0808097070 msgr2=0x7f080808da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0808097070 0x7f080808da70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55bc7a50f8d0 msgr2=0x55bc7a511d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55bc7a50f8d0 0x55bc7a511d70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06e8036790 msgr2=0x7f06e8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06e8036790 0x7f06e8038c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f081000b010 tx=0x7f0810020000 comp rx=0 tx=0).stop 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f081e961640 1 -- 172.21.15.133:0/1368381674 reap_dead start 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 msgr2=0x55bc7a4fdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4fdaf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f080808e3a0 tx=0x7f080808c960 comp rx=0 tx=0).stop 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 shutdown_connections 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/1368381674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4f6b20 0x55bc7a4fdaf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 >> 172.21.15.133:0/1368381674 conn(0x55bc7a4f2e80 msgr2=0x55bc7a4f04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 shutdown_connections 2024-02-15T22:56:23.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/1368381674 wait complete. 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/350616311 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06f8036790 msgr2=0x7f06f8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/350616311 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06f8036790 0x7f06f8038c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x55bc7a4d9c80 tx=0x7f0810005840 comp rx=0 tx=0).stop 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/350616311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4e9930 msgr2=0x55bc7a4e9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/350616311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4e9930 0x55bc7a4e9d50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0808055040 tx=0x7f0808002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/350616311 shutdown_connections 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/350616311 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06f8036790 0x7f06f8038c50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/350616311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a4e9930 0x55bc7a4e9d50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/350616311 >> 172.21.15.133:0/350616311 conn(0x55bc7a4dd9d0 msgr2=0x55bc7a4dddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/350616311 shutdown_connections 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/350616311 wait complete. 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55bc7a4d67f0 msgr2=0x55bc7a4d8c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.240+0000 7f0823216800 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55bc7a4d67f0 0x55bc7a4d8c00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.241+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0704036790 msgr2=0x7f0704038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.241+0000 7f0823216800 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0704036790 0x7f0704038c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0808054000 tx=0x7f080804e000 comp rx=0 tx=0).stop 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.241+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 msgr2=0x55bc7a4d1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.241+0000 7f0823216800 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4d1b90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f081800b700 tx=0x7f0818000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.241+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 shutdown_connections 2024-02-15T22:56:23.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.241+0000 7f0823216800 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55bc7a4d67f0 0x55bc7a4d8c00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.241+0000 7f0823216800 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0704036790 0x7f0704038c50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.241+0000 7f0823216800 1 --2- 172.21.15.133:0/2195559312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc7a3d6890 0x55bc7a4d1b90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.241+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 >> 172.21.15.133:0/2195559312 conn(0x55bc7a3d24d0 msgr2=0x55bc7a4c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.241+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 shutdown_connections 2024-02-15T22:56:23.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.241+0000 7f0823216800 1 -- 172.21.15.133:0/2195559312 wait complete. 2024-02-15T22:56:23.251 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-15T22:56:23.251 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-15T22:56:23.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-15T22:56:23.251 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-15T22:56:23.293 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:23.293 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.292+0000 7f478ed2d800 1 Processor -- start 2024-02-15T22:56:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.292+0000 7f478ed2d800 1 -- start start 2024-02-15T22:56:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.292+0000 7f478ed2d800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563185499300 0x56318549b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.292+0000 7f478ed2d800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5631853e0bb0 con 0x563185494e70 2024-02-15T22:56:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.292+0000 7f478ed2d800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x563185398450 con 0x563185499300 2024-02-15T22:56:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.292+0000 7f47821b2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563185499300 0x56318549b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.292+0000 7f478a9b3640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x563185494e70 0x563185495290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:51072/0 (socket says 172.21.15.133:51072) 2024-02-15T22:56:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.292+0000 7f47821b2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563185499300 0x56318549b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48278/0 (socket says 172.21.15.133:48278) 2024-02-15T22:56:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.292+0000 7f478a9b3640 1 -- 172.21.15.133:0/3744534479 learned_addr learned my addr 172.21.15.133:0/3744534479 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.292+0000 7f47821b2640 1 -- 172.21.15.133:0/3744534479 >> v1:172.21.15.52:6789/0 conn(0x563185494e70 legacy=0x563185495290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.292+0000 7f47821b2640 1 -- 172.21.15.133:0/3744534479 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56318549cd20 con 0x563185499300 2024-02-15T22:56:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.294+0000 7f47821b2640 1 --2- 172.21.15.133:0/3744534479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185499300 0x56318549b6f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f477400a470 tx=0x7f477401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb99866a4a638c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.294+0000 7f478a1b2640 1 -- 172.21.15.133:0/3744534479 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4774052570 con 0x563185499300 2024-02-15T22:56:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.294+0000 7f478a1b2640 1 -- 172.21.15.133:0/3744534479 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47740526d0 con 0x563185499300 2024-02-15T22:56:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.294+0000 7f478a1b2640 1 -- 172.21.15.133:0/3744534479 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4774052990 con 0x563185499300 2024-02-15T22:56:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.295+0000 7f478ed2d800 1 -- 172.21.15.133:0/3744534479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185499300 msgr2=0x56318549b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.295+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3744534479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185499300 0x56318549b6f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f477400a470 tx=0x7f477401cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.295+0000 7f478ed2d800 1 -- 172.21.15.133:0/3744534479 shutdown_connections 2024-02-15T22:56:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.295+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3744534479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185499300 0x56318549b6f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.295+0000 7f478ed2d800 1 -- 172.21.15.133:0/3744534479 >> 172.21.15.133:0/3744534479 conn(0x5631854904d0 msgr2=0x5631854928f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.295+0000 7f478ed2d800 1 -- 172.21.15.133:0/3744534479 shutdown_connections 2024-02-15T22:56:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.295+0000 7f478ed2d800 1 -- 172.21.15.133:0/3744534479 wait complete. 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.306+0000 7f478ed2d800 1 Processor -- start 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.306+0000 7f478ed2d800 1 -- start start 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.306+0000 7f478ed2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x563185408f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.306+0000 7f478ed2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563185395980 con 0x563185494e70 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.307+0000 7f478a9b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x563185408f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.307+0000 7f478a9b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x563185408f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48284/0 (socket says 172.21.15.133:48284) 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.307+0000 7f478a9b3640 1 -- 172.21.15.133:0/2519308998 learned_addr learned my addr 172.21.15.133:0/2519308998 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.307+0000 7f478a9b3640 1 -- 172.21.15.133:0/2519308998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4774005d20 con 0x563185494e70 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.307+0000 7f478a9b3640 1 --2- 172.21.15.133:0/2519308998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x563185408f30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f477c001c80 tx=0x7f477c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506380642777a1f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.307+0000 7f4678e09640 1 -- 172.21.15.133:0/2519308998 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f477c00e470 con 0x563185494e70 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.307+0000 7f4678e09640 1 -- 172.21.15.133:0/2519308998 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c00e5d0 con 0x563185494e70 2024-02-15T22:56:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.307+0000 7f4678e09640 1 -- 172.21.15.133:0/2519308998 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f477c00e8d0 con 0x563185494e70 2024-02-15T22:56:23.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.308+0000 7f478ed2d800 1 -- 172.21.15.133:0/2519308998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 msgr2=0x563185408f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.308+0000 7f478ed2d800 1 --2- 172.21.15.133:0/2519308998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x563185408f30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f477c001c80 tx=0x7f477c00b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.308+0000 7f478ed2d800 1 -- 172.21.15.133:0/2519308998 shutdown_connections 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.308+0000 7f478ed2d800 1 --2- 172.21.15.133:0/2519308998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x563185408f30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.308+0000 7f478ed2d800 1 -- 172.21.15.133:0/2519308998 >> 172.21.15.133:0/2519308998 conn(0x5631854904d0 msgr2=0x563185580810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.308+0000 7f478ed2d800 1 -- 172.21.15.133:0/2519308998 shutdown_connections 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.308+0000 7f478ed2d800 1 -- 172.21.15.133:0/2519308998 wait complete. 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.308+0000 7f478ed2d800 1 Processor -- start 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.308+0000 7f478ed2d800 1 -- start start 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f478ed2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x56318558d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f478ed2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563185391160 con 0x563185494e70 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f478a9b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x56318558d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f478a9b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x56318558d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48290/0 (socket says 172.21.15.133:48290) 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f478a9b3640 1 -- 172.21.15.133:0/3980144199 learned_addr learned my addr 172.21.15.133:0/3980144199 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f478a9b3640 1 -- 172.21.15.133:0/3980144199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631853e0bb0 con 0x563185494e70 2024-02-15T22:56:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f478a9b3640 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x56318558d6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f477c001c80 tx=0x7f477c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f4677606640 1 -- 172.21.15.133:0/3980144199 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f477c01f070 con 0x563185494e70 2024-02-15T22:56:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f4677606640 1 -- 172.21.15.133:0/3980144199 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c018640 con 0x563185494e70 2024-02-15T22:56:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f4677606640 1 -- 172.21.15.133:0/3980144199 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f477c0188e0 con 0x563185494e70 2024-02-15T22:56:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56318558dc30 con 0x563185494e70 2024-02-15T22:56:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.309+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56318558e110 con 0x563185494e70 2024-02-15T22:56:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.310+0000 7f4677606640 1 -- 172.21.15.133:0/3980144199 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f477c018b10 con 0x563185494e70 2024-02-15T22:56:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.310+0000 7f4677606640 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4670036790 0x7f4670038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.310+0000 7f4677606640 1 -- 172.21.15.133:0/3980144199 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f477c04c170 con 0x563185494e70 2024-02-15T22:56:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.310+0000 7f47821b2640 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4670036790 0x7f4670038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.311+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563185499300 0x563185594410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.311+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855949e0 con 0x563185499300 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.311+0000 7f478b1b4640 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563185499300 0x563185594410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.311+0000 7f47821b2640 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4670036790 0x7f4670038c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4774054000 tx=0x7f477404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.311+0000 7f478b1b4640 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563185499300 0x563185594410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.311+0000 7f478b1b4640 1 -- 172.21.15.133:0/3980144199 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f478400a4a0 con 0x563185499300 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.311+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563185591b00 con 0x563185499300 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.311+0000 7f478b1b4640 1 -- 172.21.15.133:0/3980144199 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f478400a4a0 con 0x563185499300 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.312+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563185594eb0 con 0x563185499300 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.312+0000 7f478b1b4640 1 -- 172.21.15.133:0/3980144199 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f478400a4a0 con 0x563185499300 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.312+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563185595ba0 con 0x563185499300 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.312+0000 7f478b1b4640 1 -- 172.21.15.133:0/3980144199 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f478400a4a0 con 0x563185499300 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.312+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563185595fb0 con 0x563185499300 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.312+0000 7f478b1b4640 1 -- 172.21.15.133:0/3980144199 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f478400a4a0 con 0x563185499300 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.313+0000 7f478ed2d800 1 Processor -- start 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.313+0000 7f478ed2d800 1 -- start start 2024-02-15T22:56:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.313+0000 7f478ed2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855a5120 0x5631855a5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.313+0000 7f478ed2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563185333e80 con 0x5631855a5120 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.313+0000 7f47821b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855a5120 0x5631855a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.313+0000 7f47821b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855a5120 0x5631855a5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48296/0 (socket says 172.21.15.133:48296) 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.313+0000 7f47821b2640 1 -- 172.21.15.133:0/3819089853 learned_addr learned my addr 172.21.15.133:0/3819089853 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.313+0000 7f47821b2640 1 -- 172.21.15.133:0/3819089853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631855a5a80 con 0x5631855a5120 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.314+0000 7f47821b2640 1 --2- 172.21.15.133:0/3819089853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855a5120 0x5631855a5540 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47740447c0 tx=0x7f4774002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.314+0000 7f4674e01640 1 -- 172.21.15.133:0/3819089853 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4774052e40 con 0x5631855a5120 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.314+0000 7f4674e01640 1 -- 172.21.15.133:0/3819089853 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477405d890 con 0x5631855a5120 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.314+0000 7f478ed2d800 1 -- 172.21.15.133:0/3819089853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5631855a5c70 con 0x5631855a5120 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.314+0000 7f4674e01640 1 -- 172.21.15.133:0/3819089853 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f477405db30 con 0x5631855a5120 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.314+0000 7f478ed2d800 1 -- 172.21.15.133:0/3819089853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631855a6820 con 0x5631855a5120 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f4674e01640 1 -- 172.21.15.133:0/3819089853 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f477405dd20 con 0x5631855a5120 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f4674e01640 1 --2- 172.21.15.133:0/3819089853 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4664036790 0x7f4664038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f4674e01640 1 -- 172.21.15.133:0/3819089853 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f477408f5e0 con 0x5631855a5120 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f478b1b4640 1 --2- 172.21.15.133:0/3819089853 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4664036790 0x7f4664038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f478ed2d800 1 Processor -- start 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f478ed2d800 1 -- start start 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f478b1b4640 1 --2- 172.21.15.133:0/3819089853 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4664036790 0x7f4664038c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x563185591a20 tx=0x7f4784005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f478ed2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855867c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f478ed2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631853095d0 con 0x5631855863a0 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f47821b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855867c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f47821b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855867c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48308/0 (socket says 172.21.15.133:48308) 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.315+0000 7f47821b2640 1 -- 172.21.15.133:0/3818573673 learned_addr learned my addr 172.21.15.133:0/3818573673 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f47821b2640 1 -- 172.21.15.133:0/3818573673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563185584b90 con 0x5631855863a0 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f47821b2640 1 --2- 172.21.15.133:0/3818573673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855867c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4774066fd0 tx=0x7f4774088f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c72b11429edb19 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f466e7fc640 1 -- 172.21.15.133:0/3818573673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47740654a0 con 0x5631855863a0 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f466e7fc640 1 -- 172.21.15.133:0/3818573673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477406db60 con 0x5631855863a0 2024-02-15T22:56:23.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f466e7fc640 1 -- 172.21.15.133:0/3818573673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f477406de40 con 0x5631855863a0 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f478ed2d800 1 -- 172.21.15.133:0/3818573673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 msgr2=0x5631855867c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3818573673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855867c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4774066fd0 tx=0x7f4774088f90 comp rx=0 tx=0).stop 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f478ed2d800 1 -- 172.21.15.133:0/3818573673 shutdown_connections 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3818573673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855867c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f478ed2d800 1 -- 172.21.15.133:0/3818573673 >> 172.21.15.133:0/3818573673 conn(0x5631855ae610 msgr2=0x5631855ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f478ed2d800 1 -- 172.21.15.133:0/3818573673 shutdown_connections 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.316+0000 7f478ed2d800 1 -- 172.21.15.133:0/3818573673 wait complete. 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.317+0000 7f478ed2d800 1 Processor -- start 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.317+0000 7f478ed2d800 1 -- start start 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.317+0000 7f478ed2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855bb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.317+0000 7f478ed2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631855bb9f0 con 0x5631855863a0 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.317+0000 7f47821b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855bb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.317+0000 7f47821b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855bb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:48320/0 (socket says 172.21.15.133:48320) 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.317+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 learned_addr learned my addr 172.21.15.133:0/1910571912 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.317+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631855a6820 con 0x5631855863a0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.318+0000 7f47821b2640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855bb4b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f477405d810 tx=0x7f477400a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.318+0000 7f466cff9640 1 -- 172.21.15.133:0/1910571912 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f477408f410 con 0x5631855863a0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.318+0000 7f466cff9640 1 -- 172.21.15.133:0/1910571912 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4774065720 con 0x5631855863a0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.318+0000 7f466cff9640 1 -- 172.21.15.133:0/1910571912 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4774065a40 con 0x5631855863a0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.318+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5631855bbbf0 con 0x5631855863a0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.318+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631855bc050 con 0x5631855863a0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.319+0000 7f466cff9640 1 -- 172.21.15.133:0/1910571912 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f477405cab0 con 0x5631855863a0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.319+0000 7f466cff9640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4654036790 0x7f4654038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.319+0000 7f466cff9640 1 -- 172.21.15.133:0/1910571912 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f477409aaf0 con 0x5631855863a0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.319+0000 7f478b1b4640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4654036790 0x7f4654038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.319+0000 7f478b1b4640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4654036790 0x7f4654038c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f478400b010 tx=0x7f4784020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.319+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.319+0000 7f478ed2d800 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5631855c7070 0x5631855c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.319+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855c9c80 con 0x5631855c7070 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478a9b3640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5631855c7070 0x5631855c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478a9b3640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5631855c7070 0x5631855c9530 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478ed2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478ed2d800 20 realm 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855ca050 con 0x5631855c7070 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478ed2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478ed2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.320+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855ca8d0 con 0x5631855c7070 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478ed2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cac30 con 0x5631855c7070 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478ed2d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cb430 con 0x5631855c7070 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478ed2d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478ed2d800 20 searching for the correct realm 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478ed2d800 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5631855cd2c0 0x5631855cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855cd2c0 2024-02-15T22:56:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f47821b2640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5631855cd2c0 0x5631855cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.321+0000 7f47821b2640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5631855cd2c0 0x5631855cf780 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.322+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4774059040 con 0x5631855cd2c0 2024-02-15T22:56:23.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.322+0000 7f47821b2640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4774099060 0x7f477408c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.322+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f4774099060 2024-02-15T22:56:23.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.322+0000 7f478b1b4640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4774099060 0x7f477408c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.322+0000 7f478b1b4640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4774099060 0x7f477408c1d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.323+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478400a4a0 con 0x7f4774099060 2024-02-15T22:56:23.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.323+0000 7f478b1b4640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f47840141d0 0x7f4784015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.323+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f47840141d0 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.323+0000 7f478a9b3640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f47840141d0 0x7f4784015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.323+0000 7f478a9b3640 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f47840141d0 0x7f4784015940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.323+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x7f47840141d0 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.323+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855c7070 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.324+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.324+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855c7070 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.324+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.324+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f47840141d0 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.324+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x7f47840141d0 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.324+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f47840141d0 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.324+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x7f47840141d0 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.324+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f4774099060 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.325+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478400a4a0 con 0x7f4774099060 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.325+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855cd2c0 2024-02-15T22:56:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.325+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4774059040 con 0x5631855cd2c0 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.325+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855c7070 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.325+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.325+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f47840141d0 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.325+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x7f47840141d0 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.325+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855c7070 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.326+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.326+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f4774099060 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.326+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.326+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855cd2c0 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.326+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4774059040 con 0x5631855cd2c0 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.326+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855cd2c0 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.326+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4774059040 con 0x5631855cd2c0 2024-02-15T22:56:23.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.326+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f47840141d0 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.327+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x7f47840141d0 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.327+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855cd2c0 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.327+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4774059040 con 0x5631855cd2c0 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.327+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855cd2c0 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.327+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4774059040 con 0x5631855cd2c0 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.327+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855c7070 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.327+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.327+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855c7070 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.327+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.328+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f47840141d0 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.328+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x7f47840141d0 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.328+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855cd2c0 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.328+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4774059040 con 0x5631855cd2c0 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.328+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f4774099060 2024-02-15T22:56:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.328+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.328+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855c7070 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.328+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f477c014070 con 0x5631855c7070 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.328+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f47840141d0 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.329+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x7f47840141d0 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.329+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855cd2c0 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.329+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.329+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f47840141d0 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.329+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c014070 con 0x7f47840141d0 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.329+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f4774099060 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855cd2c0 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f47840141d0 2024-02-15T22:56:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x5631855c7070 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cfe50 con 0x7f4774099060 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478ed2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478ed2d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478ed2d800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478ed2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478ed2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478ed2d800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.330+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cbd60 con 0x5631855c7070 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cc5b0 con 0x5631855c7070 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855cb9e0 con 0x5631855c7070 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 20 zone default found 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 4 Realm: () 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 20 zonegroup default 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d0290 con 0x7f47840141d0 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.331+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.332+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d2110 con 0x5631855cd2c0 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.332+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.332+0000 7f478ed2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.332+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.332+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d2470 con 0x5631855cd2c0 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.332+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.332+0000 7f478ed2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.332+0000 7f478ed2d800 20 started sync module instance, tier type = 2024-02-15T22:56:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.332+0000 7f478ed2d800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.332+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d16e0 con 0x7f4774099060 2024-02-15T22:56:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.333+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.333+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94770690857968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d16e0 con 0x7f4774099060 2024-02-15T22:56:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.333+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d2e60 con 0x5631855c7070 2024-02-15T22:56:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.334+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.334+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94770690861376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d36b0 con 0x5631855c7070 2024-02-15T22:56:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.334+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d3eb0 con 0x5631855cd2c0 2024-02-15T22:56:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.336+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94770690861376] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.336+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94770690857968] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.336+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.336+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94770690863632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d3ad0 con 0x5631855cd2c0 2024-02-15T22:56:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.336+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d46b0 con 0x7f4774099060 2024-02-15T22:56:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.339+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94770690863632] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.339+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.339+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94770690867728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d4630 con 0x7f4774099060 2024-02-15T22:56:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.339+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d5510 con 0x5631855c7070 2024-02-15T22:56:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.340+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.340+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94770690871408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d54d0 con 0x5631855c7070 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.340+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d6460 con 0x7f47840141d0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.340+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94770690867728] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.341+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.341+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94770690869856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d6460 con 0x7f47840141d0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.341+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d6e60 con 0x7f47840141d0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.341+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94770690871408] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.342+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94770690869856] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.342+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.342+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94770690875216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d6980 con 0x7f47840141d0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.342+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d76b0 con 0x7f47840141d0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.343+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94770690875216] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.343+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.343+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94770690873536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d6980 con 0x7f47840141d0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.343+0000 7f478ed2d800 20 add_watcher() i=0 2024-02-15T22:56:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.343+0000 7f478ed2d800 20 add_watcher() i=1 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.343+0000 7f478ed2d800 20 add_watcher() i=2 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.343+0000 7f478ed2d800 20 add_watcher() i=3 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.343+0000 7f478ed2d800 20 add_watcher() i=4 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.343+0000 7f478ed2d800 20 add_watcher() i=5 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.343+0000 7f478ed2d800 20 add_watcher() i=6 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.344+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94770690873536] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.344+0000 7f478ed2d800 20 add_watcher() i=7 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.344+0000 7f478ed2d800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.344+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855da830 con 0x5631855c7070 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.344+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.344+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94770690880016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d7b80 con 0x5631855c7070 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.345+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94770690880016] v30'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.346+0000 7f46417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.346+0000 7f478ed2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.346+0000 7f478ed2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.346+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e3160 con 0x5631855c7070 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.347+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.347+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e3770 con 0x7f47840141d0 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.348+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.348+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e3ca0 con 0x5631855cd2c0 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.349+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.349+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e4670 con 0x5631855c7070 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.350+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.350+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e4670 con 0x7f4774099060 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.351+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.351+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e4ba0 con 0x5631855cd2c0 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.352+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.352+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e5570 con 0x5631855c7070 2024-02-15T22:56:23.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.353+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.353+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e5570 con 0x7f47840141d0 2024-02-15T22:56:23.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.354+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.354+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e5570 con 0x7f4774099060 2024-02-15T22:56:23.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.355+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.355+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e2280 con 0x5631855cd2c0 2024-02-15T22:56:23.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.356+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.356+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e6130 con 0x7f4774099060 2024-02-15T22:56:23.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.357+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.357+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e6660 con 0x7f47840141d0 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.358+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.358+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e6660 con 0x7f4774099060 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.359+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.359+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e6b00 con 0x7f47840141d0 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.360+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'25 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.360+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e6b00 con 0x5631855c7070 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.361+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.361+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e6b00 con 0x5631855cd2c0 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.362+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.362+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e6b00 con 0x7f4774099060 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.363+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.363+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1100 con 0x5631855cd2c0 2024-02-15T22:56:23.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.364+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.364+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x5631855c7070 2024-02-15T22:56:23.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.365+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.365+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1390 con 0x5631855c7070 2024-02-15T22:56:23.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.366+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'44 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.366+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1350 con 0x5631855cd2c0 2024-02-15T22:56:23.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.367+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.367+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x7f4774099060 2024-02-15T22:56:23.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.368+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.368+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x5631855cd2c0 2024-02-15T22:56:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.369+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.369+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x5631855cd2c0 2024-02-15T22:56:23.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.370+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.370+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x5631855cd2c0 2024-02-15T22:56:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.371+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.371+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x5631855cd2c0 2024-02-15T22:56:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.371+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.372+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x7f47840141d0 2024-02-15T22:56:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.373+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.373+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x5631855cd2c0 2024-02-15T22:56:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.374+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.374+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x7f47840141d0 2024-02-15T22:56:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.375+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.375+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x5631855cd2c0 2024-02-15T22:56:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.376+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.376+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x7f47840141d0 2024-02-15T22:56:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.377+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.377+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855e1710 con 0x7f4774099060 2024-02-15T22:56:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.378+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.378+0000 7f45bbfff640 20 reqs_thread_entry: start 2024-02-15T22:56:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.378+0000 7f478ed2d800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.378+0000 7f478ed2d800 20 Filter name: none 2024-02-15T22:56:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.379+0000 7f45b9ffb640 20 reqs_thread_entry: start 2024-02-15T22:56:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.379+0000 7f478ed2d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.379+0000 7f478ed2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.379+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563185610a80 con 0x5631855c7070 2024-02-15T22:56:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.379+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.379+0000 7f478ed2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.379+0000 7f478ed2d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-15T22:56:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.379+0000 7f478ed2d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, user does not exist 2024-02-15T22:56:23.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.380+0000 7f46417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:23.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.380+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94770690880016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855c4460 con 0x5631855c7070 2024-02-15T22:56:23.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.381+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94770690880016] v30'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.381+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94770690857968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d7210 con 0x7f4774099060 2024-02-15T22:56:23.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.382+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94770690857968] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.382+0000 7f478ed2d800 20 remove_watcher() i=0 2024-02-15T22:56:23.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.382+0000 7f478ed2d800 2 removed watcher, disabling cache 2024-02-15T22:56:23.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.382+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94770690861376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d1bf0 con 0x5631855c7070 2024-02-15T22:56:23.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.383+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94770690861376] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.383+0000 7f478ed2d800 20 remove_watcher() i=1 2024-02-15T22:56:23.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.383+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94770690863632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d1bf0 con 0x5631855cd2c0 2024-02-15T22:56:23.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.384+0000 7f47821b2640 1 -- 172.21.15.133:0/1910571912 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94770690863632] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f47740ab040 con 0x5631855cd2c0 2024-02-15T22:56:23.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.384+0000 7f478ed2d800 20 remove_watcher() i=2 2024-02-15T22:56:23.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.384+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94770690867728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d3210 con 0x7f4774099060 2024-02-15T22:56:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.385+0000 7f478b1b4640 1 -- 172.21.15.133:0/1910571912 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94770690867728] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478403a040 con 0x7f4774099060 2024-02-15T22:56:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.385+0000 7f478ed2d800 20 remove_watcher() i=3 2024-02-15T22:56:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.385+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94770690871408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d3210 con 0x5631855c7070 2024-02-15T22:56:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.386+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94770690871408] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x5631855c7070 2024-02-15T22:56:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.386+0000 7f478ed2d800 20 remove_watcher() i=4 2024-02-15T22:56:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.386+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94770690869856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d5070 con 0x7f47840141d0 2024-02-15T22:56:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.387+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94770690869856] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.387+0000 7f478ed2d800 20 remove_watcher() i=5 2024-02-15T22:56:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.387+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94770690875216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d5070 con 0x7f47840141d0 2024-02-15T22:56:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.388+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94770690875216] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.388+0000 7f478ed2d800 20 remove_watcher() i=6 2024-02-15T22:56:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.388+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94770690873536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631855d5f50 con 0x7f47840141d0 2024-02-15T22:56:23.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94770690873536] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f477c054040 con 0x7f47840141d0 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 20 remove_watcher() i=7 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f47840141d0 msgr2=0x7f4784015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f47840141d0 0x7f4784015940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5631855c7070 msgr2=0x5631855c9530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5631855c7070 0x5631855c9530 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4774099060 msgr2=0x7f477408c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4774099060 0x7f477408c1d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5631855cd2c0 msgr2=0x5631855cf780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5631855cd2c0 0x5631855cf780 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4654036790 msgr2=0x7f4654038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4654036790 0x7f4654038c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f478400b010 tx=0x7f4784020000 comp rx=0 tx=0).stop 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478a9b3640 1 -- 172.21.15.133:0/1910571912 reap_dead start 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 msgr2=0x5631855bb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855bb4b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f477405d810 tx=0x7f477400a410 comp rx=0 tx=0).stop 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 shutdown_connections 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 --2- 172.21.15.133:0/1910571912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855863a0 0x5631855bb4b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 >> 172.21.15.133:0/1910571912 conn(0x5631855ae610 msgr2=0x5631855abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 shutdown_connections 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/1910571912 wait complete. 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/3819089853 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4664036790 msgr2=0x7f4664038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3819089853 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4664036790 0x7f4664038c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x563185591a20 tx=0x7f4784005840 comp rx=0 tx=0).stop 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/3819089853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855a5120 msgr2=0x5631855a5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3819089853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855a5120 0x5631855a5540 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47740447c0 tx=0x7f4774002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/3819089853 shutdown_connections 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3819089853 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4664036790 0x7f4664038c50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3819089853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631855a5120 0x5631855a5540 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/3819089853 >> 172.21.15.133:0/3819089853 conn(0x5631855991c0 msgr2=0x5631855995c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/3819089853 shutdown_connections 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.389+0000 7f478ed2d800 1 -- 172.21.15.133:0/3819089853 wait complete. 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563185499300 msgr2=0x563185594410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563185499300 0x563185594410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4670036790 msgr2=0x7f4670038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4670036790 0x7f4670038c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4774054000 tx=0x7f477404e000 comp rx=0 tx=0).stop 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 msgr2=0x56318558d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x56318558d6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f477c001c80 tx=0x7f477c000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 shutdown_connections 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563185499300 0x563185594410 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4670036790 0x7f4670038c50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 --2- 172.21.15.133:0/3980144199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563185494e70 0x56318558d6f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 >> 172.21.15.133:0/3980144199 conn(0x5631854904d0 msgr2=0x56318557f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 shutdown_connections 2024-02-15T22:56:23.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.390+0000 7f478ed2d800 1 -- 172.21.15.133:0/3980144199 wait complete. 2024-02-15T22:56:23.400 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-15T22:56:23.400 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-15T22:56:23.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-15T22:56:23.401 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-15T22:56:23.485 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.484+0000 7f5a41697800 1 Processor -- start 2024-02-15T22:56:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.484+0000 7f5a41697800 1 -- start start 2024-02-15T22:56:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.484+0000 7f5a41697800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5602efb883a0 0x5602efb8a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.484+0000 7f5a41697800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5602efacfc50 con 0x5602efb83f10 2024-02-15T22:56:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.484+0000 7f5a41697800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5602efa87450 con 0x5602efb883a0 2024-02-15T22:56:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.484+0000 7f5a3e995640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5602efb883a0 0x5602efb8a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.484+0000 7f5a3f196640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5602efb83f10 0x5602efb84330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44774/0 (socket says 172.21.15.133:44774) 2024-02-15T22:56:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.484+0000 7f5a3e995640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5602efb883a0 0x5602efb8a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56838/0 (socket says 172.21.15.133:56838) 2024-02-15T22:56:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.484+0000 7f5a3f196640 1 -- 172.21.15.133:0/3082008944 learned_addr learned my addr 172.21.15.133:0/3082008944 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.485+0000 7f5a3e995640 1 -- 172.21.15.133:0/3082008944 >> v1:172.21.15.52:6789/0 conn(0x5602efb83f10 legacy=0x5602efb84330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.485+0000 7f5a3e995640 1 -- 172.21.15.133:0/3082008944 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602efb8bdc0 con 0x5602efb883a0 2024-02-15T22:56:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.486+0000 7f5a3e995640 1 --2- 172.21.15.133:0/3082008944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb883a0 0x5602efb8a790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400a470 tx=0x7f5a3401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14daf67e936e531c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.486+0000 7f5a3e194640 1 -- 172.21.15.133:0/3082008944 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a34052570 con 0x5602efb883a0 2024-02-15T22:56:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.487+0000 7f5a3e194640 1 -- 172.21.15.133:0/3082008944 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a340526d0 con 0x5602efb883a0 2024-02-15T22:56:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.487+0000 7f5a3e194640 1 -- 172.21.15.133:0/3082008944 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a34052990 con 0x5602efb883a0 2024-02-15T22:56:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.487+0000 7f5a41697800 1 -- 172.21.15.133:0/3082008944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb883a0 msgr2=0x5602efb8a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.487+0000 7f5a41697800 1 --2- 172.21.15.133:0/3082008944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb883a0 0x5602efb8a790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400a470 tx=0x7f5a3401cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.487+0000 7f5a41697800 1 -- 172.21.15.133:0/3082008944 shutdown_connections 2024-02-15T22:56:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.487+0000 7f5a41697800 1 --2- 172.21.15.133:0/3082008944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb883a0 0x5602efb8a790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.487+0000 7f5a41697800 1 -- 172.21.15.133:0/3082008944 >> 172.21.15.133:0/3082008944 conn(0x5602efb7f590 msgr2=0x5602efb819b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.487+0000 7f5a41697800 1 -- 172.21.15.133:0/3082008944 shutdown_connections 2024-02-15T22:56:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.487+0000 7f5a41697800 1 -- 172.21.15.133:0/3082008944 wait complete. 2024-02-15T22:56:23.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.498+0000 7f5a41697800 1 Processor -- start 2024-02-15T22:56:23.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.499+0000 7f5a41697800 1 -- start start 2024-02-15T22:56:23.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.499+0000 7f5a41697800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efaf8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.499+0000 7f5a41697800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602efa84980 con 0x5602efb83f10 2024-02-15T22:56:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.499+0000 7f5a3f196640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efaf8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.499+0000 7f5a3f196640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efaf8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56842/0 (socket says 172.21.15.133:56842) 2024-02-15T22:56:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.499+0000 7f5a3f196640 1 -- 172.21.15.133:0/3447703803 learned_addr learned my addr 172.21.15.133:0/3447703803 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.499+0000 7f5a3f196640 1 -- 172.21.15.133:0/3447703803 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34005d20 con 0x5602efb83f10 2024-02-15T22:56:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.499+0000 7f5a3f196640 1 --2- 172.21.15.133:0/3447703803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efaf8040 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5a30001c80 tx=0x7f5a3000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c339eb7f9243aa19 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.500+0000 7f592d60a640 1 -- 172.21.15.133:0/3447703803 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a3000e470 con 0x5602efb83f10 2024-02-15T22:56:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.500+0000 7f592d60a640 1 -- 172.21.15.133:0/3447703803 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3000e5d0 con 0x5602efb83f10 2024-02-15T22:56:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.500+0000 7f592d60a640 1 -- 172.21.15.133:0/3447703803 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a3000e8d0 con 0x5602efb83f10 2024-02-15T22:56:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.500+0000 7f5a41697800 1 -- 172.21.15.133:0/3447703803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 msgr2=0x5602efaf8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.500+0000 7f5a41697800 1 --2- 172.21.15.133:0/3447703803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efaf8040 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5a30001c80 tx=0x7f5a3000b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.500+0000 7f5a41697800 1 -- 172.21.15.133:0/3447703803 shutdown_connections 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.500+0000 7f5a41697800 1 --2- 172.21.15.133:0/3447703803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efaf8040 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.500+0000 7f5a41697800 1 -- 172.21.15.133:0/3447703803 >> 172.21.15.133:0/3447703803 conn(0x5602efb7f590 msgr2=0x5602efc6f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.500+0000 7f5a41697800 1 -- 172.21.15.133:0/3447703803 shutdown_connections 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.500+0000 7f5a41697800 1 -- 172.21.15.133:0/3447703803 wait complete. 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.501+0000 7f5a41697800 1 Processor -- start 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.501+0000 7f5a41697800 1 -- start start 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.501+0000 7f5a41697800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efc7c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.501+0000 7f5a41697800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602efa80160 con 0x5602efb83f10 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.501+0000 7f5a3f196640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efc7c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.501+0000 7f5a3f196640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efc7c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56848/0 (socket says 172.21.15.133:56848) 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.501+0000 7f5a3f196640 1 -- 172.21.15.133:0/2321426342 learned_addr learned my addr 172.21.15.133:0/2321426342 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.501+0000 7f5a3f196640 1 -- 172.21.15.133:0/2321426342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602efacfc50 con 0x5602efb83f10 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.502+0000 7f5a3f196640 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efc7c800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a30001c80 tx=0x7f5a30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.502+0000 7f592be07640 1 -- 172.21.15.133:0/2321426342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a3001f070 con 0x5602efb83f10 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.502+0000 7f592be07640 1 -- 172.21.15.133:0/2321426342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a30018640 con 0x5602efb83f10 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.502+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5602efc7cd40 con 0x5602efb83f10 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.502+0000 7f592be07640 1 -- 172.21.15.133:0/2321426342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a300188e0 con 0x5602efb83f10 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.502+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602efc7d220 con 0x5602efb83f10 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.502+0000 7f5a41697800 1 Processor -- start 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5a41697800 1 -- start start 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f592be07640 1 -- 172.21.15.133:0/2321426342 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5a30018a40 con 0x5602efb83f10 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5a41697800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc89f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5a41697800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602efa22e80 con 0x5602efc89b50 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f592be07640 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59240367e0 0x7f5924038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f592be07640 1 -- 172.21.15.133:0/2321426342 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f5a3004c070 con 0x5602efb83f10 2024-02-15T22:56:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5a3f997640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc89f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5a3f196640 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59240367e0 0x7f5924038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5a3f997640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc89f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56854/0 (socket says 172.21.15.133:56854) 2024-02-15T22:56:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5a3f997640 1 -- 172.21.15.133:0/3361489360 learned_addr learned my addr 172.21.15.133:0/3361489360 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5a3f997640 1 -- 172.21.15.133:0/3361489360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602efc8a4b0 con 0x5602efc89b50 2024-02-15T22:56:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5a3f196640 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59240367e0 0x7f5924038ca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a300224e0 tx=0x7f5a30022370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5a3f997640 1 --2- 172.21.15.133:0/3361489360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc89f70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800a430 tx=0x7f5a3800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5a4df75403a082 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5929e03640 1 -- 172.21.15.133:0/3361489360 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a38001650 con 0x5602efc89b50 2024-02-15T22:56:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5929e03640 1 -- 172.21.15.133:0/3361489360 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a380017d0 con 0x5602efc89b50 2024-02-15T22:56:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.503+0000 7f5929e03640 1 -- 172.21.15.133:0/3361489360 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a38001ab0 con 0x5602efc89b50 2024-02-15T22:56:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.504+0000 7f5a41697800 1 -- 172.21.15.133:0/3361489360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 msgr2=0x5602efc89f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.504+0000 7f5a41697800 1 --2- 172.21.15.133:0/3361489360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc89f70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800a430 tx=0x7f5a3800a8f0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.504+0000 7f5a41697800 1 -- 172.21.15.133:0/3361489360 shutdown_connections 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.504+0000 7f5a41697800 1 --2- 172.21.15.133:0/3361489360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc89f70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.504+0000 7f5a41697800 1 -- 172.21.15.133:0/3361489360 >> 172.21.15.133:0/3361489360 conn(0x5602efb883a0 msgr2=0x5602efc865f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.504+0000 7f5a41697800 1 -- 172.21.15.133:0/3361489360 shutdown_connections 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.504+0000 7f5a41697800 1 -- 172.21.15.133:0/3361489360 wait complete. 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.504+0000 7f5a41697800 1 Processor -- start 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.504+0000 7f5a41697800 1 -- start start 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.504+0000 7f5a41697800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc90bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.504+0000 7f5a41697800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602ef9f85d0 con 0x5602efc89b50 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.505+0000 7f5a3f997640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc90bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.505+0000 7f5a3f997640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc90bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56864/0 (socket says 172.21.15.133:56864) 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.505+0000 7f5a3f997640 1 -- 172.21.15.133:0/1398355608 learned_addr learned my addr 172.21.15.133:0/1398355608 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.505+0000 7f5a3f997640 1 -- 172.21.15.133:0/1398355608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3800a0e0 con 0x5602efc89b50 2024-02-15T22:56:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.505+0000 7f5a3f997640 1 --2- 172.21.15.133:0/1398355608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc90bc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5a38000f80 tx=0x7f5a38003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.505+0000 7f591bfff640 1 -- 172.21.15.133:0/1398355608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a38010a40 con 0x5602efc89b50 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.505+0000 7f591bfff640 1 -- 172.21.15.133:0/1398355608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a38010ba0 con 0x5602efc89b50 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.505+0000 7f5a41697800 1 -- 172.21.15.133:0/1398355608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5602efc91100 con 0x5602efc89b50 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.505+0000 7f591bfff640 1 -- 172.21.15.133:0/1398355608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a38010e80 con 0x5602efc89b50 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.505+0000 7f5a41697800 1 -- 172.21.15.133:0/1398355608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602efc91560 con 0x5602efc89b50 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.506+0000 7f591bfff640 1 -- 172.21.15.133:0/1398355608 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5a38017070 con 0x5602efc89b50 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.506+0000 7f591bfff640 1 --2- 172.21.15.133:0/1398355608 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59200367e0 0x7f5920038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.506+0000 7f591bfff640 1 -- 172.21.15.133:0/1398355608 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f5a3804bd20 con 0x5602efc89b50 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.506+0000 7f5a3e995640 1 --2- 172.21.15.133:0/1398355608 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59200367e0 0x7f5920038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.506+0000 7f5a41697800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.506+0000 7f5a41697800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.507+0000 7f5a41697800 1 Processor -- start 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.507+0000 7f5a3e995640 1 --2- 172.21.15.133:0/1398355608 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59200367e0 0x7f5920038ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a34054000 tx=0x7f5a3404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.507+0000 7f5a41697800 1 -- start start 2024-02-15T22:56:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.507+0000 7f5a41697800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efcab070 0x5602efcab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.507+0000 7f5a41697800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602efcab9d0 con 0x5602efcab070 2024-02-15T22:56:23.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.507+0000 7f5a3f196640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efcab070 0x5602efcab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.507+0000 7f5a3f196640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efcab070 0x5602efcab490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56878/0 (socket says 172.21.15.133:56878) 2024-02-15T22:56:23.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.507+0000 7f5a3f196640 1 -- 172.21.15.133:0/986243928 learned_addr learned my addr 172.21.15.133:0/986243928 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.507+0000 7f5a3f196640 1 -- 172.21.15.133:0/986243928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602efcabb10 con 0x5602efcab070 2024-02-15T22:56:23.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.507+0000 7f5a3f196640 1 --2- 172.21.15.133:0/986243928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efcab070 0x5602efcab490 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5a3004a640 tx=0x7f5a30022970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.508+0000 7f58affff640 1 -- 172.21.15.133:0/986243928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a300234f0 con 0x5602efcab070 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.508+0000 7f58affff640 1 -- 172.21.15.133:0/986243928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a30017c50 con 0x5602efcab070 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.508+0000 7f5a41697800 1 -- 172.21.15.133:0/986243928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5602efcac440 con 0x5602efcab070 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.508+0000 7f58affff640 1 -- 172.21.15.133:0/986243928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a3004a160 con 0x5602efcab070 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.508+0000 7f5a41697800 1 -- 172.21.15.133:0/986243928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602efcac440 con 0x5602efcab070 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.508+0000 7f58affff640 1 -- 172.21.15.133:0/986243928 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5a3004d030 con 0x5602efcab070 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.508+0000 7f58affff640 1 --2- 172.21.15.133:0/986243928 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f58800367e0 0x7f5880038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.508+0000 7f58affff640 1 -- 172.21.15.133:0/986243928 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f5a30051b10 con 0x5602efcab070 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.508+0000 7f5a3e995640 1 --2- 172.21.15.133:0/986243928 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f58800367e0 0x7f5880038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.509+0000 7f58adffb640 20 reqs_thread_entry: start 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.509+0000 7f5a41697800 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5602efcb7e40 0x5602efcba230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.509+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5602efcba7d0 con 0x5602efcb7e40 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.509+0000 7f5a3e995640 1 --2- 172.21.15.133:0/986243928 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f58800367e0 0x7f5880038ca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a3401cda0 tx=0x7f5a34005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.509+0000 7f5a3f997640 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5602efcb7e40 0x5602efcba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.509+0000 7f5a3f997640 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5602efcb7e40 0x5602efcba230 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.509+0000 7f5a3f997640 1 -- 172.21.15.133:0/2321426342 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5a3801b390 con 0x5602efcb7e40 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.509+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5602efcbc030 con 0x5602efcb7e40 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.510+0000 7f5a3f997640 1 -- 172.21.15.133:0/2321426342 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f5a3801b390 con 0x5602efcb7e40 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.510+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~875 in=875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5602efcc0bf0 con 0x5602efcb7e40 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.511+0000 7f5a3f997640 1 -- 172.21.15.133:0/2321426342 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [stat,call,call,writefull 0~875] v30'4 uv4 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f5a3801b390 con 0x5602efcb7e40 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/1398355608 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59200367e0 msgr2=0x7f5920038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 --2- 172.21.15.133:0/1398355608 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59200367e0 0x7f5920038ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a34054000 tx=0x7f5a3404e000 comp rx=0 tx=0).stop 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/1398355608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 msgr2=0x5602efc90bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 --2- 172.21.15.133:0/1398355608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc90bc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5a38000f80 tx=0x7f5a38003370 comp rx=0 tx=0).stop 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/1398355608 shutdown_connections 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 --2- 172.21.15.133:0/1398355608 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59200367e0 0x7f5920038ca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 --2- 172.21.15.133:0/1398355608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efc89b50 0x5602efc90bc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/1398355608 >> 172.21.15.133:0/1398355608 conn(0x5602efb883a0 msgr2=0x5602efc83c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/1398355608 shutdown_connections 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/1398355608 wait complete. 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/986243928 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f58800367e0 msgr2=0x7f5880038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 --2- 172.21.15.133:0/986243928 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f58800367e0 0x7f5880038ca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a3401cda0 tx=0x7f5a34005a00 comp rx=0 tx=0).stop 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/986243928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efcab070 msgr2=0x5602efcab490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 --2- 172.21.15.133:0/986243928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efcab070 0x5602efcab490 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5a3004a640 tx=0x7f5a30022970 comp rx=0 tx=0).stop 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/986243928 shutdown_connections 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 --2- 172.21.15.133:0/986243928 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f58800367e0 0x7f5880038ca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 --2- 172.21.15.133:0/986243928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efcab070 0x5602efcab490 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/986243928 >> 172.21.15.133:0/986243928 conn(0x5602efc9fca0 msgr2=0x5602efca06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/986243928 shutdown_connections 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.512+0000 7f5a41697800 1 -- 172.21.15.133:0/986243928 wait complete. 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5602efcb7e40 msgr2=0x5602efcba230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5602efcb7e40 0x5602efcba230 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59240367e0 msgr2=0x7f5924038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59240367e0 0x7f5924038ca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a300224e0 tx=0x7f5a30022370 comp rx=0 tx=0).stop 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 msgr2=0x5602efc7c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efc7c800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a30001c80 tx=0x7f5a30000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 shutdown_connections 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5602efcb7e40 0x5602efcba230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f59240367e0 0x7f5924038ca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 --2- 172.21.15.133:0/2321426342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602efb83f10 0x5602efc7c800 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 >> 172.21.15.133:0/2321426342 conn(0x5602efb7f590 msgr2=0x5602efc6e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 shutdown_connections 2024-02-15T22:56:23.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.513+0000 7f5a41697800 1 -- 172.21.15.133:0/2321426342 wait complete. 2024-02-15T22:56:23.523 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T22:56:23.524 DEBUG:tasks.util.rgw: json result: {'id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T22:56:23.529 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-15T22:56:23.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-15T22:56:23.529 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-15T22:56:23.570 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:23.570 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:23.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.568+0000 7fdd63a14800 1 Processor -- start 2024-02-15T22:56:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.568+0000 7fdd63a14800 1 -- start start 2024-02-15T22:56:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.568+0000 7fdd63a14800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556fb2cd9a70 0x556fb2cdbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.568+0000 7fdd63a14800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556fb2c23ba0 con 0x556fb2cdc3a0 2024-02-15T22:56:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.568+0000 7fdd63a14800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x556fb2bdb450 con 0x556fb2cd9a70 2024-02-15T22:56:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.569+0000 7fdd5f084640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556fb2cd9a70 0x556fb2cdbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.569+0000 7fdd57fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x556fb2cdc3a0 0x556fb2cde790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44788/0 (socket says 172.21.15.133:44788) 2024-02-15T22:56:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.569+0000 7fdd5f084640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556fb2cd9a70 0x556fb2cdbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56884/0 (socket says 172.21.15.133:56884) 2024-02-15T22:56:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.569+0000 7fdd57fff640 1 -- 172.21.15.133:0/2144929465 learned_addr learned my addr 172.21.15.133:0/2144929465 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.569+0000 7fdd5f084640 1 -- 172.21.15.133:0/2144929465 >> v1:172.21.15.52:6789/0 conn(0x556fb2cdc3a0 legacy=0x556fb2cde790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.569+0000 7fdd5e883640 1 -- 172.21.15.133:0/2144929465 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873053881 0 0) 0x556fb2c23ba0 con 0x556fb2cdc3a0 2024-02-15T22:56:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.569+0000 7fdd5f084640 1 -- 172.21.15.133:0/2144929465 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb2ce0ec0 con 0x556fb2cd9a70 2024-02-15T22:56:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.571+0000 7fdd5f084640 1 --2- 172.21.15.133:0/2144929465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2cdbe60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000a470 tx=0x7fdd5001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34033743ae363ca9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.571+0000 7fdd5e883640 1 -- 172.21.15.133:0/2144929465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd50052570 con 0x556fb2cd9a70 2024-02-15T22:56:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.571+0000 7fdd5e883640 1 -- 172.21.15.133:0/2144929465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd500526d0 con 0x556fb2cd9a70 2024-02-15T22:56:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.571+0000 7fdd5e883640 1 -- 172.21.15.133:0/2144929465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd50052990 con 0x556fb2cd9a70 2024-02-15T22:56:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.571+0000 7fdd63a14800 1 -- 172.21.15.133:0/2144929465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 msgr2=0x556fb2cdbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.571+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2144929465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2cdbe60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000a470 tx=0x7fdd5001cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.571+0000 7fdd63a14800 1 -- 172.21.15.133:0/2144929465 shutdown_connections 2024-02-15T22:56:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.571+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2144929465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2cdbe60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.571+0000 7fdd63a14800 1 -- 172.21.15.133:0/2144929465 >> 172.21.15.133:0/2144929465 conn(0x556fb2cd34c0 msgr2=0x556fb2cd58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.571+0000 7fdd63a14800 1 -- 172.21.15.133:0/2144929465 shutdown_connections 2024-02-15T22:56:23.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.571+0000 7fdd63a14800 1 -- 172.21.15.133:0/2144929465 wait complete. 2024-02-15T22:56:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.583+0000 7fdd63a14800 1 Processor -- start 2024-02-15T22:56:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.583+0000 7fdd63a14800 1 -- start start 2024-02-15T22:56:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.583+0000 7fdd63a14800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dc8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.583+0000 7fdd63a14800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb2bd8980 con 0x556fb2cd9a70 2024-02-15T22:56:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.583+0000 7fdd5f084640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dc8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.583+0000 7fdd5f084640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dc8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56898/0 (socket says 172.21.15.133:56898) 2024-02-15T22:56:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.583+0000 7fdd5f084640 1 -- 172.21.15.133:0/677335003 learned_addr learned my addr 172.21.15.133:0/677335003 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.584+0000 7fdd5f084640 1 -- 172.21.15.133:0/677335003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd50005d20 con 0x556fb2cd9a70 2024-02-15T22:56:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.584+0000 7fdd5f084640 1 --2- 172.21.15.133:0/677335003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dc8fb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdd50055040 tx=0x7fdd5004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb7f964e5cf2422 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.584+0000 7fdc4d60a640 1 -- 172.21.15.133:0/677335003 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd5000a180 con 0x556fb2cd9a70 2024-02-15T22:56:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.584+0000 7fdc4d60a640 1 -- 172.21.15.133:0/677335003 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5000a2e0 con 0x556fb2cd9a70 2024-02-15T22:56:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.584+0000 7fdc4d60a640 1 -- 172.21.15.133:0/677335003 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd500529b0 con 0x556fb2cd9a70 2024-02-15T22:56:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd63a14800 1 -- 172.21.15.133:0/677335003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 msgr2=0x556fb2dc8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd63a14800 1 --2- 172.21.15.133:0/677335003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dc8fb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdd50055040 tx=0x7fdd5004c000 comp rx=0 tx=0).stop 2024-02-15T22:56:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd63a14800 1 -- 172.21.15.133:0/677335003 shutdown_connections 2024-02-15T22:56:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd63a14800 1 --2- 172.21.15.133:0/677335003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dc8fb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd63a14800 1 -- 172.21.15.133:0/677335003 >> 172.21.15.133:0/677335003 conn(0x556fb2cd34c0 msgr2=0x556fb2dc4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd63a14800 1 -- 172.21.15.133:0/677335003 shutdown_connections 2024-02-15T22:56:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd63a14800 1 -- 172.21.15.133:0/677335003 wait complete. 2024-02-15T22:56:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd63a14800 1 Processor -- start 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd63a14800 1 -- start start 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd63a14800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dd0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd63a14800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb2bd4160 con 0x556fb2cd9a70 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.585+0000 7fdd5f084640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dd0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.586+0000 7fdd5f084640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dd0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56908/0 (socket says 172.21.15.133:56908) 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.586+0000 7fdd5f084640 1 -- 172.21.15.133:0/1903854946 learned_addr learned my addr 172.21.15.133:0/1903854946 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.586+0000 7fdd5f084640 1 -- 172.21.15.133:0/1903854946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb2ce0ec0 con 0x556fb2cd9a70 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.586+0000 7fdd5f084640 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dd0420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000a470 tx=0x7fdd50002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.586+0000 7fdc4be07640 1 -- 172.21.15.133:0/1903854946 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd5006a070 con 0x556fb2cd9a70 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.586+0000 7fdc4be07640 1 -- 172.21.15.133:0/1903854946 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5005d420 con 0x556fb2cd9a70 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.586+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fb2dd0960 con 0x556fb2cd9a70 2024-02-15T22:56:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.586+0000 7fdc4be07640 1 -- 172.21.15.133:0/1903854946 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd5005d5d0 con 0x556fb2cd9a70 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.586+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fb2dd0e40 con 0x556fb2cd9a70 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.587+0000 7fdc4be07640 1 -- 172.21.15.133:0/1903854946 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdd5005d730 con 0x556fb2cd9a70 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.587+0000 7fdc4be07640 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc440367e0 0x7fdc44038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.587+0000 7fdc4be07640 1 -- 172.21.15.133:0/1903854946 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fdd5008d9a0 con 0x556fb2cd9a70 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.587+0000 7fdd57fff640 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc440367e0 0x7fdc44038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.587+0000 7fdd63a14800 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556fb2cdc3a0 0x556fb2dd70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.587+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2dd76d0 con 0x556fb2cdc3a0 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.587+0000 7fdd5f885640 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556fb2cdc3a0 0x556fb2dd70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.587+0000 7fdd57fff640 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc440367e0 0x7fdc44038ca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdd48000c00 tx=0x7fdd480013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.588+0000 7fdd5f885640 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556fb2cdc3a0 0x556fb2dd70b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.588+0000 7fdd5f885640 1 -- 172.21.15.133:0/1903854946 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdd5800a4a0 con 0x556fb2cdc3a0 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.588+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2dd47a0 con 0x556fb2cdc3a0 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.588+0000 7fdd5f885640 1 -- 172.21.15.133:0/1903854946 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdd5800a4a0 con 0x556fb2cdc3a0 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.588+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2dd7b90 con 0x556fb2cdc3a0 2024-02-15T22:56:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.588+0000 7fdd5f885640 1 -- 172.21.15.133:0/1903854946 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fdd5800a4a0 con 0x556fb2cdc3a0 2024-02-15T22:56:23.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.588+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2dd8860 con 0x556fb2cdc3a0 2024-02-15T22:56:23.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.589+0000 7fdd5f885640 1 -- 172.21.15.133:0/1903854946 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdd5800a4a0 con 0x556fb2cdc3a0 2024-02-15T22:56:23.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.589+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2dd8c70 con 0x556fb2cdc3a0 2024-02-15T22:56:23.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.589+0000 7fdd5f885640 1 -- 172.21.15.133:0/1903854946 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fdd5800a4a0 con 0x556fb2cdc3a0 2024-02-15T22:56:23.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.589+0000 7fdd63a14800 1 Processor -- start 2024-02-15T22:56:23.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.589+0000 7fdd63a14800 1 -- start start 2024-02-15T22:56:23.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.589+0000 7fdd63a14800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2de7e30 0x556fb2de8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.589+0000 7fdd63a14800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb2b76e80 con 0x556fb2de7e30 2024-02-15T22:56:23.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.590+0000 7fdd57fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2de7e30 0x556fb2de8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.590+0000 7fdd57fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2de7e30 0x556fb2de8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56920/0 (socket says 172.21.15.133:56920) 2024-02-15T22:56:23.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.590+0000 7fdd57fff640 1 -- 172.21.15.133:0/611053492 learned_addr learned my addr 172.21.15.133:0/611053492 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.590+0000 7fdd57fff640 1 -- 172.21.15.133:0/611053492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb2de8790 con 0x556fb2de7e30 2024-02-15T22:56:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.590+0000 7fdd57fff640 1 --2- 172.21.15.133:0/611053492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2de7e30 0x556fb2de8250 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800e610 tx=0x7fdd4800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.590+0000 7fdc49602640 1 -- 172.21.15.133:0/611053492 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd4800bea0 con 0x556fb2de7e30 2024-02-15T22:56:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.590+0000 7fdc49602640 1 -- 172.21.15.133:0/611053492 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800d500 con 0x556fb2de7e30 2024-02-15T22:56:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.590+0000 7fdc49602640 1 -- 172.21.15.133:0/611053492 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd4800d7a0 con 0x556fb2de7e30 2024-02-15T22:56:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.590+0000 7fdd63a14800 1 -- 172.21.15.133:0/611053492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fb2de9200 con 0x556fb2de7e30 2024-02-15T22:56:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.590+0000 7fdd63a14800 1 -- 172.21.15.133:0/611053492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fb2de96c0 con 0x556fb2de7e30 2024-02-15T22:56:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.591+0000 7fdc49602640 1 -- 172.21.15.133:0/611053492 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdd4801a070 con 0x556fb2de7e30 2024-02-15T22:56:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.591+0000 7fdc49602640 1 --2- 172.21.15.133:0/611053492 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc380367e0 0x7fdc38038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.591+0000 7fdc49602640 1 -- 172.21.15.133:0/611053492 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fdd48017050 con 0x556fb2de7e30 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.591+0000 7fdd5f885640 1 --2- 172.21.15.133:0/611053492 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc380367e0 0x7fdc38038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.591+0000 7fdd63a14800 1 Processor -- start 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdd63a14800 1 -- start start 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdd5f885640 1 --2- 172.21.15.133:0/611053492 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc380367e0 0x7fdc38038ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x556fb2dd82a0 tx=0x7fdd58005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdd63a14800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 0x556fb2df5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdd63a14800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb2b4c5d0 con 0x556fb2df5050 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdd57fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 0x556fb2df5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdd57fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 0x556fb2df5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56926/0 (socket says 172.21.15.133:56926) 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdd57fff640 1 -- 172.21.15.133:0/2974603571 learned_addr learned my addr 172.21.15.133:0/2974603571 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdd57fff640 1 -- 172.21.15.133:0/2974603571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb2df5a40 con 0x556fb2df5050 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdd57fff640 1 --2- 172.21.15.133:0/2974603571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 0x556fb2df5470 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd4804b9d0 tx=0x7fdd4804bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3a524af6f9f153 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdc42ffd640 1 -- 172.21.15.133:0/2974603571 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd4801a530 con 0x556fb2df5050 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdc42ffd640 1 -- 172.21.15.133:0/2974603571 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4804d0d0 con 0x556fb2df5050 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.592+0000 7fdc42ffd640 1 -- 172.21.15.133:0/2974603571 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd4801ac40 con 0x556fb2df5050 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd63a14800 1 -- 172.21.15.133:0/2974603571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 msgr2=0x556fb2df5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2974603571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 0x556fb2df5470 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd4804b9d0 tx=0x7fdd4804bc50 comp rx=0 tx=0).stop 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd63a14800 1 -- 172.21.15.133:0/2974603571 shutdown_connections 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2974603571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 0x556fb2df5470 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd63a14800 1 -- 172.21.15.133:0/2974603571 >> 172.21.15.133:0/2974603571 conn(0x556fb2df13b0 msgr2=0x556fb2def410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd63a14800 1 -- 172.21.15.133:0/2974603571 shutdown_connections 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd63a14800 1 -- 172.21.15.133:0/2974603571 wait complete. 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd63a14800 1 Processor -- start 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd63a14800 1 -- start start 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd63a14800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 0x556fb2dfc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd63a14800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb2dfc5c0 con 0x556fb2df5050 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd57fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 0x556fb2dfc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd57fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 0x556fb2dfc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56938/0 (socket says 172.21.15.133:56938) 2024-02-15T22:56:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.593+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 learned_addr learned my addr 172.21.15.133:0/2864467384 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.594+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb2de96c0 con 0x556fb2df5050 2024-02-15T22:56:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.594+0000 7fdd57fff640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 0x556fb2dfc080 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd48048040 tx=0x7fdd4804b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.594+0000 7fdc417fa640 1 -- 172.21.15.133:0/2864467384 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd48024680 con 0x556fb2df5050 2024-02-15T22:56:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.594+0000 7fdc417fa640 1 -- 172.21.15.133:0/2864467384 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4801a6b0 con 0x556fb2df5050 2024-02-15T22:56:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.594+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fb2dfc7c0 con 0x556fb2df5050 2024-02-15T22:56:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.594+0000 7fdc417fa640 1 -- 172.21.15.133:0/2864467384 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd4801a990 con 0x556fb2df5050 2024-02-15T22:56:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.594+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fb2dfcc80 con 0x556fb2df5050 2024-02-15T22:56:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.595+0000 7fdc417fa640 1 -- 172.21.15.133:0/2864467384 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdd4800d040 con 0x556fb2df5050 2024-02-15T22:56:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.595+0000 7fdc417fa640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc28036790 0x7fdc28038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.595+0000 7fdc417fa640 1 -- 172.21.15.133:0/2864467384 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fdd4800a040 con 0x556fb2df5050 2024-02-15T22:56:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.595+0000 7fdd5f885640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc28036790 0x7fdc28038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.595+0000 7fdd63a14800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.595+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556fb2e07de0 0x556fb2e0a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.595+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e0a9f0 con 0x556fb2e07de0 2024-02-15T22:56:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.595+0000 7fdd5f084640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556fb2e07de0 0x556fb2e0a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.595+0000 7fdd5f885640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc28036790 0x7fdc28038c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800b010 tx=0x7fdd58020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd5f084640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556fb2e07de0 0x556fb2e0a2a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdd50059040 con 0x556fb2e07de0 2024-02-15T22:56:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 20 realm 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e0adc0 con 0x556fb2e07de0 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdd50059040 con 0x556fb2e07de0 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e0b640 con 0x556fb2e07de0 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdd50059040 con 0x556fb2e07de0 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e0b9a0 con 0x556fb2e07de0 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdd50059040 con 0x556fb2e07de0 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.596+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e0b2a0 con 0x556fb2e07de0 2024-02-15T22:56:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.597+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fdd5007e040 con 0x556fb2e07de0 2024-02-15T22:56:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.597+0000 7fdd63a14800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.597+0000 7fdd63a14800 20 searching for the correct realm 2024-02-15T22:56:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.597+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556fb2e0dd20 0x556fb2e10110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.597+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e0dd20 2024-02-15T22:56:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.597+0000 7fdd57fff640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556fb2e0dd20 0x556fb2e10110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.597+0000 7fdd57fff640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556fb2e0dd20 0x556fb2e10110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.598+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.598+0000 7fdd57fff640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdd48027060 0x7fdd4801b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.598+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd48027060 2024-02-15T22:56:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.598+0000 7fdd5f885640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdd48027060 0x7fdd4801b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.598+0000 7fdd5f885640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdd48027060 0x7fdd4801b6f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.598+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5800a4a0 con 0x7fdd48027060 2024-02-15T22:56:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.598+0000 7fdd5f885640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdd580141d0 0x7fdd58015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.598+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd580141d0 2024-02-15T22:56:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.598+0000 7fdd5f084640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdd580141d0 0x7fdd58015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.599+0000 7fdd5f084640 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdd580141d0 0x7fdd58015940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.599+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x7fdd580141d0 2024-02-15T22:56:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.599+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e07de0 2024-02-15T22:56:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.599+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x556fb2e07de0 2024-02-15T22:56:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.599+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e07de0 2024-02-15T22:56:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.599+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x556fb2e07de0 2024-02-15T22:56:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.599+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd580141d0 2024-02-15T22:56:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.600+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x7fdd580141d0 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.600+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd580141d0 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.600+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x7fdd580141d0 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.600+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd48027060 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.600+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5800a4a0 con 0x7fdd48027060 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.600+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e0dd20 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.600+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.601+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e07de0 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.601+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x556fb2e07de0 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.601+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd580141d0 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.601+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x7fdd580141d0 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.601+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e07de0 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.601+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x556fb2e07de0 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.601+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd48027060 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.601+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.601+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e0dd20 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.602+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.602+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e0dd20 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.602+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.602+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd580141d0 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.602+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x7fdd580141d0 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.602+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e0dd20 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.602+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.602+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e0dd20 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.603+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.603+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e07de0 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.603+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x556fb2e07de0 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.603+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e07de0 2024-02-15T22:56:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.603+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fdd5007e040 con 0x556fb2e07de0 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.603+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd580141d0 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.603+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x7fdd580141d0 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.603+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e0dd20 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.604+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.604+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd48027060 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.604+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.604+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e07de0 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.604+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdd5007e040 con 0x556fb2e07de0 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.604+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd580141d0 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.605+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5007e040 con 0x7fdd580141d0 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.605+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e0dd20 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.605+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.605+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd580141d0 2024-02-15T22:56:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.605+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.605+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd48027060 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.605+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.605+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e0dd20 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd580141d0 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x556fb2e07de0 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e107c0 con 0x7fdd48027060 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd63a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd63a14800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd63a14800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd63a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd63a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd63a14800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd63a14800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.606+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e0c7c0 con 0x556fb2e07de0 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e0c440 con 0x556fb2e07de0 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e0d150 con 0x556fb2e07de0 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 20 zone default found 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 4 Realm: () 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 20 zonegroup default 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.607+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e10c30 con 0x7fdd580141d0 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd63a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd63a14800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e12ab0 con 0x556fb2e0dd20 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd63a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd63a14800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e12e10 con 0x556fb2e0dd20 2024-02-15T22:56:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd63a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd63a14800 20 started sync module instance, tier type = 2024-02-15T22:56:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd63a14800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.608+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e12080 con 0x7fdd48027060 2024-02-15T22:56:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.609+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.609+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93938230830128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e11cf0 con 0x7fdd48027060 2024-02-15T22:56:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.609+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e13c20 con 0x556fb2e07de0 2024-02-15T22:56:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.610+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93938230830128] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.610+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.610+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93938230833520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e13c20 con 0x556fb2e07de0 2024-02-15T22:56:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.610+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e14640 con 0x556fb2e0dd20 2024-02-15T22:56:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.612+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.612+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93938230837568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e14ec0 con 0x556fb2e0dd20 2024-02-15T22:56:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.612+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e15950 con 0x7fdd48027060 2024-02-15T22:56:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.612+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93938230833520] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.615+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93938230837568] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.615+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.615+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93938230839840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e13780 con 0x7fdd48027060 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.615+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e16310 con 0x556fb2e07de0 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.618+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.618+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93938230845040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e16730 con 0x556fb2e07de0 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.618+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e17200 con 0x7fdd580141d0 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.619+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.619+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93938230848736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e171c0 con 0x7fdd580141d0 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.619+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e18120 con 0x7fdd580141d0 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.620+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.620+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93938230852672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e185c0 con 0x7fdd580141d0 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.620+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e19060 con 0x7fdd580141d0 2024-02-15T22:56:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.621+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93938230848736] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.621+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93938230839840] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.622+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93938230852672] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.624+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93938230845040] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.624+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.624+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93938230856512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e17540 con 0x7fdd580141d0 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.624+0000 7fdd63a14800 20 add_watcher() i=0 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.624+0000 7fdd63a14800 20 add_watcher() i=1 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.624+0000 7fdd63a14800 20 add_watcher() i=2 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.624+0000 7fdd63a14800 20 add_watcher() i=3 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.624+0000 7fdd63a14800 20 add_watcher() i=4 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.624+0000 7fdd63a14800 20 add_watcher() i=5 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.624+0000 7fdd63a14800 20 add_watcher() i=6 2024-02-15T22:56:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.625+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93938230856512] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.625+0000 7fdd63a14800 20 add_watcher() i=7 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.625+0000 7fdd63a14800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.625+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e18120 con 0x556fb2e07de0 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.625+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.625+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93938230842480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e18120 con 0x556fb2e07de0 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.627+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93938230842480] v30'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.627+0000 7fdc167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.627+0000 7fdd63a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.627+0000 7fdd63a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.627+0000 7fdd63a14800 5 note: GC not initialized 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.627+0000 7fdc157e2640 20 reqs_thread_entry: start 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.627+0000 7fdd63a14800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.627+0000 7fdd63a14800 20 Filter name: none 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.627+0000 7fdc0effd640 20 reqs_thread_entry: start 2024-02-15T22:56:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.627+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4da90 con 0x556fb2e07de0 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.628+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.628+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4da90 con 0x7fdd48027060 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.628+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.628+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4da90 con 0x556fb2e07de0 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.628+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.628+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4da90 con 0x556fb2e0dd20 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.628+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.628+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4de40 con 0x556fb2e0dd20 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.628+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.629+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e1f0 con 0x556fb2e0dd20 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.629+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.629+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e5a0 con 0x556fb2e07de0 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.629+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.629+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e5a0 con 0x556fb2e07de0 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.629+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.629+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e5a0 con 0x556fb2e0dd20 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.629+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.629+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e5a0 con 0x556fb2e0dd20 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.630+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.630+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd580141d0 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.630+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.630+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e07de0 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.630+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.630+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd48027060 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.630+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.630+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e0dd20 2024-02-15T22:56:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.631+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.631+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd580141d0 2024-02-15T22:56:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.631+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.631+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd580141d0 2024-02-15T22:56:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.631+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.631+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e0dd20 2024-02-15T22:56:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.631+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.631+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd580141d0 2024-02-15T22:56:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.632+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.632+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e07de0 2024-02-15T22:56:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.632+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.632+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e0dd20 2024-02-15T22:56:23.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.632+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.632+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd580141d0 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.632+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.632+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd48027060 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.633+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.633+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd580141d0 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.633+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.633+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e07de0 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.633+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.633+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e07de0 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.633+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.633+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e0dd20 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.633+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.633+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e07de0 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.634+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.634+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e07de0 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.634+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.634+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e0dd20 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.634+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.634+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e0dd20 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.634+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.634+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e0dd20 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.634+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.634+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd580141d0 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.635+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.636+0000 7fdc167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.636+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93938230842480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e07de0 2024-02-15T22:56:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.637+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93938230842480] v30'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.637+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93938230830128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd48027060 2024-02-15T22:56:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.639+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93938230830128] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.639+0000 7fdd63a14800 20 remove_watcher() i=0 2024-02-15T22:56:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.639+0000 7fdd63a14800 2 removed watcher, disabling cache 2024-02-15T22:56:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.639+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93938230833520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e07de0 2024-02-15T22:56:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.640+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93938230833520] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.640+0000 7fdd63a14800 20 remove_watcher() i=1 2024-02-15T22:56:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.640+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93938230837568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e0dd20 2024-02-15T22:56:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.642+0000 7fdd57fff640 1 -- 172.21.15.133:0/2864467384 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93938230837568] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd4804bdb0 con 0x556fb2e0dd20 2024-02-15T22:56:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.642+0000 7fdd63a14800 20 remove_watcher() i=2 2024-02-15T22:56:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.642+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93938230839840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd48027060 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.643+0000 7fdd5f885640 1 -- 172.21.15.133:0/2864467384 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93938230839840] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5803a040 con 0x7fdd48027060 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.643+0000 7fdd63a14800 20 remove_watcher() i=3 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.643+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93938230845040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x556fb2e07de0 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.646+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93938230845040] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x556fb2e07de0 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.646+0000 7fdd63a14800 20 remove_watcher() i=4 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.646+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93938230848736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd580141d0 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.647+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93938230848736] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.647+0000 7fdd63a14800 20 remove_watcher() i=5 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.647+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93938230852672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd580141d0 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.650+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93938230852672] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.650+0000 7fdd63a14800 20 remove_watcher() i=6 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.650+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93938230856512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556fb2e4e550 con 0x7fdd580141d0 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93938230856512] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd5009d040 con 0x7fdd580141d0 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 20 remove_watcher() i=7 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdd580141d0 msgr2=0x7fdd58015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdd580141d0 0x7fdd58015940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556fb2e07de0 msgr2=0x556fb2e0a2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556fb2e07de0 0x556fb2e0a2a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdd48027060 msgr2=0x7fdd4801b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdd48027060 0x7fdd4801b6f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556fb2e0dd20 msgr2=0x556fb2e10110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556fb2e0dd20 0x556fb2e10110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc28036790 msgr2=0x7fdc28038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc28036790 0x7fdc28038c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800b010 tx=0x7fdd58020000 comp rx=0 tx=0).stop 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 msgr2=0x556fb2dfc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 --2- 172.21.15.133:0/2864467384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2df5050 0x556fb2dfc080 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd48048040 tx=0x7fdd4804b930 comp rx=0 tx=0).stop 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 reap_dead start 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd5f084640 1 -- 172.21.15.133:0/2864467384 reap_dead start 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 shutdown_connections 2024-02-15T22:56:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 >> 172.21.15.133:0/2864467384 conn(0x556fb2df13b0 msgr2=0x556fb2deea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 shutdown_connections 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/2864467384 wait complete. 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/611053492 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc380367e0 msgr2=0x7fdc38038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 --2- 172.21.15.133:0/611053492 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc380367e0 0x7fdc38038ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x556fb2dd82a0 tx=0x7fdd58005840 comp rx=0 tx=0).stop 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/611053492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2de7e30 msgr2=0x556fb2de8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 --2- 172.21.15.133:0/611053492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2de7e30 0x556fb2de8250 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800e610 tx=0x7fdd4800ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 -- 172.21.15.133:0/611053492 shutdown_connections 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 --2- 172.21.15.133:0/611053492 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc380367e0 0x7fdc38038ca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.651+0000 7fdd63a14800 1 --2- 172.21.15.133:0/611053492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2de7e30 0x556fb2de8250 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 -- 172.21.15.133:0/611053492 >> 172.21.15.133:0/611053492 conn(0x556fb2ddbed0 msgr2=0x556fb2ddc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 -- 172.21.15.133:0/611053492 shutdown_connections 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 -- 172.21.15.133:0/611053492 wait complete. 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556fb2cdc3a0 msgr2=0x556fb2dd70b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556fb2cdc3a0 0x556fb2dd70b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc440367e0 msgr2=0x7fdc44038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc440367e0 0x7fdc44038ca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdd48000c00 tx=0x7fdd480013b0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 msgr2=0x556fb2dd0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dd0420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000a470 tx=0x7fdd50002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 shutdown_connections 2024-02-15T22:56:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556fb2cdc3a0 0x556fb2dd70b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdc440367e0 0x7fdc44038ca0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 --2- 172.21.15.133:0/1903854946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556fb2cd9a70 0x556fb2dd0420 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 >> 172.21.15.133:0/1903854946 conn(0x556fb2cd34c0 msgr2=0x556fb2dca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 shutdown_connections 2024-02-15T22:56:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.652+0000 7fdd63a14800 1 -- 172.21.15.133:0/1903854946 wait complete. 2024-02-15T22:56:23.663 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[],"summary":[]} 2024-02-15T22:56:23.663 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-15T22:56:23.664 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T22:56:23.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T22:56:23.664 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T22:56:23.745 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:23.746 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:23.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.744+0000 7fd6f6d2f800 1 Processor -- start 2024-02-15T22:56:23.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.744+0000 7fd6f6d2f800 1 -- start start 2024-02-15T22:56:23.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.744+0000 7fd6f6d2f800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55f9345913d0 0x55f934599ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.744+0000 7fd6f6d2f800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f9344dbbb0 con 0x55f93458f890 2024-02-15T22:56:23.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.744+0000 7fd6f6d2f800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f934493450 con 0x55f9345913d0 2024-02-15T22:56:23.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.744+0000 7fd6f21b2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55f9345913d0 0x55f934599ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.744+0000 7fd6f21b2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55f9345913d0 0x55f934599ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56946/0 (socket says 172.21.15.133:56946) 2024-02-15T22:56:23.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.744+0000 7fd6f29b3640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55f93458f890 0x55f93458fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44794/0 (socket says 172.21.15.133:44794) 2024-02-15T22:56:23.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.744+0000 7fd6f21b2640 1 -- 172.21.15.133:0/3154861042 learned_addr learned my addr 172.21.15.133:0/3154861042 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.745+0000 7fd6f21b2640 1 -- 172.21.15.133:0/3154861042 >> v1:172.21.15.52:6789/0 conn(0x55f93458f890 legacy=0x55f93458fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.745+0000 7fd6f21b2640 1 -- 172.21.15.133:0/3154861042 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f934504180 con 0x55f9345913d0 2024-02-15T22:56:23.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.745+0000 7fd6f19b1640 1 -- 172.21.15.133:0/3154861042 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835374219 0 0) 0x55f9344dbbb0 con 0x55f93458f890 2024-02-15T22:56:23.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.746+0000 7fd6f21b2640 1 --2- 172.21.15.133:0/3154861042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9345913d0 0x55f934599ed0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800a520 tx=0x7fd6e801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91dc2433d0683ae server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.747+0000 7fd6f19b1640 1 -- 172.21.15.133:0/3154861042 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e8052570 con 0x55f9345913d0 2024-02-15T22:56:23.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.747+0000 7fd6f19b1640 1 -- 172.21.15.133:0/3154861042 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e80526d0 con 0x55f9345913d0 2024-02-15T22:56:23.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.747+0000 7fd6f19b1640 1 -- 172.21.15.133:0/3154861042 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e8052990 con 0x55f9345913d0 2024-02-15T22:56:23.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.747+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/3154861042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9345913d0 msgr2=0x55f934599ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.747+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/3154861042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9345913d0 0x55f934599ed0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800a520 tx=0x7fd6e801cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.747+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/3154861042 shutdown_connections 2024-02-15T22:56:23.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.747+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/3154861042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9345913d0 0x55f934599ed0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.747+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/3154861042 >> 172.21.15.133:0/3154861042 conn(0x55f93458b4d0 msgr2=0x55f93458d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.747+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/3154861042 shutdown_connections 2024-02-15T22:56:23.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.747+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/3154861042 wait complete. 2024-02-15T22:56:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.759+0000 7fd6f6d2f800 1 Processor -- start 2024-02-15T22:56:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.759+0000 7fd6f6d2f800 1 -- start start 2024-02-15T22:56:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.759+0000 7fd6f6d2f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f934683150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.759+0000 7fd6f6d2f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f934490980 con 0x55f93458f890 2024-02-15T22:56:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.759+0000 7fd6f29b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f934683150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.759+0000 7fd6f29b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f934683150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56958/0 (socket says 172.21.15.133:56958) 2024-02-15T22:56:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.759+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1737979382 learned_addr learned my addr 172.21.15.133:0/1737979382 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.759+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1737979382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e8005de0 con 0x55f93458f890 2024-02-15T22:56:23.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.760+0000 7fd6f29b3640 1 --2- 172.21.15.133:0/1737979382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f934683150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b210 tx=0x7fd6e400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649bf0ba61447335 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.760+0000 7fd5e0e09640 1 -- 172.21.15.133:0/1737979382 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e4014070 con 0x55f93458f890 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.760+0000 7fd5e0e09640 1 -- 172.21.15.133:0/1737979382 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e400d500 con 0x55f93458f890 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.760+0000 7fd5e0e09640 1 -- 172.21.15.133:0/1737979382 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e400d800 con 0x55f93458f890 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.760+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1737979382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 msgr2=0x55f934683150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.760+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/1737979382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f934683150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b210 tx=0x7fd6e400b6d0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.760+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1737979382 shutdown_connections 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.760+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/1737979382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f934683150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.760+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1737979382 >> 172.21.15.133:0/1737979382 conn(0x55f93458b4d0 msgr2=0x55f93467ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.760+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1737979382 shutdown_connections 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.760+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1737979382 wait complete. 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.761+0000 7fd6f6d2f800 1 Processor -- start 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.761+0000 7fd6f6d2f800 1 -- start start 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.761+0000 7fd6f6d2f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f93468a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.761+0000 7fd6f6d2f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f93448c160 con 0x55f93458f890 2024-02-15T22:56:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.761+0000 7fd6f29b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f93468a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.761+0000 7fd6f29b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f93468a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56966/0 (socket says 172.21.15.133:56966) 2024-02-15T22:56:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.761+0000 7fd6f29b3640 1 -- 172.21.15.133:0/2847477893 learned_addr learned my addr 172.21.15.133:0/2847477893 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.762+0000 7fd6f29b3640 1 -- 172.21.15.133:0/2847477893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e4001b70 con 0x55f93458f890 2024-02-15T22:56:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.762+0000 7fd6f29b3640 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f93468a810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b210 tx=0x7fd6e4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.762+0000 7fd5df606640 1 -- 172.21.15.133:0/2847477893 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e400f950 con 0x55f93458f890 2024-02-15T22:56:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.762+0000 7fd5df606640 1 -- 172.21.15.133:0/2847477893 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e4020070 con 0x55f93458f890 2024-02-15T22:56:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.762+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f93468ad50 con 0x55f93458f890 2024-02-15T22:56:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.762+0000 7fd5df606640 1 -- 172.21.15.133:0/2847477893 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e400fc20 con 0x55f93458f890 2024-02-15T22:56:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.762+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f93468b230 con 0x55f93458f890 2024-02-15T22:56:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.763+0000 7fd5df606640 1 -- 172.21.15.133:0/2847477893 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd6e400d040 con 0x55f93458f890 2024-02-15T22:56:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.763+0000 7fd5df606640 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5d80367e0 0x7fd5d8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.763+0000 7fd5df606640 1 -- 172.21.15.133:0/2847477893 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fd6e400a040 con 0x55f93458f890 2024-02-15T22:56:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.763+0000 7fd6f21b2640 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5d80367e0 0x7fd5d8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.763+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55f9345913d0 0x55f9346914f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.763+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f934691ac0 con 0x55f9345913d0 2024-02-15T22:56:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.763+0000 7fd6f31b4640 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55f9345913d0 0x55f9346914f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.763+0000 7fd6f21b2640 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5d80367e0 0x7fd5d8038ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8054000 tx=0x7fd6e804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.763+0000 7fd6f31b4640 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55f9345913d0 0x55f9346914f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.764+0000 7fd6f31b4640 1 -- 172.21.15.133:0/2847477893 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd6ec00a4a0 con 0x55f9345913d0 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.764+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f93468ec20 con 0x55f9345913d0 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.764+0000 7fd6f31b4640 1 -- 172.21.15.133:0/2847477893 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd6ec00a4a0 con 0x55f9345913d0 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.764+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f934693820 con 0x55f9345913d0 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.764+0000 7fd6f31b4640 1 -- 172.21.15.133:0/2847477893 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd6ec00a4a0 con 0x55f9345913d0 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.764+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f934692b30 con 0x55f9345913d0 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.765+0000 7fd6f31b4640 1 -- 172.21.15.133:0/2847477893 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd6ec00a4a0 con 0x55f9345913d0 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.765+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f934692f40 con 0x55f9345913d0 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.765+0000 7fd6f31b4640 1 -- 172.21.15.133:0/2847477893 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd6ec00a4a0 con 0x55f9345913d0 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.765+0000 7fd6f6d2f800 1 Processor -- start 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.765+0000 7fd6f6d2f800 1 -- start start 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.765+0000 7fd6f6d2f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346a2290 0x55f9346a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.765+0000 7fd6f6d2f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f93442ee80 con 0x55f9346a2290 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.766+0000 7fd6f21b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346a2290 0x55f9346a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.766+0000 7fd6f21b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346a2290 0x55f9346a26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56968/0 (socket says 172.21.15.133:56968) 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.766+0000 7fd6f21b2640 1 -- 172.21.15.133:0/584735542 learned_addr learned my addr 172.21.15.133:0/584735542 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.766+0000 7fd6f21b2640 1 -- 172.21.15.133:0/584735542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9346a2bf0 con 0x55f9346a2290 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.766+0000 7fd6f21b2640 1 --2- 172.21.15.133:0/584735542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346a2290 0x55f9346a26b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8044830 tx=0x7fd6e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.766+0000 7fd5dce01640 1 -- 172.21.15.133:0/584735542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e805db80 con 0x55f9346a2290 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.766+0000 7fd5dce01640 1 -- 172.21.15.133:0/584735542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e805dd00 con 0x55f9346a2290 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.766+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/584735542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f9346a2de0 con 0x55f9346a2290 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.766+0000 7fd5dce01640 1 -- 172.21.15.133:0/584735542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e8069400 con 0x55f9346a2290 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.766+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/584735542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9346a3930 con 0x55f9346a2290 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.767+0000 7fd5dce01640 1 -- 172.21.15.133:0/584735542 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd6e8059040 con 0x55f9346a2290 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.767+0000 7fd5dce01640 1 --2- 172.21.15.133:0/584735542 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5cc0367e0 0x7fd5cc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.767+0000 7fd5dce01640 1 -- 172.21.15.133:0/584735542 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fd6e808f3d0 con 0x55f9346a2290 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.767+0000 7fd6f31b4640 1 --2- 172.21.15.133:0/584735542 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5cc0367e0 0x7fd5cc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.767+0000 7fd6f6d2f800 1 Processor -- start 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.767+0000 7fd6f31b4640 1 --2- 172.21.15.133:0/584735542 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5cc0367e0 0x7fd5cc038ca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55f934692570 tx=0x7fd6ec005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.767+0000 7fd6f6d2f800 1 -- start start 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.768+0000 7fd6f6d2f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 0x55f9346af870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.768+0000 7fd6f6d2f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9344045d0 con 0x55f9346af450 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.768+0000 7fd6f21b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 0x55f9346af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.768+0000 7fd6f21b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 0x55f9346af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56978/0 (socket says 172.21.15.133:56978) 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.768+0000 7fd6f21b2640 1 -- 172.21.15.133:0/563742316 learned_addr learned my addr 172.21.15.133:0/563742316 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.768+0000 7fd6f21b2640 1 -- 172.21.15.133:0/563742316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9346afe40 con 0x55f9346af450 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.768+0000 7fd6f21b2640 1 --2- 172.21.15.133:0/563742316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 0x55f9346af870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd6e805cfd0 tx=0x7fd6e8068e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f98919574cc5bc server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.768+0000 7fd5d67fc640 1 -- 172.21.15.133:0/563742316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e80723c0 con 0x55f9346af450 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd5d67fc640 1 -- 172.21.15.133:0/563742316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8050340 con 0x55f9346af450 2024-02-15T22:56:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd5d67fc640 1 -- 172.21.15.133:0/563742316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e808f070 con 0x55f9346af450 2024-02-15T22:56:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/563742316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 msgr2=0x55f9346af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/563742316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 0x55f9346af870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd6e805cfd0 tx=0x7fd6e8068e80 comp rx=0 tx=0).stop 2024-02-15T22:56:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/563742316 shutdown_connections 2024-02-15T22:56:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/563742316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 0x55f9346af870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/563742316 >> 172.21.15.133:0/563742316 conn(0x55f9346ab7b0 msgr2=0x55f9346a9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/563742316 shutdown_connections 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/563742316 wait complete. 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd6f6d2f800 1 Processor -- start 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd6f6d2f800 1 -- start start 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd6f6d2f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 0x55f9346b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.769+0000 7fd6f6d2f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9346b6990 con 0x55f9346af450 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.770+0000 7fd6f21b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 0x55f9346b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.770+0000 7fd6f21b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 0x55f9346b6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:56990/0 (socket says 172.21.15.133:56990) 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.770+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 learned_addr learned my addr 172.21.15.133:0/1728603212 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.770+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9346a3930 con 0x55f9346af450 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.770+0000 7fd6f21b2640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 0x55f9346b6450 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80066e0 tx=0x7fd6e808d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.770+0000 7fd5d4ff9640 1 -- 172.21.15.133:0/1728603212 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e8006500 con 0x55f9346af450 2024-02-15T22:56:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.770+0000 7fd5d4ff9640 1 -- 172.21.15.133:0/1728603212 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8068730 con 0x55f9346af450 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.770+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f9346b6b90 con 0x55f9346af450 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.770+0000 7fd5d4ff9640 1 -- 172.21.15.133:0/1728603212 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6e808c130 con 0x55f9346af450 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.770+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9346b6b90 con 0x55f9346af450 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.771+0000 7fd5d4ff9640 1 -- 172.21.15.133:0/1728603212 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd6e808c290 con 0x55f9346af450 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.771+0000 7fd5d4ff9640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5bc0367e0 0x7fd5bc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.771+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.771+0000 7fd5d4ff9640 1 -- 172.21.15.133:0/1728603212 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fd6e8099b10 con 0x55f9346af450 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.771+0000 7fd6f31b4640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5bc0367e0 0x7fd5bc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.771+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55f9346c1e70 0x55f9346c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.771+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346c49f0 con 0x55f9346c1e70 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.771+0000 7fd6f29b3640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55f9346c1e70 0x55f9346c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f31b4640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5bc0367e0 0x7fd5bc038ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00b010 tx=0x7fd6ec020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f29b3640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55f9346c1e70 0x55f9346c42a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd6e4016070 con 0x55f9346c1e70 2024-02-15T22:56:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f6d2f800 20 realm 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346c4dc0 con 0x55f9346c1e70 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd6e4016070 con 0x55f9346c1e70 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f6d2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346c5610 con 0x55f9346c1e70 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd6e4016070 con 0x55f9346c1e70 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.772+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346c5970 con 0x55f9346c1e70 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.773+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd6e4016070 con 0x55f9346c1e70 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.773+0000 7fd6f6d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.773+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.773+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346c52b0 con 0x55f9346c1e70 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.773+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd6e4016070 con 0x55f9346c1e70 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.773+0000 7fd6f6d2f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.773+0000 7fd6f6d2f800 20 searching for the correct realm 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.773+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55f9346c7d30 0x55f9346ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.773+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c7d30 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.773+0000 7fd6f21b2640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55f9346c7d30 0x55f9346ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.773+0000 7fd6f21b2640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55f9346c7d30 0x55f9346ca120 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.774+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.774+0000 7fd6f21b2640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd6e8087070 0x7fd6e808f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.774+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6e8087070 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.774+0000 7fd6f31b4640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd6e8087070 0x7fd6e808f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.774+0000 7fd6f31b4640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd6e8087070 0x7fd6e808f800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.774+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6ec00a4a0 con 0x7fd6e8087070 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.774+0000 7fd6f31b4640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd6ec0141d0 0x7fd6ec015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.774+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6ec0141d0 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.775+0000 7fd6f29b3640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd6ec0141d0 0x7fd6ec015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.775+0000 7fd6f29b3640 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd6ec0141d0 0x7fd6ec015940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.775+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4016070 con 0x7fd6ec0141d0 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.775+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c1e70 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.775+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4016070 con 0x55f9346c1e70 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.775+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c1e70 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.776+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4016070 con 0x55f9346c1e70 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.776+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6ec0141d0 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.776+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4016070 con 0x7fd6ec0141d0 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.776+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6ec0141d0 2024-02-15T22:56:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.776+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4016070 con 0x7fd6ec0141d0 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.776+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6e8087070 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.776+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6ec00a4a0 con 0x7fd6e8087070 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.776+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c7d30 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.777+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.777+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c1e70 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.777+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4016070 con 0x55f9346c1e70 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.777+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6ec0141d0 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.777+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4016070 con 0x7fd6ec0141d0 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.777+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c1e70 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.778+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4016070 con 0x55f9346c1e70 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.778+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6e8087070 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.778+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd6ec03a040 con 0x7fd6e8087070 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.778+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c7d30 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.778+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.778+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c7d30 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.778+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.778+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6ec0141d0 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.779+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4016070 con 0x7fd6ec0141d0 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.779+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c7d30 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.779+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.779+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c7d30 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.779+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.779+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c1e70 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.779+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4016070 con 0x55f9346c1e70 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.779+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c1e70 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.779+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd6e4016070 con 0x55f9346c1e70 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.779+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6ec0141d0 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.780+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.780+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c7d30 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.780+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.780+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6e8087070 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.780+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6ec03a040 con 0x7fd6e8087070 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.780+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c1e70 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.781+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.781+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6ec0141d0 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.781+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.781+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c7d30 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.781+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.781+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6ec0141d0 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.781+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.781+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6e8087070 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.782+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6ec03a040 con 0x7fd6e8087070 2024-02-15T22:56:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.782+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c7d30 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.782+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.782+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6ec0141d0 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.782+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.782+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x55f9346c1e70 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.782+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ca7a0 con 0x7fd6e8087070 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd6ec03a040 con 0x7fd6e8087070 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346c6840 con 0x55f9346c1e70 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346c64c0 con 0x55f9346c1e70 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.783+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346c7110 con 0x55f9346c1e70 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 20 zone default found 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 4 Realm: () 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:23.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 20 zonegroup default 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346c7110 con 0x7fd6ec0141d0 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cc5f0 con 0x55f9346c7d30 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cc950 con 0x55f9346c7d30 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 20 started sync module instance, tier type = 2024-02-15T22:56:23.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:23.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.784+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cbed0 con 0x7fd6e8087070 2024-02-15T22:56:23.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.785+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6ec03a040 con 0x7fd6e8087070 2024-02-15T22:56:23.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.786+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94528814758448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cbe50 con 0x7fd6e8087070 2024-02-15T22:56:23.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.786+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cd660 con 0x55f9346c1e70 2024-02-15T22:56:23.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.787+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.787+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94528814764480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cda80 con 0x55f9346c1e70 2024-02-15T22:56:23.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.787+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ce500 con 0x55f9346c7d30 2024-02-15T22:56:23.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.789+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94528814764480] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.789+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94528814758448] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6ec03a040 con 0x7fd6e8087070 2024-02-15T22:56:23.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.791+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.791+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94528814763296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cda80 con 0x55f9346c7d30 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.791+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ced90 con 0x7fd6e8087070 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.792+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94528814763296] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.792+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6ec03a040 con 0x7fd6e8087070 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.792+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94528814765536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cf140 con 0x7fd6e8087070 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.792+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cfb70 con 0x55f9346c1e70 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.793+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.793+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94528814773872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cfb70 con 0x55f9346c1e70 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.793+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346d0b00 con 0x7fd6ec0141d0 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.796+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94528814765536] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6ec03a040 con 0x7fd6e8087070 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.796+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.796+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94528814777824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346d0ac0 con 0x7fd6ec0141d0 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.796+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346d14c0 con 0x7fd6ec0141d0 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.799+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94528814773872] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.799+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94528814777824] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.802+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.802+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94528814770352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346d1020 con 0x7fd6ec0141d0 2024-02-15T22:56:23.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.802+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346d1d40 con 0x7fd6ec0141d0 2024-02-15T22:56:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.803+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94528814770352] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.803+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.803+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94528814776016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346d1a40 con 0x7fd6ec0141d0 2024-02-15T22:56:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.803+0000 7fd6f6d2f800 20 add_watcher() i=0 2024-02-15T22:56:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.803+0000 7fd6f6d2f800 20 add_watcher() i=1 2024-02-15T22:56:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.803+0000 7fd6f6d2f800 20 add_watcher() i=2 2024-02-15T22:56:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.803+0000 7fd6f6d2f800 20 add_watcher() i=3 2024-02-15T22:56:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.803+0000 7fd6f6d2f800 20 add_watcher() i=4 2024-02-15T22:56:23.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.803+0000 7fd6f6d2f800 20 add_watcher() i=5 2024-02-15T22:56:23.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.803+0000 7fd6f6d2f800 20 add_watcher() i=6 2024-02-15T22:56:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.806+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94528814776016] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.806+0000 7fd6f6d2f800 20 add_watcher() i=7 2024-02-15T22:56:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.806+0000 7fd6f6d2f800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.806+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346d4e80 con 0x55f9346c1e70 2024-02-15T22:56:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.807+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.807+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94528814794912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346d1bb0 con 0x55f9346c1e70 2024-02-15T22:56:23.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.809+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94528814794912] v30'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.809+0000 7fd5a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:23.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.809+0000 7fd6f6d2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.809+0000 7fd6f6d2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.809+0000 7fd6f6d2f800 5 note: GC not initialized 2024-02-15T22:56:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.809+0000 7fd523fff640 20 reqs_thread_entry: start 2024-02-15T22:56:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.809+0000 7fd6f6d2f800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.809+0000 7fd6f6d2f800 20 Filter name: none 2024-02-15T22:56:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.809+0000 7fd521ffb640 20 reqs_thread_entry: start 2024-02-15T22:56:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.810+0000 7fd6f6d2f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.810+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f934706910 con 0x55f9346c1e70 2024-02-15T22:56:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.810+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.810+0000 7fd6f6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:could not fetch user info: no user info saved 2024-02-15T22:56:23.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.810+0000 7fd5a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:23.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.810+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94528814794912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9347068d0 con 0x55f9346c1e70 2024-02-15T22:56:23.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.812+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94528814794912] v30'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.812+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94528814758448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9347068d0 con 0x7fd6e8087070 2024-02-15T22:56:23.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.814+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94528814758448] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6ec03a040 con 0x7fd6e8087070 2024-02-15T22:56:23.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.814+0000 7fd6f6d2f800 20 remove_watcher() i=0 2024-02-15T22:56:23.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.814+0000 7fd6f6d2f800 2 removed watcher, disabling cache 2024-02-15T22:56:23.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.814+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94528814764480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9347068d0 con 0x55f9346c1e70 2024-02-15T22:56:23.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.816+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94528814764480] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.816+0000 7fd6f6d2f800 20 remove_watcher() i=1 2024-02-15T22:56:23.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.816+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94528814763296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9347068d0 con 0x55f9346c7d30 2024-02-15T22:56:23.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.817+0000 7fd6f21b2640 1 -- 172.21.15.133:0/1728603212 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94528814763296] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e806f020 con 0x55f9346c7d30 2024-02-15T22:56:23.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.817+0000 7fd6f6d2f800 20 remove_watcher() i=2 2024-02-15T22:56:23.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.817+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94528814765536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cd1c0 con 0x7fd6e8087070 2024-02-15T22:56:23.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.818+0000 7fd6f31b4640 1 -- 172.21.15.133:0/1728603212 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94528814765536] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6ec03a040 con 0x7fd6e8087070 2024-02-15T22:56:23.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.818+0000 7fd6f6d2f800 20 remove_watcher() i=3 2024-02-15T22:56:23.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.818+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94528814773872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ccd20 con 0x55f9346c1e70 2024-02-15T22:56:23.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.819+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94528814773872] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x55f9346c1e70 2024-02-15T22:56:23.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.819+0000 7fd6f6d2f800 20 remove_watcher() i=4 2024-02-15T22:56:23.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.819+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94528814777824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cf670 con 0x7fd6ec0141d0 2024-02-15T22:56:23.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.821+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94528814777824] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.821+0000 7fd6f6d2f800 20 remove_watcher() i=5 2024-02-15T22:56:23.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.821+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94528814770352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346ccd20 con 0x7fd6ec0141d0 2024-02-15T22:56:23.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.822+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94528814770352] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.822+0000 7fd6f6d2f800 20 remove_watcher() i=6 2024-02-15T22:56:23.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.822+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94528814776016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f9346cf670 con 0x7fd6ec0141d0 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94528814776016] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd6e4052040 con 0x7fd6ec0141d0 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 20 remove_watcher() i=7 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd6ec0141d0 msgr2=0x7fd6ec015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd6ec0141d0 0x7fd6ec015940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55f9346c1e70 msgr2=0x55f9346c42a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55f9346c1e70 0x55f9346c42a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd6e8087070 msgr2=0x7fd6e808f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd6e8087070 0x7fd6e808f800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55f9346c7d30 msgr2=0x55f9346ca120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55f9346c7d30 0x55f9346ca120 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5bc0367e0 msgr2=0x7fd5bc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5bc0367e0 0x7fd5bc038ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00b010 tx=0x7fd6ec020000 comp rx=0 tx=0).stop 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 msgr2=0x55f9346b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/1728603212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346af450 0x55f9346b6450 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80066e0 tx=0x7fd6e808d880 comp rx=0 tx=0).stop 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 reap_dead start 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f29b3640 1 -- 172.21.15.133:0/1728603212 reap_dead start 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 shutdown_connections 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 >> 172.21.15.133:0/1728603212 conn(0x55f9346ab7b0 msgr2=0x55f9346a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 shutdown_connections 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/1728603212 wait complete. 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/584735542 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5cc0367e0 msgr2=0x7fd5cc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.823+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/584735542 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5cc0367e0 0x7fd5cc038ca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55f934692570 tx=0x7fd6ec005840 comp rx=0 tx=0).stop 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/584735542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346a2290 msgr2=0x55f9346a26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/584735542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346a2290 0x55f9346a26b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8044830 tx=0x7fd6e8002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/584735542 shutdown_connections 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/584735542 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5cc0367e0 0x7fd5cc038ca0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/584735542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9346a2290 0x55f9346a26b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/584735542 >> 172.21.15.133:0/584735542 conn(0x55f934696330 msgr2=0x55f934696730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/584735542 shutdown_connections 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/584735542 wait complete. 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55f9345913d0 msgr2=0x55f9346914f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55f9345913d0 0x55f9346914f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5d80367e0 msgr2=0x7fd5d8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5d80367e0 0x7fd5d8038ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8054000 tx=0x7fd6e804e000 comp rx=0 tx=0).stop 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 msgr2=0x55f93468a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f93468a810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b210 tx=0x7fd6e4000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 shutdown_connections 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55f9345913d0 0x55f9346914f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd5d80367e0 0x7fd5d8038ca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 --2- 172.21.15.133:0/2847477893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f93458f890 0x55f93468a810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 >> 172.21.15.133:0/2847477893 conn(0x55f93458b4d0 msgr2=0x55f93467d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 shutdown_connections 2024-02-15T22:56:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.824+0000 7fd6f6d2f800 1 -- 172.21.15.133:0/2847477893 wait complete. 2024-02-15T22:56:23.834 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-15T22:56:23.835 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-15T22:56:23.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-15T22:56:23.835 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-02-15T22:56:23.928 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:23.928 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.926+0000 7f07a5931800 1 Processor -- start 2024-02-15T22:56:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.926+0000 7f07a5931800 1 -- start start 2024-02-15T22:56:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.926+0000 7f07a5931800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55be040852a0 0x55be04087690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.926+0000 7f07a5931800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55be03fccb50 con 0x55be04080e10 2024-02-15T22:56:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.926+0000 7f07a5931800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55be03f84450 con 0x55be040852a0 2024-02-15T22:56:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.927+0000 7f07a0e33640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55be040852a0 0x55be04087690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.927+0000 7f07a1634640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55be04080e10 0x55be04081230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44810/0 (socket says 172.21.15.133:44810) 2024-02-15T22:56:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.927+0000 7f07a1634640 1 -- 172.21.15.133:0/1849311824 learned_addr learned my addr 172.21.15.133:0/1849311824 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.927+0000 7f07a0e33640 1 -- 172.21.15.133:0/1849311824 >> v1:172.21.15.52:6789/0 conn(0x55be04080e10 legacy=0x55be04081230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.927+0000 7f07a0e33640 1 -- 172.21.15.133:0/1849311824 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be04088cc0 con 0x55be040852a0 2024-02-15T22:56:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.927+0000 7f0793fff640 1 -- 172.21.15.133:0/1849311824 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217362904 0 0) 0x55be03fccb50 con 0x55be04080e10 2024-02-15T22:56:23.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.929+0000 7f07a0e33640 1 --2- 172.21.15.133:0/1849311824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be040852a0 0x55be04087690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f079800a470 tx=0x7f079801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f108388ee1688b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.929+0000 7f0793fff640 1 -- 172.21.15.133:0/1849311824 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0798052570 con 0x55be040852a0 2024-02-15T22:56:23.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.929+0000 7f0793fff640 1 -- 172.21.15.133:0/1849311824 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07980526d0 con 0x55be040852a0 2024-02-15T22:56:23.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.929+0000 7f0793fff640 1 -- 172.21.15.133:0/1849311824 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0798052990 con 0x55be040852a0 2024-02-15T22:56:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.930+0000 7f07a5931800 1 -- 172.21.15.133:0/1849311824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be040852a0 msgr2=0x55be04087690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.930+0000 7f07a5931800 1 --2- 172.21.15.133:0/1849311824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be040852a0 0x55be04087690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f079800a470 tx=0x7f079801cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.930+0000 7f07a5931800 1 -- 172.21.15.133:0/1849311824 shutdown_connections 2024-02-15T22:56:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.930+0000 7f07a5931800 1 --2- 172.21.15.133:0/1849311824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be040852a0 0x55be04087690 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.930+0000 7f07a5931800 1 -- 172.21.15.133:0/1849311824 >> 172.21.15.133:0/1849311824 conn(0x55be0407c470 msgr2=0x55be0407e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.930+0000 7f07a5931800 1 -- 172.21.15.133:0/1849311824 shutdown_connections 2024-02-15T22:56:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.930+0000 7f07a5931800 1 -- 172.21.15.133:0/1849311824 wait complete. 2024-02-15T22:56:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.941+0000 7f07a5931800 1 Processor -- start 2024-02-15T22:56:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.941+0000 7f07a5931800 1 -- start start 2024-02-15T22:56:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.941+0000 7f07a5931800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04170e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.941+0000 7f07a5931800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be03f81980 con 0x55be04080e10 2024-02-15T22:56:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.942+0000 7f07a1634640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04170e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.942+0000 7f07a1634640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04170e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57004/0 (socket says 172.21.15.133:57004) 2024-02-15T22:56:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.942+0000 7f07a1634640 1 -- 172.21.15.133:0/2793760354 learned_addr learned my addr 172.21.15.133:0/2793760354 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.942+0000 7f07a1634640 1 -- 172.21.15.133:0/2793760354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0798005d20 con 0x55be04080e10 2024-02-15T22:56:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.942+0000 7f07a1634640 1 --2- 172.21.15.133:0/2793760354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04170e80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f079400b240 tx=0x7f079400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd728edf023fe08 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.942+0000 7f068f606640 1 -- 172.21.15.133:0/2793760354 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0794014070 con 0x55be04080e10 2024-02-15T22:56:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.942+0000 7f068f606640 1 -- 172.21.15.133:0/2793760354 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079400d500 con 0x55be04080e10 2024-02-15T22:56:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.942+0000 7f068f606640 1 -- 172.21.15.133:0/2793760354 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f079400d820 con 0x55be04080e10 2024-02-15T22:56:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.943+0000 7f07a5931800 1 -- 172.21.15.133:0/2793760354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 msgr2=0x55be04170e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.943+0000 7f07a5931800 1 --2- 172.21.15.133:0/2793760354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04170e80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f079400b240 tx=0x7f079400b700 comp rx=0 tx=0).stop 2024-02-15T22:56:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.943+0000 7f07a5931800 1 -- 172.21.15.133:0/2793760354 shutdown_connections 2024-02-15T22:56:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.943+0000 7f07a5931800 1 --2- 172.21.15.133:0/2793760354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04170e80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.943+0000 7f07a5931800 1 -- 172.21.15.133:0/2793760354 >> 172.21.15.133:0/2793760354 conn(0x55be0407c470 msgr2=0x55be0416c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.943+0000 7f07a5931800 1 -- 172.21.15.133:0/2793760354 shutdown_connections 2024-02-15T22:56:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.943+0000 7f07a5931800 1 -- 172.21.15.133:0/2793760354 wait complete. 2024-02-15T22:56:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.943+0000 7f07a5931800 1 Processor -- start 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.943+0000 7f07a5931800 1 -- start start 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.943+0000 7f07a5931800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04178400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.943+0000 7f07a5931800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be03f7d160 con 0x55be04080e10 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.944+0000 7f07a1634640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04178400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.944+0000 7f07a1634640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04178400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57008/0 (socket says 172.21.15.133:57008) 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.944+0000 7f07a1634640 1 -- 172.21.15.133:0/3954388375 learned_addr learned my addr 172.21.15.133:0/3954388375 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.944+0000 7f07a1634640 1 -- 172.21.15.133:0/3954388375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0794001ba0 con 0x55be04080e10 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.944+0000 7f07a1634640 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04178400 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55be04171a90 tx=0x7f0794000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.944+0000 7f068de03640 1 -- 172.21.15.133:0/3954388375 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f079400f980 con 0x55be04080e10 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.944+0000 7f068de03640 1 -- 172.21.15.133:0/3954388375 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0794020070 con 0x55be04080e10 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.944+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be04178940 con 0x55be04080e10 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.944+0000 7f068de03640 1 -- 172.21.15.133:0/3954388375 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f079400fc30 con 0x55be04080e10 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.944+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be04178e20 con 0x55be04080e10 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.945+0000 7f068de03640 1 -- 172.21.15.133:0/3954388375 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f079400d040 con 0x55be04080e10 2024-02-15T22:56:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.945+0000 7f068de03640 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06880367e0 0x7f0688038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.945+0000 7f068de03640 1 -- 172.21.15.133:0/3954388375 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f079400a040 con 0x55be04080e10 2024-02-15T22:56:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.945+0000 7f07a0e33640 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06880367e0 0x7f0688038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.945+0000 7f07a5931800 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be040852a0 0x55be0417f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.945+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be0417f760 con 0x55be040852a0 2024-02-15T22:56:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.945+0000 7f07a1e35640 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be040852a0 0x55be0417f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.946+0000 7f07a0e33640 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06880367e0 0x7f0688038ca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0798054000 tx=0x7f079804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.946+0000 7f07a1e35640 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be040852a0 0x55be0417f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.946+0000 7f07a1e35640 1 -- 172.21.15.133:0/3954388375 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f079c00a4a0 con 0x55be040852a0 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.946+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be0417c7f0 con 0x55be040852a0 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.946+0000 7f07a1e35640 1 -- 172.21.15.133:0/3954388375 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f079c00a4a0 con 0x55be040852a0 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.946+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be04181490 con 0x55be040852a0 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.947+0000 7f07a1e35640 1 -- 172.21.15.133:0/3954388375 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f079c00a4a0 con 0x55be040852a0 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.947+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be04180690 con 0x55be040852a0 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.947+0000 7f07a1e35640 1 -- 172.21.15.133:0/3954388375 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f079c00a4a0 con 0x55be040852a0 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.947+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be04180aa0 con 0x55be040852a0 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.947+0000 7f07a1e35640 1 -- 172.21.15.133:0/3954388375 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f079c00a4a0 con 0x55be040852a0 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.948+0000 7f07a5931800 1 Processor -- start 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.948+0000 7f07a5931800 1 -- start start 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.948+0000 7f07a5931800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04191c10 0x55be04194000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.948+0000 7f07a5931800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be03f1fe80 con 0x55be04191c10 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.948+0000 7f07a0e33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04191c10 0x55be04194000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.948+0000 7f07a0e33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04191c10 0x55be04194000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57018/0 (socket says 172.21.15.133:57018) 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.948+0000 7f07a0e33640 1 -- 172.21.15.133:0/3955856105 learned_addr learned my addr 172.21.15.133:0/3955856105 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.949+0000 7f07a0e33640 1 -- 172.21.15.133:0/3955856105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be03ff5130 con 0x55be04191c10 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.949+0000 7f07a0e33640 1 --2- 172.21.15.133:0/3955856105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04191c10 0x55be04194000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0798000c00 tx=0x7f0798002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.949+0000 7f0686ffd640 1 -- 172.21.15.133:0/3955856105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f079805d930 con 0x55be04191c10 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.949+0000 7f0686ffd640 1 -- 172.21.15.133:0/3955856105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079805da90 con 0x55be04191c10 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.949+0000 7f07a5931800 1 -- 172.21.15.133:0/3955856105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be04194540 con 0x55be04191c10 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.949+0000 7f0686ffd640 1 -- 172.21.15.133:0/3955856105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f079805dd30 con 0x55be04191c10 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.949+0000 7f07a5931800 1 -- 172.21.15.133:0/3955856105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be041948e0 con 0x55be04191c10 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.950+0000 7f0686ffd640 1 -- 172.21.15.133:0/3955856105 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0798066040 con 0x55be04191c10 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.950+0000 7f0686ffd640 1 --2- 172.21.15.133:0/3955856105 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06780367e0 0x7f0678038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.950+0000 7f0686ffd640 1 -- 172.21.15.133:0/3955856105 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f0798063040 con 0x55be04191c10 2024-02-15T22:56:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.950+0000 7f07a1e35640 1 --2- 172.21.15.133:0/3955856105 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06780367e0 0x7f0678038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.950+0000 7f07a5931800 1 Processor -- start 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.950+0000 7f07a5931800 1 -- start start 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.950+0000 7f07a1e35640 1 --2- 172.21.15.133:0/3955856105 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06780367e0 0x7f0678038ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55be041800d0 tx=0x7f079c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.950+0000 7f07a5931800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be0419e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.950+0000 7f07a5931800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be03ef55d0 con 0x55be0419e180 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.951+0000 7f07a0e33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be0419e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.951+0000 7f07a0e33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be0419e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57020/0 (socket says 172.21.15.133:57020) 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.951+0000 7f07a0e33640 1 -- 172.21.15.133:0/3717018496 learned_addr learned my addr 172.21.15.133:0/3717018496 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.951+0000 7f07a0e33640 1 -- 172.21.15.133:0/3717018496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be0419eb70 con 0x55be0419e180 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.951+0000 7f07a0e33640 1 --2- 172.21.15.133:0/3717018496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be0419e5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0798052460 tx=0x7f079805cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fda734c5e33214 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.951+0000 7f0684ff9640 1 -- 172.21.15.133:0/3717018496 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0798067390 con 0x55be0419e180 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.951+0000 7f0684ff9640 1 -- 172.21.15.133:0/3717018496 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07980674f0 con 0x55be0419e180 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.951+0000 7f0684ff9640 1 -- 172.21.15.133:0/3717018496 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0798071cc0 con 0x55be0419e180 2024-02-15T22:56:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.951+0000 7f07a5931800 1 -- 172.21.15.133:0/3717018496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 msgr2=0x55be0419e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.951+0000 7f07a5931800 1 --2- 172.21.15.133:0/3717018496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be0419e5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0798052460 tx=0x7f079805cf80 comp rx=0 tx=0).stop 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a5931800 1 -- 172.21.15.133:0/3717018496 shutdown_connections 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a5931800 1 --2- 172.21.15.133:0/3717018496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be0419e5a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a5931800 1 -- 172.21.15.133:0/3717018496 >> 172.21.15.133:0/3717018496 conn(0x55be0419a4e0 msgr2=0x55be04198540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a5931800 1 -- 172.21.15.133:0/3717018496 shutdown_connections 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a5931800 1 -- 172.21.15.133:0/3717018496 wait complete. 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a5931800 1 Processor -- start 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a5931800 1 -- start start 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a5931800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be041a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a5931800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be041a56d0 con 0x55be0419e180 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a0e33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be041a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a0e33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be041a5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57024/0 (socket says 172.21.15.133:57024) 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 learned_addr learned my addr 172.21.15.133:0/2709519365 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.952+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be041948e0 con 0x55be0419e180 2024-02-15T22:56:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.953+0000 7f07a0e33640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be041a5190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0798052460 tx=0x7f079807e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.953+0000 7f0676ffd640 1 -- 172.21.15.133:0/2709519365 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f079808c040 con 0x55be0419e180 2024-02-15T22:56:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.953+0000 7f0676ffd640 1 -- 172.21.15.133:0/2709519365 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079808f850 con 0x55be0419e180 2024-02-15T22:56:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.953+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be041a58d0 con 0x55be0419e180 2024-02-15T22:56:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.953+0000 7f0676ffd640 1 -- 172.21.15.133:0/2709519365 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f079808faf0 con 0x55be0419e180 2024-02-15T22:56:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.953+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be041a58d0 con 0x55be0419e180 2024-02-15T22:56:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.954+0000 7f0676ffd640 1 -- 172.21.15.133:0/2709519365 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f079808fc50 con 0x55be0419e180 2024-02-15T22:56:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.954+0000 7f0676ffd640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f066c0367e0 0x7f066c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.954+0000 7f0676ffd640 1 -- 172.21.15.133:0/2709519365 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f0798099b00 con 0x55be0419e180 2024-02-15T22:56:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.954+0000 7f07a1e35640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f066c0367e0 0x7f066c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.954+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.954+0000 7f07a5931800 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be041b0c20 0x55be041b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.954+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b3830 con 0x55be041b0c20 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.954+0000 7f07a1e35640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f066c0367e0 0x7f066c038ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f079c00b010 tx=0x7f079c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.954+0000 7f07a1634640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be041b0c20 0x55be041b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a1634640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be041b0c20 0x55be041b30e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0794016070 con 0x55be041b0c20 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a5931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a5931800 20 realm 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b3c00 con 0x55be041b0c20 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0794016070 con 0x55be041b0c20 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a5931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a5931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4480 con 0x55be041b0c20 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0794016070 con 0x55be041b0c20 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a5931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.955+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b47e0 con 0x55be041b0c20 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.956+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0794016070 con 0x55be041b0c20 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.956+0000 7f07a5931800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.956+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.956+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b0c20 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.956+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0794016070 con 0x55be041b0c20 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.956+0000 7f07a5931800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.956+0000 7f07a5931800 20 searching for the correct realm 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.956+0000 7f07a5931800 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55be041b6f00 0x55be041b93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.956+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b9a70 con 0x55be041b6f00 2024-02-15T22:56:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.956+0000 7f07a0e33640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55be041b6f00 0x55be041b93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.956+0000 7f07a0e33640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55be041b6f00 0x55be041b93a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.957+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f079806e020 con 0x55be041b6f00 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.957+0000 7f07a0e33640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0798098070 0x7f079807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.957+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b9a70 con 0x7f0798098070 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.957+0000 7f07a1e35640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0798098070 0x7f079807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.957+0000 7f07a1e35640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0798098070 0x7f079807d440 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.957+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f0798098070 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.957+0000 7f07a1e35640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f079c0141d0 0x7f079c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.957+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b9a70 con 0x7f079c0141d0 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.958+0000 7f07a1634640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f079c0141d0 0x7f079c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.958+0000 7f07a1634640 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f079c0141d0 0x7f079c015940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.958+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794016070 con 0x7f079c0141d0 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.958+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b0c20 2024-02-15T22:56:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.959+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794016070 con 0x55be041b0c20 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.959+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b0c20 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.959+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794016070 con 0x55be041b0c20 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.959+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f079c0141d0 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.959+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794016070 con 0x7f079c0141d0 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.959+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f079c0141d0 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.959+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794016070 con 0x7f079c0141d0 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.959+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f0798098070 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.960+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f079c00a4a0 con 0x7f0798098070 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.960+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b6f00 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.960+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f079806e020 con 0x55be041b6f00 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.960+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b0c20 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.960+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794016070 con 0x55be041b0c20 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.960+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f079c0141d0 2024-02-15T22:56:23.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.961+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794016070 con 0x7f079c0141d0 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.961+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b0c20 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.961+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794016070 con 0x55be041b0c20 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.961+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f0798098070 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.961+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.961+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b6f00 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.961+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.961+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b6f00 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.962+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.962+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f079c0141d0 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.962+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794016070 con 0x7f079c0141d0 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.962+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b6f00 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.962+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.962+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b6f00 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.962+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.962+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b0c20 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.962+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794016070 con 0x55be041b0c20 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.963+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b0c20 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.963+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0794016070 con 0x55be041b0c20 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.963+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f079c0141d0 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.963+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.963+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b6f00 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.963+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.963+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f0798098070 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.964+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.964+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b0c20 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.964+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.964+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f079c0141d0 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.964+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.964+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b6f00 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.964+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.964+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f079c0141d0 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.965+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.965+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f0798098070 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.965+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.965+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b6f00 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.965+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.965+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f079c0141d0 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x55be041b0c20 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b4fe0 con 0x7f0798098070 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a5931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a5931800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a5931800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a5931800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a5931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a5931800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b53a0 con 0x55be041b0c20 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a5931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.966+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b5750 con 0x55be041b0c20 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b5750 con 0x55be041b0c20 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 20 zone default found 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 4 Realm: () 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 20 zonegroup default 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.967+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b6520 con 0x7f079c0141d0 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a5931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041b5c60 con 0x55be041b6f00 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a5931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bb8c0 con 0x55be041b6f00 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a5931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a5931800 20 started sync module instance, tier type = 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a5931800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.968+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bb170 con 0x7f0798098070 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.969+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.969+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94274601069776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bb520 con 0x7f0798098070 2024-02-15T22:56:23.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.969+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bc600 con 0x55be041b0c20 2024-02-15T22:56:23.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.972+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.972+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94274601075040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bca20 con 0x55be041b0c20 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.972+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bd3d0 con 0x55be041b6f00 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.972+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94274601069776] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.975+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94274601075040] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.975+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.975+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94274601073856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bca20 con 0x55be041b6f00 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.975+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bdc60 con 0x7f0798098070 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.976+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.976+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94274601073856] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.976+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94274601080704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041be010 con 0x7f0798098070 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.976+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bea10 con 0x55be041b0c20 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.978+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.978+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94274601084176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bea10 con 0x55be041b0c20 2024-02-15T22:56:23.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.978+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bf9b0 con 0x7f079c0141d0 2024-02-15T22:56:23.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.980+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.980+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94274601088176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bf970 con 0x7f079c0141d0 2024-02-15T22:56:23.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.980+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041c0900 con 0x7f079c0141d0 2024-02-15T22:56:23.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.981+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94274601080704] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:23.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.982+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94274601088176] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.984+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94274601084176] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.985+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.985+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94274601090400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041c03f0 con 0x7f079c0141d0 2024-02-15T22:56:23.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.985+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041c0900 con 0x7f079c0141d0 2024-02-15T22:56:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94274601086288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041c0da0 con 0x7f079c0141d0 2024-02-15T22:56:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a5931800 20 add_watcher() i=0 2024-02-15T22:56:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a5931800 20 add_watcher() i=1 2024-02-15T22:56:23.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a5931800 20 add_watcher() i=2 2024-02-15T22:56:23.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a5931800 20 add_watcher() i=3 2024-02-15T22:56:23.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a5931800 20 add_watcher() i=4 2024-02-15T22:56:23.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a5931800 20 add_watcher() i=5 2024-02-15T22:56:23.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94274601090400] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a5931800 20 add_watcher() i=6 2024-02-15T22:56:23.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94274601086288] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a5931800 20 add_watcher() i=7 2024-02-15T22:56:23.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.988+0000 7f07a5931800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:23.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.989+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041c0da0 con 0x55be041b0c20 2024-02-15T22:56:23.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.989+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.989+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94274601093376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041c1600 con 0x55be041b0c20 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.990+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94274601093376] v30'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.990+0000 7f06577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 5 note: GC not initialized 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f06567e4640 20 reqs_thread_entry: start 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 20 Filter name: none 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f05c7fff640 20 reqs_thread_entry: start 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041f5e70 con 0x55be041b0c20 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.991+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041f5e70 con 0x55be041b0c20 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041f45e0 con 0x7f079c0141d0 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-02-15T22:56:23.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-15T22:56:23.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-15T22:56:23.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-15T22:56:23.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.992+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041f4e60 con 0x55be041b0c20 2024-02-15T22:56:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.993+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~358] v30'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.993+0000 7f07a5931800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.993+0000 7f07a5931800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.993+0000 7f07a5931800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.993+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94274601306560 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041f9870 con 0x55be041b0c20 2024-02-15T22:56:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.994+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== watch-notify(notify (1) cookie 94274601084176 notify 128849018880 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f079404ae70 con 0x55be041b0c20 2024-02-15T22:56:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.994+0000 7f0684ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94274601084176 notifier 4285 bl.length()=534 2024-02-15T22:56:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.994+0000 7f0684ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.994+0000 7f0684ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.994+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(66 notify.4 [notify cookie 94274601306560 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.994+0000 7f0684ff9640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0664003e90 con 0x55be041b0c20 2024-02-15T22:56:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.994+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.994+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== watch-notify(notify_complete (2) cookie 94274601306560 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55be04178e20 con 0x55be041b0c20 2024-02-15T22:56:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.994+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041f73b0 con 0x55be041b0c20 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.996+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.996+0000 7f07a5931800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.996+0000 7f07a5931800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.996+0000 7f07a5931800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.996+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94274601306432 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041f9870 con 0x7f0798098070 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.996+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== watch-notify(notify (1) cookie 94274601080704 notify 128849018880 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x7f079c026bd0 con 0x7f0798098070 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.996+0000 7f0677fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94274601080704 notifier 4285 bl.length()=169 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.996+0000 7f0677fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.996+0000 7f0677fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.996+0000 7f0677fff640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05d40033f0 con 0x7f0798098070 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.996+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(69 notify.3 [notify cookie 94274601306432 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.997+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.997+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== watch-notify(notify_complete (2) cookie 94274601306432 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f079c026e30 con 0x7f0798098070 2024-02-15T22:56:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.997+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041f7850 con 0x7f079c0141d0 2024-02-15T22:56:24.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.998+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:24.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.998+0000 7f07a5931800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-15T22:56:24.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.998+0000 7f07a5931800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-15T22:56:24.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.998+0000 7f07a5931800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-15T22:56:24.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.998+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94274601321408 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041f9c90 con 0x7f0798098070 2024-02-15T22:56:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.998+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== watch-notify(notify (1) cookie 94274601080704 notify 128849018881 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f079c026e30 con 0x7f0798098070 2024-02-15T22:56:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.999+0000 7f0684ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94274601080704 notifier 4285 bl.length()=177 2024-02-15T22:56:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.999+0000 7f0684ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-15T22:56:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.999+0000 7f0684ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-15T22:56:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.999+0000 7f0684ff9640 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0664003e90 con 0x7f0798098070 2024-02-15T22:56:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.999+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(72 notify.3 [notify cookie 94274601321408 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.999+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:23.999+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== watch-notify(notify_complete (2) cookie 94274601321408 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f079c0306f0 con 0x7f0798098070 2024-02-15T22:56:24.003 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.000+0000 7f06577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.000+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94274601093376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041c38e0 con 0x55be041b0c20 2024-02-15T22:56:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.001+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94274601093376] v30'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.001+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94274601069776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041c0900 con 0x7f0798098070 2024-02-15T22:56:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.002+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94274601069776] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.002+0000 7f07a5931800 20 remove_watcher() i=0 2024-02-15T22:56:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.002+0000 7f07a5931800 2 removed watcher, disabling cache 2024-02-15T22:56:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.002+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94274601075040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041c0900 con 0x55be041b0c20 2024-02-15T22:56:24.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.003+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94274601075040] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:24.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.003+0000 7f07a5931800 20 remove_watcher() i=1 2024-02-15T22:56:24.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.003+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94274601073856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041c0900 con 0x55be041b6f00 2024-02-15T22:56:24.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.004+0000 7f07a0e33640 1 -- 172.21.15.133:0/2709519365 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94274601073856] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f07980ac040 con 0x55be041b6f00 2024-02-15T22:56:24.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.004+0000 7f07a5931800 20 remove_watcher() i=2 2024-02-15T22:56:24.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.004+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94274601080704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bbcc0 con 0x7f0798098070 2024-02-15T22:56:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.006+0000 7f07a1e35640 1 -- 172.21.15.133:0/2709519365 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94274601080704] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f079c03a040 con 0x7f0798098070 2024-02-15T22:56:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.006+0000 7f07a5931800 20 remove_watcher() i=3 2024-02-15T22:56:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.006+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94274601084176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bbcc0 con 0x55be041b0c20 2024-02-15T22:56:24.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.007+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94274601084176] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x55be041b0c20 2024-02-15T22:56:24.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.007+0000 7f07a5931800 20 remove_watcher() i=4 2024-02-15T22:56:24.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.007+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94274601088176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bbcc0 con 0x7f079c0141d0 2024-02-15T22:56:24.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.008+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94274601088176] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:24.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.008+0000 7f07a5931800 20 remove_watcher() i=5 2024-02-15T22:56:24.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.008+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94274601090400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bacd0 con 0x7f079c0141d0 2024-02-15T22:56:24.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.009+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94274601090400] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:24.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.009+0000 7f07a5931800 20 remove_watcher() i=6 2024-02-15T22:56:24.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.009+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94274601086288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be041bacd0 con 0x7f079c0141d0 2024-02-15T22:56:24.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.010+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94274601086288] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0794052040 con 0x7f079c0141d0 2024-02-15T22:56:24.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.010+0000 7f07a5931800 20 remove_watcher() i=7 2024-02-15T22:56:24.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f079c0141d0 msgr2=0x7f079c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f079c0141d0 0x7f079c015940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be041b0c20 msgr2=0x55be041b30e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be041b0c20 0x55be041b30e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0798098070 msgr2=0x7f079807d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0798098070 0x7f079807d440 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55be041b6f00 msgr2=0x55be041b93a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55be041b6f00 0x55be041b93a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f066c0367e0 msgr2=0x7f066c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f066c0367e0 0x7f066c038ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f079c00b010 tx=0x7f079c020000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 msgr2=0x55be041a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a1634640 1 -- 172.21.15.133:0/2709519365 reap_dead start 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be041a5190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0798052460 tx=0x7f079807e000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 shutdown_connections 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 --2- 172.21.15.133:0/2709519365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be0419e180 0x55be041a5190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 >> 172.21.15.133:0/2709519365 conn(0x55be0419a4e0 msgr2=0x55be04197b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 shutdown_connections 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/2709519365 wait complete. 2024-02-15T22:56:24.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/3955856105 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06780367e0 msgr2=0x7f0678038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 --2- 172.21.15.133:0/3955856105 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06780367e0 0x7f0678038ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55be041800d0 tx=0x7f079c005840 comp rx=0 tx=0).stop 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/3955856105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04191c10 msgr2=0x55be04194000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 --2- 172.21.15.133:0/3955856105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04191c10 0x55be04194000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0798000c00 tx=0x7f0798002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/3955856105 shutdown_connections 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 --2- 172.21.15.133:0/3955856105 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06780367e0 0x7f0678038ca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 --2- 172.21.15.133:0/3955856105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04191c10 0x55be04194000 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/3955856105 >> 172.21.15.133:0/3955856105 conn(0x55be04183fb0 msgr2=0x55be041843b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/3955856105 shutdown_connections 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.011+0000 7f07a5931800 1 -- 172.21.15.133:0/3955856105 wait complete. 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be040852a0 msgr2=0x55be0417f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be040852a0 0x55be0417f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06880367e0 msgr2=0x7f0688038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06880367e0 0x7f0688038ca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0798054000 tx=0x7f079804e000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 msgr2=0x55be04178400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04178400 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55be04171a90 tx=0x7f0794000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 shutdown_connections 2024-02-15T22:56:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be040852a0 0x55be0417f190 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f06880367e0 0x7f0688038ca0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 --2- 172.21.15.133:0/3954388375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be04080e10 0x55be04178400 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 >> 172.21.15.133:0/3954388375 conn(0x55be0407c470 msgr2=0x55be0416aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 shutdown_connections 2024-02-15T22:56:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.012+0000 7f07a5931800 1 -- 172.21.15.133:0/3954388375 wait complete. 2024-02-15T22:56:24.022 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:24.022 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-15T22:56:24.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-15T22:56:24.023 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-02-15T22:56:24.069 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:24.069 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:24.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.067+0000 7feb3190d800 1 Processor -- start 2024-02-15T22:56:24.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.067+0000 7feb3190d800 1 -- start start 2024-02-15T22:56:24.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.067+0000 7feb3190d800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5616f5f7c8b0 0x5616f5f7ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.067+0000 7feb3190d800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5616f5ec8c50 con 0x5616f5f7d210 2024-02-15T22:56:24.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.067+0000 7feb3190d800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5616f5e80450 con 0x5616f5f7c8b0 2024-02-15T22:56:24.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.067+0000 7feb2f40c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5616f5f7c8b0 0x5616f5f7ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.067+0000 7feb2ec0b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5616f5f7d210 0x5616f5f7d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44816/0 (socket says 172.21.15.133:44816) 2024-02-15T22:56:24.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.068+0000 7feb2ec0b640 1 -- 172.21.15.133:0/500327591 learned_addr learned my addr 172.21.15.133:0/500327591 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:24.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.068+0000 7feb2f40c640 1 -- 172.21.15.133:0/500327591 >> v1:172.21.15.52:6789/0 conn(0x5616f5f7d210 legacy=0x5616f5f7d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.068+0000 7feb2f40c640 1 -- 172.21.15.133:0/500327591 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616f5ef1330 con 0x5616f5f7c8b0 2024-02-15T22:56:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.070+0000 7feb2f40c640 1 --2- 172.21.15.133:0/500327591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f5f7ccd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb2000a470 tx=0x7feb2001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd71fbf316e33e67 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.070+0000 7feb2e40a640 1 -- 172.21.15.133:0/500327591 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb20052570 con 0x5616f5f7c8b0 2024-02-15T22:56:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.070+0000 7feb2e40a640 1 -- 172.21.15.133:0/500327591 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb200526d0 con 0x5616f5f7c8b0 2024-02-15T22:56:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.070+0000 7feb2e40a640 1 -- 172.21.15.133:0/500327591 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb20052990 con 0x5616f5f7c8b0 2024-02-15T22:56:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.070+0000 7feb3190d800 1 -- 172.21.15.133:0/500327591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 msgr2=0x5616f5f7ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.070+0000 7feb3190d800 1 --2- 172.21.15.133:0/500327591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f5f7ccd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb2000a470 tx=0x7feb2001cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.070+0000 7feb3190d800 1 -- 172.21.15.133:0/500327591 shutdown_connections 2024-02-15T22:56:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.070+0000 7feb3190d800 1 --2- 172.21.15.133:0/500327591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f5f7ccd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.070+0000 7feb3190d800 1 -- 172.21.15.133:0/500327591 >> 172.21.15.133:0/500327591 conn(0x5616f5f784f0 msgr2=0x5616f5f7a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.070+0000 7feb3190d800 1 -- 172.21.15.133:0/500327591 shutdown_connections 2024-02-15T22:56:24.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.070+0000 7feb3190d800 1 -- 172.21.15.133:0/500327591 wait complete. 2024-02-15T22:56:24.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.082+0000 7feb3190d800 1 Processor -- start 2024-02-15T22:56:24.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.082+0000 7feb3190d800 1 -- start start 2024-02-15T22:56:24.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.082+0000 7feb3190d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.082+0000 7feb3190d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5e7d980 con 0x5616f5f7c8b0 2024-02-15T22:56:24.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.082+0000 7feb2f40c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.082+0000 7feb2f40c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57052/0 (socket says 172.21.15.133:57052) 2024-02-15T22:56:24.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.082+0000 7feb2f40c640 1 -- 172.21.15.133:0/2768023236 learned_addr learned my addr 172.21.15.133:0/2768023236 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.082+0000 7feb2f40c640 1 -- 172.21.15.133:0/2768023236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb20005d20 con 0x5616f5f7c8b0 2024-02-15T22:56:24.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.083+0000 7feb2f40c640 1 --2- 172.21.15.133:0/2768023236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6070200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feb20055040 tx=0x7feb2004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e5b09ed3c72485 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.083+0000 7fea1d60a640 1 -- 172.21.15.133:0/2768023236 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb2000a180 con 0x5616f5f7c8b0 2024-02-15T22:56:24.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.083+0000 7fea1d60a640 1 -- 172.21.15.133:0/2768023236 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2000a2e0 con 0x5616f5f7c8b0 2024-02-15T22:56:24.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.083+0000 7fea1d60a640 1 -- 172.21.15.133:0/2768023236 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb200529b0 con 0x5616f5f7c8b0 2024-02-15T22:56:24.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.083+0000 7feb3190d800 1 -- 172.21.15.133:0/2768023236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 msgr2=0x5616f6070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.083+0000 7feb3190d800 1 --2- 172.21.15.133:0/2768023236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6070200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feb20055040 tx=0x7feb2004c000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.083+0000 7feb3190d800 1 -- 172.21.15.133:0/2768023236 shutdown_connections 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.083+0000 7feb3190d800 1 --2- 172.21.15.133:0/2768023236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6070200 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.083+0000 7feb3190d800 1 -- 172.21.15.133:0/2768023236 >> 172.21.15.133:0/2768023236 conn(0x5616f5f784f0 msgr2=0x5616f606bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.083+0000 7feb3190d800 1 -- 172.21.15.133:0/2768023236 shutdown_connections 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.083+0000 7feb3190d800 1 -- 172.21.15.133:0/2768023236 wait complete. 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.084+0000 7feb3190d800 1 Processor -- start 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.084+0000 7feb3190d800 1 -- start start 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.084+0000 7feb3190d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6077830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.084+0000 7feb3190d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5e79160 con 0x5616f5f7c8b0 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.084+0000 7feb2f40c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6077830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.084+0000 7feb2f40c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6077830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57054/0 (socket says 172.21.15.133:57054) 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.084+0000 7feb2f40c640 1 -- 172.21.15.133:0/3896185025 learned_addr learned my addr 172.21.15.133:0/3896185025 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.085+0000 7feb2f40c640 1 -- 172.21.15.133:0/3896185025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616f5ef1330 con 0x5616f5f7c8b0 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.085+0000 7feb2f40c640 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6077830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb2000a470 tx=0x7feb20002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.085+0000 7fea1be07640 1 -- 172.21.15.133:0/3896185025 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb2006a070 con 0x5616f5f7c8b0 2024-02-15T22:56:24.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.085+0000 7fea1be07640 1 -- 172.21.15.133:0/3896185025 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2005d420 con 0x5616f5f7c8b0 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.085+0000 7fea1be07640 1 -- 172.21.15.133:0/3896185025 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb2005d5d0 con 0x5616f5f7c8b0 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.085+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616f6077d70 con 0x5616f5f7c8b0 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.085+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616f6078250 con 0x5616f5f7c8b0 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.086+0000 7fea1be07640 1 -- 172.21.15.133:0/3896185025 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7feb2005d730 con 0x5616f5f7c8b0 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.086+0000 7fea1be07640 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea14036790 0x7fea14038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.086+0000 7fea1be07640 1 -- 172.21.15.133:0/3896185025 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7feb2008d910 con 0x5616f5f7c8b0 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.086+0000 7feb2ec0b640 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea14036790 0x7fea14038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.086+0000 7feb3190d800 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616f5f7d210 0x5616f607e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.086+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f607eb90 con 0x5616f5f7d210 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.086+0000 7feb2fc0d640 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616f5f7d210 0x5616f607e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.087+0000 7feb2ec0b640 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea14036790 0x7fea14038c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb24000f60 tx=0x7feb240012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.087+0000 7feb2fc0d640 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616f5f7d210 0x5616f607e5c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.087+0000 7feb2fc0d640 1 -- 172.21.15.133:0/3896185025 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb2800a4a0 con 0x5616f5f7d210 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.087+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f607bc20 con 0x5616f5f7d210 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.087+0000 7feb2fc0d640 1 -- 172.21.15.133:0/3896185025 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feb2800a4a0 con 0x5616f5f7d210 2024-02-15T22:56:24.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.087+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60808c0 con 0x5616f5f7d210 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.087+0000 7feb2fc0d640 1 -- 172.21.15.133:0/3896185025 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7feb2800a4a0 con 0x5616f5f7d210 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.088+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f607fac0 con 0x5616f5f7d210 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.088+0000 7feb2fc0d640 1 -- 172.21.15.133:0/3896185025 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feb2800a4a0 con 0x5616f5f7d210 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.088+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f607fed0 con 0x5616f5f7d210 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.088+0000 7feb2fc0d640 1 -- 172.21.15.133:0/3896185025 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7feb2800a4a0 con 0x5616f5f7d210 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.088+0000 7feb3190d800 1 Processor -- start 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.088+0000 7feb3190d800 1 -- start start 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7feb3190d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f608f2d0 0x5616f608f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7feb3190d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5e1be80 con 0x5616f608f2d0 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7feb2ec0b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f608f2d0 0x5616f608f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7feb2ec0b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f608f2d0 0x5616f608f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57068/0 (socket says 172.21.15.133:57068) 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7feb2ec0b640 1 -- 172.21.15.133:0/763374300 learned_addr learned my addr 172.21.15.133:0/763374300 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7feb2ec0b640 1 -- 172.21.15.133:0/763374300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616f608fc30 con 0x5616f608f2d0 2024-02-15T22:56:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7feb2ec0b640 1 --2- 172.21.15.133:0/763374300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f608f2d0 0x5616f608f6f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feb24001ed0 tx=0x7feb2400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7fea19602640 1 -- 172.21.15.133:0/763374300 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb24020070 con 0x5616f608f2d0 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7fea19602640 1 -- 172.21.15.133:0/763374300 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2401b550 con 0x5616f608f2d0 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7feb3190d800 1 -- 172.21.15.133:0/763374300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616f60906a0 con 0x5616f608f2d0 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7fea19602640 1 -- 172.21.15.133:0/763374300 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb24013040 con 0x5616f608f2d0 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.089+0000 7feb3190d800 1 -- 172.21.15.133:0/763374300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616f6090b60 con 0x5616f608f2d0 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.090+0000 7fea19602640 1 -- 172.21.15.133:0/763374300 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7feb2401b7f0 con 0x5616f608f2d0 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.090+0000 7fea19602640 1 --2- 172.21.15.133:0/763374300 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea080367e0 0x7fea08038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.090+0000 7fea19602640 1 -- 172.21.15.133:0/763374300 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7feb2404e270 con 0x5616f608f2d0 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.090+0000 7feb2fc0d640 1 --2- 172.21.15.133:0/763374300 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea080367e0 0x7fea08038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.090+0000 7feb3190d800 1 Processor -- start 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7feb3190d800 1 -- start start 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7feb2fc0d640 1 --2- 172.21.15.133:0/763374300 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea080367e0 0x7fea08038ca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5616f607f500 tx=0x7feb28005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7feb3190d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f609c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7feb3190d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5df15d0 con 0x5616f609c5b0 2024-02-15T22:56:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7feb2ec0b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f609c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7feb2ec0b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f609c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57074/0 (socket says 172.21.15.133:57074) 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7feb2ec0b640 1 -- 172.21.15.133:0/2997237154 learned_addr learned my addr 172.21.15.133:0/2997237154 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7feb2ec0b640 1 -- 172.21.15.133:0/2997237154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616f609cfa0 con 0x5616f609c5b0 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7feb2ec0b640 1 --2- 172.21.15.133:0/2997237154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f609c9d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feb2404c750 tx=0x7feb2404e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd70f55c104d9c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7fea12ffd640 1 -- 172.21.15.133:0/2997237154 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb24024c90 con 0x5616f609c5b0 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7fea12ffd640 1 -- 172.21.15.133:0/2997237154 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb24040e90 con 0x5616f609c5b0 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.091+0000 7fea12ffd640 1 -- 172.21.15.133:0/2997237154 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb24025410 con 0x5616f609c5b0 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.092+0000 7feb3190d800 1 -- 172.21.15.133:0/2997237154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 msgr2=0x5616f609c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.092+0000 7feb3190d800 1 --2- 172.21.15.133:0/2997237154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f609c9d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feb2404c750 tx=0x7feb2404e050 comp rx=0 tx=0).stop 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.092+0000 7feb3190d800 1 -- 172.21.15.133:0/2997237154 shutdown_connections 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.092+0000 7feb3190d800 1 --2- 172.21.15.133:0/2997237154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f609c9d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.092+0000 7feb3190d800 1 -- 172.21.15.133:0/2997237154 >> 172.21.15.133:0/2997237154 conn(0x5616f6098910 msgr2=0x5616f6096970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.092+0000 7feb3190d800 1 -- 172.21.15.133:0/2997237154 shutdown_connections 2024-02-15T22:56:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.092+0000 7feb3190d800 1 -- 172.21.15.133:0/2997237154 wait complete. 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.092+0000 7feb3190d800 1 Processor -- start 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.092+0000 7feb3190d800 1 -- start start 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.092+0000 7feb3190d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f60a3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.092+0000 7feb3190d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f60a3a60 con 0x5616f609c5b0 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.093+0000 7feb2ec0b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f60a3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.093+0000 7feb2ec0b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f60a3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57090/0 (socket says 172.21.15.133:57090) 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.093+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 learned_addr learned my addr 172.21.15.133:0/330405764 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.093+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616f6090b60 con 0x5616f609c5b0 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.093+0000 7feb2ec0b640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f60a3520 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feb2404c810 tx=0x7feb2404c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.093+0000 7fea117fa640 1 -- 172.21.15.133:0/330405764 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb24025410 con 0x5616f609c5b0 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.093+0000 7fea117fa640 1 -- 172.21.15.133:0/330405764 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb24025590 con 0x5616f609c5b0 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.093+0000 7fea117fa640 1 -- 172.21.15.133:0/330405764 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb2401bc80 con 0x5616f609c5b0 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.093+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616f60a3c60 con 0x5616f609c5b0 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.093+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616f60a3c60 con 0x5616f609c5b0 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.094+0000 7fea117fa640 1 -- 172.21.15.133:0/330405764 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7feb2400cc60 con 0x5616f609c5b0 2024-02-15T22:56:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.094+0000 7fea117fa640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe9f80367e0 0x7fe9f8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.094+0000 7fea117fa640 1 -- 172.21.15.133:0/330405764 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7feb24050710 con 0x5616f609c5b0 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.094+0000 7feb2fc0d640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe9f80367e0 0x7fe9f8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.095+0000 7feb2fc0d640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe9f80367e0 0x7fe9f8038ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb2800b010 tx=0x7feb28020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.095+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.095+0000 7feb3190d800 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616f60aef60 0x5616f60b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.095+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b1b70 con 0x5616f60aef60 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.095+0000 7feb2f40c640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616f60aef60 0x5616f60b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.095+0000 7feb2f40c640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616f60aef60 0x5616f60b1420 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.095+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb20059040 con 0x5616f60aef60 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.095+0000 7feb3190d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.095+0000 7feb3190d800 20 realm 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.095+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.095+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b1f40 con 0x5616f60aef60 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb20059040 con 0x5616f60aef60 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b27c0 con 0x5616f60aef60 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb20059040 con 0x5616f60aef60 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b2b20 con 0x5616f60aef60 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feb20059040 con 0x5616f60aef60 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b3320 con 0x5616f60aef60 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7feb2007e040 con 0x5616f60aef60 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 20 searching for the correct realm 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5616f60b5210 0x5616f60b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60b5210 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.096+0000 7feb2ec0b640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5616f60b5210 0x5616f60b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.097+0000 7feb2ec0b640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5616f60b5210 0x5616f60b76d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.097+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.097+0000 7feb2ec0b640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7feb24037070 0x7feb240509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.097+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb24037070 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.097+0000 7feb2fc0d640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7feb24037070 0x7feb240509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.098+0000 7feb2fc0d640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7feb24037070 0x7feb240509b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.098+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb2800a4a0 con 0x7feb24037070 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.098+0000 7feb2fc0d640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7feb280141d0 0x7feb28015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.098+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb280141d0 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.098+0000 7feb2f40c640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7feb280141d0 0x7feb28015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.098+0000 7feb2f40c640 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7feb280141d0 0x7feb28015940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.098+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb2007e040 con 0x7feb280141d0 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.098+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60aef60 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.099+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb2007e040 con 0x5616f60aef60 2024-02-15T22:56:24.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.099+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60aef60 2024-02-15T22:56:24.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.099+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.099+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb280141d0 2024-02-15T22:56:24.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.099+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.099+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb280141d0 2024-02-15T22:56:24.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.099+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.099+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb24037070 2024-02-15T22:56:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.100+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb2800a4a0 con 0x7feb24037070 2024-02-15T22:56:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.100+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60b5210 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.100+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.100+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60aef60 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.100+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.100+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb280141d0 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.100+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.100+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60aef60 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.100+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.100+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb24037070 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.101+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7feb2803a040 con 0x7feb24037070 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.101+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60b5210 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.101+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.101+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60b5210 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.101+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.101+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb280141d0 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.101+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.101+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60b5210 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.102+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.102+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60b5210 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.102+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.102+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60aef60 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.102+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.102+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60aef60 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.102+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.102+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb280141d0 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.103+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.103+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60b5210 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.103+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.103+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb24037070 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.103+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb2803a040 con 0x7feb24037070 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.103+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60aef60 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.103+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.103+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb280141d0 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.104+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.104+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60b5210 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.104+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.104+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb280141d0 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.104+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.104+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb24037070 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.104+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb2803a040 con 0x7feb24037070 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.104+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60b5210 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb280141d0 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x5616f60aef60 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b7da0 con 0x7feb24037070 2024-02-15T22:56:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb2803a040 con 0x7feb24037070 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb3190d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb3190d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb3190d800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb3190d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb3190d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb3190d800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b3b50 con 0x5616f60aef60 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.105+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b3f00 con 0x5616f60aef60 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b42e0 con 0x5616f60aef60 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 20 zone default found 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 4 Realm: () 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 20 zonegroup default 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b81e0 con 0x7feb280141d0 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.106+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60ba060 con 0x5616f60b5210 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.107+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.107+0000 7feb3190d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.107+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.107+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60ba3c0 con 0x5616f60b5210 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.107+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.107+0000 7feb3190d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.107+0000 7feb3190d800 20 started sync module instance, tier type = 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.107+0000 7feb3190d800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.107+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b9630 con 0x7feb24037070 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.108+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb2803a040 con 0x7feb24037070 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.108+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94656617224720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b9630 con 0x7feb24037070 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.108+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60badd0 con 0x5616f60aef60 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.109+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94656617224720] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb2803a040 con 0x7feb24037070 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.109+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.109+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94656617222544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60badd0 con 0x5616f60aef60 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.109+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60bb820 con 0x5616f60b5210 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.111+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.111+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94656617222544] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.111+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94656617231104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60bc070 con 0x5616f60b5210 2024-02-15T22:56:24.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.111+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60ba8e0 con 0x7feb24037070 2024-02-15T22:56:24.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.114+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94656617231104] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.114+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb2803a040 con 0x7feb24037070 2024-02-15T22:56:24.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.114+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94656617233360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60bca90 con 0x7feb24037070 2024-02-15T22:56:24.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.114+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60bd400 con 0x5616f60aef60 2024-02-15T22:56:24.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.117+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.117+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94656617238368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60bd880 con 0x5616f60aef60 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.117+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60be350 con 0x7feb280141d0 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.117+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94656617233360] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb2803a040 con 0x7feb24037070 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.118+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94656617238368] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.118+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.118+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94656617239424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60be310 con 0x7feb280141d0 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.118+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60beba0 con 0x7feb280141d0 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.119+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94656617239424] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.119+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.119+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94656617242160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60be310 con 0x7feb280141d0 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.119+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60bf1d0 con 0x7feb280141d0 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.120+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94656617242160] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.120+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.120+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94656617245968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60bf1d0 con 0x7feb280141d0 2024-02-15T22:56:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.120+0000 7feb3190d800 20 add_watcher() i=0 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.120+0000 7feb3190d800 20 add_watcher() i=1 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.120+0000 7feb3190d800 20 add_watcher() i=2 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.120+0000 7feb3190d800 20 add_watcher() i=3 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.120+0000 7feb3190d800 20 add_watcher() i=4 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.120+0000 7feb3190d800 20 add_watcher() i=5 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.120+0000 7feb3190d800 20 add_watcher() i=6 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.121+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94656617245968] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.121+0000 7feb3190d800 20 add_watcher() i=7 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.121+0000 7feb3190d800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.121+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60be620 con 0x5616f60aef60 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.121+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.121+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94656617248176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60bff80 con 0x5616f60aef60 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.122+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94656617248176] v30'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.122+0000 7fe9e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.122+0000 7feb3190d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.122+0000 7feb3190d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.122+0000 7feb3190d800 5 note: GC not initialized 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.122+0000 7fe9e4fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 20 Filter name: none 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7fe95e7fc640 20 reqs_thread_entry: start 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60f4b10 con 0x7feb280141d0 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60f4b10 con 0x5616f60aef60 2024-02-15T22:56:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+23 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.123+0000 7feb3190d800 20 rados_obj.operate() r=0 bl.length=7 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.124+0000 7feb3190d800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.124+0000 7feb3190d800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.124+0000 7feb3190d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.124+0000 7feb3190d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.124+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60f3320 con 0x5616f60aef60 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.124+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 foo [call out=48b,read 0~358 out=358b] v0'0 uv1 ondisk = 0) v8 ==== 189+0+406 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.124+0000 7feb3190d800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.124+0000 7feb3190d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.124+0000 7feb3190d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.124+0000 7feb3190d800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.125+0000 7fe9e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.125+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94656617248176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60f3ef0 con 0x5616f60aef60 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.126+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94656617248176] v30'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.126+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94656617224720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60f3ef0 con 0x7feb24037070 2024-02-15T22:56:24.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.127+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94656617224720] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb2803a040 con 0x7feb24037070 2024-02-15T22:56:24.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.127+0000 7feb3190d800 20 remove_watcher() i=0 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.127+0000 7feb3190d800 2 removed watcher, disabling cache 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.127+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94656617222544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60f3ef0 con 0x5616f60aef60 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.128+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94656617222544] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.128+0000 7feb3190d800 20 remove_watcher() i=1 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.128+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94656617231104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60f3ef0 con 0x5616f60b5210 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.129+0000 7feb2ec0b640 1 -- 172.21.15.133:0/330405764 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94656617231104] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb24022070 con 0x5616f60b5210 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.129+0000 7feb3190d800 20 remove_watcher() i=2 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.129+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94656617233360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b9a10 con 0x7feb24037070 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.130+0000 7feb2fc0d640 1 -- 172.21.15.133:0/330405764 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94656617233360] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb2803a040 con 0x7feb24037070 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.130+0000 7feb3190d800 20 remove_watcher() i=3 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.130+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94656617238368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60bbbd0 con 0x5616f60aef60 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.131+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94656617238368] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x5616f60aef60 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.131+0000 7feb3190d800 20 remove_watcher() i=4 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.131+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94656617239424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b9a10 con 0x7feb280141d0 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.132+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94656617239424] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.132+0000 7feb3190d800 20 remove_watcher() i=5 2024-02-15T22:56:24.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.132+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94656617242160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60bbbd0 con 0x7feb280141d0 2024-02-15T22:56:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.133+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94656617242160] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.133+0000 7feb3190d800 20 remove_watcher() i=6 2024-02-15T22:56:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.133+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94656617245968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5616f60b9a10 con 0x7feb280141d0 2024-02-15T22:56:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94656617245968] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb20088040 con 0x7feb280141d0 2024-02-15T22:56:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 20 remove_watcher() i=7 2024-02-15T22:56:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7feb280141d0 msgr2=0x7feb28015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7feb280141d0 0x7feb28015940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616f60aef60 msgr2=0x5616f60b1420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616f60aef60 0x5616f60b1420 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7feb24037070 msgr2=0x7feb240509b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7feb24037070 0x7feb240509b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5616f60b5210 msgr2=0x5616f60b76d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5616f60b5210 0x5616f60b76d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe9f80367e0 msgr2=0x7fe9f8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe9f80367e0 0x7fe9f8038ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb2800b010 tx=0x7feb28020000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 msgr2=0x5616f60a3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb2f40c640 1 -- 172.21.15.133:0/330405764 reap_dead start 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f60a3520 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feb2404c810 tx=0x7feb2404c6e0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 shutdown_connections 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 --2- 172.21.15.133:0/330405764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f609c5b0 0x5616f60a3520 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 >> 172.21.15.133:0/330405764 conn(0x5616f6098910 msgr2=0x5616f6095f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 shutdown_connections 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.134+0000 7feb3190d800 1 -- 172.21.15.133:0/330405764 wait complete. 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/763374300 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea080367e0 msgr2=0x7fea08038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 --2- 172.21.15.133:0/763374300 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea080367e0 0x7fea08038ca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5616f607f500 tx=0x7feb28005840 comp rx=0 tx=0).stop 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/763374300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f608f2d0 msgr2=0x5616f608f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 --2- 172.21.15.133:0/763374300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f608f2d0 0x5616f608f6f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feb24001ed0 tx=0x7feb2400d7a0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/763374300 shutdown_connections 2024-02-15T22:56:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 --2- 172.21.15.133:0/763374300 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea080367e0 0x7fea08038ca0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 --2- 172.21.15.133:0/763374300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f608f2d0 0x5616f608f6f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/763374300 >> 172.21.15.133:0/763374300 conn(0x5616f6083370 msgr2=0x5616f6083770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/763374300 shutdown_connections 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/763374300 wait complete. 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616f5f7d210 msgr2=0x5616f607e5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616f5f7d210 0x5616f607e5c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea14036790 msgr2=0x7fea14038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea14036790 0x7fea14038c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb24000f60 tx=0x7feb240012b0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 msgr2=0x5616f6077830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6077830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb2000a470 tx=0x7feb20002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 shutdown_connections 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616f5f7d210 0x5616f607e5c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fea14036790 0x7fea14038c50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 --2- 172.21.15.133:0/3896185025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616f5f7c8b0 0x5616f6077830 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 >> 172.21.15.133:0/3896185025 conn(0x5616f5f784f0 msgr2=0x5616f606a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 shutdown_connections 2024-02-15T22:56:24.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.135+0000 7feb3190d800 1 -- 172.21.15.133:0/3896185025 wait complete. 2024-02-15T22:56:24.145 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-02-15T22:56:24.145 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T22:56:24.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T22:56:24.146 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T22:56:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.186+0000 7f4070a13800 1 Processor -- start 2024-02-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.186+0000 7f4070a13800 1 -- start start 2024-02-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.186+0000 7f4070a13800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d63247f300 0x55d6324816f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.186+0000 7f4070a13800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d6323c6bb0 con 0x55d63247ae70 2024-02-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.186+0000 7f4070a13800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d63237e450 con 0x55d63247f300 2024-02-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.186+0000 7f406dd18640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d63247f300 0x55d6324816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.186+0000 7f406e519640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55d63247ae70 0x55d63247b290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44822/0 (socket says 172.21.15.133:44822) 2024-02-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.186+0000 7f406e519640 1 -- 172.21.15.133:0/4099496089 learned_addr learned my addr 172.21.15.133:0/4099496089 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.186+0000 7f406dd18640 1 -- 172.21.15.133:0/4099496089 >> v1:172.21.15.52:6789/0 conn(0x55d63247ae70 legacy=0x55d63247b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.186+0000 7f406d517640 1 -- 172.21.15.133:0/4099496089 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302349005 0 0) 0x55d6323c6bb0 con 0x55d63247ae70 2024-02-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.186+0000 7f406dd18640 1 -- 172.21.15.133:0/4099496089 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d632482d20 con 0x55d63247f300 2024-02-15T22:56:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.188+0000 7f406dd18640 1 --2- 172.21.15.133:0/4099496089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247f300 0x55d6324816f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f406400a470 tx=0x7f406401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2feb3e4dbae25f5a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.188+0000 7f406d517640 1 -- 172.21.15.133:0/4099496089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4064052570 con 0x55d63247f300 2024-02-15T22:56:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.188+0000 7f406d517640 1 -- 172.21.15.133:0/4099496089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40640526d0 con 0x55d63247f300 2024-02-15T22:56:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.188+0000 7f406d517640 1 -- 172.21.15.133:0/4099496089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4064052990 con 0x55d63247f300 2024-02-15T22:56:24.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.189+0000 7f4070a13800 1 -- 172.21.15.133:0/4099496089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247f300 msgr2=0x55d6324816f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.189+0000 7f4070a13800 1 --2- 172.21.15.133:0/4099496089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247f300 0x55d6324816f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f406400a470 tx=0x7f406401cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:24.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.189+0000 7f4070a13800 1 -- 172.21.15.133:0/4099496089 shutdown_connections 2024-02-15T22:56:24.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.189+0000 7f4070a13800 1 --2- 172.21.15.133:0/4099496089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247f300 0x55d6324816f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.189+0000 7f4070a13800 1 -- 172.21.15.133:0/4099496089 >> 172.21.15.133:0/4099496089 conn(0x55d6324764d0 msgr2=0x55d6324788f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.189+0000 7f4070a13800 1 -- 172.21.15.133:0/4099496089 shutdown_connections 2024-02-15T22:56:24.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.189+0000 7f4070a13800 1 -- 172.21.15.133:0/4099496089 wait complete. 2024-02-15T22:56:24.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.200+0000 7f4070a13800 1 Processor -- start 2024-02-15T22:56:24.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.201+0000 7f4070a13800 1 -- start start 2024-02-15T22:56:24.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.201+0000 7f4070a13800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d6323eef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.201+0000 7f4070a13800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d63237b980 con 0x55d63247ae70 2024-02-15T22:56:24.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.201+0000 7f406e519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d6323eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.201+0000 7f406e519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d6323eef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57106/0 (socket says 172.21.15.133:57106) 2024-02-15T22:56:24.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.201+0000 7f406e519640 1 -- 172.21.15.133:0/1931248461 learned_addr learned my addr 172.21.15.133:0/1931248461 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.201+0000 7f406e519640 1 -- 172.21.15.133:0/1931248461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4064005d20 con 0x55d63247ae70 2024-02-15T22:56:24.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.202+0000 7f406e519640 1 --2- 172.21.15.133:0/1931248461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d6323eef30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f406000b240 tx=0x7f406000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576d87be5220d74 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.202+0000 7f3f5c608640 1 -- 172.21.15.133:0/1931248461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4060014070 con 0x55d63247ae70 2024-02-15T22:56:24.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.202+0000 7f3f5c608640 1 -- 172.21.15.133:0/1931248461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406000d500 con 0x55d63247ae70 2024-02-15T22:56:24.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.202+0000 7f3f5c608640 1 -- 172.21.15.133:0/1931248461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f406000d820 con 0x55d63247ae70 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.202+0000 7f4070a13800 1 -- 172.21.15.133:0/1931248461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 msgr2=0x55d6323eef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.202+0000 7f4070a13800 1 --2- 172.21.15.133:0/1931248461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d6323eef30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f406000b240 tx=0x7f406000b700 comp rx=0 tx=0).stop 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.202+0000 7f4070a13800 1 -- 172.21.15.133:0/1931248461 shutdown_connections 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.202+0000 7f4070a13800 1 --2- 172.21.15.133:0/1931248461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d6323eef30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.202+0000 7f4070a13800 1 -- 172.21.15.133:0/1931248461 >> 172.21.15.133:0/1931248461 conn(0x55d6324764d0 msgr2=0x55d6325665c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.202+0000 7f4070a13800 1 -- 172.21.15.133:0/1931248461 shutdown_connections 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.202+0000 7f4070a13800 1 -- 172.21.15.133:0/1931248461 wait complete. 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.203+0000 7f4070a13800 1 Processor -- start 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.203+0000 7f4070a13800 1 -- start start 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.203+0000 7f4070a13800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d632573560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.203+0000 7f4070a13800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d632377160 con 0x55d63247ae70 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.203+0000 7f406e519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d632573560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.203+0000 7f406e519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d632573560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57122/0 (socket says 172.21.15.133:57122) 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.203+0000 7f406e519640 1 -- 172.21.15.133:0/742494828 learned_addr learned my addr 172.21.15.133:0/742494828 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.203+0000 7f406e519640 1 -- 172.21.15.133:0/742494828 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4060001ba0 con 0x55d63247ae70 2024-02-15T22:56:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.204+0000 7f406e519640 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d632573560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55d6323ee560 tx=0x7f4060000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.204+0000 7f3f5ae05640 1 -- 172.21.15.133:0/742494828 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4060019870 con 0x55d63247ae70 2024-02-15T22:56:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.204+0000 7f3f5ae05640 1 -- 172.21.15.133:0/742494828 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4060020070 con 0x55d63247ae70 2024-02-15T22:56:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.204+0000 7f3f5ae05640 1 -- 172.21.15.133:0/742494828 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4060019b00 con 0x55d63247ae70 2024-02-15T22:56:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.204+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d632573aa0 con 0x55d63247ae70 2024-02-15T22:56:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.204+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d632573f80 con 0x55d63247ae70 2024-02-15T22:56:24.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.204+0000 7f3f5ae05640 1 -- 172.21.15.133:0/742494828 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f406000d040 con 0x55d63247ae70 2024-02-15T22:56:24.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.205+0000 7f3f5ae05640 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f540367e0 0x7f3f54038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.205+0000 7f3f5ae05640 1 -- 172.21.15.133:0/742494828 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f406000a040 con 0x55d63247ae70 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.205+0000 7f406dd18640 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f540367e0 0x7f3f54038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.205+0000 7f4070a13800 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d63247f300 0x55d63257a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.205+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d63257a890 con 0x55d63247f300 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.205+0000 7f406ed1a640 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d63247f300 0x55d63257a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.205+0000 7f406dd18640 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f540367e0 0x7f3f54038ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4064054000 tx=0x7f406404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.205+0000 7f406ed1a640 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d63247f300 0x55d63257a2c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.205+0000 7f406ed1a640 1 -- 172.21.15.133:0/742494828 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f406800a4a0 con 0x55d63247f300 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.205+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d632577950 con 0x55d63247f300 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.206+0000 7f406ed1a640 1 -- 172.21.15.133:0/742494828 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f406800a4a0 con 0x55d63247f300 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.206+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d63257c5c0 con 0x55d63247f300 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.206+0000 7f406ed1a640 1 -- 172.21.15.133:0/742494828 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f406800a4a0 con 0x55d63247f300 2024-02-15T22:56:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.206+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d63257b7c0 con 0x55d63247f300 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.206+0000 7f406ed1a640 1 -- 172.21.15.133:0/742494828 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f406800a4a0 con 0x55d63247f300 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.206+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d63257bbd0 con 0x55d63247f300 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.207+0000 7f406ed1a640 1 -- 172.21.15.133:0/742494828 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f406800a4a0 con 0x55d63247f300 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.207+0000 7f4070a13800 1 Processor -- start 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.207+0000 7f4070a13800 1 -- start start 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.207+0000 7f4070a13800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63258afd0 0x55d63258b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.207+0000 7f4070a13800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d632319e80 con 0x55d63258afd0 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.207+0000 7f406dd18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63258afd0 0x55d63258b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.207+0000 7f406dd18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63258afd0 0x55d63258b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57136/0 (socket says 172.21.15.133:57136) 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.207+0000 7f406dd18640 1 -- 172.21.15.133:0/4211342508 learned_addr learned my addr 172.21.15.133:0/4211342508 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.208+0000 7f406dd18640 1 -- 172.21.15.133:0/4211342508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d63258b930 con 0x55d63258afd0 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.208+0000 7f406dd18640 1 --2- 172.21.15.133:0/4211342508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63258afd0 0x55d63258b3f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4064000c00 tx=0x7f4064002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.208+0000 7f3f53fff640 1 -- 172.21.15.133:0/4211342508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f406405d930 con 0x55d63258afd0 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.208+0000 7f3f53fff640 1 -- 172.21.15.133:0/4211342508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406405da90 con 0x55d63258afd0 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.208+0000 7f4070a13800 1 -- 172.21.15.133:0/4211342508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d63258bb20 con 0x55d63258afd0 2024-02-15T22:56:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.208+0000 7f3f53fff640 1 -- 172.21.15.133:0/4211342508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f406405dd30 con 0x55d63258afd0 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.208+0000 7f4070a13800 1 -- 172.21.15.133:0/4211342508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d63258c610 con 0x55d63258afd0 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.209+0000 7f3f53fff640 1 -- 172.21.15.133:0/4211342508 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4064066040 con 0x55d63258afd0 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.209+0000 7f3f53fff640 1 --2- 172.21.15.133:0/4211342508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f480367e0 0x7f3f48038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.209+0000 7f3f53fff640 1 -- 172.21.15.133:0/4211342508 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4064063040 con 0x55d63258afd0 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.209+0000 7f406ed1a640 1 --2- 172.21.15.133:0/4211342508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f480367e0 0x7f3f48038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.209+0000 7f4070a13800 1 Processor -- start 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.209+0000 7f4070a13800 1 -- start start 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.209+0000 7f406ed1a640 1 --2- 172.21.15.133:0/4211342508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f480367e0 0x7f3f48038ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55d63257b200 tx=0x7f4068005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.209+0000 7f4070a13800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d632598590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.209+0000 7f4070a13800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6322ef5d0 con 0x55d632598170 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.210+0000 7f406dd18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d632598590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.210+0000 7f406dd18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d632598590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57152/0 (socket says 172.21.15.133:57152) 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.210+0000 7f406dd18640 1 -- 172.21.15.133:0/637586748 learned_addr learned my addr 172.21.15.133:0/637586748 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.210+0000 7f406dd18640 1 -- 172.21.15.133:0/637586748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d632598b60 con 0x55d632598170 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.210+0000 7f406dd18640 1 --2- 172.21.15.133:0/637586748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d632598590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4064052460 tx=0x7f406405cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1250315a54e455 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.210+0000 7f3f51ffb640 1 -- 172.21.15.133:0/637586748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4064067390 con 0x55d632598170 2024-02-15T22:56:24.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.210+0000 7f3f51ffb640 1 -- 172.21.15.133:0/637586748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40640674f0 con 0x55d632598170 2024-02-15T22:56:24.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.210+0000 7f3f51ffb640 1 -- 172.21.15.133:0/637586748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4064071cc0 con 0x55d632598170 2024-02-15T22:56:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.210+0000 7f4070a13800 1 -- 172.21.15.133:0/637586748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 msgr2=0x55d632598590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.210+0000 7f4070a13800 1 --2- 172.21.15.133:0/637586748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d632598590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4064052460 tx=0x7f406405cf80 comp rx=0 tx=0).stop 2024-02-15T22:56:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f4070a13800 1 -- 172.21.15.133:0/637586748 shutdown_connections 2024-02-15T22:56:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f4070a13800 1 --2- 172.21.15.133:0/637586748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d632598590 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f4070a13800 1 -- 172.21.15.133:0/637586748 >> 172.21.15.133:0/637586748 conn(0x55d632594490 msgr2=0x55d6325924f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f4070a13800 1 -- 172.21.15.133:0/637586748 shutdown_connections 2024-02-15T22:56:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f4070a13800 1 -- 172.21.15.133:0/637586748 wait complete. 2024-02-15T22:56:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f4070a13800 1 Processor -- start 2024-02-15T22:56:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f4070a13800 1 -- start start 2024-02-15T22:56:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f4070a13800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d63259f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f4070a13800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d63259f750 con 0x55d632598170 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f406dd18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d63259f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f406dd18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d63259f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57162/0 (socket says 172.21.15.133:57162) 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.211+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 learned_addr learned my addr 172.21.15.133:0/3470744870 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.212+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d63258c610 con 0x55d632598170 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.212+0000 7f406dd18640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d63259f210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4064052460 tx=0x7f406407e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.212+0000 7f3f3ffff640 1 -- 172.21.15.133:0/3470744870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f406408c040 con 0x55d632598170 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.212+0000 7f3f3ffff640 1 -- 172.21.15.133:0/3470744870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406408f890 con 0x55d632598170 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.212+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d63259f950 con 0x55d632598170 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.212+0000 7f3f3ffff640 1 -- 172.21.15.133:0/3470744870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f406408fb30 con 0x55d632598170 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.212+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d63259f950 con 0x55d632598170 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.213+0000 7f3f3ffff640 1 -- 172.21.15.133:0/3470744870 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f406408fc90 con 0x55d632598170 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.213+0000 7f3f3ffff640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f38036790 0x7f3f38038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.213+0000 7f3f3ffff640 1 -- 172.21.15.133:0/3470744870 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4064099b00 con 0x55d632598170 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.213+0000 7f406ed1a640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f38036790 0x7f3f38038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.213+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.213+0000 7f4070a13800 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d6325aab90 0x55d6325ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.213+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325ad7a0 con 0x55d6325aab90 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.213+0000 7f406e519640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d6325aab90 0x55d6325ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.213+0000 7f406e519640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d6325aab90 0x55d6325ad050 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.213+0000 7f406ed1a640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f38036790 0x7f3f38038c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f406800b010 tx=0x7f4068020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 20 realm 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325adb70 con 0x55d6325aab90 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325ae3f0 con 0x55d6325aab90 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325ae750 con 0x55d6325aab90 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325ae050 con 0x55d6325aab90 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 20 searching for the correct realm 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55d6325b0ad0 0x55d6325b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.214+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325b0ad0 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.215+0000 7f406dd18640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55d6325b0ad0 0x55d6325b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.215+0000 7f406dd18640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55d6325b0ad0 0x55d6325b2ec0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.215+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406406e020 con 0x55d6325b0ad0 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.215+0000 7f406dd18640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4064098070 0x7f406408c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.215+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f4064098070 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.215+0000 7f406ed1a640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4064098070 0x7f406408c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.216+0000 7f406ed1a640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4064098070 0x7f406408c600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.216+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406800a4a0 con 0x7f4064098070 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.216+0000 7f406ed1a640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f40680141d0 0x7f4068015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.216+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f40680141d0 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.216+0000 7f406e519640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f40680141d0 0x7f4068015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.216+0000 7f406e519640 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f40680141d0 0x7f4068015940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.217+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060016070 con 0x7f40680141d0 2024-02-15T22:56:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.217+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325aab90 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.217+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.217+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325aab90 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.217+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.217+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f40680141d0 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.217+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060016070 con 0x7f40680141d0 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.217+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f40680141d0 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.217+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060016070 con 0x7f40680141d0 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.218+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f4064098070 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.218+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406800a4a0 con 0x7f4064098070 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.218+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325b0ad0 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.218+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406406e020 con 0x55d6325b0ad0 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.218+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325aab90 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.218+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.218+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f40680141d0 2024-02-15T22:56:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.218+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060016070 con 0x7f40680141d0 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.219+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325aab90 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.219+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.219+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f4064098070 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.219+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f406803a040 con 0x7f4064098070 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.219+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325b0ad0 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.219+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.219+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325b0ad0 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.219+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.219+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f40680141d0 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.220+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060016070 con 0x7f40680141d0 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.220+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325b0ad0 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.220+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.220+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325b0ad0 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.220+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.220+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325aab90 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.220+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.220+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325aab90 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.220+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.221+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f40680141d0 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.221+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060016070 con 0x7f40680141d0 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.221+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325b0ad0 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.221+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.221+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f4064098070 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.221+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406803a040 con 0x7f4064098070 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.221+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325aab90 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.222+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4060016070 con 0x55d6325aab90 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.222+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f40680141d0 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.222+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.222+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325b0ad0 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.222+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.222+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f40680141d0 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.222+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.222+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f4064098070 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.223+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406803a040 con 0x7f4064098070 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.223+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325b0ad0 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.223+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.223+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f40680141d0 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x55d6325aab90 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b3570 con 0x7f4064098070 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406803a040 con 0x7f4064098070 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f4070a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:24.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f4070a13800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f4070a13800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f4070a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f4070a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f4070a13800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325af570 con 0x55d6325aab90 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f4070a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325af1f0 con 0x55d6325aab90 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.224+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325afe40 con 0x55d6325aab90 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 20 zone default found 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 4 Realm: () 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 20 zonegroup default 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325afe40 con 0x7f40680141d0 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.225+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.226+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b53c0 con 0x55d6325b0ad0 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.226+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.226+0000 7f4070a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.226+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.226+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b5720 con 0x55d6325b0ad0 2024-02-15T22:56:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.226+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.226+0000 7f4070a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.226+0000 7f4070a13800 20 started sync module instance, tier type = 2024-02-15T22:56:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.226+0000 7f4070a13800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.226+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b4ca0 con 0x7f4064098070 2024-02-15T22:56:24.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.227+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f406803a040 con 0x7f4064098070 2024-02-15T22:56:24.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.227+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94378456205312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b4c20 con 0x7f4064098070 2024-02-15T22:56:24.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.227+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b6430 con 0x55d6325aab90 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.228+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94378456205312] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f406803a040 con 0x7f4064098070 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.228+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.228+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94378456210160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b63b0 con 0x55d6325aab90 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.228+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b6da0 con 0x55d6325b0ad0 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.229+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94378456210160] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.229+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.230+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94378456211216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b6330 con 0x55d6325b0ad0 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.230+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b7c00 con 0x7f4064098070 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.231+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94378456211216] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.231+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f406803a040 con 0x7f4064098070 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.231+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94378456217440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b8020 con 0x7f4064098070 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.231+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b8990 con 0x55d6325aab90 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.232+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.232+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94378456220912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b8950 con 0x55d6325aab90 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.232+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b9910 con 0x7f40680141d0 2024-02-15T22:56:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.232+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94378456217440] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f406803a040 con 0x7f4064098070 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.233+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94378456220912] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.233+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.233+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94378456224816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b8b30 con 0x7f40680141d0 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.233+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325ba160 con 0x7f40680141d0 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.234+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94378456224816] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.234+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.234+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94378456218496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b9db0 con 0x7f40680141d0 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.234+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325ba760 con 0x7f40680141d0 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.235+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94378456218496] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.235+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.235+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94378456228480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325ba940 con 0x7f40680141d0 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.235+0000 7f4070a13800 20 add_watcher() i=0 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.235+0000 7f4070a13800 20 add_watcher() i=1 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.235+0000 7f4070a13800 20 add_watcher() i=2 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.235+0000 7f4070a13800 20 add_watcher() i=3 2024-02-15T22:56:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.235+0000 7f4070a13800 20 add_watcher() i=4 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.235+0000 7f4070a13800 20 add_watcher() i=5 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.235+0000 7f4070a13800 20 add_watcher() i=6 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.236+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94378456228480] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.236+0000 7f4070a13800 20 add_watcher() i=7 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.236+0000 7f4070a13800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.236+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325bdd00 con 0x55d6325aab90 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.236+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.236+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94378456229936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325bb200 con 0x55d6325aab90 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.237+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94378456229936] v30'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.237+0000 7f3f24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.237+0000 7f4070a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.237+0000 7f4070a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.237+0000 7f4070a13800 5 note: GC not initialized 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.238+0000 7f3e9f7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.238+0000 7f4070a13800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:24.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.238+0000 7f4070a13800 20 Filter name: none 2024-02-15T22:56:24.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.238+0000 7f3e9d7fa640 20 reqs_thread_entry: start 2024-02-15T22:56:24.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.238+0000 7f4070a13800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.238+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325ef8c0 con 0x55d6325aab90 2024-02-15T22:56:24.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.238+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.238+0000 7f4070a13800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:24.248 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:24.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.239+0000 7f3f24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.239+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94378456229936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325bd630 con 0x55d6325aab90 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.241+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94378456229936] v30'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.241+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94378456205312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325ba830 con 0x7f4064098070 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.242+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94378456205312] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f406803a040 con 0x7f4064098070 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.242+0000 7f4070a13800 20 remove_watcher() i=0 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.242+0000 7f4070a13800 2 removed watcher, disabling cache 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.242+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94378456210160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b4800 con 0x55d6325aab90 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.243+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94378456210160] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.243+0000 7f4070a13800 20 remove_watcher() i=1 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.243+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94378456211216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b4800 con 0x55d6325b0ad0 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.244+0000 7f406dd18640 1 -- 172.21.15.133:0/3470744870 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94378456211216] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40640ab040 con 0x55d6325b0ad0 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.244+0000 7f4070a13800 20 remove_watcher() i=2 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.244+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94378456217440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b5f90 con 0x7f4064098070 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.245+0000 7f406ed1a640 1 -- 172.21.15.133:0/3470744870 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94378456217440] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f406803a040 con 0x7f4064098070 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.245+0000 7f4070a13800 20 remove_watcher() i=3 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.245+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94378456220912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b5f90 con 0x55d6325aab90 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.246+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94378456220912] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x55d6325aab90 2024-02-15T22:56:24.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.246+0000 7f4070a13800 20 remove_watcher() i=4 2024-02-15T22:56:24.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.246+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94378456224816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b5f90 con 0x7f40680141d0 2024-02-15T22:56:24.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.247+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94378456224816] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.247+0000 7f4070a13800 20 remove_watcher() i=5 2024-02-15T22:56:24.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.247+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94378456218496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b5f90 con 0x7f40680141d0 2024-02-15T22:56:24.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.248+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94378456218496] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.248+0000 7f4070a13800 20 remove_watcher() i=6 2024-02-15T22:56:24.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.248+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94378456228480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d6325b5f90 con 0x7f40680141d0 2024-02-15T22:56:24.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94378456228480] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4060054040 con 0x7f40680141d0 2024-02-15T22:56:24.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 20 remove_watcher() i=7 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f40680141d0 msgr2=0x7f4068015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f40680141d0 0x7f4068015940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d6325aab90 msgr2=0x55d6325ad050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d6325aab90 0x55d6325ad050 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4064098070 msgr2=0x7f406408c600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4064098070 0x7f406408c600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55d6325b0ad0 msgr2=0x55d6325b2ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55d6325b0ad0 0x55d6325b2ec0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f38036790 msgr2=0x7f3f38038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f38036790 0x7f3f38038c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f406800b010 tx=0x7f4068020000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 msgr2=0x55d63259f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f406e519640 1 -- 172.21.15.133:0/3470744870 reap_dead start 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d63259f210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4064052460 tx=0x7f406407e000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 shutdown_connections 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 --2- 172.21.15.133:0/3470744870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d632598170 0x55d63259f210 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 >> 172.21.15.133:0/3470744870 conn(0x55d632594490 msgr2=0x55d632591af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 shutdown_connections 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/3470744870 wait complete. 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/4211342508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f480367e0 msgr2=0x7f3f48038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 --2- 172.21.15.133:0/4211342508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f480367e0 0x7f3f48038ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55d63257b200 tx=0x7f4068005840 comp rx=0 tx=0).stop 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/4211342508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63258afd0 msgr2=0x55d63258b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 --2- 172.21.15.133:0/4211342508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63258afd0 0x55d63258b3f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4064000c00 tx=0x7f4064002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 -- 172.21.15.133:0/4211342508 shutdown_connections 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 --2- 172.21.15.133:0/4211342508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f480367e0 0x7f3f48038ca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.249+0000 7f4070a13800 1 --2- 172.21.15.133:0/4211342508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63258afd0 0x55d63258b3f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 -- 172.21.15.133:0/4211342508 >> 172.21.15.133:0/4211342508 conn(0x55d63257f070 msgr2=0x55d63257f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 -- 172.21.15.133:0/4211342508 shutdown_connections 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 -- 172.21.15.133:0/4211342508 wait complete. 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d63247f300 msgr2=0x55d63257a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d63247f300 0x55d63257a2c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f540367e0 msgr2=0x7f3f54038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f540367e0 0x7f3f54038ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4064054000 tx=0x7f406404e000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 msgr2=0x55d632573560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d632573560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55d6323ee560 tx=0x7f4060000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 shutdown_connections 2024-02-15T22:56:24.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d63247f300 0x55d63257a2c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3f540367e0 0x7f3f54038ca0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 --2- 172.21.15.133:0/742494828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d63247ae70 0x55d632573560 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 >> 172.21.15.133:0/742494828 conn(0x55d6324764d0 msgr2=0x55d632564e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 shutdown_connections 2024-02-15T22:56:24.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.250+0000 7f4070a13800 1 -- 172.21.15.133:0/742494828 wait complete. 2024-02-15T22:56:24.261 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:24.261 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-15T22:56:24.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-15T22:56:24.261 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-15T22:56:24.343 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:24.344 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.342+0000 7fdb46b2d800 1 Processor -- start 2024-02-15T22:56:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.342+0000 7fdb46b2d800 1 -- start start 2024-02-15T22:56:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.342+0000 7fdb46b2d800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557ab72fba00 0x557ab72fddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.342+0000 7fdb46b2d800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557ab7245bb0 con 0x557ab72fe330 2024-02-15T22:56:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.342+0000 7fdb46b2d800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x557ab71fd450 con 0x557ab72fba00 2024-02-15T22:56:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.342+0000 7fdb4277d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557ab72fba00 0x557ab72fddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.342+0000 7fdb41f7c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x557ab72fe330 0x557ab7300720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44826/0 (socket says 172.21.15.133:44826) 2024-02-15T22:56:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.342+0000 7fdb4277d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557ab72fba00 0x557ab72fddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57172/0 (socket says 172.21.15.133:57172) 2024-02-15T22:56:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.342+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2691190905 learned_addr learned my addr 172.21.15.133:0/2691190905 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.343+0000 7fdb4277d640 1 -- 172.21.15.133:0/2691190905 >> v1:172.21.15.52:6789/0 conn(0x557ab72fe330 legacy=0x557ab7300720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.343+0000 7fdb4277d640 1 -- 172.21.15.133:0/2691190905 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ab7302e50 con 0x557ab72fba00 2024-02-15T22:56:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.344+0000 7fdb4277d640 1 --2- 172.21.15.133:0/2691190905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab72fddf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00a470 tx=0x7fdb3c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80102d994c3df7c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.344+0000 7fdb4177b640 1 -- 172.21.15.133:0/2691190905 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c052570 con 0x557ab72fba00 2024-02-15T22:56:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.344+0000 7fdb4177b640 1 -- 172.21.15.133:0/2691190905 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c0526d0 con 0x557ab72fba00 2024-02-15T22:56:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.345+0000 7fdb4177b640 1 -- 172.21.15.133:0/2691190905 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c052990 con 0x557ab72fba00 2024-02-15T22:56:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.345+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2691190905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 msgr2=0x557ab72fddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.345+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2691190905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab72fddf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00a470 tx=0x7fdb3c01cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.345+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2691190905 shutdown_connections 2024-02-15T22:56:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.345+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2691190905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab72fddf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.345+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2691190905 >> 172.21.15.133:0/2691190905 conn(0x557ab72f54d0 msgr2=0x557ab72f78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.345+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2691190905 shutdown_connections 2024-02-15T22:56:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.345+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2691190905 wait complete. 2024-02-15T22:56:24.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.356+0000 7fdb46b2d800 1 Processor -- start 2024-02-15T22:56:24.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.357+0000 7fdb46b2d800 1 -- start start 2024-02-15T22:56:24.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.357+0000 7fdb46b2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab72fb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.357+0000 7fdb46b2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab71fa980 con 0x557ab72fba00 2024-02-15T22:56:24.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.357+0000 7fdb4277d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab72fb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.357+0000 7fdb4277d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab72fb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57178/0 (socket says 172.21.15.133:57178) 2024-02-15T22:56:24.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.357+0000 7fdb4277d640 1 -- 172.21.15.133:0/3173837318 learned_addr learned my addr 172.21.15.133:0/3173837318 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.357+0000 7fdb4277d640 1 -- 172.21.15.133:0/3173837318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c005d20 con 0x557ab72fba00 2024-02-15T22:56:24.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.358+0000 7fdb4277d640 1 --2- 172.21.15.133:0/3173837318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab72fb340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c055040 tx=0x7fdb3c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4542c96f326354ba server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.358+0000 7fda30608640 1 -- 172.21.15.133:0/3173837318 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c00a180 con 0x557ab72fba00 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.358+0000 7fda30608640 1 -- 172.21.15.133:0/3173837318 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c00a2e0 con 0x557ab72fba00 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.358+0000 7fda30608640 1 -- 172.21.15.133:0/3173837318 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c0529b0 con 0x557ab72fba00 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.358+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3173837318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 msgr2=0x557ab72fb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.358+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/3173837318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab72fb340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c055040 tx=0x7fdb3c04c000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.358+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3173837318 shutdown_connections 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.358+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/3173837318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab72fb340 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.358+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3173837318 >> 172.21.15.133:0/3173837318 conn(0x557ab72f54d0 msgr2=0x557ab73e68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.359+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3173837318 shutdown_connections 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.359+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3173837318 wait complete. 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.359+0000 7fdb46b2d800 1 Processor -- start 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.359+0000 7fdb46b2d800 1 -- start start 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.359+0000 7fdb46b2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab73f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.359+0000 7fdb46b2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab71f6160 con 0x557ab72fba00 2024-02-15T22:56:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.359+0000 7fdb4277d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab73f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.359+0000 7fdb4277d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab73f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57192/0 (socket says 172.21.15.133:57192) 2024-02-15T22:56:24.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.359+0000 7fdb4277d640 1 -- 172.21.15.133:0/2089013856 learned_addr learned my addr 172.21.15.133:0/2089013856 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.359+0000 7fdb4277d640 1 -- 172.21.15.133:0/2089013856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ab7302e50 con 0x557ab72fba00 2024-02-15T22:56:24.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.360+0000 7fdb4277d640 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab73f4780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00a470 tx=0x7fdb3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.360+0000 7fda2ee05640 1 -- 172.21.15.133:0/2089013856 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c06a070 con 0x557ab72fba00 2024-02-15T22:56:24.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.360+0000 7fda2ee05640 1 -- 172.21.15.133:0/2089013856 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c05d420 con 0x557ab72fba00 2024-02-15T22:56:24.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.360+0000 7fda2ee05640 1 -- 172.21.15.133:0/2089013856 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c05d5d0 con 0x557ab72fba00 2024-02-15T22:56:24.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.360+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557ab73f4cc0 con 0x557ab72fba00 2024-02-15T22:56:24.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.360+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ab73f51a0 con 0x557ab72fba00 2024-02-15T22:56:24.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.360+0000 7fda2ee05640 1 -- 172.21.15.133:0/2089013856 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdb3c05d730 con 0x557ab72fba00 2024-02-15T22:56:24.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.361+0000 7fda2ee05640 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda280367e0 0x7fda28038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.361+0000 7fda2ee05640 1 -- 172.21.15.133:0/2089013856 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fdb3c08d9a0 con 0x557ab72fba00 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.361+0000 7fdb41f7c640 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda280367e0 0x7fda28038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.361+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557ab72fe330 0x557ab73fb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.361+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab73fba70 con 0x557ab72fe330 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.361+0000 7fdb42f7e640 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557ab72fe330 0x557ab73fb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.361+0000 7fdb41f7c640 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda280367e0 0x7fda28038ca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c000f60 tx=0x7fdb2c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.361+0000 7fdb42f7e640 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557ab72fe330 0x557ab73fb4a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.362+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2089013856 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdb3400a4a0 con 0x557ab72fe330 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.362+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab73f8b90 con 0x557ab72fe330 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.362+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2089013856 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdb3400a4a0 con 0x557ab72fe330 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.362+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab73fd7d0 con 0x557ab72fe330 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.362+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2089013856 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fdb3400a4a0 con 0x557ab72fe330 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.362+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab73fcae0 con 0x557ab72fe330 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.362+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2089013856 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdb3400a4a0 con 0x557ab72fe330 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.362+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab73fcef0 con 0x557ab72fe330 2024-02-15T22:56:24.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.363+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2089013856 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fdb3400a4a0 con 0x557ab72fe330 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.363+0000 7fdb46b2d800 1 Processor -- start 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.363+0000 7fdb46b2d800 1 -- start start 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.363+0000 7fdb46b2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab740c240 0x557ab740c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.363+0000 7fdb46b2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab7198e80 con 0x557ab740c240 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.363+0000 7fdb41f7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab740c240 0x557ab740c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.363+0000 7fdb41f7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab740c240 0x557ab740c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57206/0 (socket says 172.21.15.133:57206) 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.363+0000 7fdb41f7c640 1 -- 172.21.15.133:0/3143141167 learned_addr learned my addr 172.21.15.133:0/3143141167 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.364+0000 7fdb41f7c640 1 -- 172.21.15.133:0/3143141167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ab740cba0 con 0x557ab740c240 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.364+0000 7fdb41f7c640 1 --2- 172.21.15.133:0/3143141167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab740c240 0x557ab740c660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c001ed0 tx=0x7fdb2c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.364+0000 7fda27fff640 1 -- 172.21.15.133:0/3143141167 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb2c020070 con 0x557ab740c240 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.364+0000 7fda27fff640 1 -- 172.21.15.133:0/3143141167 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c01b550 con 0x557ab740c240 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.364+0000 7fda27fff640 1 -- 172.21.15.133:0/3143141167 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb2c013040 con 0x557ab740c240 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.364+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3143141167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557ab740d610 con 0x557ab740c240 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.364+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3143141167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ab740dad0 con 0x557ab740c240 2024-02-15T22:56:24.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.365+0000 7fda27fff640 1 -- 172.21.15.133:0/3143141167 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdb2c01b7f0 con 0x557ab740c240 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.365+0000 7fda27fff640 1 --2- 172.21.15.133:0/3143141167 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda1c0367e0 0x7fda1c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.365+0000 7fda27fff640 1 -- 172.21.15.133:0/3143141167 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fdb2c04e270 con 0x557ab740c240 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.365+0000 7fdb42f7e640 1 --2- 172.21.15.133:0/3143141167 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda1c0367e0 0x7fda1c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.365+0000 7fdb46b2d800 1 Processor -- start 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.365+0000 7fdb42f7e640 1 --2- 172.21.15.133:0/3143141167 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda1c0367e0 0x7fda1c038ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x557ab73fc520 tx=0x7fdb34005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.365+0000 7fdb46b2d800 1 -- start start 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.366+0000 7fdb46b2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 0x557ab7419960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.366+0000 7fdb46b2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab716e5d0 con 0x557ab7419540 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.366+0000 7fdb41f7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 0x557ab7419960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.366+0000 7fdb41f7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 0x557ab7419960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57214/0 (socket says 172.21.15.133:57214) 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.366+0000 7fdb41f7c640 1 -- 172.21.15.133:0/3520701773 learned_addr learned my addr 172.21.15.133:0/3520701773 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.366+0000 7fdb41f7c640 1 -- 172.21.15.133:0/3520701773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ab7419f30 con 0x557ab7419540 2024-02-15T22:56:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.366+0000 7fdb41f7c640 1 --2- 172.21.15.133:0/3520701773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 0x557ab7419960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c04c750 tx=0x7fdb2c04e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d142ef81bfabe7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.366+0000 7fda25ffb640 1 -- 172.21.15.133:0/3520701773 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb2c024c90 con 0x557ab7419540 2024-02-15T22:56:24.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.366+0000 7fda25ffb640 1 -- 172.21.15.133:0/3520701773 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c040e90 con 0x557ab7419540 2024-02-15T22:56:24.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.366+0000 7fda25ffb640 1 -- 172.21.15.133:0/3520701773 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb2c025410 con 0x557ab7419540 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3520701773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 msgr2=0x557ab7419960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/3520701773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 0x557ab7419960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c04c750 tx=0x7fdb2c04e050 comp rx=0 tx=0).stop 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3520701773 shutdown_connections 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/3520701773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 0x557ab7419960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3520701773 >> 172.21.15.133:0/3520701773 conn(0x557ab74158a0 msgr2=0x557ab7413900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3520701773 shutdown_connections 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3520701773 wait complete. 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb46b2d800 1 Processor -- start 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb46b2d800 1 -- start start 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb46b2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 0x557ab7420510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb46b2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab7420a50 con 0x557ab7419540 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb41f7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 0x557ab7420510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb41f7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 0x557ab7420510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57226/0 (socket says 172.21.15.133:57226) 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.367+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 learned_addr learned my addr 172.21.15.133:0/2686614755 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.368+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ab740dad0 con 0x557ab7419540 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.368+0000 7fdb41f7c640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 0x557ab7420510 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c04c810 tx=0x7fdb2c04c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.368+0000 7fda13fff640 1 -- 172.21.15.133:0/2686614755 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb2c025410 con 0x557ab7419540 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.368+0000 7fda13fff640 1 -- 172.21.15.133:0/2686614755 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c025590 con 0x557ab7419540 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.368+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557ab7420c50 con 0x557ab7419540 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.368+0000 7fda13fff640 1 -- 172.21.15.133:0/2686614755 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb2c01bc80 con 0x557ab7419540 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.368+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ab7420c50 con 0x557ab7419540 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.369+0000 7fda13fff640 1 -- 172.21.15.133:0/2686614755 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdb2c00cc60 con 0x557ab7419540 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.369+0000 7fda13fff640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda0c0367e0 0x7fda0c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.369+0000 7fda13fff640 1 -- 172.21.15.133:0/2686614755 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fdb2c050710 con 0x557ab7419540 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.369+0000 7fdb42f7e640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda0c0367e0 0x7fda0c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.369+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.369+0000 7fdb42f7e640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda0c0367e0 0x7fda0c038ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400b010 tx=0x7fdb34020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.369+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557ab742bf00 0x557ab742e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.369+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab742eb10 con 0x557ab742bf00 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb4277d640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557ab742bf00 0x557ab742e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb4277d640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557ab742bf00 0x557ab742e3c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdb3c059040 con 0x557ab742bf00 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb46b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb46b2d800 20 realm 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab742eee0 con 0x557ab742bf00 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdb3c059040 con 0x557ab742bf00 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb46b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb46b2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab742f760 con 0x557ab742bf00 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdb3c059040 con 0x557ab742bf00 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb46b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.370+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab742fac0 con 0x557ab742bf00 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.371+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdb3c059040 con 0x557ab742bf00 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.371+0000 7fdb46b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.371+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.371+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab74302c0 con 0x557ab742bf00 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.371+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fdb3c07e040 con 0x557ab742bf00 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.371+0000 7fdb46b2d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.371+0000 7fdb46b2d800 20 searching for the correct realm 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.371+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557ab74321e0 0x557ab7434660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.371+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab74321e0 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.371+0000 7fdb41f7c640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557ab74321e0 0x557ab7434660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.371+0000 7fdb41f7c640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557ab74321e0 0x557ab7434660 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.372+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.372+0000 7fdb41f7c640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdb2c037070 0x7fdb2c0509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.372+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb2c037070 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.372+0000 7fdb42f7e640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdb2c037070 0x7fdb2c0509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.372+0000 7fdb42f7e640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdb2c037070 0x7fdb2c0509b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.372+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3400a4a0 con 0x7fdb2c037070 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.372+0000 7fdb42f7e640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdb340141d0 0x7fdb34015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.372+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb340141d0 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.373+0000 7fdb4277d640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdb340141d0 0x7fdb34015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.373+0000 7fdb4277d640 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdb340141d0 0x7fdb34015940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.373+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x7fdb340141d0 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.373+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab742bf00 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.374+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x557ab742bf00 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.374+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab742bf00 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.374+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x557ab742bf00 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.374+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb340141d0 2024-02-15T22:56:24.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.374+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x7fdb340141d0 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.374+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb340141d0 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.374+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x7fdb340141d0 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.374+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb2c037070 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.375+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3400a4a0 con 0x7fdb2c037070 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.375+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab74321e0 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.375+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.375+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab742bf00 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.375+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x557ab742bf00 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.375+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb340141d0 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.376+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x7fdb340141d0 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.376+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab742bf00 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.376+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x557ab742bf00 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.376+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb2c037070 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.376+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fdb3403a040 con 0x7fdb2c037070 2024-02-15T22:56:24.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.376+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab74321e0 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.376+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.376+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab74321e0 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.376+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.376+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb340141d0 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.377+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x7fdb340141d0 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.377+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab74321e0 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.377+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.377+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab74321e0 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.377+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.377+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab742bf00 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.377+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x557ab742bf00 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.378+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab742bf00 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.378+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fdb3c07e040 con 0x557ab742bf00 2024-02-15T22:56:24.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.378+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb340141d0 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.378+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x7fdb340141d0 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.378+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab74321e0 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.378+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.378+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb2c037070 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.378+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3403a040 con 0x7fdb2c037070 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.378+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab742bf00 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.379+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdb3c07e040 con 0x557ab742bf00 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.379+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb340141d0 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.379+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x7fdb340141d0 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.379+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab74321e0 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.379+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.379+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb340141d0 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.379+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c07e040 con 0x7fdb340141d0 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.380+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb2c037070 2024-02-15T22:56:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.380+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3403a040 con 0x7fdb2c037070 2024-02-15T22:56:24.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.380+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab74321e0 2024-02-15T22:56:24.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.380+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.380+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb340141d0 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3c093040 con 0x7fdb340141d0 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x557ab742bf00 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7434d30 con 0x7fdb2c037070 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb3403a040 con 0x7fdb2c037070 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb46b2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb46b2d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb46b2d800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb46b2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb46b2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb46b2d800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab74317f0 con 0x557ab742bf00 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb46b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.381+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7431010 con 0x557ab742bf00 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7435170 con 0x557ab742bf00 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 20 zone default found 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 4 Realm: () 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 20 zonegroup default 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab74354d0 con 0x7fdb340141d0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x7fdb340141d0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7437260 con 0x557ab74321e0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.382+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.383+0000 7fdb46b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.383+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.383+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab74375c0 con 0x557ab74321e0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.383+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.383+0000 7fdb46b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.383+0000 7fdb46b2d800 20 started sync module instance, tier type = 2024-02-15T22:56:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.383+0000 7fdb46b2d800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.383+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7436b40 con 0x7fdb2c037070 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.384+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3403a040 con 0x7fdb2c037070 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.384+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93985549018784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7436ac0 con 0x7fdb2c037070 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.384+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab74382f0 con 0x557ab742bf00 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.385+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93985549018784] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3403a040 con 0x7fdb2c037070 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.385+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.385+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93985549023664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7438270 con 0x557ab742bf00 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.385+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7438c20 con 0x557ab74321e0 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.386+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93985549023664] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.386+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.386+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93985549024720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab74381f0 con 0x557ab74321e0 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.386+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7439a80 con 0x7fdb2c037070 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.387+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3403a040 con 0x7fdb2c037070 2024-02-15T22:56:24.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.387+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93985549031360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743a200 con 0x7fdb2c037070 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.387+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743acd0 con 0x557ab742bf00 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.387+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93985549024720] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.388+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.388+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93985549035440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743ac90 con 0x557ab742bf00 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.388+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743b6e0 con 0x7fdb340141d0 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.388+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93985549031360] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3403a040 con 0x7fdb2c037070 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.389+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x7fdb340141d0 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.389+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93985549038112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743b6e0 con 0x7fdb340141d0 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.389+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743c0d0 con 0x7fdb340141d0 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.389+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93985549035440] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.390+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93985549038112] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x7fdb340141d0 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.390+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x7fdb340141d0 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.391+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93985549032544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743bc30 con 0x7fdb340141d0 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.391+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743c5a0 con 0x7fdb340141d0 2024-02-15T22:56:24.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.391+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93985549032544] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x7fdb340141d0 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.392+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x7fdb340141d0 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.392+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93985549029328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743c5a0 con 0x7fdb340141d0 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.392+0000 7fdb46b2d800 20 add_watcher() i=0 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.392+0000 7fdb46b2d800 20 add_watcher() i=1 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.392+0000 7fdb46b2d800 20 add_watcher() i=2 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.392+0000 7fdb46b2d800 20 add_watcher() i=3 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.392+0000 7fdb46b2d800 20 add_watcher() i=4 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.392+0000 7fdb46b2d800 20 add_watcher() i=5 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.392+0000 7fdb46b2d800 20 add_watcher() i=6 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.392+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93985549029328] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x7fdb340141d0 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.392+0000 7fdb46b2d800 20 add_watcher() i=7 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.393+0000 7fdb46b2d800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.393+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743c5a0 con 0x557ab742bf00 2024-02-15T22:56:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.393+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.393+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93985549044064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743d220 con 0x557ab742bf00 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.394+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93985549044064] v30'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.394+0000 7fd9f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.394+0000 7fdb46b2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.394+0000 7fdb46b2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.394+0000 7fdb46b2d800 5 note: GC not initialized 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.394+0000 7fd9737fe640 20 reqs_thread_entry: start 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.394+0000 7fdb46b2d800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.394+0000 7fdb46b2d800 20 Filter name: none 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fd9717fa640 20 reqs_thread_entry: start 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fdb46b2d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fdb46b2d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7471ae0 con 0x557ab742bf00 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fdb46b2d800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fdb46b2d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fdb46b2d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fdb46b2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7474000 con 0x7fdb2c037070 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fdb3403a040 con 0x7fdb2c037070 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.395+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab74779b0 con 0x557ab742bf00 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.396+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~358] v30'2 uv2 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.396+0000 7fdb46b2d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.396+0000 7fdb46b2d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.397+0000 7fdb46b2d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.397+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93985549284560 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab7474870 con 0x557ab742bf00 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.397+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 93985549035440 notify 128849018881 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x557ab73f51a0 con 0x557ab742bf00 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.397+0000 7fda25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 93985549035440 notifier 4306 bl.length()=534 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.397+0000 7fda25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.397+0000 7fda25ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.397+0000 7fda25ffb640 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fda08003e90 con 0x557ab742bf00 2024-02-15T22:56:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.397+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(65 notify.4 [notify cookie 93985549284560 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.397+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.397+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== watch-notify(notify_complete (2) cookie 93985549284560 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557ab73f4cc0 con 0x557ab742bf00 2024-02-15T22:56:24.408 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.398+0000 7fd9f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.398+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93985549044064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743f1b0 con 0x557ab742bf00 2024-02-15T22:56:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.399+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93985549044064] v30'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.399+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93985549018784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743c960 con 0x7fdb2c037070 2024-02-15T22:56:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.400+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93985549018784] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3403a040 con 0x7fdb2c037070 2024-02-15T22:56:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.400+0000 7fdb46b2d800 20 remove_watcher() i=0 2024-02-15T22:56:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.400+0000 7fdb46b2d800 2 removed watcher, disabling cache 2024-02-15T22:56:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.400+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93985549023664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743c960 con 0x557ab742bf00 2024-02-15T22:56:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.401+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93985549023664] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.401+0000 7fdb46b2d800 20 remove_watcher() i=1 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.401+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93985549024720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab74379b0 con 0x557ab74321e0 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.402+0000 7fdb41f7c640 1 -- 172.21.15.133:0/2686614755 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93985549024720] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb2c022070 con 0x557ab74321e0 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.402+0000 7fdb46b2d800 20 remove_watcher() i=2 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.402+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93985549031360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743c960 con 0x7fdb2c037070 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.403+0000 7fdb42f7e640 1 -- 172.21.15.133:0/2686614755 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93985549031360] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3403a040 con 0x7fdb2c037070 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.403+0000 7fdb46b2d800 20 remove_watcher() i=3 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.403+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93985549035440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab74397c0 con 0x557ab742bf00 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.404+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93985549035440] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x557ab742bf00 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.404+0000 7fdb46b2d800 20 remove_watcher() i=4 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.404+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93985549038112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743c960 con 0x7fdb340141d0 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.405+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93985549038112] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x7fdb340141d0 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.405+0000 7fdb46b2d800 20 remove_watcher() i=5 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.405+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93985549032544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743c960 con 0x7fdb340141d0 2024-02-15T22:56:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.406+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93985549032544] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x7fdb340141d0 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.406+0000 7fdb46b2d800 20 remove_watcher() i=6 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.406+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93985549029328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ab743c960 con 0x7fdb340141d0 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93985549029328] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb3c093040 con 0x7fdb340141d0 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 20 remove_watcher() i=7 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdb340141d0 msgr2=0x7fdb34015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdb340141d0 0x7fdb34015940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557ab742bf00 msgr2=0x557ab742e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557ab742bf00 0x557ab742e3c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdb2c037070 msgr2=0x7fdb2c0509b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdb2c037070 0x7fdb2c0509b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557ab74321e0 msgr2=0x557ab7434660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557ab74321e0 0x557ab7434660 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda0c0367e0 msgr2=0x7fda0c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda0c0367e0 0x7fda0c038ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400b010 tx=0x7fdb34020000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 msgr2=0x557ab7420510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2686614755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab7419540 0x557ab7420510 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c04c810 tx=0x7fdb2c04c6e0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 reap_dead start 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb4277d640 1 -- 172.21.15.133:0/2686614755 reap_dead start 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 shutdown_connections 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 >> 172.21.15.133:0/2686614755 conn(0x557ab74158a0 msgr2=0x557ab7412f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 shutdown_connections 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.407+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2686614755 wait complete. 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3143141167 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda1c0367e0 msgr2=0x7fda1c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/3143141167 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda1c0367e0 0x7fda1c038ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x557ab73fc520 tx=0x7fdb34005840 comp rx=0 tx=0).stop 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3143141167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab740c240 msgr2=0x557ab740c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/3143141167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab740c240 0x557ab740c660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c001ed0 tx=0x7fdb2c00d7a0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3143141167 shutdown_connections 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/3143141167 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda1c0367e0 0x7fda1c038ca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/3143141167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab740c240 0x557ab740c660 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3143141167 >> 172.21.15.133:0/3143141167 conn(0x557ab74002e0 msgr2=0x557ab74006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3143141167 shutdown_connections 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/3143141167 wait complete. 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557ab72fe330 msgr2=0x557ab73fb4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557ab72fe330 0x557ab73fb4a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda280367e0 msgr2=0x7fda28038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda280367e0 0x7fda28038ca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c000f60 tx=0x7fdb2c0012b0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 msgr2=0x557ab73f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab73f4780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00a470 tx=0x7fdb3c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 shutdown_connections 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557ab72fe330 0x557ab73fb4a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fda280367e0 0x7fda28038ca0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 --2- 172.21.15.133:0/2089013856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557ab72fba00 0x557ab73f4780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 >> 172.21.15.133:0/2089013856 conn(0x557ab72f54d0 msgr2=0x557ab72f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 shutdown_connections 2024-02-15T22:56:24.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.408+0000 7fdb46b2d800 1 -- 172.21.15.133:0/2089013856 wait complete. 2024-02-15T22:56:24.419 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:24.419 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T22:56:24.419 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T22:56:24.419 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T22:56:24.501 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:24.502 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.500+0000 7f3655739800 1 Processor -- start 2024-02-15T22:56:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.500+0000 7f3655739800 1 -- start start 2024-02-15T22:56:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.500+0000 7f3655739800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5613c98841c0 0x5613c98845e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.500+0000 7f3655739800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5613c97ccbb0 con 0x5613c98853d0 2024-02-15T22:56:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.500+0000 7f3655739800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5613c9784450 con 0x5613c98841c0 2024-02-15T22:56:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.500+0000 7f36514d0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5613c98841c0 0x5613c98845e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.500+0000 7f3650ccf640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5613c98853d0 0x5613c9885850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44832/0 (socket says 172.21.15.133:44832) 2024-02-15T22:56:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.500+0000 7f36514d0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5613c98841c0 0x5613c98845e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57230/0 (socket says 172.21.15.133:57230) 2024-02-15T22:56:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.500+0000 7f3650ccf640 1 -- 172.21.15.133:0/1189533095 learned_addr learned my addr 172.21.15.133:0/1189533095 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.500+0000 7f36514d0640 1 -- 172.21.15.133:0/1189533095 >> v1:172.21.15.52:6789/0 conn(0x5613c98853d0 legacy=0x5613c9885850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.500+0000 7f36514d0640 1 -- 172.21.15.133:0/1189533095 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613c9884cb0 con 0x5613c98841c0 2024-02-15T22:56:24.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.502+0000 7f36514d0640 1 --2- 172.21.15.133:0/1189533095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c98845e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f364c00a470 tx=0x7f364c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a351802c6a28456e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.502+0000 7f364bfff640 1 -- 172.21.15.133:0/1189533095 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f364c052570 con 0x5613c98841c0 2024-02-15T22:56:24.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.502+0000 7f364bfff640 1 -- 172.21.15.133:0/1189533095 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c0526d0 con 0x5613c98841c0 2024-02-15T22:56:24.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.502+0000 7f364bfff640 1 -- 172.21.15.133:0/1189533095 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f364c052990 con 0x5613c98841c0 2024-02-15T22:56:24.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.503+0000 7f3655739800 1 -- 172.21.15.133:0/1189533095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 msgr2=0x5613c98845e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.503+0000 7f3655739800 1 --2- 172.21.15.133:0/1189533095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c98845e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f364c00a470 tx=0x7f364c01cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:24.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.503+0000 7f3655739800 1 -- 172.21.15.133:0/1189533095 shutdown_connections 2024-02-15T22:56:24.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.503+0000 7f3655739800 1 --2- 172.21.15.133:0/1189533095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c98845e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.503+0000 7f3655739800 1 -- 172.21.15.133:0/1189533095 >> 172.21.15.133:0/1189533095 conn(0x5613c987f8e0 msgr2=0x5613c9881cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.503+0000 7f3655739800 1 -- 172.21.15.133:0/1189533095 shutdown_connections 2024-02-15T22:56:24.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.503+0000 7f3655739800 1 -- 172.21.15.133:0/1189533095 wait complete. 2024-02-15T22:56:24.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.514+0000 7f3655739800 1 Processor -- start 2024-02-15T22:56:24.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.514+0000 7f3655739800 1 -- start start 2024-02-15T22:56:24.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.515+0000 7f3655739800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c99745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.515+0000 7f3655739800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c9781980 con 0x5613c98841c0 2024-02-15T22:56:24.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.515+0000 7f36514d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c99745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.515+0000 7f36514d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c99745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57240/0 (socket says 172.21.15.133:57240) 2024-02-15T22:56:24.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.515+0000 7f36514d0640 1 -- 172.21.15.133:0/3765665725 learned_addr learned my addr 172.21.15.133:0/3765665725 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.515+0000 7f36514d0640 1 -- 172.21.15.133:0/3765665725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c005d20 con 0x5613c98841c0 2024-02-15T22:56:24.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.515+0000 7f36514d0640 1 --2- 172.21.15.133:0/3765665725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c99745b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f364c055040 tx=0x7f364c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22dde495a05563d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.516+0000 7f353f606640 1 -- 172.21.15.133:0/3765665725 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f364c00a180 con 0x5613c98841c0 2024-02-15T22:56:24.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.516+0000 7f353f606640 1 -- 172.21.15.133:0/3765665725 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c00a2e0 con 0x5613c98841c0 2024-02-15T22:56:24.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.516+0000 7f353f606640 1 -- 172.21.15.133:0/3765665725 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f364c0529b0 con 0x5613c98841c0 2024-02-15T22:56:24.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.516+0000 7f3655739800 1 -- 172.21.15.133:0/3765665725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 msgr2=0x5613c99745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.516+0000 7f3655739800 1 --2- 172.21.15.133:0/3765665725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c99745b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f364c055040 tx=0x7f364c04c000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.516+0000 7f3655739800 1 -- 172.21.15.133:0/3765665725 shutdown_connections 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.516+0000 7f3655739800 1 --2- 172.21.15.133:0/3765665725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c99745b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.516+0000 7f3655739800 1 -- 172.21.15.133:0/3765665725 >> 172.21.15.133:0/3765665725 conn(0x5613c987f8e0 msgr2=0x5613c996fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.516+0000 7f3655739800 1 -- 172.21.15.133:0/3765665725 shutdown_connections 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.516+0000 7f3655739800 1 -- 172.21.15.133:0/3765665725 wait complete. 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.517+0000 7f3655739800 1 Processor -- start 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.517+0000 7f3655739800 1 -- start start 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.517+0000 7f3655739800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c997bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.517+0000 7f3655739800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c977d160 con 0x5613c98841c0 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.517+0000 7f36514d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c997bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.517+0000 7f36514d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c997bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57256/0 (socket says 172.21.15.133:57256) 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.517+0000 7f36514d0640 1 -- 172.21.15.133:0/800100464 learned_addr learned my addr 172.21.15.133:0/800100464 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.517+0000 7f36514d0640 1 -- 172.21.15.133:0/800100464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c04e070 con 0x5613c98841c0 2024-02-15T22:56:24.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.518+0000 7f36514d0640 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c997bc20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f364c00a470 tx=0x7f364c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.518+0000 7f353de03640 1 -- 172.21.15.133:0/800100464 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f364c06a070 con 0x5613c98841c0 2024-02-15T22:56:24.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.518+0000 7f353de03640 1 -- 172.21.15.133:0/800100464 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c052cc0 con 0x5613c98841c0 2024-02-15T22:56:24.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.518+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613c997c160 con 0x5613c98841c0 2024-02-15T22:56:24.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.518+0000 7f353de03640 1 -- 172.21.15.133:0/800100464 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f364c05d420 con 0x5613c98841c0 2024-02-15T22:56:24.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.518+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613c997c640 con 0x5613c98841c0 2024-02-15T22:56:24.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.518+0000 7f353de03640 1 -- 172.21.15.133:0/800100464 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f364c05d580 con 0x5613c98841c0 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.519+0000 7f353de03640 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35380367e0 0x7f3538038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.519+0000 7f353de03640 1 -- 172.21.15.133:0/800100464 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f364c08d520 con 0x5613c98841c0 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.519+0000 7f3650ccf640 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35380367e0 0x7f3538038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.519+0000 7f3655739800 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5613c98853d0 0x5613c99828e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.519+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c9982e20 con 0x5613c98853d0 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.519+0000 7f3651cd1640 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5613c98853d0 0x5613c99828e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.519+0000 7f3650ccf640 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35380367e0 0x7f3538038ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f363c000f60 tx=0x7f363c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.519+0000 7f3651cd1640 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5613c98853d0 0x5613c99828e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.519+0000 7f3651cd1640 1 -- 172.21.15.133:0/800100464 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f364400a4a0 con 0x5613c98853d0 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.519+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c9983200 con 0x5613c98853d0 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.520+0000 7f3651cd1640 1 -- 172.21.15.133:0/800100464 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f364400a4a0 con 0x5613c98853d0 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.520+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c9984ab0 con 0x5613c98853d0 2024-02-15T22:56:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.520+0000 7f3651cd1640 1 -- 172.21.15.133:0/800100464 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f364400a4a0 con 0x5613c98853d0 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.520+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c9983d00 con 0x5613c98853d0 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.520+0000 7f3651cd1640 1 -- 172.21.15.133:0/800100464 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f364400a4a0 con 0x5613c98853d0 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.520+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c9984110 con 0x5613c98853d0 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.521+0000 7f3651cd1640 1 -- 172.21.15.133:0/800100464 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f364400a4a0 con 0x5613c98853d0 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.521+0000 7f3655739800 1 Processor -- start 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.521+0000 7f3655739800 1 -- start start 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.521+0000 7f3655739800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99934d0 0x5613c99938f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.521+0000 7f3655739800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c971fe80 con 0x5613c99934d0 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.521+0000 7f3650ccf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99934d0 0x5613c99938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.521+0000 7f3650ccf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99934d0 0x5613c99938f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57264/0 (socket says 172.21.15.133:57264) 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.521+0000 7f3650ccf640 1 -- 172.21.15.133:0/811544678 learned_addr learned my addr 172.21.15.133:0/811544678 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.522+0000 7f3650ccf640 1 -- 172.21.15.133:0/811544678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613c9993e30 con 0x5613c99934d0 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.522+0000 7f3650ccf640 1 --2- 172.21.15.133:0/811544678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99934d0 0x5613c99938f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f363c001ed0 tx=0x7f363c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.522+0000 7f3536ffd640 1 -- 172.21.15.133:0/811544678 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c020070 con 0x5613c99934d0 2024-02-15T22:56:24.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.522+0000 7f3536ffd640 1 -- 172.21.15.133:0/811544678 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c01b550 con 0x5613c99934d0 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.522+0000 7f3655739800 1 -- 172.21.15.133:0/811544678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613c99948a0 con 0x5613c99934d0 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.522+0000 7f3536ffd640 1 -- 172.21.15.133:0/811544678 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c013040 con 0x5613c99934d0 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.522+0000 7f3655739800 1 -- 172.21.15.133:0/811544678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613c9994d60 con 0x5613c99934d0 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.523+0000 7f3536ffd640 1 -- 172.21.15.133:0/811544678 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f363c01b7f0 con 0x5613c99934d0 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.523+0000 7f3536ffd640 1 --2- 172.21.15.133:0/811544678 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35280368a0 0x7f3528038d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.523+0000 7f3536ffd640 1 -- 172.21.15.133:0/811544678 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f363c04e270 con 0x5613c99934d0 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.523+0000 7f3651cd1640 1 --2- 172.21.15.133:0/811544678 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35280368a0 0x7f3528038d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.523+0000 7f3655739800 1 Processor -- start 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.523+0000 7f3655739800 1 -- start start 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.523+0000 7f3651cd1640 1 --2- 172.21.15.133:0/811544678 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35280368a0 0x7f3528038d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5613c9983740 tx=0x7f3644005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.523+0000 7f3655739800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.523+0000 7f3655739800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c96f55d0 con 0x5613c99a07d0 2024-02-15T22:56:24.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.524+0000 7f3650ccf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.524+0000 7f3650ccf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57274/0 (socket says 172.21.15.133:57274) 2024-02-15T22:56:24.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.524+0000 7f3650ccf640 1 -- 172.21.15.133:0/2448666453 learned_addr learned my addr 172.21.15.133:0/2448666453 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.524+0000 7f3650ccf640 1 -- 172.21.15.133:0/2448666453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613c99a11c0 con 0x5613c99a07d0 2024-02-15T22:56:24.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.524+0000 7f3650ccf640 1 --2- 172.21.15.133:0/2448666453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a0bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f363c04c750 tx=0x7f363c04e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8495b520ef2ca0c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.524+0000 7f3534ff9640 1 -- 172.21.15.133:0/2448666453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c024c90 con 0x5613c99a07d0 2024-02-15T22:56:24.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.524+0000 7f3534ff9640 1 -- 172.21.15.133:0/2448666453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c040e90 con 0x5613c99a07d0 2024-02-15T22:56:24.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.524+0000 7f3534ff9640 1 -- 172.21.15.133:0/2448666453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c025410 con 0x5613c99a07d0 2024-02-15T22:56:24.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3655739800 1 -- 172.21.15.133:0/2448666453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 msgr2=0x5613c99a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3655739800 1 --2- 172.21.15.133:0/2448666453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a0bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f363c04c750 tx=0x7f363c04e050 comp rx=0 tx=0).stop 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3655739800 1 -- 172.21.15.133:0/2448666453 shutdown_connections 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3655739800 1 --2- 172.21.15.133:0/2448666453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a0bf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3655739800 1 -- 172.21.15.133:0/2448666453 >> 172.21.15.133:0/2448666453 conn(0x5613c999cb30 msgr2=0x5613c999ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3655739800 1 -- 172.21.15.133:0/2448666453 shutdown_connections 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3655739800 1 -- 172.21.15.133:0/2448666453 wait complete. 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3655739800 1 Processor -- start 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3655739800 1 -- start start 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3655739800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3655739800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c99a7cd0 con 0x5613c99a07d0 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3650ccf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3650ccf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57278/0 (socket says 172.21.15.133:57278) 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 learned_addr learned my addr 172.21.15.133:0/2458466983 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.525+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613c9994d60 con 0x5613c99a07d0 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.526+0000 7f3650ccf640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a7790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f363c04c810 tx=0x7f363c04c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.526+0000 7f3526ffd640 1 -- 172.21.15.133:0/2458466983 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c025410 con 0x5613c99a07d0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.526+0000 7f3526ffd640 1 -- 172.21.15.133:0/2458466983 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c025590 con 0x5613c99a07d0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.526+0000 7f3526ffd640 1 -- 172.21.15.133:0/2458466983 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363c01bc80 con 0x5613c99a07d0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.526+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613c99a7ed0 con 0x5613c99a07d0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.526+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613c99a7ed0 con 0x5613c99a07d0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.526+0000 7f3526ffd640 1 -- 172.21.15.133:0/2458466983 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f363c00cc60 con 0x5613c99a07d0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.527+0000 7f3526ffd640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f351c0367e0 0x7f351c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.527+0000 7f3526ffd640 1 -- 172.21.15.133:0/2458466983 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f363c050710 con 0x5613c99a07d0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.527+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.527+0000 7f3651cd1640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f351c0367e0 0x7f351c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.527+0000 7f3655739800 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5613c99b3180 0x5613c99b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.527+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99b5d60 con 0x5613c99b3180 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.527+0000 7f36514d0640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5613c99b3180 0x5613c99b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.527+0000 7f3651cd1640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f351c0367e0 0x7f351c038ca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f364400b010 tx=0x7f3644020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.527+0000 7f36514d0640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5613c99b3180 0x5613c99b5610 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f364c059040 con 0x5613c99b3180 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 20 realm 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99b6130 con 0x5613c99b3180 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f364c059040 con 0x5613c99b3180 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99b6980 con 0x5613c99b3180 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f364c059040 con 0x5613c99b3180 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99b6ce0 con 0x5613c99b3180 2024-02-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f364c059040 con 0x5613c99b3180 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99b6620 con 0x5613c99b3180 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f364c07e380 con 0x5613c99b3180 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 20 searching for the correct realm 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5613c99b90a0 0x5613c99bb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.528+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b90a0 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.529+0000 7f3650ccf640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5613c99b90a0 0x5613c99bb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.529+0000 7f3650ccf640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5613c99b90a0 0x5613c99bb490 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.529+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.529+0000 7f3650ccf640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f363c037070 0x7f363c0509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.529+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f363c037070 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.529+0000 7f3651cd1640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f363c037070 0x7f363c0509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.530+0000 7f3651cd1640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f363c037070 0x7f363c0509b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.530+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364400a4a0 con 0x7f363c037070 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.530+0000 7f3651cd1640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f36440141d0 0x7f3644015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.530+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f36440141d0 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.530+0000 7f36514d0640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f36440141d0 0x7f3644015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.530+0000 7f36514d0640 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f36440141d0 0x7f3644015940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.531+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x7f36440141d0 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.531+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b3180 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.531+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x5613c99b3180 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.531+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b3180 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.531+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x5613c99b3180 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.531+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f36440141d0 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.531+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x7f36440141d0 2024-02-15T22:56:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.531+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f36440141d0 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.532+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x7f36440141d0 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.532+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f363c037070 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.532+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364400a4a0 con 0x7f363c037070 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.532+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b90a0 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.532+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.532+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b3180 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.532+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x5613c99b3180 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.532+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f36440141d0 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.533+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x7f36440141d0 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.533+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b3180 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.533+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x5613c99b3180 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.533+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f363c037070 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.533+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f364403a040 con 0x7f363c037070 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.533+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b90a0 2024-02-15T22:56:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.533+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.533+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b90a0 2024-02-15T22:56:24.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.534+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.534+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f36440141d0 2024-02-15T22:56:24.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.534+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x7f36440141d0 2024-02-15T22:56:24.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.534+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b90a0 2024-02-15T22:56:24.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.534+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.534+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b90a0 2024-02-15T22:56:24.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.534+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.534+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b3180 2024-02-15T22:56:24.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.534+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x5613c99b3180 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.534+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b3180 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.535+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f364c07e380 con 0x5613c99b3180 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.535+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f36440141d0 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.535+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x7f36440141d0 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.535+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b90a0 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.535+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.535+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f363c037070 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.535+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364403a040 con 0x7f363c037070 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.535+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b3180 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.536+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f364c07e380 con 0x5613c99b3180 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.536+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f36440141d0 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.536+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c07e380 con 0x7f36440141d0 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.536+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b90a0 2024-02-15T22:56:24.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.536+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.536+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f36440141d0 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.536+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.536+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f363c037070 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.537+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364403a040 con 0x7f363c037070 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.537+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b90a0 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.537+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.537+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f36440141d0 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.537+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.537+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x5613c99b3180 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbb10 con 0x7f363c037070 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f364403a040 con 0x7f363c037070 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:24.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99b7bb0 con 0x5613c99b3180 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99b7830 con 0x5613c99b3180 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.538+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99b8540 con 0x5613c99b3180 2024-02-15T22:56:24.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 20 zone default found 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 4 Realm: () 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 20 zonegroup default 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bbf50 con 0x7f36440141d0 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bdce0 con 0x5613c99b90a0 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99be040 con 0x5613c99b90a0 2024-02-15T22:56:24.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.539+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.540+0000 7f3655739800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.540+0000 7f3655739800 20 started sync module instance, tier type = 2024-02-15T22:56:24.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.540+0000 7f3655739800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:24.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.540+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bd5c0 con 0x7f363c037070 2024-02-15T22:56:24.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.541+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364403a040 con 0x7f363c037070 2024-02-15T22:56:24.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.541+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94642986799392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bd970 con 0x7f363c037070 2024-02-15T22:56:24.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.541+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bed50 con 0x5613c99b3180 2024-02-15T22:56:24.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.542+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94642986799392] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364403a040 con 0x7f363c037070 2024-02-15T22:56:24.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.542+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.542+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94642986804240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bee10 con 0x5613c99b3180 2024-02-15T22:56:24.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.542+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bf8e0 con 0x5613c99b90a0 2024-02-15T22:56:24.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.543+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.543+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94642986808256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c0130 con 0x5613c99b90a0 2024-02-15T22:56:24.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.543+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c0bd0 con 0x7f363c037070 2024-02-15T22:56:24.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.543+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94642986804240] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.544+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94642986808256] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.544+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364403a040 con 0x7f363c037070 2024-02-15T22:56:24.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.544+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94642986810512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99be870 con 0x7f363c037070 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.544+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c1590 con 0x5613c99b3180 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.545+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94642986810512] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364403a040 con 0x7f363c037070 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.545+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.545+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94642986813104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c1590 con 0x5613c99b3180 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.545+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c1f00 con 0x7f36440141d0 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.546+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.546+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94642986818144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c1e80 con 0x7f36440141d0 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.546+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c2e00 con 0x7f36440141d0 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.546+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94642986813104] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.547+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94642986818144] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.547+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.547+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94642986815728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c2260 con 0x7f36440141d0 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.547+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c3410 con 0x7f36440141d0 2024-02-15T22:56:24.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.548+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94642986815728] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.548+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.548+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94642986821872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c3410 con 0x7f36440141d0 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.548+0000 7f3655739800 20 add_watcher() i=0 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.548+0000 7f3655739800 20 add_watcher() i=1 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.548+0000 7f3655739800 20 add_watcher() i=2 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.548+0000 7f3655739800 20 add_watcher() i=3 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.548+0000 7f3655739800 20 add_watcher() i=4 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.548+0000 7f3655739800 20 add_watcher() i=5 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.548+0000 7f3655739800 20 add_watcher() i=6 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.549+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94642986821872] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.549+0000 7f3655739800 20 add_watcher() i=7 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.549+0000 7f3655739800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.549+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c67a0 con 0x5613c99b3180 2024-02-15T22:56:24.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.549+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.549+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94642986836592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c3580 con 0x5613c99b3180 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.550+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94642986836592] v30'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.550+0000 7f35077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.550+0000 7f3655739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.550+0000 7f3655739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.550+0000 7f3655739800 5 note: GC not initialized 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.551+0000 7f35067e4640 20 reqs_thread_entry: start 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.551+0000 7f3655739800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.551+0000 7f3655739800 20 Filter name: none 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.551+0000 7f3477fff640 20 reqs_thread_entry: start 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.551+0000 7f3655739800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.551+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99f8270 con 0x5613c99b3180 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.551+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.551+0000 7f3655739800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:24.565 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:24.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.552+0000 7f35077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.552+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94642986836592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c56d0 con 0x5613c99b3180 2024-02-15T22:56:24.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.553+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94642986836592] v30'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.553+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94642986799392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c6270 con 0x7f363c037070 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.554+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94642986799392] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364403a040 con 0x7f363c037070 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.554+0000 7f3655739800 20 remove_watcher() i=0 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.554+0000 7f3655739800 2 removed watcher, disabling cache 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.554+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94642986804240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bd120 con 0x5613c99b3180 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.555+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94642986804240] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.555+0000 7f3655739800 20 remove_watcher() i=1 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.555+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94642986808256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bd120 con 0x5613c99b90a0 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.556+0000 7f3650ccf640 1 -- 172.21.15.133:0/2458466983 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94642986808256] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f363c022070 con 0x5613c99b90a0 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.556+0000 7f3655739800 20 remove_watcher() i=2 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.556+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94642986810512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bf3c0 con 0x7f363c037070 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.557+0000 7f3651cd1640 1 -- 172.21.15.133:0/2458466983 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94642986810512] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364403a040 con 0x7f363c037070 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.557+0000 7f3655739800 20 remove_watcher() i=3 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.557+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94642986813104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99bfc90 con 0x5613c99b3180 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.558+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94642986813104] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x5613c99b3180 2024-02-15T22:56:24.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.558+0000 7f3655739800 20 remove_watcher() i=4 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.558+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94642986818144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c06b0 con 0x7f36440141d0 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.559+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94642986818144] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.559+0000 7f3655739800 20 remove_watcher() i=5 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.559+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94642986815728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c06b0 con 0x7f36440141d0 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.560+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94642986815728] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.560+0000 7f3655739800 20 remove_watcher() i=6 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.560+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94642986821872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613c99c06b0 con 0x7f36440141d0 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.561+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94642986821872] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f364c09d040 con 0x7f36440141d0 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.561+0000 7f3655739800 20 remove_watcher() i=7 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.561+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f36440141d0 msgr2=0x7f3644015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.561+0000 7f3655739800 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f36440141d0 0x7f3644015940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.561+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5613c99b3180 msgr2=0x5613c99b5610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.561+0000 7f3655739800 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5613c99b3180 0x5613c99b5610 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.561+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f363c037070 msgr2=0x7f363c0509b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.561+0000 7f3655739800 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f363c037070 0x7f363c0509b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.561+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5613c99b90a0 msgr2=0x5613c99bb490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.561+0000 7f3655739800 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5613c99b90a0 0x5613c99bb490 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f351c0367e0 msgr2=0x7f351c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f351c0367e0 0x7f351c038ca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f364400b010 tx=0x7f3644020000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 msgr2=0x5613c99a7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f36514d0640 1 -- 172.21.15.133:0/2458466983 reap_dead start 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a7790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f363c04c810 tx=0x7f363c04c6e0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 shutdown_connections 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 --2- 172.21.15.133:0/2458466983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99a07d0 0x5613c99a7790 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 >> 172.21.15.133:0/2458466983 conn(0x5613c999cb30 msgr2=0x5613c999a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 shutdown_connections 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/2458466983 wait complete. 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/811544678 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35280368a0 msgr2=0x7f3528038d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 --2- 172.21.15.133:0/811544678 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35280368a0 0x7f3528038d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5613c9983740 tx=0x7f3644005840 comp rx=0 tx=0).stop 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/811544678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99934d0 msgr2=0x5613c99938f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 --2- 172.21.15.133:0/811544678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99934d0 0x5613c99938f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f363c001ed0 tx=0x7f363c00d7a0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/811544678 shutdown_connections 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 --2- 172.21.15.133:0/811544678 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35280368a0 0x7f3528038d60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 --2- 172.21.15.133:0/811544678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c99934d0 0x5613c99938f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/811544678 >> 172.21.15.133:0/811544678 conn(0x5613c9987570 msgr2=0x5613c9987970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/811544678 shutdown_connections 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/811544678 wait complete. 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5613c98853d0 msgr2=0x5613c99828e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5613c98853d0 0x5613c99828e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35380367e0 msgr2=0x7f3538038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35380367e0 0x7f3538038ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f363c000f60 tx=0x7f363c0012b0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 msgr2=0x5613c997bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.562+0000 7f3655739800 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c997bc20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f364c00a470 tx=0x7f364c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.563+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 shutdown_connections 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.563+0000 7f3655739800 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5613c98853d0 0x5613c99828e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.563+0000 7f3655739800 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f35380367e0 0x7f3538038ca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.563+0000 7f3655739800 1 --2- 172.21.15.133:0/800100464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613c98841c0 0x5613c997bc20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.563+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 >> 172.21.15.133:0/800100464 conn(0x5613c987f8e0 msgr2=0x5613c9972fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.563+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 shutdown_connections 2024-02-15T22:56:24.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.563+0000 7f3655739800 1 -- 172.21.15.133:0/800100464 wait complete. 2024-02-15T22:56:24.574 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:24.575 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-15T22:56:24.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-15T22:56:24.575 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-15T22:56:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.656+0000 7f05ff818800 1 Processor -- start 2024-02-15T22:56:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.656+0000 7f05ff818800 1 -- start start 2024-02-15T22:56:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.656+0000 7f05ff818800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55ca3faf0120 0x55ca3fb7fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.656+0000 7f05ff818800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ca3fac7bb0 con 0x55ca3fb800b0 2024-02-15T22:56:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.656+0000 7f05ff818800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ca3fa7f450 con 0x55ca3faf0120 2024-02-15T22:56:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.656+0000 7f05fae20640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55ca3faf0120 0x55ca3fb7fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.657+0000 7f05fa61f640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55ca3fb800b0 0x55ca3fb82550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44846/0 (socket says 172.21.15.133:44846) 2024-02-15T22:56:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.657+0000 7f05fa61f640 1 -- 172.21.15.133:0/253146677 learned_addr learned my addr 172.21.15.133:0/253146677 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:24.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.657+0000 7f05fae20640 1 -- 172.21.15.133:0/253146677 >> v1:172.21.15.52:6789/0 conn(0x55ca3fb800b0 legacy=0x55ca3fb82550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.657+0000 7f05f9e1e640 1 -- 172.21.15.133:0/253146677 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640012016 0 0) 0x55ca3fac7bb0 con 0x55ca3fb800b0 2024-02-15T22:56:24.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.657+0000 7f05fae20640 1 -- 172.21.15.133:0/253146677 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca3fb84e10 con 0x55ca3faf0120 2024-02-15T22:56:24.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.659+0000 7f05fae20640 1 --2- 172.21.15.133:0/253146677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fb7fb10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00a470 tx=0x7f05ec01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623718cb959efa50 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.659+0000 7f05f9e1e640 1 -- 172.21.15.133:0/253146677 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05ec052570 con 0x55ca3faf0120 2024-02-15T22:56:24.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.659+0000 7f05f9e1e640 1 -- 172.21.15.133:0/253146677 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec0526d0 con 0x55ca3faf0120 2024-02-15T22:56:24.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.659+0000 7f05f9e1e640 1 -- 172.21.15.133:0/253146677 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05ec052990 con 0x55ca3faf0120 2024-02-15T22:56:24.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.659+0000 7f05ff818800 1 -- 172.21.15.133:0/253146677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 msgr2=0x55ca3fb7fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.659+0000 7f05ff818800 1 --2- 172.21.15.133:0/253146677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fb7fb10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00a470 tx=0x7f05ec01cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.659+0000 7f05ff818800 1 -- 172.21.15.133:0/253146677 shutdown_connections 2024-02-15T22:56:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.659+0000 7f05ff818800 1 --2- 172.21.15.133:0/253146677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fb7fb10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.659+0000 7f05ff818800 1 -- 172.21.15.133:0/253146677 >> 172.21.15.133:0/253146677 conn(0x55ca3fb774d0 msgr2=0x55ca3fb798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.659+0000 7f05ff818800 1 -- 172.21.15.133:0/253146677 shutdown_connections 2024-02-15T22:56:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.659+0000 7f05ff818800 1 -- 172.21.15.133:0/253146677 wait complete. 2024-02-15T22:56:24.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.671+0000 7f05ff818800 1 Processor -- start 2024-02-15T22:56:24.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.671+0000 7f05ff818800 1 -- start start 2024-02-15T22:56:24.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.671+0000 7f05ff818800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fb7d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.671+0000 7f05ff818800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca3fa7c980 con 0x55ca3faf0120 2024-02-15T22:56:24.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.671+0000 7f05fae20640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fb7d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.672+0000 7f05fae20640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fb7d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57284/0 (socket says 172.21.15.133:57284) 2024-02-15T22:56:24.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.672+0000 7f05fae20640 1 -- 172.21.15.133:0/3087412222 learned_addr learned my addr 172.21.15.133:0/3087412222 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.672+0000 7f05fae20640 1 -- 172.21.15.133:0/3087412222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec005d20 con 0x55ca3faf0120 2024-02-15T22:56:24.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.672+0000 7f05fae20640 1 --2- 172.21.15.133:0/3087412222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fb7d440 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f05ec055040 tx=0x7f05ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8801ccaa3c7a23f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.672+0000 7f04e8e09640 1 -- 172.21.15.133:0/3087412222 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05ec00a170 con 0x55ca3faf0120 2024-02-15T22:56:24.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.672+0000 7f04e8e09640 1 -- 172.21.15.133:0/3087412222 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec00a2d0 con 0x55ca3faf0120 2024-02-15T22:56:24.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.672+0000 7f04e8e09640 1 -- 172.21.15.133:0/3087412222 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05ec052990 con 0x55ca3faf0120 2024-02-15T22:56:24.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.673+0000 7f05ff818800 1 -- 172.21.15.133:0/3087412222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 msgr2=0x55ca3fb7d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.673+0000 7f05ff818800 1 --2- 172.21.15.133:0/3087412222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fb7d440 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f05ec055040 tx=0x7f05ec04c000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.673+0000 7f05ff818800 1 -- 172.21.15.133:0/3087412222 shutdown_connections 2024-02-15T22:56:24.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.673+0000 7f05ff818800 1 --2- 172.21.15.133:0/3087412222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fb7d440 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.673+0000 7f05ff818800 1 -- 172.21.15.133:0/3087412222 >> 172.21.15.133:0/3087412222 conn(0x55ca3fb774d0 msgr2=0x55ca3fc686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.673+0000 7f05ff818800 1 -- 172.21.15.133:0/3087412222 shutdown_connections 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.673+0000 7f05ff818800 1 -- 172.21.15.133:0/3087412222 wait complete. 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.673+0000 7f05ff818800 1 Processor -- start 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.673+0000 7f05ff818800 1 -- start start 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.673+0000 7f05ff818800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fc76550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.673+0000 7f05ff818800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca3fa78160 con 0x55ca3faf0120 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.674+0000 7f05fae20640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fc76550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.674+0000 7f05fae20640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fc76550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57288/0 (socket says 172.21.15.133:57288) 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.674+0000 7f05fae20640 1 -- 172.21.15.133:0/3047523305 learned_addr learned my addr 172.21.15.133:0/3047523305 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.674+0000 7f05fae20640 1 -- 172.21.15.133:0/3047523305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca3fb84e10 con 0x55ca3faf0120 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.674+0000 7f05fae20640 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fc76550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f05ec000c00 tx=0x7f05ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.674+0000 7f04e7606640 1 -- 172.21.15.133:0/3047523305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05ec068780 con 0x55ca3faf0120 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.674+0000 7f04e7606640 1 -- 172.21.15.133:0/3047523305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec068900 con 0x55ca3faf0120 2024-02-15T22:56:24.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.674+0000 7f04e7606640 1 -- 172.21.15.133:0/3047523305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05ec068be0 con 0x55ca3faf0120 2024-02-15T22:56:24.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.674+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca3fc76a90 con 0x55ca3faf0120 2024-02-15T22:56:24.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.674+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca3fc76fd0 con 0x55ca3faf0120 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.675+0000 7f04e7606640 1 -- 172.21.15.133:0/3047523305 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f05ec068d40 con 0x55ca3faf0120 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.675+0000 7f04e7606640 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04e00367e0 0x7f04e0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.675+0000 7f04e7606640 1 -- 172.21.15.133:0/3047523305 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f05ec08e030 con 0x55ca3faf0120 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.675+0000 7f05fa61f640 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04e00367e0 0x7f04e0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.676+0000 7f05ff818800 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ca3fb800b0 0x55ca3fc7d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.676+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fc7d8c0 con 0x55ca3fb800b0 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.676+0000 7f05fb621640 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ca3fb800b0 0x55ca3fc7d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.676+0000 7f05fa61f640 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04e00367e0 0x7f04e0038ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f05f0000c00 tx=0x7f05f00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.676+0000 7f05fb621640 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ca3fb800b0 0x55ca3fc7d380 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.676+0000 7f05fb621640 1 -- 172.21.15.133:0/3047523305 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05f400a4a0 con 0x55ca3fb800b0 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.676+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fc7dc90 con 0x55ca3fb800b0 2024-02-15T22:56:24.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.676+0000 7f05fb621640 1 -- 172.21.15.133:0/3047523305 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f05f400a4a0 con 0x55ca3fb800b0 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.677+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fc7f540 con 0x55ca3fb800b0 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.677+0000 7f05fb621640 1 -- 172.21.15.133:0/3047523305 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f05f400a4a0 con 0x55ca3fb800b0 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.677+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fc7e850 con 0x55ca3fb800b0 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.677+0000 7f05fb621640 1 -- 172.21.15.133:0/3047523305 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f05f400a4a0 con 0x55ca3fb800b0 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.677+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fc7ec60 con 0x55ca3fb800b0 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.677+0000 7f05fb621640 1 -- 172.21.15.133:0/3047523305 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f05f400a4a0 con 0x55ca3fb800b0 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.678+0000 7f05ff818800 1 Processor -- start 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.678+0000 7f05ff818800 1 -- start start 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.678+0000 7f05ff818800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc8df60 0x55ca3fc8e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.678+0000 7f05ff818800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca3fa1ae80 con 0x55ca3fc8df60 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.678+0000 7f05fa61f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc8df60 0x55ca3fc8e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.678+0000 7f05fa61f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc8df60 0x55ca3fc8e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57294/0 (socket says 172.21.15.133:57294) 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.678+0000 7f05fa61f640 1 -- 172.21.15.133:0/3659599154 learned_addr learned my addr 172.21.15.133:0/3659599154 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.678+0000 7f05fa61f640 1 -- 172.21.15.133:0/3659599154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca3fc8e8c0 con 0x55ca3fc8df60 2024-02-15T22:56:24.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.678+0000 7f05fa61f640 1 --2- 172.21.15.133:0/3659599154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc8df60 0x55ca3fc8e380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f05f000e610 tx=0x7f05f000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.679+0000 7f04e4e01640 1 -- 172.21.15.133:0/3659599154 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f000bea0 con 0x55ca3fc8df60 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.679+0000 7f04e4e01640 1 -- 172.21.15.133:0/3659599154 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f000d500 con 0x55ca3fc8df60 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.679+0000 7f05ff818800 1 -- 172.21.15.133:0/3659599154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca3fc8f330 con 0x55ca3fc8df60 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.679+0000 7f04e4e01640 1 -- 172.21.15.133:0/3659599154 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f000d7a0 con 0x55ca3fc8df60 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.679+0000 7f05ff818800 1 -- 172.21.15.133:0/3659599154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca3fc8f7f0 con 0x55ca3fc8df60 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.679+0000 7f04e4e01640 1 -- 172.21.15.133:0/3659599154 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f05f001a070 con 0x55ca3fc8df60 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f04e4e01640 1 --2- 172.21.15.133:0/3659599154 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04d4036790 0x7f04d4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f04e4e01640 1 -- 172.21.15.133:0/3659599154 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f05f0017050 con 0x55ca3fc8df60 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f05fb621640 1 --2- 172.21.15.133:0/3659599154 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04d4036790 0x7f04d4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f05ff818800 1 Processor -- start 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f05ff818800 1 -- start start 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f05fb621640 1 --2- 172.21.15.133:0/3659599154 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04d4036790 0x7f04d4038c50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55ca3fc7e290 tx=0x7f05f4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f05ff818800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 0x55ca3fc9b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f05ff818800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca3f9f05d0 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f05fa61f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 0x55ca3fc9b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f05fa61f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 0x55ca3fc9b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57302/0 (socket says 172.21.15.133:57302) 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f05fa61f640 1 -- 172.21.15.133:0/3527555683 learned_addr learned my addr 172.21.15.133:0/3527555683 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.680+0000 7f05fa61f640 1 -- 172.21.15.133:0/3527555683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca3fc9bbc0 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.681+0000 7f05fa61f640 1 --2- 172.21.15.133:0/3527555683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 0x55ca3fc9b5f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f05f0026fd0 tx=0x7f05f000dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3016606159ca754f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.681+0000 7f04de7fc640 1 -- 172.21.15.133:0/3527555683 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f001a530 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.681+0000 7f04de7fc640 1 -- 172.21.15.133:0/3527555683 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f004d070 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.681+0000 7f04de7fc640 1 -- 172.21.15.133:0/3527555683 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f001ac40 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.681+0000 7f05ff818800 1 -- 172.21.15.133:0/3527555683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 msgr2=0x55ca3fc9b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.681+0000 7f05ff818800 1 --2- 172.21.15.133:0/3527555683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 0x55ca3fc9b5f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f05f0026fd0 tx=0x7f05f000dcd0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.681+0000 7f05ff818800 1 -- 172.21.15.133:0/3527555683 shutdown_connections 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.681+0000 7f05ff818800 1 --2- 172.21.15.133:0/3527555683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 0x55ca3fc9b5f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.681+0000 7f05ff818800 1 -- 172.21.15.133:0/3527555683 >> 172.21.15.133:0/3527555683 conn(0x55ca3fc97530 msgr2=0x55ca3fc95590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.681+0000 7f05ff818800 1 -- 172.21.15.133:0/3527555683 shutdown_connections 2024-02-15T22:56:24.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.681+0000 7f05ff818800 1 -- 172.21.15.133:0/3527555683 wait complete. 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f05ff818800 1 Processor -- start 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f05ff818800 1 -- start start 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f05ff818800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 0x55ca3fca2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f05ff818800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca3fca26c0 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f05fa61f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 0x55ca3fca2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f05fa61f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 0x55ca3fca2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57306/0 (socket says 172.21.15.133:57306) 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 learned_addr learned my addr 172.21.15.133:0/2319401884 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca3fc8f7f0 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f05fa61f640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 0x55ca3fca2180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f05f000ee30 tx=0x7f05f004b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f04dcff9640 1 -- 172.21.15.133:0/2319401884 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f004bd40 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f04dcff9640 1 -- 172.21.15.133:0/2319401884 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f001a6b0 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca3fca28c0 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.682+0000 7f04dcff9640 1 -- 172.21.15.133:0/2319401884 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f001a990 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.683+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca3fca2d80 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.683+0000 7f04dcff9640 1 -- 172.21.15.133:0/2319401884 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f05f000d040 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.683+0000 7f04dcff9640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04c4036790 0x7f04c4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.683+0000 7f04dcff9640 1 -- 172.21.15.133:0/2319401884 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f05f000a040 con 0x55ca3fc9b1d0 2024-02-15T22:56:24.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.683+0000 7f05fb621640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04c4036790 0x7f04c4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.684+0000 7f05fb621640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04c4036790 0x7f04c4038c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f05f400b010 tx=0x7f05f4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.684+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.684+0000 7f05ff818800 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ca3fcadcf0 0x55ca3fcb01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.684+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb0900 con 0x55ca3fcadcf0 2024-02-15T22:56:24.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.684+0000 7f05fae20640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ca3fcadcf0 0x55ca3fcb01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.684+0000 7f05fae20640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ca3fcadcf0 0x55ca3fcb01b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.684+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.684+0000 7f05ff818800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.684+0000 7f05ff818800 20 realm 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.684+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.684+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb0cd0 con 0x55ca3fcadcf0 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb1550 con 0x55ca3fcadcf0 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb18b0 con 0x55ca3fcadcf0 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb20b0 con 0x55ca3fcadcf0 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 20 searching for the correct realm 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55ca3fcb3f40 0x55ca3fcb63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.685+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb6a90 con 0x55ca3fcb3f40 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.686+0000 7f05fa61f640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55ca3fcb3f40 0x55ca3fcb63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.686+0000 7f05fa61f640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55ca3fcb3f40 0x55ca3fcb63c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.686+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.686+0000 7f05fa61f640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f05f0036070 0x7f05f0027850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.686+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb6a90 con 0x7f05f0036070 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.686+0000 7f05fb621640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f05f0036070 0x7f05f0027850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.687+0000 7f05fb621640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f05f0036070 0x7f05f0027850 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.687+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f400a4a0 con 0x7f05f0036070 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.687+0000 7f05fb621640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f05f40141d0 0x7f05f4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.687+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb6a90 con 0x7f05f40141d0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.687+0000 7f05fae20640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f05f40141d0 0x7f05f4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.687+0000 7f05fae20640 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f05f40141d0 0x7f05f4015940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.688+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec063070 con 0x7f05f40141d0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.688+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb6a90 con 0x55ca3fcadcf0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.688+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.688+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb6a90 con 0x55ca3fcadcf0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.688+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.688+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb6a90 con 0x7f05f40141d0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.688+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec063070 con 0x7f05f40141d0 2024-02-15T22:56:24.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.688+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb6a90 con 0x7f05f40141d0 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.689+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec063070 con 0x7f05f40141d0 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.689+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x7f05f0036070 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.689+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f400a4a0 con 0x7f05f0036070 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.689+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcb3f40 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.689+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.689+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.689+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.689+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x7f05f40141d0 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.690+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec063070 con 0x7f05f40141d0 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.690+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.690+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.690+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x7f05f0036070 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.690+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f05f403a040 con 0x7f05f0036070 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.690+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcb3f40 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.690+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.690+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcb3f40 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.691+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.691+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x7f05f40141d0 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.691+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec063070 con 0x7f05f40141d0 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.691+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcb3f40 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.691+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.691+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcb3f40 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.691+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.691+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.692+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.692+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.693+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.693+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x7f05f40141d0 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.693+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec063070 con 0x7f05f40141d0 2024-02-15T22:56:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.693+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcb3f40 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.693+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.693+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x7f05f0036070 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.694+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f403a040 con 0x7f05f0036070 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.694+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.694+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f05ec063070 con 0x55ca3fcadcf0 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.694+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x7f05f40141d0 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.694+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.694+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcb3f40 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.694+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.694+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x7f05f40141d0 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.695+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.695+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x7f05f0036070 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.695+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f403a040 con 0x7f05f0036070 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.695+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcb3f40 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.695+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.695+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x7f05f40141d0 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.695+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.695+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f05ec092040 con 0x7f05f0036070 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f403a040 con 0x7f05f0036070 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb2a10 con 0x55ca3fcadcf0 2024-02-15T22:56:24.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb3260 con 0x55ca3fcadcf0 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.696+0000 7f05ff818800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb3260 con 0x55ca3fcadcf0 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 20 zone default found 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 4 Realm: () 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 20 zonegroup default 2024-02-15T22:56:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb3260 con 0x7f05f40141d0 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.697+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb88b0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.698+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.698+0000 7f05ff818800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.698+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.698+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb8c10 con 0x55ca3fcb3f40 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.698+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.698+0000 7f05ff818800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.698+0000 7f05ff818800 20 started sync module instance, tier type = 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.698+0000 7f05ff818800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.698+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb8190 con 0x7f05f0036070 2024-02-15T22:56:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.699+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05f403a040 con 0x7f05f0036070 2024-02-15T22:56:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.699+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94327142055152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb8110 con 0x7f05f0036070 2024-02-15T22:56:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.699+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb9920 con 0x55ca3fcadcf0 2024-02-15T22:56:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.700+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94327142055152] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05f403a040 con 0x7f05f0036070 2024-02-15T22:56:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.700+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.700+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94327142060000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb98a0 con 0x55ca3fcadcf0 2024-02-15T22:56:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.700+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcba210 con 0x55ca3fcb3f40 2024-02-15T22:56:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.701+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94327142060000] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.702+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.702+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94327142063472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcba570 con 0x55ca3fcb3f40 2024-02-15T22:56:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.702+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbb010 con 0x7f05f0036070 2024-02-15T22:56:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.702+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05f403a040 con 0x7f05f0036070 2024-02-15T22:56:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.703+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94327142066928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbb860 con 0x7f05f0036070 2024-02-15T22:56:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.703+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbc330 con 0x55ca3fcadcf0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.703+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94327142063472] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.704+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.704+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94327142066928] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05f403a040 con 0x7f05f0036070 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.704+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94327142071824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbb3c0 con 0x55ca3fcadcf0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.704+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbcb80 con 0x7f05f40141d0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.705+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94327142071824] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.705+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.705+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94327142061056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbcac0 con 0x7f05f40141d0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.705+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbd2c0 con 0x7f05f40141d0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.706+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94327142061056] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.706+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.706+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94327142074288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbd150 con 0x7f05f40141d0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.706+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbdbf0 con 0x7f05f40141d0 2024-02-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.707+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94327142074288] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.707+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.707+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94327142078160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbdbb0 con 0x7f05f40141d0 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.707+0000 7f05ff818800 20 add_watcher() i=0 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.707+0000 7f05ff818800 20 add_watcher() i=1 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.707+0000 7f05ff818800 20 add_watcher() i=2 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.707+0000 7f05ff818800 20 add_watcher() i=3 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.707+0000 7f05ff818800 20 add_watcher() i=4 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.707+0000 7f05ff818800 20 add_watcher() i=5 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.707+0000 7f05ff818800 20 add_watcher() i=6 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.708+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94327142078160] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.708+0000 7f05ff818800 20 add_watcher() i=7 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.708+0000 7f05ff818800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.708+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcc1140 con 0x55ca3fcadcf0 2024-02-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.708+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.708+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94327142075344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbe470 con 0x55ca3fcadcf0 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.709+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94327142075344] v30'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.709+0000 7f04b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.709+0000 7f05ff818800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.709+0000 7f05ff818800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.709+0000 7f05ff818800 5 note: GC not initialized 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.709+0000 7f042bfff640 20 reqs_thread_entry: start 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05ff818800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05ff818800 20 Filter name: none 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f0429ffb640 20 reqs_thread_entry: start 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05ff818800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05ff818800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcf30b0 con 0x55ca3fcadcf0 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05ff818800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05ff818800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05ff818800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05ff818800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcf55d0 con 0x7f05f0036070 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f05f403a040 con 0x7f05f0036070 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.710+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcf8f80 con 0x55ca3fcadcf0 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~358] v30'3 uv3 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f05ff818800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f05ff818800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f05ff818800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94327142320800 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcf5e40 con 0x55ca3fcadcf0 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 94327142071824 notify 128849018882 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x55ca3fc76fd0 con 0x55ca3fcadcf0 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f04de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94327142071824 notifier 4320 bl.length()=534 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f04de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f04de7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f04de7fc640 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f04c0003e90 con 0x55ca3fcadcf0 2024-02-15T22:56:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(65 notify.4 [notify cookie 94327142320800 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.712+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== watch-notify(notify_complete (2) cookie 94327142320800 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ca3fc76a90 con 0x55ca3fcadcf0 2024-02-15T22:56:24.723 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.713+0000 7f04b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.713+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94327142075344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcc0730 con 0x55ca3fcadcf0 2024-02-15T22:56:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.714+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94327142075344] v30'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.714+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94327142055152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbcbd0 con 0x7f05f0036070 2024-02-15T22:56:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.715+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94327142055152] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05f403a040 con 0x7f05f0036070 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.715+0000 7f05ff818800 20 remove_watcher() i=0 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.715+0000 7f05ff818800 2 removed watcher, disabling cache 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.715+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94327142060000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbcbd0 con 0x55ca3fcadcf0 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.716+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94327142060000] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.716+0000 7f05ff818800 20 remove_watcher() i=1 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.716+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94327142063472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb8fe0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.717+0000 7f05fa61f640 1 -- 172.21.15.133:0/2319401884 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94327142063472] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05f003a7e0 con 0x55ca3fcb3f40 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.717+0000 7f05ff818800 20 remove_watcher() i=2 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.717+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94327142066928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbcbd0 con 0x7f05f0036070 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.718+0000 7f05fb621640 1 -- 172.21.15.133:0/2319401884 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94327142066928] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05f403a040 con 0x7f05f0036070 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.718+0000 7f05ff818800 20 remove_watcher() i=3 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.718+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94327142071824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb9d70 con 0x55ca3fcadcf0 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.719+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94327142071824] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x55ca3fcadcf0 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.719+0000 7f05ff818800 20 remove_watcher() i=4 2024-02-15T22:56:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.719+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94327142061056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcbcbd0 con 0x7f05f40141d0 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.720+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94327142061056] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.720+0000 7f05ff818800 20 remove_watcher() i=5 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.720+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94327142074288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb9d70 con 0x7f05f40141d0 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.721+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94327142074288] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.721+0000 7f05ff818800 20 remove_watcher() i=6 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.721+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94327142078160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca3fcb9d70 con 0x7f05f40141d0 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94327142078160] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05ec09c040 con 0x7f05f40141d0 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 20 remove_watcher() i=7 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f05f40141d0 msgr2=0x7f05f4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f05f40141d0 0x7f05f4015940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ca3fcadcf0 msgr2=0x55ca3fcb01b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ca3fcadcf0 0x55ca3fcb01b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f05f0036070 msgr2=0x7f05f0027850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f05f0036070 0x7f05f0027850 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55ca3fcb3f40 msgr2=0x55ca3fcb63c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55ca3fcb3f40 0x55ca3fcb63c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04c4036790 msgr2=0x7f04c4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04c4036790 0x7f04c4038c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f05f400b010 tx=0x7f05f4020000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 msgr2=0x55ca3fca2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 --2- 172.21.15.133:0/2319401884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc9b1d0 0x55ca3fca2180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f05f000ee30 tx=0x7f05f004b980 comp rx=0 tx=0).stop 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 reap_dead start 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05fae20640 1 -- 172.21.15.133:0/2319401884 reap_dead start 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 shutdown_connections 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 >> 172.21.15.133:0/2319401884 conn(0x55ca3fc97530 msgr2=0x55ca3fc94b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 shutdown_connections 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 -- 172.21.15.133:0/2319401884 wait complete. 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.722+0000 7f05ff818800 1 -- 172.21.15.133:0/3659599154 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04d4036790 msgr2=0x7f04d4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 --2- 172.21.15.133:0/3659599154 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04d4036790 0x7f04d4038c50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55ca3fc7e290 tx=0x7f05f4005840 comp rx=0 tx=0).stop 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3659599154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc8df60 msgr2=0x55ca3fc8e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 --2- 172.21.15.133:0/3659599154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc8df60 0x55ca3fc8e380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f05f000e610 tx=0x7f05f000ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3659599154 shutdown_connections 2024-02-15T22:56:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 --2- 172.21.15.133:0/3659599154 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04d4036790 0x7f04d4038c50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 --2- 172.21.15.133:0/3659599154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3fc8df60 0x55ca3fc8e380 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3659599154 >> 172.21.15.133:0/3659599154 conn(0x55ca3fc82000 msgr2=0x55ca3fc82400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3659599154 shutdown_connections 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3659599154 wait complete. 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ca3fb800b0 msgr2=0x55ca3fc7d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ca3fb800b0 0x55ca3fc7d380 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04e00367e0 msgr2=0x7f04e0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04e00367e0 0x7f04e0038ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f05f0000c00 tx=0x7f05f00013b0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 msgr2=0x55ca3fc76550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fc76550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f05ec000c00 tx=0x7f05ec002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 shutdown_connections 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ca3fb800b0 0x55ca3fc7d380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f04e00367e0 0x7f04e0038ca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 --2- 172.21.15.133:0/3047523305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3faf0120 0x55ca3fc76550 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 >> 172.21.15.133:0/3047523305 conn(0x55ca3fb774d0 msgr2=0x55ca3fb7bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 shutdown_connections 2024-02-15T22:56:24.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.723+0000 7f05ff818800 1 -- 172.21.15.133:0/3047523305 wait complete. 2024-02-15T22:56:24.734 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:24.734 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T22:56:24.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T22:56:24.734 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T22:56:24.817 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:24.817 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:24.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.815+0000 7f15afb33800 1 Processor -- start 2024-02-15T22:56:24.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.815+0000 7f15afb33800 1 -- start start 2024-02-15T22:56:24.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.815+0000 7f15afb33800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564322d34300 0x564322d366f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.815+0000 7f15afb33800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564322c7bbb0 con 0x564322d2fe70 2024-02-15T22:56:24.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.815+0000 7f15afb33800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x564322c33450 con 0x564322d34300 2024-02-15T22:56:24.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.816+0000 7f15ab0f1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564322d34300 0x564322d366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.816+0000 7f15ab8f2640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x564322d2fe70 0x564322d30290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44852/0 (socket says 172.21.15.133:44852) 2024-02-15T22:56:24.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.816+0000 7f15ab8f2640 1 -- 172.21.15.133:0/260496207 learned_addr learned my addr 172.21.15.133:0/260496207 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:24.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.816+0000 7f15ab0f1640 1 -- 172.21.15.133:0/260496207 >> v1:172.21.15.52:6789/0 conn(0x564322d2fe70 legacy=0x564322d30290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.816+0000 7f15ab0f1640 1 -- 172.21.15.133:0/260496207 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564322d37d20 con 0x564322d34300 2024-02-15T22:56:24.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.818+0000 7f15ab0f1640 1 --2- 172.21.15.133:0/260496207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d34300 0x564322d366f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f15a000a470 tx=0x7f15a001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e7af7103c347a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.818+0000 7f15aa8f0640 1 -- 172.21.15.133:0/260496207 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a0052570 con 0x564322d34300 2024-02-15T22:56:24.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.818+0000 7f15aa8f0640 1 -- 172.21.15.133:0/260496207 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a00526d0 con 0x564322d34300 2024-02-15T22:56:24.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.818+0000 7f15aa8f0640 1 -- 172.21.15.133:0/260496207 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a0052990 con 0x564322d34300 2024-02-15T22:56:24.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.818+0000 7f15afb33800 1 -- 172.21.15.133:0/260496207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d34300 msgr2=0x564322d366f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.818+0000 7f15afb33800 1 --2- 172.21.15.133:0/260496207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d34300 0x564322d366f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f15a000a470 tx=0x7f15a001cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:24.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.818+0000 7f15afb33800 1 -- 172.21.15.133:0/260496207 shutdown_connections 2024-02-15T22:56:24.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.818+0000 7f15afb33800 1 --2- 172.21.15.133:0/260496207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d34300 0x564322d366f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.818+0000 7f15afb33800 1 -- 172.21.15.133:0/260496207 >> 172.21.15.133:0/260496207 conn(0x564322d2b4d0 msgr2=0x564322d2d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.818+0000 7f15afb33800 1 -- 172.21.15.133:0/260496207 shutdown_connections 2024-02-15T22:56:24.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.818+0000 7f15afb33800 1 -- 172.21.15.133:0/260496207 wait complete. 2024-02-15T22:56:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.830+0000 7f15afb33800 1 Processor -- start 2024-02-15T22:56:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.830+0000 7f15afb33800 1 -- start start 2024-02-15T22:56:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.830+0000 7f15afb33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322ca3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.830+0000 7f15afb33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564322c30980 con 0x564322d2fe70 2024-02-15T22:56:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.830+0000 7f15ab8f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322ca3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.830+0000 7f15ab8f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322ca3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57316/0 (socket says 172.21.15.133:57316) 2024-02-15T22:56:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.830+0000 7f15ab8f2640 1 -- 172.21.15.133:0/3527869952 learned_addr learned my addr 172.21.15.133:0/3527869952 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.831+0000 7f15ab8f2640 1 -- 172.21.15.133:0/3527869952 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a0005d20 con 0x564322d2fe70 2024-02-15T22:56:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.831+0000 7f15ab8f2640 1 --2- 172.21.15.133:0/3527869952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322ca3f30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f159c001c80 tx=0x7f159c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e103eb800cbb045 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.831+0000 7f1499e0b640 1 -- 172.21.15.133:0/3527869952 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f159c00e470 con 0x564322d2fe70 2024-02-15T22:56:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.831+0000 7f1499e0b640 1 -- 172.21.15.133:0/3527869952 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c00e5d0 con 0x564322d2fe70 2024-02-15T22:56:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.831+0000 7f1499e0b640 1 -- 172.21.15.133:0/3527869952 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f159c00e8d0 con 0x564322d2fe70 2024-02-15T22:56:24.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.832+0000 7f15afb33800 1 -- 172.21.15.133:0/3527869952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 msgr2=0x564322ca3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.832+0000 7f15afb33800 1 --2- 172.21.15.133:0/3527869952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322ca3f30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f159c001c80 tx=0x7f159c00b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.832+0000 7f15afb33800 1 -- 172.21.15.133:0/3527869952 shutdown_connections 2024-02-15T22:56:24.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.832+0000 7f15afb33800 1 --2- 172.21.15.133:0/3527869952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322ca3f30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.832+0000 7f15afb33800 1 -- 172.21.15.133:0/3527869952 >> 172.21.15.133:0/3527869952 conn(0x564322d2b4d0 msgr2=0x564322e1b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.832+0000 7f15afb33800 1 -- 172.21.15.133:0/3527869952 shutdown_connections 2024-02-15T22:56:24.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.832+0000 7f15afb33800 1 -- 172.21.15.133:0/3527869952 wait complete. 2024-02-15T22:56:24.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.832+0000 7f15afb33800 1 Processor -- start 2024-02-15T22:56:24.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.832+0000 7f15afb33800 1 -- start start 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.832+0000 7f15afb33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322e286f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.832+0000 7f15afb33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564322c2c160 con 0x564322d2fe70 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.833+0000 7f15ab8f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322e286f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.833+0000 7f15ab8f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322e286f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57332/0 (socket says 172.21.15.133:57332) 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.833+0000 7f15ab8f2640 1 -- 172.21.15.133:0/926591658 learned_addr learned my addr 172.21.15.133:0/926591658 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.833+0000 7f15ab8f2640 1 -- 172.21.15.133:0/926591658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564322c7bbb0 con 0x564322d2fe70 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.833+0000 7f15ab8f2640 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322e286f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f159c001c80 tx=0x7f159c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.833+0000 7f1493fff640 1 -- 172.21.15.133:0/926591658 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f159c01f070 con 0x564322d2fe70 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.833+0000 7f1493fff640 1 -- 172.21.15.133:0/926591658 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c018640 con 0x564322d2fe70 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.833+0000 7f1493fff640 1 -- 172.21.15.133:0/926591658 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f159c0188e0 con 0x564322d2fe70 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.833+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564322e28c30 con 0x564322d2fe70 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.833+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564322e29110 con 0x564322d2fe70 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.834+0000 7f1493fff640 1 -- 172.21.15.133:0/926591658 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f159c018b10 con 0x564322d2fe70 2024-02-15T22:56:24.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.834+0000 7f1493fff640 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14940367e0 0x7f1494038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.834+0000 7f1493fff640 1 -- 172.21.15.133:0/926591658 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f159c04c1b0 con 0x564322d2fe70 2024-02-15T22:56:24.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.834+0000 7f15ab0f1640 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14940367e0 0x7f1494038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.834+0000 7f15afb33800 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564322d34300 0x564322e2f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.834+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e2f9c0 con 0x564322d34300 2024-02-15T22:56:24.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.834+0000 7f15ac0f3640 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564322d34300 0x564322e2f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.835+0000 7f15ab0f1640 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14940367e0 0x7f1494038ca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f15a0054000 tx=0x7f15a004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.835+0000 7f15ac0f3640 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564322d34300 0x564322e2f3f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.835+0000 7f15ac0f3640 1 -- 172.21.15.133:0/926591658 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f15a400a4a0 con 0x564322d34300 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.835+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e2cb00 con 0x564322d34300 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.835+0000 7f15ac0f3640 1 -- 172.21.15.133:0/926591658 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f15a400a4a0 con 0x564322d34300 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.835+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e31720 con 0x564322d34300 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.836+0000 7f15ac0f3640 1 -- 172.21.15.133:0/926591658 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f15a400a4a0 con 0x564322d34300 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.836+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e30a30 con 0x564322d34300 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.836+0000 7f15ac0f3640 1 -- 172.21.15.133:0/926591658 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f15a400a4a0 con 0x564322d34300 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.836+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e30e40 con 0x564322d34300 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.836+0000 7f15ac0f3640 1 -- 172.21.15.133:0/926591658 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f15a400a4a0 con 0x564322d34300 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.836+0000 7f15afb33800 1 Processor -- start 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.836+0000 7f15afb33800 1 -- start start 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f15afb33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e40120 0x564322e40540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f15afb33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564322bcee80 con 0x564322e40120 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f15ab0f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e40120 0x564322e40540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f15ab0f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e40120 0x564322e40540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57346/0 (socket says 172.21.15.133:57346) 2024-02-15T22:56:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f15ab0f1640 1 -- 172.21.15.133:0/3763869046 learned_addr learned my addr 172.21.15.133:0/3763869046 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f15ab0f1640 1 -- 172.21.15.133:0/3763869046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564322e40a80 con 0x564322e40120 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f15ab0f1640 1 --2- 172.21.15.133:0/3763869046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e40120 0x564322e40540 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f15a00447c0 tx=0x7f15a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f14917fa640 1 -- 172.21.15.133:0/3763869046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a0052e40 con 0x564322e40120 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f14917fa640 1 -- 172.21.15.133:0/3763869046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a005d890 con 0x564322e40120 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f15afb33800 1 -- 172.21.15.133:0/3763869046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564322e40c70 con 0x564322e40120 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f14917fa640 1 -- 172.21.15.133:0/3763869046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a005db30 con 0x564322e40120 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.837+0000 7f15afb33800 1 -- 172.21.15.133:0/3763869046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564322e41820 con 0x564322e40120 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.838+0000 7f14917fa640 1 -- 172.21.15.133:0/3763869046 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f15a005dd20 con 0x564322e40120 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.838+0000 7f14917fa640 1 --2- 172.21.15.133:0/3763869046 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1484036790 0x7f1484038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.838+0000 7f14917fa640 1 -- 172.21.15.133:0/3763869046 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f15a008f5e0 con 0x564322e40120 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.838+0000 7f15ac0f3640 1 --2- 172.21.15.133:0/3763869046 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1484036790 0x7f1484038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.839+0000 7f15afb33800 1 Processor -- start 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.839+0000 7f15afb33800 1 -- start start 2024-02-15T22:56:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.839+0000 7f15ac0f3640 1 --2- 172.21.15.133:0/3763869046 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1484036790 0x7f1484038c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x564322e30470 tx=0x7f15a4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.839+0000 7f15afb33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e4d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.839+0000 7f15afb33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564322ba45d0 con 0x564322e4d2b0 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.839+0000 7f15ab0f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e4d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.839+0000 7f15ab0f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e4d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57360/0 (socket says 172.21.15.133:57360) 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.839+0000 7f15ab0f1640 1 -- 172.21.15.133:0/387236508 learned_addr learned my addr 172.21.15.133:0/387236508 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.839+0000 7f15ab0f1640 1 -- 172.21.15.133:0/387236508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564322e4dca0 con 0x564322e4d2b0 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.839+0000 7f15ab0f1640 1 --2- 172.21.15.133:0/387236508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e4d6d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15a0066fd0 tx=0x7f15a0088f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad81a21d7d70b431 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f148affd640 1 -- 172.21.15.133:0/387236508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a00654a0 con 0x564322e4d2b0 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f148affd640 1 -- 172.21.15.133:0/387236508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a006db60 con 0x564322e4d2b0 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f148affd640 1 -- 172.21.15.133:0/387236508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a006de40 con 0x564322e4d2b0 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f15afb33800 1 -- 172.21.15.133:0/387236508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 msgr2=0x564322e4d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f15afb33800 1 --2- 172.21.15.133:0/387236508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e4d6d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15a0066fd0 tx=0x7f15a0088f90 comp rx=0 tx=0).stop 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f15afb33800 1 -- 172.21.15.133:0/387236508 shutdown_connections 2024-02-15T22:56:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f15afb33800 1 --2- 172.21.15.133:0/387236508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e4d6d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f15afb33800 1 -- 172.21.15.133:0/387236508 >> 172.21.15.133:0/387236508 conn(0x564322e49610 msgr2=0x564322e47670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f15afb33800 1 -- 172.21.15.133:0/387236508 shutdown_connections 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f15afb33800 1 -- 172.21.15.133:0/387236508 wait complete. 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f15afb33800 1 Processor -- start 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.840+0000 7f15afb33800 1 -- start start 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f15afb33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e21650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f15afb33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564322e21b90 con 0x564322e4d2b0 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f15ab0f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e21650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f15ab0f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e21650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57364/0 (socket says 172.21.15.133:57364) 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 learned_addr learned my addr 172.21.15.133:0/4041153889 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564322e41820 con 0x564322e4d2b0 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f15ab0f1640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e21650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f15a005d810 tx=0x7f15a000a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f14897fa640 1 -- 172.21.15.133:0/4041153889 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a008f410 con 0x564322e4d2b0 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f14897fa640 1 -- 172.21.15.133:0/4041153889 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a0065720 con 0x564322e4d2b0 2024-02-15T22:56:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564322e1fd40 con 0x564322e4d2b0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f14897fa640 1 -- 172.21.15.133:0/4041153889 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a00659c0 con 0x564322e4d2b0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.841+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564322e201a0 con 0x564322e4d2b0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.842+0000 7f14897fa640 1 -- 172.21.15.133:0/4041153889 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f15a005cab0 con 0x564322e4d2b0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.842+0000 7f14897fa640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1474036740 0x7f1474038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.842+0000 7f14897fa640 1 -- 172.21.15.133:0/4041153889 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f15a00073e0 con 0x564322e4d2b0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.842+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.842+0000 7f15ac0f3640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1474036740 0x7f1474038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.842+0000 7f15afb33800 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564322e620a0 0x564322e64540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.842+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e64c90 con 0x564322e620a0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.842+0000 7f15ab8f2640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564322e620a0 0x564322e64540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15ac0f3640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1474036740 0x7f1474038c00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f15a400b010 tx=0x7f15a4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15ab8f2640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564322e620a0 0x564322e64540 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f159c014070 con 0x564322e620a0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15afb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15afb33800 20 realm 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e65060 con 0x564322e620a0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f159c014070 con 0x564322e620a0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15afb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15afb33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e658b0 con 0x564322e620a0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f159c014070 con 0x564322e620a0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15afb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.843+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e65c10 con 0x564322e620a0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.844+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f159c014070 con 0x564322e620a0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.844+0000 7f15afb33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.844+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.844+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e65550 con 0x564322e620a0 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.844+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f159c014070 con 0x564322e620a0 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.844+0000 7f15afb33800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.844+0000 7f15afb33800 20 searching for the correct realm 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.844+0000 7f15afb33800 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564322e67fd0 0x564322e6a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.844+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e67fd0 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.844+0000 7f15ab0f1640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564322e67fd0 0x564322e6a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.844+0000 7f15ab0f1640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564322e67fd0 0x564322e6a3c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.845+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.845+0000 7f15ab0f1640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f15a0099060 0x7f15a006f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.845+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a0099060 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.845+0000 7f15ac0f3640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f15a0099060 0x7f15a006f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.845+0000 7f15ac0f3640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f15a0099060 0x7f15a006f450 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.845+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a400a4a0 con 0x7f15a0099060 2024-02-15T22:56:24.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.845+0000 7f15ac0f3640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f15a40141d0 0x7f15a4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.845+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a40141d0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.846+0000 7f15ab8f2640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f15a40141d0 0x7f15a4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.846+0000 7f15ab8f2640 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f15a40141d0 0x7f15a4015940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.846+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c014070 con 0x7f15a40141d0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.846+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e620a0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.846+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c014070 con 0x564322e620a0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.846+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e620a0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.847+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.847+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a40141d0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.847+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.847+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a40141d0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.847+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.847+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a0099060 2024-02-15T22:56:24.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.847+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a400a4a0 con 0x7f15a0099060 2024-02-15T22:56:24.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.847+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e67fd0 2024-02-15T22:56:24.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.848+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.848+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e620a0 2024-02-15T22:56:24.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.848+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.848+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a40141d0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.848+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.848+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e620a0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.848+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.848+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a0099060 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.848+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f15a403a040 con 0x7f15a0099060 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.849+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e67fd0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.849+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.849+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e67fd0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.849+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.849+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a40141d0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.849+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.849+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e67fd0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.849+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.849+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e67fd0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.850+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.850+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e620a0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.850+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.850+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e620a0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.850+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.850+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a40141d0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.851+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.851+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e67fd0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.851+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.851+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a0099060 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.851+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a403a040 con 0x7f15a0099060 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.851+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e620a0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.852+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.852+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a40141d0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.852+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.852+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e67fd0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.852+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.852+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a40141d0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.852+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.852+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a0099060 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.853+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a403a040 con 0x7f15a0099060 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.853+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e67fd0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.853+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.853+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a40141d0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x564322e620a0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6a9f0 con 0x7f15a0099060 2024-02-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15a403a040 con 0x7f15a0099060 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15afb33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15afb33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15afb33800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15afb33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15afb33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15afb33800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e66ab0 con 0x564322e620a0 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15afb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.854+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e66730 con 0x564322e620a0 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e67440 con 0x564322e620a0 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 20 zone default found 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 4 Realm: () 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 20 zonegroup default 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6ae30 con 0x7f15a40141d0 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.855+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6cbc0 con 0x564322e67fd0 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.856+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.856+0000 7f15afb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.856+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.856+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6cf20 con 0x564322e67fd0 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.856+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.856+0000 7f15afb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.856+0000 7f15afb33800 20 started sync module instance, tier type = 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.856+0000 7f15afb33800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.856+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6c4a0 con 0x7f15a0099060 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.857+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15a403a040 con 0x7f15a0099060 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.857+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94846348345344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6c420 con 0x7f15a0099060 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.857+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6dc80 con 0x564322e620a0 2024-02-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.858+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94846348345344] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15a403a040 con 0x7f15a0099060 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.858+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.858+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94846348350272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6dc00 con 0x564322e620a0 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.858+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6e5b0 con 0x564322e67fd0 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.859+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94846348350272] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.859+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.859+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94846348351328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6db80 con 0x564322e67fd0 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.859+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6f3c0 con 0x7f15a0099060 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.860+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15a403a040 con 0x7f15a0099060 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.860+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94846348357888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6fc10 con 0x7f15a0099060 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.860+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e706b0 con 0x564322e620a0 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.861+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94846348351328] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.861+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.861+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94846348362128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e70670 con 0x564322e620a0 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.861+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e71120 con 0x7f15a40141d0 2024-02-15T22:56:24.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.861+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94846348357888] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15a403a040 con 0x7f15a0099060 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.862+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.862+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94846348364800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e710e0 con 0x7f15a40141d0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.862+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e71b00 con 0x7f15a40141d0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.862+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94846348362128] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.863+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94846348364800] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.863+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.863+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94846348359536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6e910 con 0x7f15a40141d0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.863+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e72110 con 0x7f15a40141d0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.864+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94846348359536] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.864+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.864+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94846348367424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e72110 con 0x7f15a40141d0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.864+0000 7f15afb33800 20 add_watcher() i=0 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.864+0000 7f15afb33800 20 add_watcher() i=1 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.864+0000 7f15afb33800 20 add_watcher() i=2 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.864+0000 7f15afb33800 20 add_watcher() i=3 2024-02-15T22:56:24.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.864+0000 7f15afb33800 20 add_watcher() i=4 2024-02-15T22:56:24.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.864+0000 7f15afb33800 20 add_watcher() i=5 2024-02-15T22:56:24.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.864+0000 7f15afb33800 20 add_watcher() i=6 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.865+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94846348367424] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.865+0000 7f15afb33800 20 add_watcher() i=7 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.865+0000 7f15afb33800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.865+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e75530 con 0x564322e620a0 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.866+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.866+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94846348382064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e72280 con 0x564322e620a0 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.867+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94846348382064] v30'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.867+0000 7f1461fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.867+0000 7f15afb33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.867+0000 7f15afb33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.867+0000 7f15afb33800 5 note: GC not initialized 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.867+0000 7f1460fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.867+0000 7f15afb33800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.867+0000 7f15afb33800 20 Filter name: none 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.867+0000 7f13da7fc640 20 reqs_thread_entry: start 2024-02-15T22:56:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.867+0000 7f15afb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:24.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.867+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322ea7040 con 0x564322e620a0 2024-02-15T22:56:24.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.868+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.868+0000 7f15afb33800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:24.879 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:24.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.869+0000 7f1461fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:24.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.869+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94846348382064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e74370 con 0x564322e620a0 2024-02-15T22:56:24.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.870+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94846348382064] v30'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.870+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94846348345344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e74f70 con 0x7f15a0099060 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.871+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94846348345344] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15a403a040 con 0x7f15a0099060 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.871+0000 7f15afb33800 20 remove_watcher() i=0 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.871+0000 7f15afb33800 2 removed watcher, disabling cache 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.871+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94846348350272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e74f70 con 0x564322e620a0 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.872+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94846348350272] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.872+0000 7f15afb33800 20 remove_watcher() i=1 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.872+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94846348351328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e6d340 con 0x564322e67fd0 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.873+0000 7f15ab0f1640 1 -- 172.21.15.133:0/4041153889 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94846348351328] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15a0059040 con 0x564322e67fd0 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.873+0000 7f15afb33800 20 remove_watcher() i=2 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.873+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94846348357888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e74f70 con 0x7f15a0099060 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.874+0000 7f15ac0f3640 1 -- 172.21.15.133:0/4041153889 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94846348357888] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15a403a040 con 0x7f15a0099060 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.874+0000 7f15afb33800 20 remove_watcher() i=3 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.874+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94846348362128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e74f70 con 0x564322e620a0 2024-02-15T22:56:24.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.875+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94846348362128] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x564322e620a0 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.875+0000 7f15afb33800 20 remove_watcher() i=4 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.875+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94846348364800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e70190 con 0x7f15a40141d0 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.876+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94846348364800] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.876+0000 7f15afb33800 20 remove_watcher() i=5 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.876+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94846348359536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e74f70 con 0x7f15a40141d0 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.877+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94846348359536] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.877+0000 7f15afb33800 20 remove_watcher() i=6 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.877+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94846348367424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564322e74f70 con 0x7f15a40141d0 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94846348367424] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f159c035040 con 0x7f15a40141d0 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 20 remove_watcher() i=7 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f15a40141d0 msgr2=0x7f15a4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f15a40141d0 0x7f15a4015940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564322e620a0 msgr2=0x564322e64540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564322e620a0 0x564322e64540 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f15a0099060 msgr2=0x7f15a006f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f15a0099060 0x7f15a006f450 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564322e67fd0 msgr2=0x564322e6a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564322e67fd0 0x564322e6a3c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1474036740 msgr2=0x7f1474038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1474036740 0x7f1474038c00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f15a400b010 tx=0x7f15a4020000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 msgr2=0x564322e21650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15ab8f2640 1 -- 172.21.15.133:0/4041153889 reap_dead start 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e21650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f15a005d810 tx=0x7f15a000a410 comp rx=0 tx=0).stop 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 shutdown_connections 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 --2- 172.21.15.133:0/4041153889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e4d2b0 0x564322e21650 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 >> 172.21.15.133:0/4041153889 conn(0x564322e49610 msgr2=0x564322e46c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 shutdown_connections 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.878+0000 7f15afb33800 1 -- 172.21.15.133:0/4041153889 wait complete. 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/3763869046 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1484036790 msgr2=0x7f1484038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 --2- 172.21.15.133:0/3763869046 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1484036790 0x7f1484038c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x564322e30470 tx=0x7f15a4005840 comp rx=0 tx=0).stop 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/3763869046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e40120 msgr2=0x564322e40540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 --2- 172.21.15.133:0/3763869046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e40120 0x564322e40540 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f15a00447c0 tx=0x7f15a0002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/3763869046 shutdown_connections 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 --2- 172.21.15.133:0/3763869046 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1484036790 0x7f1484038c50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 --2- 172.21.15.133:0/3763869046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322e40120 0x564322e40540 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/3763869046 >> 172.21.15.133:0/3763869046 conn(0x564322e341c0 msgr2=0x564322e345c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/3763869046 shutdown_connections 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/3763869046 wait complete. 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564322d34300 msgr2=0x564322e2f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564322d34300 0x564322e2f3f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14940367e0 msgr2=0x7f1494038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14940367e0 0x7f1494038ca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f15a0054000 tx=0x7f15a004e000 comp rx=0 tx=0).stop 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 msgr2=0x564322e286f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322e286f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f159c001c80 tx=0x7f159c000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 shutdown_connections 2024-02-15T22:56:24.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564322d34300 0x564322e2f3f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14940367e0 0x7f1494038ca0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 --2- 172.21.15.133:0/926591658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564322d2fe70 0x564322e286f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 >> 172.21.15.133:0/926591658 conn(0x564322d2b4d0 msgr2=0x564322e1a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 shutdown_connections 2024-02-15T22:56:24.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.879+0000 7f15afb33800 1 -- 172.21.15.133:0/926591658 wait complete. 2024-02-15T22:56:24.890 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:24.890 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-15T22:56:24.890 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-15T22:56:24.890 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-02-15T22:56:24.976 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:24.976 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:24.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.975+0000 7f461aa99800 1 Processor -- start 2024-02-15T22:56:24.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.975+0000 7f461aa99800 1 -- start start 2024-02-15T22:56:24.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.975+0000 7f461aa99800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560f25b3b5d0 0x560f25b3d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.975+0000 7f461aa99800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560f25a81c50 con 0x560f25b37ac0 2024-02-15T22:56:24.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.975+0000 7f461aa99800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x560f25a39450 con 0x560f25b3b5d0 2024-02-15T22:56:24.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.975+0000 7f4617d97640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560f25b3b5d0 0x560f25b3d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.975+0000 7f4617d97640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560f25b3b5d0 0x560f25b3d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57374/0 (socket says 172.21.15.133:57374) 2024-02-15T22:56:24.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.975+0000 7f4617d97640 1 -- 172.21.15.133:0/1445270131 learned_addr learned my addr 172.21.15.133:0/1445270131 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.975+0000 7f4618598640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x560f25b37ac0 0x560f25b39eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44858/0 (socket says 172.21.15.133:44858) 2024-02-15T22:56:24.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.975+0000 7f4617d97640 1 -- 172.21.15.133:0/1445270131 >> v1:172.21.15.52:6789/0 conn(0x560f25b37ac0 legacy=0x560f25b39eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.975+0000 7f4617d97640 1 -- 172.21.15.133:0/1445270131 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f25b3ef10 con 0x560f25b3b5d0 2024-02-15T22:56:24.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.977+0000 7f4617d97640 1 --2- 172.21.15.133:0/1445270131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b3b5d0 0x560f25b3d9c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f460c00a520 tx=0x7f460c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4ff55503a9220 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.977+0000 7f4617596640 1 -- 172.21.15.133:0/1445270131 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f460c052570 con 0x560f25b3b5d0 2024-02-15T22:56:24.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.977+0000 7f4617596640 1 -- 172.21.15.133:0/1445270131 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c0526d0 con 0x560f25b3b5d0 2024-02-15T22:56:24.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.977+0000 7f4617596640 1 -- 172.21.15.133:0/1445270131 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f460c052990 con 0x560f25b3b5d0 2024-02-15T22:56:24.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.978+0000 7f461aa99800 1 -- 172.21.15.133:0/1445270131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b3b5d0 msgr2=0x560f25b3d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.978+0000 7f461aa99800 1 --2- 172.21.15.133:0/1445270131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b3b5d0 0x560f25b3d9c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f460c00a520 tx=0x7f460c01cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.978+0000 7f461aa99800 1 -- 172.21.15.133:0/1445270131 shutdown_connections 2024-02-15T22:56:24.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.978+0000 7f461aa99800 1 --2- 172.21.15.133:0/1445270131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b3b5d0 0x560f25b3d9c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.978+0000 7f461aa99800 1 -- 172.21.15.133:0/1445270131 >> 172.21.15.133:0/1445270131 conn(0x560f25b314f0 msgr2=0x560f25b33910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.978+0000 7f461aa99800 1 -- 172.21.15.133:0/1445270131 shutdown_connections 2024-02-15T22:56:24.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.978+0000 7f461aa99800 1 -- 172.21.15.133:0/1445270131 wait complete. 2024-02-15T22:56:24.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.989+0000 7f461aa99800 1 Processor -- start 2024-02-15T22:56:24.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.990+0000 7f461aa99800 1 -- start start 2024-02-15T22:56:24.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.990+0000 7f461aa99800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25c270f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.990+0000 7f461aa99800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f25a36980 con 0x560f25b37ac0 2024-02-15T22:56:24.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.990+0000 7f4618598640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25c270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.990+0000 7f4618598640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25c270f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57380/0 (socket says 172.21.15.133:57380) 2024-02-15T22:56:24.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.990+0000 7f4618598640 1 -- 172.21.15.133:0/3037912770 learned_addr learned my addr 172.21.15.133:0/3037912770 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.990+0000 7f4618598640 1 -- 172.21.15.133:0/3037912770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c005de0 con 0x560f25b37ac0 2024-02-15T22:56:24.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.990+0000 7f4618598640 1 --2- 172.21.15.133:0/3037912770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25c270f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4608001d00 tx=0x7f460800b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243c7a966c36d9d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.991+0000 7f450660c640 1 -- 172.21.15.133:0/3037912770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4608014070 con 0x560f25b37ac0 2024-02-15T22:56:24.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.991+0000 7f450660c640 1 -- 172.21.15.133:0/3037912770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460800f450 con 0x560f25b37ac0 2024-02-15T22:56:24.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.991+0000 7f450660c640 1 -- 172.21.15.133:0/3037912770 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f460800f730 con 0x560f25b37ac0 2024-02-15T22:56:24.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.991+0000 7f461aa99800 1 -- 172.21.15.133:0/3037912770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 msgr2=0x560f25c270f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:24.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.991+0000 7f461aa99800 1 --2- 172.21.15.133:0/3037912770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25c270f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4608001d00 tx=0x7f460800b600 comp rx=0 tx=0).stop 2024-02-15T22:56:24.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.991+0000 7f461aa99800 1 -- 172.21.15.133:0/3037912770 shutdown_connections 2024-02-15T22:56:24.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.991+0000 7f461aa99800 1 --2- 172.21.15.133:0/3037912770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25c270f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:24.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.991+0000 7f461aa99800 1 -- 172.21.15.133:0/3037912770 >> 172.21.15.133:0/3037912770 conn(0x560f25b314f0 msgr2=0x560f25c22a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:24.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.992+0000 7f461aa99800 1 -- 172.21.15.133:0/3037912770 shutdown_connections 2024-02-15T22:56:24.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.992+0000 7f461aa99800 1 -- 172.21.15.133:0/3037912770 wait complete. 2024-02-15T22:56:24.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.992+0000 7f461aa99800 1 Processor -- start 2024-02-15T22:56:24.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.992+0000 7f461aa99800 1 -- start start 2024-02-15T22:56:24.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.992+0000 7f461aa99800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25b373e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:24.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.992+0000 7f461aa99800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f25a32160 con 0x560f25b37ac0 2024-02-15T22:56:24.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.992+0000 7f4618598640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25b373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:24.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.992+0000 7f4618598640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25b373e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57390/0 (socket says 172.21.15.133:57390) 2024-02-15T22:56:24.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.992+0000 7f4618598640 1 -- 172.21.15.133:0/1809521131 learned_addr learned my addr 172.21.15.133:0/1809521131 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:24.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.992+0000 7f4618598640 1 -- 172.21.15.133:0/1809521131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f25a81c50 con 0x560f25b37ac0 2024-02-15T22:56:24.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.993+0000 7f4618598640 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25b373e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x560f25c27e80 tx=0x7f4608000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:24.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.993+0000 7f4504e09640 1 -- 172.21.15.133:0/1809521131 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4608014050 con 0x560f25b37ac0 2024-02-15T22:56:24.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.993+0000 7f4504e09640 1 -- 172.21.15.133:0/1809521131 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460801ba30 con 0x560f25b37ac0 2024-02-15T22:56:24.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.993+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560f25b37920 con 0x560f25b37ac0 2024-02-15T22:56:24.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.993+0000 7f4504e09640 1 -- 172.21.15.133:0/1809521131 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f460801bcd0 con 0x560f25b37ac0 2024-02-15T22:56:24.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.993+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f25b35e20 con 0x560f25b37ac0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.994+0000 7f4504e09640 1 -- 172.21.15.133:0/1809521131 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4608022020 con 0x560f25b37ac0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.994+0000 7f4504e09640 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4500036790 0x7f4500038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.994+0000 7f4504e09640 1 -- 172.21.15.133:0/1809521131 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4608008030 con 0x560f25b37ac0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.994+0000 7f4617d97640 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4500036790 0x7f4500038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.994+0000 7f461aa99800 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560f25b3b5d0 0x560f25c375c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.994+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c37b50 con 0x560f25b3b5d0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.994+0000 7f4618d99640 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560f25b3b5d0 0x560f25c375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.994+0000 7f4617d97640 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4500036790 0x7f4500038c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f460c054000 tx=0x7f460c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.994+0000 7f4618d99640 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560f25b3b5d0 0x560f25c375c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.995+0000 7f4618d99640 1 -- 172.21.15.133:0/1809521131 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f461000a4a0 con 0x560f25b3b5d0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.995+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25b36150 con 0x560f25b3b5d0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.995+0000 7f4618d99640 1 -- 172.21.15.133:0/1809521131 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f461000a4a0 con 0x560f25b3b5d0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.995+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c39880 con 0x560f25b3b5d0 2024-02-15T22:56:25.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.995+0000 7f4618d99640 1 -- 172.21.15.133:0/1809521131 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f461000a4a0 con 0x560f25b3b5d0 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.995+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c38a80 con 0x560f25b3b5d0 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.996+0000 7f4618d99640 1 -- 172.21.15.133:0/1809521131 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f461000a4a0 con 0x560f25b3b5d0 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.996+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c38e90 con 0x560f25b3b5d0 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.996+0000 7f4618d99640 1 -- 172.21.15.133:0/1809521131 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f461000a4a0 con 0x560f25b3b5d0 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.996+0000 7f461aa99800 1 Processor -- start 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.996+0000 7f461aa99800 1 -- start start 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.996+0000 7f461aa99800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c482e0 0x560f25c48700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.996+0000 7f461aa99800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f259d4e80 con 0x560f25c482e0 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.997+0000 7f4617d97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c482e0 0x560f25c48700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.997+0000 7f4617d97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c482e0 0x560f25c48700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57400/0 (socket says 172.21.15.133:57400) 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.997+0000 7f4617d97640 1 -- 172.21.15.133:0/4168609280 learned_addr learned my addr 172.21.15.133:0/4168609280 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.997+0000 7f4617d97640 1 -- 172.21.15.133:0/4168609280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f25c48c40 con 0x560f25c482e0 2024-02-15T22:56:25.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.997+0000 7f4617d97640 1 --2- 172.21.15.133:0/4168609280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c482e0 0x560f25c48700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f460c055040 tx=0x7f460c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.997+0000 7f44fdffb640 1 -- 172.21.15.133:0/4168609280 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f460c05db80 con 0x560f25c482e0 2024-02-15T22:56:25.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.997+0000 7f44fdffb640 1 -- 172.21.15.133:0/4168609280 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c05dce0 con 0x560f25c482e0 2024-02-15T22:56:25.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.997+0000 7f461aa99800 1 -- 172.21.15.133:0/4168609280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560f25c48e30 con 0x560f25c482e0 2024-02-15T22:56:25.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.997+0000 7f44fdffb640 1 -- 172.21.15.133:0/4168609280 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f460c069400 con 0x560f25c482e0 2024-02-15T22:56:25.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.997+0000 7f461aa99800 1 -- 172.21.15.133:0/4168609280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f25c49980 con 0x560f25c482e0 2024-02-15T22:56:25.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.998+0000 7f44fdffb640 1 -- 172.21.15.133:0/4168609280 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f460c059040 con 0x560f25c482e0 2024-02-15T22:56:25.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.998+0000 7f44fdffb640 1 --2- 172.21.15.133:0/4168609280 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44f0036790 0x7f44f0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.998+0000 7f44fdffb640 1 -- 172.21.15.133:0/4168609280 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f460c08f450 con 0x560f25c482e0 2024-02-15T22:56:25.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.998+0000 7f4618d99640 1 --2- 172.21.15.133:0/4168609280 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44f0036790 0x7f44f0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.998+0000 7f461aa99800 1 Processor -- start 2024-02-15T22:56:25.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.999+0000 7f461aa99800 1 -- start start 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.999+0000 7f4618d99640 1 --2- 172.21.15.133:0/4168609280 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44f0036790 0x7f44f0038c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x560f25c384c0 tx=0x7f4610005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.999+0000 7f461aa99800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.999+0000 7f461aa99800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f259aa5d0 con 0x560f25c554a0 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.999+0000 7f4617d97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.999+0000 7f4617d97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57402/0 (socket says 172.21.15.133:57402) 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.999+0000 7f4617d97640 1 -- 172.21.15.133:0/2634878985 learned_addr learned my addr 172.21.15.133:0/2634878985 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.999+0000 7f4617d97640 1 -- 172.21.15.133:0/2634878985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f25c55e90 con 0x560f25c554a0 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:24.999+0000 7f4617d97640 1 --2- 172.21.15.133:0/2634878985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c558c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f460c0684a0 tx=0x7f460c068e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3601687d54e12779 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f44f77fe640 1 -- 172.21.15.133:0/2634878985 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f460c072580 con 0x560f25c554a0 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f44f77fe640 1 -- 172.21.15.133:0/2634878985 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c006380 con 0x560f25c554a0 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f44f77fe640 1 -- 172.21.15.133:0/2634878985 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f460c08f070 con 0x560f25c554a0 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f461aa99800 1 -- 172.21.15.133:0/2634878985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 msgr2=0x560f25c558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f461aa99800 1 --2- 172.21.15.133:0/2634878985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c558c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f460c0684a0 tx=0x7f460c068e80 comp rx=0 tx=0).stop 2024-02-15T22:56:25.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f461aa99800 1 -- 172.21.15.133:0/2634878985 shutdown_connections 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f461aa99800 1 --2- 172.21.15.133:0/2634878985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c558c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f461aa99800 1 -- 172.21.15.133:0/2634878985 >> 172.21.15.133:0/2634878985 conn(0x560f25c51800 msgr2=0x560f25c4f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f461aa99800 1 -- 172.21.15.133:0/2634878985 shutdown_connections 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f461aa99800 1 -- 172.21.15.133:0/2634878985 wait complete. 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f461aa99800 1 Processor -- start 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f461aa99800 1 -- start start 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f461aa99800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c5c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.000+0000 7f461aa99800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f25c5c9a0 con 0x560f25c554a0 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.001+0000 7f4617d97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c5c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.001+0000 7f4617d97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c5c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57410/0 (socket says 172.21.15.133:57410) 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.001+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 learned_addr learned my addr 172.21.15.133:0/3972402166 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.001+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f25c49980 con 0x560f25c554a0 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.001+0000 7f4617d97640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c5c460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f460c05d870 tx=0x7f460c08d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.001+0000 7f44f5ffb640 1 -- 172.21.15.133:0/3972402166 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f460c0064f0 con 0x560f25c554a0 2024-02-15T22:56:25.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.001+0000 7f44f5ffb640 1 -- 172.21.15.133:0/3972402166 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c068730 con 0x560f25c554a0 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.001+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560f25c5cba0 con 0x560f25c554a0 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.001+0000 7f44f5ffb640 1 -- 172.21.15.133:0/3972402166 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f460c08c0c0 con 0x560f25c554a0 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.001+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f25c5cba0 con 0x560f25c554a0 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.002+0000 7f44f5ffb640 1 -- 172.21.15.133:0/3972402166 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f460c095070 con 0x560f25c554a0 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.002+0000 7f44f5ffb640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44e8036790 0x7f44e8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.002+0000 7f44f5ffb640 1 -- 172.21.15.133:0/3972402166 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f460c099b20 con 0x560f25c554a0 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.002+0000 7f4618d99640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44e8036790 0x7f44e8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f4618d99640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44e8036790 0x7f44e8038c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f461000b010 tx=0x7f4610020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f461aa99800 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560f25c67e90 0x560f25c6a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6aaa0 con 0x560f25c67e90 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f4618598640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560f25c67e90 0x560f25c6a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f4618598640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560f25c67e90 0x560f25c6a350 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f461aa99800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f461aa99800 20 realm 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6ae70 con 0x560f25c67e90 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.003+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6b6f0 con 0x560f25c67e90 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6ba50 con 0x560f25c67e90 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c67e90 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 20 searching for the correct realm 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560f25c6e0e0 0x560f25c705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c70c70 con 0x560f25c6e0e0 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.004+0000 7f4617d97640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560f25c6e0e0 0x560f25c705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.005+0000 7f4617d97640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560f25c6e0e0 0x560f25c705a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.005+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.005+0000 7f4617d97640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f460c087070 0x7f460c05c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.005+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c70c70 con 0x7f460c087070 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.005+0000 7f4618d99640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f460c087070 0x7f460c05c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.005+0000 7f4618d99640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f460c087070 0x7f460c05c980 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.006+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f461000a4a0 con 0x7f460c087070 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.006+0000 7f4618d99640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f46100141d0 0x7f4610015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.006+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c70c70 con 0x7f46100141d0 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.006+0000 7f4618598640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f46100141d0 0x7f4610015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.006+0000 7f4618598640 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f46100141d0 0x7f4610015940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.006+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.007+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c67e90 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.007+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.007+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c67e90 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.007+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.007+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f46100141d0 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.007+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.007+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f46100141d0 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.007+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.007+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f460c087070 2024-02-15T22:56:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.008+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f461000a4a0 con 0x7f460c087070 2024-02-15T22:56:25.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.008+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c6e0e0 2024-02-15T22:56:25.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.008+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.008+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c67e90 2024-02-15T22:56:25.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.008+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.008+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f46100141d0 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.009+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.009+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c67e90 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.009+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.009+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f460c087070 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.010+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f461003a040 con 0x7f460c087070 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.010+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c6e0e0 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.010+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.010+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c6e0e0 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.010+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.010+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f46100141d0 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.011+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.011+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c6e0e0 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.011+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.011+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c6e0e0 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.011+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.011+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c67e90 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.011+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.011+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c67e90 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.012+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.012+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f46100141d0 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.012+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.012+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c6e0e0 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.012+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.012+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f460c087070 2024-02-15T22:56:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.012+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f461003a040 con 0x7f460c087070 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.012+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c67e90 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.013+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.013+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f46100141d0 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.013+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.013+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c6e0e0 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.013+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.013+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f46100141d0 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.013+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.013+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f460c087070 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.014+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f461003a040 con 0x7f460c087070 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.014+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c6e0e0 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.014+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.014+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f46100141d0 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.014+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.014+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x560f25c67e90 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.014+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.014+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6c250 con 0x7f460c087070 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f461003a040 con 0x7f460c087070 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6ca50 con 0x560f25c67e90 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6ce00 con 0x560f25c67e90 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6ce00 con 0x560f25c67e90 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.015+0000 7f461aa99800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 20 zone default found 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 4 Realm: () 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 20 zonegroup default 2024-02-15T22:56:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6d2d0 con 0x7f46100141d0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c6d6d0 con 0x560f25c6e0e0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c72b00 con 0x560f25c6e0e0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.016+0000 7f461aa99800 20 started sync module instance, tier type = 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.017+0000 7f461aa99800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.017+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c72370 con 0x7f460c087070 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.017+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f461003a040 con 0x7f460c087070 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.017+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94623058304720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c72720 con 0x7f460c087070 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.018+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c73860 con 0x560f25c67e90 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.018+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94623058304720] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f461003a040 con 0x7f460c087070 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.019+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.019+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94623058308896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c73960 con 0x560f25c67e90 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.019+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c743e0 con 0x560f25c6e0e0 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.020+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94623058308896] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.020+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.020+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94623058312928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c747c0 con 0x560f25c6e0e0 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.020+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c75170 con 0x7f460c087070 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.021+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94623058312928] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.021+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f461003a040 con 0x7f460c087070 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.021+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94623058310080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c75520 con 0x7f460c087070 2024-02-15T22:56:25.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.021+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c75f70 con 0x560f25c67e90 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.022+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.022+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94623058319952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c75f30 con 0x560f25c67e90 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.022+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94623058310080] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f461003a040 con 0x7f460c087070 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.022+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c76ef0 con 0x7f46100141d0 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.023+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.023+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94623058319952] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.023+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94623058316512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c76ef0 con 0x7f46100141d0 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.023+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c76340 con 0x7f46100141d0 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.024+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.024+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94623058322240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c77890 con 0x7f46100141d0 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.024+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c782c0 con 0x7f46100141d0 2024-02-15T22:56:25.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.024+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94623058316512] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.025+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.025+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94623058322240] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.025+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94623058329024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c78280 con 0x7f46100141d0 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.025+0000 7f461aa99800 20 add_watcher() i=0 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.025+0000 7f461aa99800 20 add_watcher() i=1 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.025+0000 7f461aa99800 20 add_watcher() i=2 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.025+0000 7f461aa99800 20 add_watcher() i=3 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.025+0000 7f461aa99800 20 add_watcher() i=4 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.025+0000 7f461aa99800 20 add_watcher() i=5 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.025+0000 7f461aa99800 20 add_watcher() i=6 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.026+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94623058329024] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.026+0000 7f461aa99800 20 add_watcher() i=7 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.026+0000 7f461aa99800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:25.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.026+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c7b2e0 con 0x560f25c67e90 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.026+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.026+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94623058323984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c78720 con 0x560f25c67e90 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.027+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94623058323984] v30'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.027+0000 7f44ce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 5 note: GC not initialized 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f44cd7e2640 20 reqs_thread_entry: start 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 20 Filter name: none 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f443effd640 20 reqs_thread_entry: start 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25cad3f0 con 0x560f25c67e90 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.028+0000 7f461aa99800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.029+0000 7f461aa99800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.029+0000 7f461aa99800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.029+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25cacf30 con 0x7f46100141d0 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.029+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.029+0000 7f461aa99800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.029+0000 7f461aa99800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.029+0000 7f461aa99800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.029+0000 7f461aa99800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.029+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~461 in=461b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25cb3430 con 0x560f25c67e90 2024-02-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~461] v30'4 uv4 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f461aa99800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f461aa99800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f461aa99800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94623058571056 in=649b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25cb02d0 con 0x560f25c67e90 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 94623058319952 notify 128849018883 ret 0) v3 ==== 679+0+0 (crc 0 0 0) 0x560f25b35e20 con 0x560f25c67e90 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f44f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94623058319952 notifier 4334 bl.length()=637 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f44f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f44f77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(65 notify.4 [notify cookie 94623058571056 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f44f77fe640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44dc003e90 con 0x560f25c67e90 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.030+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.031+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== watch-notify(notify_complete (2) cookie 94623058571056 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560f25a81c50 con 0x560f25c67e90 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.031+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25cb06c0 con 0x7f46100141d0 2024-02-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f461aa99800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f461aa99800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f461aa99800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94623058571056 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25cadd90 con 0x560f25c6e0e0 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== watch-notify(notify (1) cookie 94623058312928 notify 128849018880 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x560f25c49980 con 0x560f25c6e0e0 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f44f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94623058312928 notifier 4334 bl.length()=177 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f44f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f44f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(68 notify.2 [notify cookie 94623058571056 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f44f6ffd640 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f444c0033f0 con 0x560f25c6e0e0 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.032+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.033+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== watch-notify(notify_complete (2) cookie 94623058571056 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560f25c55e90 con 0x560f25c6e0e0 2024-02-15T22:56:25.044 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.033+0000 7f44ce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.033+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94623058323984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c7a5a0 con 0x560f25c67e90 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.034+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94623058323984] v30'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.034+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94623058304720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c76a10 con 0x7f460c087070 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.035+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94623058304720] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f461003a040 con 0x7f460c087070 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.035+0000 7f461aa99800 20 remove_watcher() i=0 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.035+0000 7f461aa99800 2 removed watcher, disabling cache 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.035+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94623058308896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c76a10 con 0x560f25c67e90 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.036+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94623058308896] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.036+0000 7f461aa99800 20 remove_watcher() i=1 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.036+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94623058312928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c76a10 con 0x560f25c6e0e0 2024-02-15T22:56:25.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.037+0000 7f4617d97640 1 -- 172.21.15.133:0/3972402166 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94623058312928] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f460c094030 con 0x560f25c6e0e0 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.037+0000 7f461aa99800 20 remove_watcher() i=2 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.037+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94623058310080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c71ed0 con 0x7f460c087070 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.039+0000 7f4618d99640 1 -- 172.21.15.133:0/3972402166 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94623058310080] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f461003a040 con 0x7f460c087070 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.039+0000 7f461aa99800 20 remove_watcher() i=3 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.039+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94623058319952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c71ed0 con 0x560f25c67e90 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.040+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94623058319952] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x560f25c67e90 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.040+0000 7f461aa99800 20 remove_watcher() i=4 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.040+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94623058316512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c71ed0 con 0x7f46100141d0 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.041+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94623058316512] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.041+0000 7f461aa99800 20 remove_watcher() i=5 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.041+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94623058322240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c74ce0 con 0x7f46100141d0 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.042+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94623058322240] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.042+0000 7f461aa99800 20 remove_watcher() i=6 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.042+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94623058329024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f25c74ce0 con 0x7f46100141d0 2024-02-15T22:56:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94623058329024] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4608016070 con 0x7f46100141d0 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 20 remove_watcher() i=7 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f46100141d0 msgr2=0x7f4610015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f46100141d0 0x7f4610015940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560f25c67e90 msgr2=0x560f25c6a350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560f25c67e90 0x560f25c6a350 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f460c087070 msgr2=0x7f460c05c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f460c087070 0x7f460c05c980 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560f25c6e0e0 msgr2=0x560f25c705a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560f25c6e0e0 0x560f25c705a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44e8036790 msgr2=0x7f44e8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44e8036790 0x7f44e8038c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f461000b010 tx=0x7f4610020000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 msgr2=0x560f25c5c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f4618598640 1 -- 172.21.15.133:0/3972402166 reap_dead start 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c5c460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f460c05d870 tx=0x7f460c08d8c0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 shutdown_connections 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 --2- 172.21.15.133:0/3972402166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c554a0 0x560f25c5c460 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 >> 172.21.15.133:0/3972402166 conn(0x560f25c51800 msgr2=0x560f25c4ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 shutdown_connections 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/3972402166 wait complete. 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/4168609280 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44f0036790 msgr2=0x7f44f0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 --2- 172.21.15.133:0/4168609280 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44f0036790 0x7f44f0038c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x560f25c384c0 tx=0x7f4610005840 comp rx=0 tx=0).stop 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 -- 172.21.15.133:0/4168609280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c482e0 msgr2=0x560f25c48700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.043+0000 7f461aa99800 1 --2- 172.21.15.133:0/4168609280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c482e0 0x560f25c48700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f460c055040 tx=0x7f460c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 -- 172.21.15.133:0/4168609280 shutdown_connections 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 --2- 172.21.15.133:0/4168609280 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44f0036790 0x7f44f0038c50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 --2- 172.21.15.133:0/4168609280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25c482e0 0x560f25c48700 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 -- 172.21.15.133:0/4168609280 >> 172.21.15.133:0/4168609280 conn(0x560f25c3c380 msgr2=0x560f25c3c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 -- 172.21.15.133:0/4168609280 shutdown_connections 2024-02-15T22:56:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 -- 172.21.15.133:0/4168609280 wait complete. 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560f25b3b5d0 msgr2=0x560f25c375c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560f25b3b5d0 0x560f25c375c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4500036790 msgr2=0x7f4500038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4500036790 0x7f4500038c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f460c054000 tx=0x7f460c04e000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 msgr2=0x560f25b373e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25b373e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x560f25c27e80 tx=0x7f4608000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 shutdown_connections 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560f25b3b5d0 0x560f25c375c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4500036790 0x7f4500038c50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 --2- 172.21.15.133:0/1809521131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f25b37ac0 0x560f25b373e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 >> 172.21.15.133:0/1809521131 conn(0x560f25b314f0 msgr2=0x560f25c212d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 shutdown_connections 2024-02-15T22:56:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.044+0000 7f461aa99800 1 -- 172.21.15.133:0/1809521131 wait complete. 2024-02-15T22:56:25.054 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:25.054 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T22:56:25.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T22:56:25.055 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T22:56:25.097 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:25.097 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:25.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.095+0000 7f375262e800 1 Processor -- start 2024-02-15T22:56:25.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.095+0000 7f375262e800 1 -- start start 2024-02-15T22:56:25.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.095+0000 7f375262e800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e0434c4e70 0x55e0434c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.095+0000 7f375262e800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e043410bb0 con 0x55e0434c60d0 2024-02-15T22:56:25.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.095+0000 7f375262e800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e0433c8450 con 0x55e0434c4e70 2024-02-15T22:56:25.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.096+0000 7f374d96c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e0434c4e70 0x55e0434c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.096+0000 7f374d96c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e0434c4e70 0x55e0434c5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57416/0 (socket says 172.21.15.133:57416) 2024-02-15T22:56:25.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.096+0000 7f374d96c640 1 -- 172.21.15.133:0/873496500 learned_addr learned my addr 172.21.15.133:0/873496500 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.096+0000 7f374d96c640 1 -- 172.21.15.133:0/873496500 >> v1:172.21.15.52:6789/0 conn(0x55e0434c60d0 legacy=0x55e0434c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.096+0000 7f374d96c640 1 -- 172.21.15.133:0/873496500 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0434c5960 con 0x55e0434c4e70 2024-02-15T22:56:25.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.098+0000 7f374d96c640 1 --2- 172.21.15.133:0/873496500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e0434c5290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f374000a520 tx=0x7f374001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3db53de7956d28 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.098+0000 7f374d16b640 1 -- 172.21.15.133:0/873496500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3740052570 con 0x55e0434c4e70 2024-02-15T22:56:25.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.098+0000 7f374d16b640 1 -- 172.21.15.133:0/873496500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37400526d0 con 0x55e0434c4e70 2024-02-15T22:56:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.098+0000 7f374d16b640 1 -- 172.21.15.133:0/873496500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3740052990 con 0x55e0434c4e70 2024-02-15T22:56:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.098+0000 7f375262e800 1 -- 172.21.15.133:0/873496500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 msgr2=0x55e0434c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.098+0000 7f375262e800 1 --2- 172.21.15.133:0/873496500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e0434c5290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f374000a520 tx=0x7f374001cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.098+0000 7f375262e800 1 -- 172.21.15.133:0/873496500 shutdown_connections 2024-02-15T22:56:25.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.098+0000 7f375262e800 1 --2- 172.21.15.133:0/873496500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e0434c5290 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.098+0000 7f375262e800 1 -- 172.21.15.133:0/873496500 >> 172.21.15.133:0/873496500 conn(0x55e0434c04d0 msgr2=0x55e0434c28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.099+0000 7f375262e800 1 -- 172.21.15.133:0/873496500 shutdown_connections 2024-02-15T22:56:25.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.099+0000 7f375262e800 1 -- 172.21.15.133:0/873496500 wait complete. 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.110+0000 7f375262e800 1 Processor -- start 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.110+0000 7f375262e800 1 -- start start 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.110+0000 7f375262e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e043438f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.110+0000 7f375262e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0433c5980 con 0x55e0434c4e70 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.111+0000 7f374d96c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e043438f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.111+0000 7f374d96c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e043438f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57424/0 (socket says 172.21.15.133:57424) 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.111+0000 7f374d96c640 1 -- 172.21.15.133:0/276304694 learned_addr learned my addr 172.21.15.133:0/276304694 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.111+0000 7f374d96c640 1 -- 172.21.15.133:0/276304694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740005de0 con 0x55e0434c4e70 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.111+0000 7f374d96c640 1 --2- 172.21.15.133:0/276304694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e043438f30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3740055040 tx=0x7f374004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcea06f85d3b02e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.111+0000 7f363be07640 1 -- 172.21.15.133:0/276304694 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3740052840 con 0x55e0434c4e70 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.111+0000 7f363be07640 1 -- 172.21.15.133:0/276304694 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37400529c0 con 0x55e0434c4e70 2024-02-15T22:56:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.111+0000 7f363be07640 1 -- 172.21.15.133:0/276304694 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3740052ca0 con 0x55e0434c4e70 2024-02-15T22:56:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.112+0000 7f375262e800 1 -- 172.21.15.133:0/276304694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 msgr2=0x55e043438f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.112+0000 7f375262e800 1 --2- 172.21.15.133:0/276304694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e043438f30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3740055040 tx=0x7f374004c000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.112+0000 7f375262e800 1 -- 172.21.15.133:0/276304694 shutdown_connections 2024-02-15T22:56:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.112+0000 7f375262e800 1 --2- 172.21.15.133:0/276304694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e043438f30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.112+0000 7f375262e800 1 -- 172.21.15.133:0/276304694 >> 172.21.15.133:0/276304694 conn(0x55e0434c04d0 msgr2=0x55e0435b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.112+0000 7f375262e800 1 -- 172.21.15.133:0/276304694 shutdown_connections 2024-02-15T22:56:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.112+0000 7f375262e800 1 -- 172.21.15.133:0/276304694 wait complete. 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.112+0000 7f375262e800 1 Processor -- start 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.112+0000 7f375262e800 1 -- start start 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f375262e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e0435bd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f375262e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0433c1160 con 0x55e0434c4e70 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f374d96c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e0435bd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f374d96c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e0435bd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57436/0 (socket says 172.21.15.133:57436) 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f374d96c640 1 -- 172.21.15.133:0/1718498310 learned_addr learned my addr 172.21.15.133:0/1718498310 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f374d96c640 1 -- 172.21.15.133:0/1718498310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374004e070 con 0x55e0434c4e70 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f374d96c640 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e0435bd9e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f374001ceb0 tx=0x7f3740002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f363a604640 1 -- 172.21.15.133:0/1718498310 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f374006c070 con 0x55e0434c4e70 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f363a604640 1 -- 172.21.15.133:0/1718498310 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374005d480 con 0x55e0434c4e70 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0435bdf20 con 0x55e0434c4e70 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f363a604640 1 -- 172.21.15.133:0/1718498310 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f374005d760 con 0x55e0434c4e70 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.113+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0435be460 con 0x55e0434c4e70 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.114+0000 7f363a604640 1 -- 172.21.15.133:0/1718498310 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3740059040 con 0x55e0434c4e70 2024-02-15T22:56:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.114+0000 7f363a604640 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3634036790 0x7f3634038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.114+0000 7f363a604640 1 -- 172.21.15.133:0/1718498310 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f374008d320 con 0x55e0434c4e70 2024-02-15T22:56:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.114+0000 7f374516b640 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3634036790 0x7f3634038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.114+0000 7f375262e800 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e0434c60d0 0x55e0435c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.114+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435c4be0 con 0x55e0434c60d0 2024-02-15T22:56:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.115+0000 7f374e16d640 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e0434c60d0 0x55e0435c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.115+0000 7f374516b640 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3634036790 0x7f3634038c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3738001e10 tx=0x7f3738001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.115+0000 7f374e16d640 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e0434c60d0 0x55e0435c46a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.115+0000 7f374e16d640 1 -- 172.21.15.133:0/1718498310 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f374800a4a0 con 0x55e0434c60d0 2024-02-15T22:56:25.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.115+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435c1dd0 con 0x55e0434c60d0 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.115+0000 7f374e16d640 1 -- 172.21.15.133:0/1718498310 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f374800a4a0 con 0x55e0434c60d0 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.115+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435c6910 con 0x55e0434c60d0 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.116+0000 7f374e16d640 1 -- 172.21.15.133:0/1718498310 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f374800a4a0 con 0x55e0434c60d0 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.116+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435c5b10 con 0x55e0434c60d0 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.116+0000 7f374e16d640 1 -- 172.21.15.133:0/1718498310 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f374800a4a0 con 0x55e0434c60d0 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.116+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435c5f20 con 0x55e0434c60d0 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.116+0000 7f374e16d640 1 -- 172.21.15.133:0/1718498310 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f374800a4a0 con 0x55e0434c60d0 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.116+0000 7f375262e800 1 Processor -- start 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.117+0000 7f375262e800 1 -- start start 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.117+0000 7f375262e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435d5300 0x55e0435d5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.117+0000 7f375262e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e043363e80 con 0x55e0435d5300 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.117+0000 7f374516b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435d5300 0x55e0435d5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.117+0000 7f374516b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435d5300 0x55e0435d5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57450/0 (socket says 172.21.15.133:57450) 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.117+0000 7f374516b640 1 -- 172.21.15.133:0/1424032643 learned_addr learned my addr 172.21.15.133:0/1424032643 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.117+0000 7f374516b640 1 -- 172.21.15.133:0/1424032643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0435d5c60 con 0x55e0435d5300 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.117+0000 7f374516b640 1 --2- 172.21.15.133:0/1424032643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435d5300 0x55e0435d5720 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3738001770 tx=0x7f373800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.117+0000 7f36337fe640 1 -- 172.21.15.133:0/1424032643 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f373801c410 con 0x55e0435d5300 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.117+0000 7f36337fe640 1 -- 172.21.15.133:0/1424032643 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373801c570 con 0x55e0435d5300 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.117+0000 7f375262e800 1 -- 172.21.15.133:0/1424032643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0435d66d0 con 0x55e0435d5300 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.118+0000 7f36337fe640 1 -- 172.21.15.133:0/1424032643 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f373801c810 con 0x55e0435d5300 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.118+0000 7f375262e800 1 -- 172.21.15.133:0/1424032643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0435d6b90 con 0x55e0435d5300 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.118+0000 7f36337fe640 1 -- 172.21.15.133:0/1424032643 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f373801c970 con 0x55e0435d5300 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.118+0000 7f36337fe640 1 --2- 172.21.15.133:0/1424032643 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f36280367e0 0x7f3628038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.118+0000 7f36337fe640 1 -- 172.21.15.133:0/1424032643 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f3738018040 con 0x55e0435d5300 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.118+0000 7f374e16d640 1 --2- 172.21.15.133:0/1424032643 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f36280367e0 0x7f3628038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.119+0000 7f375262e800 1 Processor -- start 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.119+0000 7f375262e800 1 -- start start 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.119+0000 7f375262e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.119+0000 7f375262e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0433395d0 con 0x55e0435b67c0 2024-02-15T22:56:25.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.119+0000 7f374e16d640 1 --2- 172.21.15.133:0/1424032643 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f36280367e0 0x7f3628038ca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55e0435c5550 tx=0x7f3748005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.119+0000 7f374516b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.119+0000 7f374516b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57466/0 (socket says 172.21.15.133:57466) 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.119+0000 7f374516b640 1 -- 172.21.15.133:0/1018350723 learned_addr learned my addr 172.21.15.133:0/1018350723 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.119+0000 7f374516b640 1 -- 172.21.15.133:0/1018350723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0435b6c30 con 0x55e0435b67c0 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.119+0000 7f374516b640 1 --2- 172.21.15.133:0/1018350723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435b4eb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f373804c0c0 tx=0x7f3738024f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296875666c4610e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f36317fa640 1 -- 172.21.15.133:0/1018350723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3738024920 con 0x55e0435b67c0 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f36317fa640 1 -- 172.21.15.133:0/1018350723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3738024b80 con 0x55e0435b67c0 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f36317fa640 1 -- 172.21.15.133:0/1018350723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3738025a00 con 0x55e0435b67c0 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f375262e800 1 -- 172.21.15.133:0/1018350723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 msgr2=0x55e0435b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f375262e800 1 --2- 172.21.15.133:0/1018350723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435b4eb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f373804c0c0 tx=0x7f3738024f00 comp rx=0 tx=0).stop 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f375262e800 1 -- 172.21.15.133:0/1018350723 shutdown_connections 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f375262e800 1 --2- 172.21.15.133:0/1018350723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435b4eb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f375262e800 1 -- 172.21.15.133:0/1018350723 >> 172.21.15.133:0/1018350723 conn(0x55e0435de8e0 msgr2=0x55e0435dc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f375262e800 1 -- 172.21.15.133:0/1018350723 shutdown_connections 2024-02-15T22:56:25.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f375262e800 1 -- 172.21.15.133:0/1018350723 wait complete. 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f375262e800 1 Processor -- start 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f375262e800 1 -- start start 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f375262e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435eb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.120+0000 7f375262e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0435ebce0 con 0x55e0435b67c0 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.121+0000 7f374516b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435eb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.121+0000 7f374516b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435eb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57468/0 (socket says 172.21.15.133:57468) 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.121+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 learned_addr learned my addr 172.21.15.133:0/3492513013 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.121+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0435d6b90 con 0x55e0435b67c0 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.121+0000 7f374516b640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435eb7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f373804afe0 tx=0x7f373804c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.121+0000 7f361f7fe640 1 -- 172.21.15.133:0/3492513013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3738034030 con 0x55e0435b67c0 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.121+0000 7f361f7fe640 1 -- 172.21.15.133:0/3492513013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37380258d0 con 0x55e0435b67c0 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.121+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0435d6b90 con 0x55e0435b67c0 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.121+0000 7f361f7fe640 1 -- 172.21.15.133:0/3492513013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3738023300 con 0x55e0435b67c0 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.121+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0435d6b90 con 0x55e0435b67c0 2024-02-15T22:56:25.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.122+0000 7f361f7fe640 1 -- 172.21.15.133:0/3492513013 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3738037070 con 0x55e0435b67c0 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.122+0000 7f361f7fe640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f36180367e0 0x7f3618038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.122+0000 7f361f7fe640 1 -- 172.21.15.133:0/3492513013 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f3738035070 con 0x55e0435b67c0 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.122+0000 7f374e16d640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f36180367e0 0x7f3618038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.122+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.122+0000 7f375262e800 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e0435f6fe0 0x55e0435f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.122+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435f9bf0 con 0x55e0435f6fe0 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f374d96c640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e0435f6fe0 0x55e0435f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f374e16d640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f36180367e0 0x7f3618038ca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f374800b010 tx=0x7f3748020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f374d96c640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e0435f6fe0 0x55e0435f94a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3740080040 con 0x55e0435f6fe0 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f375262e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f375262e800 20 realm 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435f9fc0 con 0x55e0435f6fe0 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3740080040 con 0x55e0435f6fe0 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f375262e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f375262e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435fa840 con 0x55e0435f6fe0 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3740080040 con 0x55e0435f6fe0 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f375262e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.123+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435faba0 con 0x55e0435f6fe0 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.124+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3740080040 con 0x55e0435f6fe0 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.124+0000 7f375262e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.124+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.124+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435fa4a0 con 0x55e0435f6fe0 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.124+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3740080040 con 0x55e0435f6fe0 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.124+0000 7f375262e800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.124+0000 7f375262e800 20 searching for the correct realm 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.124+0000 7f375262e800 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55e0435fcf20 0x55e0435ff310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.124+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435fcf20 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.124+0000 7f374516b640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55e0435fcf20 0x55e0435ff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.124+0000 7f374516b640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55e0435fcf20 0x55e0435ff310 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.125+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f373802f830 con 0x55e0435fcf20 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.125+0000 7f374516b640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f373801c030 0x7f3738052040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.125+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f373801c030 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.125+0000 7f374e16d640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f373801c030 0x7f3738052040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.125+0000 7f374e16d640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f373801c030 0x7f3738052040 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.125+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374800a4a0 con 0x7f373801c030 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.125+0000 7f374e16d640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f37480141d0 0x7f3748015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.125+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f37480141d0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.126+0000 7f374d96c640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f37480141d0 0x7f3748015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.126+0000 7f374d96c640 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f37480141d0 0x7f3748015940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.126+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3740080040 con 0x7f37480141d0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.126+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435f6fe0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.126+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3740080040 con 0x55e0435f6fe0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.126+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435f6fe0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.127+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.127+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f37480141d0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.127+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.127+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f37480141d0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.127+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.127+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f373801c030 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.127+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374800a4a0 con 0x7f373801c030 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.127+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435fcf20 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.128+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f373802f830 con 0x55e0435fcf20 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.128+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435f6fe0 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.128+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.128+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f37480141d0 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.128+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.128+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435f6fe0 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.128+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.128+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f373801c030 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.129+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f374803a040 con 0x7f373801c030 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.129+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435fcf20 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.129+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f373802f830 con 0x55e0435fcf20 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.129+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435fcf20 2024-02-15T22:56:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.129+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f373802f830 con 0x55e0435fcf20 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.129+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f37480141d0 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.129+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.129+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435fcf20 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.130+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f373802f830 con 0x55e0435fcf20 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.130+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435fcf20 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.130+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f373802f830 con 0x55e0435fcf20 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.130+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435f6fe0 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.130+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.130+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435f6fe0 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.130+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.130+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f37480141d0 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.131+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.131+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435fcf20 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.131+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f373802f830 con 0x55e0435fcf20 2024-02-15T22:56:25.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.131+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f373801c030 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.131+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374803a040 con 0x7f373801c030 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.131+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435f6fe0 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.131+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.131+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f37480141d0 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.132+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.132+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435fcf20 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.132+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f373802f830 con 0x55e0435fcf20 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.132+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f37480141d0 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.132+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.132+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f373801c030 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.133+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374803a040 con 0x7f373801c030 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.133+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435fcf20 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.133+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f373802f830 con 0x55e0435fcf20 2024-02-15T22:56:25.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.133+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f37480141d0 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.133+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.133+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x55e0435f6fe0 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.133+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ff9c0 con 0x7f373801c030 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f374803a040 con 0x7f373801c030 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435fb990 con 0x55e0435f6fe0 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435fb610 con 0x55e0435f6fe0 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435fc320 con 0x55e0435f6fe0 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 zone default found 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 4 Realm: () 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 zonegroup default 2024-02-15T22:56:25.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.134+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0435ffe50 con 0x7f37480141d0 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f375262e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043601cd0 con 0x55e0435fcf20 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3738067040 con 0x55e0435fcf20 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f375262e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043602030 con 0x55e0435fcf20 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3738067040 con 0x55e0435fcf20 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f375262e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f375262e800 20 started sync module instance, tier type = 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f375262e800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.135+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0436012a0 con 0x7f373801c030 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.136+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374803a040 con 0x7f373801c030 2024-02-15T22:56:25.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.136+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94421691405904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0436012a0 con 0x7f373801c030 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.136+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043602ad0 con 0x55e0435f6fe0 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.137+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94421691405904] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374803a040 con 0x7f373801c030 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.137+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.137+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94421691409840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0436012a0 con 0x55e0435f6fe0 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.137+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043603530 con 0x55e0435fcf20 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.138+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94421691409840] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.139+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3738067040 con 0x55e0435fcf20 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.139+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94421691403776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043601220 con 0x55e0435fcf20 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.139+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0436043c0 con 0x7f373801c030 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.140+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374803a040 con 0x7f373801c030 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.140+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94421691403776] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3738067040 con 0x55e0435fcf20 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.140+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94421691416832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043604b80 con 0x7f373801c030 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.140+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043605130 con 0x55e0435f6fe0 2024-02-15T22:56:25.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.141+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94421691416832] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374803a040 con 0x7f373801c030 2024-02-15T22:56:25.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.141+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.141+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94421691414800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043605130 con 0x55e0435f6fe0 2024-02-15T22:56:25.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.141+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043605b10 con 0x7f37480141d0 2024-02-15T22:56:25.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.142+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.142+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94421691422256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043605ab0 con 0x7f37480141d0 2024-02-15T22:56:25.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.142+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94421691414800] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.142+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043604620 con 0x7f37480141d0 2024-02-15T22:56:25.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.143+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94421691422256] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.143+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.143+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94421691418144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0436065b0 con 0x7f37480141d0 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.143+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043606f20 con 0x7f37480141d0 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.144+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.144+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94421691427456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0436073a0 con 0x7f37480141d0 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.144+0000 7f375262e800 20 add_watcher() i=0 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.144+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94421691418144] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.144+0000 7f375262e800 20 add_watcher() i=1 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.144+0000 7f375262e800 20 add_watcher() i=2 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.144+0000 7f375262e800 20 add_watcher() i=3 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.144+0000 7f375262e800 20 add_watcher() i=4 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.144+0000 7f375262e800 20 add_watcher() i=5 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.144+0000 7f375262e800 20 add_watcher() i=6 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.145+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94421691427456] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.145+0000 7f375262e800 20 add_watcher() i=7 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.145+0000 7f375262e800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.145+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e04360a840 con 0x55e0435f6fe0 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.146+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.146+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94421691428512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043607cb0 con 0x55e0435f6fe0 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.147+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94421691428512] v30'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.147+0000 7f35ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.147+0000 7f375262e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.147+0000 7f375262e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.147+0000 7f375262e800 5 note: GC not initialized 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.147+0000 7f35fe7fc640 20 reqs_thread_entry: start 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.147+0000 7f375262e800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.147+0000 7f375262e800 20 Filter name: none 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.147+0000 7f3573fff640 20 reqs_thread_entry: start 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.147+0000 7f375262e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.147+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e04363bff0 con 0x55e0435f6fe0 2024-02-15T22:56:25.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.148+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~461 out=461b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+584 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.148+0000 7f375262e800 20 rados_obj.operate() r=0 bl.length=461 2024-02-15T22:56:25.158 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.149+0000 7f35ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.149+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94421691428512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043607810 con 0x55e0435f6fe0 2024-02-15T22:56:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.150+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94421691428512] v30'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.150+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94421691405904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043606ea0 con 0x7f373801c030 2024-02-15T22:56:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.151+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94421691405904] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374803a040 con 0x7f373801c030 2024-02-15T22:56:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.151+0000 7f375262e800 20 remove_watcher() i=0 2024-02-15T22:56:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.151+0000 7f375262e800 2 removed watcher, disabling cache 2024-02-15T22:56:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.151+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94421691409840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043606ea0 con 0x55e0435f6fe0 2024-02-15T22:56:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.152+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94421691409840] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.152+0000 7f375262e800 20 remove_watcher() i=1 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.152+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94421691403776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0436025b0 con 0x55e0435fcf20 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.153+0000 7f374516b640 1 -- 172.21.15.133:0/3492513013 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94421691403776] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3738067040 con 0x55e0435fcf20 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.153+0000 7f375262e800 20 remove_watcher() i=2 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.153+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94421691416832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043606ea0 con 0x7f373801c030 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.154+0000 7f374e16d640 1 -- 172.21.15.133:0/3492513013 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94421691416832] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374803a040 con 0x7f373801c030 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.154+0000 7f375262e800 20 remove_watcher() i=3 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.154+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94421691414800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043600e00 con 0x55e0435f6fe0 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.155+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94421691414800] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x55e0435f6fe0 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.155+0000 7f375262e800 20 remove_watcher() i=4 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.155+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94421691422256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043604100 con 0x7f37480141d0 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.156+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94421691422256] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.156+0000 7f375262e800 20 remove_watcher() i=5 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.156+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94421691418144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043606ea0 con 0x7f37480141d0 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.157+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94421691418144] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.157+0000 7f375262e800 20 remove_watcher() i=6 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.157+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94421691427456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e043600e00 con 0x7f37480141d0 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94421691427456] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f374008a040 con 0x7f37480141d0 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 20 remove_watcher() i=7 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f37480141d0 msgr2=0x7f3748015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f37480141d0 0x7f3748015940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e0435f6fe0 msgr2=0x55e0435f94a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e0435f6fe0 0x55e0435f94a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f373801c030 msgr2=0x7f3738052040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f373801c030 0x7f3738052040 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55e0435fcf20 msgr2=0x55e0435ff310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55e0435fcf20 0x55e0435ff310 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f36180367e0 msgr2=0x7f3618038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f36180367e0 0x7f3618038ca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f374800b010 tx=0x7f3748020000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 msgr2=0x55e0435eb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f374d96c640 1 -- 172.21.15.133:0/3492513013 reap_dead start 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435eb7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f373804afe0 tx=0x7f373804c050 comp rx=0 tx=0).stop 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 shutdown_connections 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 --2- 172.21.15.133:0/3492513013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435b67c0 0x55e0435eb7a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 >> 172.21.15.133:0/3492513013 conn(0x55e0435de8e0 msgr2=0x55e0435dbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 shutdown_connections 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/3492513013 wait complete. 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/1424032643 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f36280367e0 msgr2=0x7f3628038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 --2- 172.21.15.133:0/1424032643 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f36280367e0 0x7f3628038ca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55e0435c5550 tx=0x7f3748005840 comp rx=0 tx=0).stop 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/1424032643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435d5300 msgr2=0x55e0435d5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 --2- 172.21.15.133:0/1424032643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435d5300 0x55e0435d5720 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3738001770 tx=0x7f373800f790 comp rx=0 tx=0).stop 2024-02-15T22:56:25.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/1424032643 shutdown_connections 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 --2- 172.21.15.133:0/1424032643 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f36280367e0 0x7f3628038ca0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 --2- 172.21.15.133:0/1424032643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0435d5300 0x55e0435d5720 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/1424032643 >> 172.21.15.133:0/1424032643 conn(0x55e0435c93a0 msgr2=0x55e0435c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/1424032643 shutdown_connections 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.158+0000 7f375262e800 1 -- 172.21.15.133:0/1424032643 wait complete. 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e0434c60d0 msgr2=0x55e0435c46a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e0434c60d0 0x55e0435c46a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3634036790 msgr2=0x7f3634038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3634036790 0x7f3634038c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3738001e10 tx=0x7f3738001390 comp rx=0 tx=0).stop 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 msgr2=0x55e0435bd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e0435bd9e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f374001ceb0 tx=0x7f3740002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 shutdown_connections 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e0434c60d0 0x55e0435c46a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3634036790 0x7f3634038c50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 --2- 172.21.15.133:0/1718498310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0434c4e70 0x55e0435bd9e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 >> 172.21.15.133:0/1718498310 conn(0x55e0434c04d0 msgr2=0x55e0435af440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 shutdown_connections 2024-02-15T22:56:25.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.159+0000 7f375262e800 1 -- 172.21.15.133:0/1718498310 wait complete. 2024-02-15T22:56:25.169 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:25.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-15T22:56:25.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-15T22:56:25.170 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-02-15T22:56:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.255+0000 7f4b55b42800 1 Processor -- start 2024-02-15T22:56:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.255+0000 7f4b55b42800 1 -- start start 2024-02-15T22:56:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.255+0000 7f4b55b42800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5635d2f75320 0x5635d2f77710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.255+0000 7f4b55b42800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5635d2ebcba0 con 0x5635d2f70e90 2024-02-15T22:56:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.255+0000 7f4b55b42800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5635d2e74450 con 0x5635d2f75320 2024-02-15T22:56:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.255+0000 7f4b4904a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5635d2f75320 0x5635d2f77710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.255+0000 7f4b5184b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5635d2f70e90 0x5635d2f712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44886/0 (socket says 172.21.15.133:44886) 2024-02-15T22:56:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.255+0000 7f4b4904a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5635d2f75320 0x5635d2f77710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57476/0 (socket says 172.21.15.133:57476) 2024-02-15T22:56:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.255+0000 7f4b5184b640 1 -- 172.21.15.133:0/1884552767 learned_addr learned my addr 172.21.15.133:0/1884552767 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.256+0000 7f4b5104a640 1 -- 172.21.15.133:0/1884552767 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583697889 0 0) 0x5635d2ebcba0 con 0x5635d2f70e90 2024-02-15T22:56:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.256+0000 7f4b5104a640 1 -- 172.21.15.133:0/1884552767 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b40001e10 con 0x5635d2f70e90 2024-02-15T22:56:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.256+0000 7f4b4904a640 1 -- 172.21.15.133:0/1884552767 >> v1:172.21.15.52:6789/0 conn(0x5635d2f70e90 legacy=0x5635d2f712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.256+0000 7f4b4904a640 1 -- 172.21.15.133:0/1884552767 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635d2f78d40 con 0x5635d2f75320 2024-02-15T22:56:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.257+0000 7f4b4904a640 1 --2- 172.21.15.133:0/1884552767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f75320 0x5635d2f77710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00a470 tx=0x7f4b3c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822300ed87999af server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.258+0000 7f4b5104a640 1 -- 172.21.15.133:0/1884552767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c04ad60 con 0x5635d2f75320 2024-02-15T22:56:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.258+0000 7f4b5104a640 1 -- 172.21.15.133:0/1884552767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c052440 con 0x5635d2f75320 2024-02-15T22:56:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.258+0000 7f4b5104a640 1 -- 172.21.15.133:0/1884552767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c052700 con 0x5635d2f75320 2024-02-15T22:56:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.258+0000 7f4b55b42800 1 -- 172.21.15.133:0/1884552767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f75320 msgr2=0x5635d2f77710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.258+0000 7f4b55b42800 1 --2- 172.21.15.133:0/1884552767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f75320 0x5635d2f77710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00a470 tx=0x7f4b3c01cc80 comp rx=0 tx=0).stop 2024-02-15T22:56:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.258+0000 7f4b55b42800 1 -- 172.21.15.133:0/1884552767 shutdown_connections 2024-02-15T22:56:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.258+0000 7f4b55b42800 1 --2- 172.21.15.133:0/1884552767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f75320 0x5635d2f77710 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.258+0000 7f4b55b42800 1 -- 172.21.15.133:0/1884552767 >> 172.21.15.133:0/1884552767 conn(0x5635d2f6c4f0 msgr2=0x5635d2f6e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.258+0000 7f4b55b42800 1 -- 172.21.15.133:0/1884552767 shutdown_connections 2024-02-15T22:56:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.258+0000 7f4b55b42800 1 -- 172.21.15.133:0/1884552767 wait complete. 2024-02-15T22:56:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.270+0000 7f4b55b42800 1 Processor -- start 2024-02-15T22:56:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.270+0000 7f4b55b42800 1 -- start start 2024-02-15T22:56:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.270+0000 7f4b55b42800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d2ee4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.270+0000 7f4b55b42800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635d2e71980 con 0x5635d2f70e90 2024-02-15T22:56:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.270+0000 7f4b5184b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d2ee4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.270+0000 7f4b5184b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d2ee4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57488/0 (socket says 172.21.15.133:57488) 2024-02-15T22:56:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.270+0000 7f4b5184b640 1 -- 172.21.15.133:0/2413990388 learned_addr learned my addr 172.21.15.133:0/2413990388 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.270+0000 7f4b5184b640 1 -- 172.21.15.133:0/2413990388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c005d20 con 0x5635d2f70e90 2024-02-15T22:56:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.270+0000 7f4b5184b640 1 --2- 172.21.15.133:0/2413990388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d2ee4f50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4b44001ca0 tx=0x7f4b4400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea70a99feb61aadd server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.271+0000 7f4a3fe07640 1 -- 172.21.15.133:0/2413990388 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b4400e470 con 0x5635d2f70e90 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.271+0000 7f4a3fe07640 1 -- 172.21.15.133:0/2413990388 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4400e5d0 con 0x5635d2f70e90 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.271+0000 7f4a3fe07640 1 -- 172.21.15.133:0/2413990388 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b4400e8f0 con 0x5635d2f70e90 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.271+0000 7f4b55b42800 1 -- 172.21.15.133:0/2413990388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 msgr2=0x5635d2ee4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.271+0000 7f4b55b42800 1 --2- 172.21.15.133:0/2413990388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d2ee4f50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4b44001ca0 tx=0x7f4b4400b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.271+0000 7f4b55b42800 1 -- 172.21.15.133:0/2413990388 shutdown_connections 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.271+0000 7f4b55b42800 1 --2- 172.21.15.133:0/2413990388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d2ee4f50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.271+0000 7f4b55b42800 1 -- 172.21.15.133:0/2413990388 >> 172.21.15.133:0/2413990388 conn(0x5635d2f6c4f0 msgr2=0x5635d305c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.271+0000 7f4b55b42800 1 -- 172.21.15.133:0/2413990388 shutdown_connections 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.271+0000 7f4b55b42800 1 -- 172.21.15.133:0/2413990388 wait complete. 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.272+0000 7f4b55b42800 1 Processor -- start 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.272+0000 7f4b55b42800 1 -- start start 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.272+0000 7f4b55b42800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d3069540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.272+0000 7f4b55b42800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635d2e6d160 con 0x5635d2f70e90 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.272+0000 7f4b5184b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d3069540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.272+0000 7f4b5184b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d3069540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57494/0 (socket says 172.21.15.133:57494) 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.272+0000 7f4b5184b640 1 -- 172.21.15.133:0/2983375826 learned_addr learned my addr 172.21.15.133:0/2983375826 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.272+0000 7f4b5184b640 1 -- 172.21.15.133:0/2983375826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40001e10 con 0x5635d2f70e90 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.272+0000 7f4b5184b640 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d3069540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b44001ed0 tx=0x7f4b44000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.273+0000 7f4a3e604640 1 -- 172.21.15.133:0/2983375826 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b4401f070 con 0x5635d2f70e90 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.273+0000 7f4a3e604640 1 -- 172.21.15.133:0/2983375826 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44018770 con 0x5635d2f70e90 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.273+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635d3069a80 con 0x5635d2f70e90 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.273+0000 7f4a3e604640 1 -- 172.21.15.133:0/2983375826 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b44018a30 con 0x5635d2f70e90 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.273+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635d3069f60 con 0x5635d2f70e90 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.273+0000 7f4a3e604640 1 -- 172.21.15.133:0/2983375826 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4b44018b90 con 0x5635d2f70e90 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.274+0000 7f4a3e604640 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a380367e0 0x7f4a38038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.274+0000 7f4a3e604640 1 -- 172.21.15.133:0/2983375826 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4b4404c0a0 con 0x5635d2f70e90 2024-02-15T22:56:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.274+0000 7f4b4904a640 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a380367e0 0x7f4a38038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.274+0000 7f4b55b42800 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5635d2f75320 0x5635d3070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.274+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d3070810 con 0x5635d2f75320 2024-02-15T22:56:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.274+0000 7f4b5204c640 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5635d2f75320 0x5635d3070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.274+0000 7f4b4904a640 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a380367e0 0x7f4a38038ca0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c054000 tx=0x7f4b3c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.274+0000 7f4b5204c640 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5635d2f75320 0x5635d3070240 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.274+0000 7f4b5204c640 1 -- 172.21.15.133:0/2983375826 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b4c00a4a0 con 0x5635d2f75320 2024-02-15T22:56:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.274+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d306d930 con 0x5635d2f75320 2024-02-15T22:56:25.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.275+0000 7f4b5204c640 1 -- 172.21.15.133:0/2983375826 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b4c00a4a0 con 0x5635d2f75320 2024-02-15T22:56:25.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.275+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d3072540 con 0x5635d2f75320 2024-02-15T22:56:25.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.275+0000 7f4b5204c640 1 -- 172.21.15.133:0/2983375826 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4b4c00a4a0 con 0x5635d2f75320 2024-02-15T22:56:25.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.275+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d3071740 con 0x5635d2f75320 2024-02-15T22:56:25.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.275+0000 7f4b5204c640 1 -- 172.21.15.133:0/2983375826 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b4c00a4a0 con 0x5635d2f75320 2024-02-15T22:56:25.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.275+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d3071b50 con 0x5635d2f75320 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.276+0000 7f4b5204c640 1 -- 172.21.15.133:0/2983375826 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4b4c00a4a0 con 0x5635d2f75320 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.276+0000 7f4b55b42800 1 Processor -- start 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.276+0000 7f4b55b42800 1 -- start start 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.276+0000 7f4b55b42800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d3080fc0 0x5635d30813e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.276+0000 7f4b55b42800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635d2e0fe80 con 0x5635d3080fc0 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.276+0000 7f4b4904a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d3080fc0 0x5635d30813e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.276+0000 7f4b4904a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d3080fc0 0x5635d30813e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57504/0 (socket says 172.21.15.133:57504) 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.276+0000 7f4b4904a640 1 -- 172.21.15.133:0/3698810259 learned_addr learned my addr 172.21.15.133:0/3698810259 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.277+0000 7f4b4904a640 1 -- 172.21.15.133:0/3698810259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635d3081920 con 0x5635d3080fc0 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.277+0000 7f4b4904a640 1 --2- 172.21.15.133:0/3698810259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d3080fc0 0x5635d30813e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c055040 tx=0x7f4b3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.277+0000 7f4a377fe640 1 -- 172.21.15.133:0/3698810259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c05c540 con 0x5635d3080fc0 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.277+0000 7f4a377fe640 1 -- 172.21.15.133:0/3698810259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c063040 con 0x5635d3080fc0 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.277+0000 7f4a377fe640 1 -- 172.21.15.133:0/3698810259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c05c7d0 con 0x5635d3080fc0 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.277+0000 7f4b55b42800 1 -- 172.21.15.133:0/3698810259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635d3081b10 con 0x5635d3080fc0 2024-02-15T22:56:25.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.277+0000 7f4b55b42800 1 -- 172.21.15.133:0/3698810259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635d3082660 con 0x5635d3080fc0 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.278+0000 7f4a377fe640 1 -- 172.21.15.133:0/3698810259 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4b3c05c930 con 0x5635d3080fc0 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.278+0000 7f4a377fe640 1 --2- 172.21.15.133:0/3698810259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a2c0367e0 0x7f4a2c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.278+0000 7f4a377fe640 1 -- 172.21.15.133:0/3698810259 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4b3c08ed40 con 0x5635d3080fc0 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.278+0000 7f4b5204c640 1 --2- 172.21.15.133:0/3698810259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a2c0367e0 0x7f4a2c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.278+0000 7f4b55b42800 1 Processor -- start 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.278+0000 7f4b55b42800 1 -- start start 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.278+0000 7f4b5204c640 1 --2- 172.21.15.133:0/3698810259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a2c0367e0 0x7f4a2c038ca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5635d3071180 tx=0x7f4b4c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.278+0000 7f4b55b42800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d308e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.278+0000 7f4b55b42800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635d2de55d0 con 0x5635d308e180 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.279+0000 7f4b4904a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d308e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.279+0000 7f4b4904a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d308e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57518/0 (socket says 172.21.15.133:57518) 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.279+0000 7f4b4904a640 1 -- 172.21.15.133:0/2005612456 learned_addr learned my addr 172.21.15.133:0/2005612456 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.279+0000 7f4b4904a640 1 -- 172.21.15.133:0/2005612456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635d308eb70 con 0x5635d308e180 2024-02-15T22:56:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.279+0000 7f4b4904a640 1 --2- 172.21.15.133:0/2005612456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d308e5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c08d500 tx=0x7f4b3c08d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5588c11c345ac613 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.279+0000 7f4a357fa640 1 -- 172.21.15.133:0/2005612456 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c05b370 con 0x5635d308e180 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.279+0000 7f4a357fa640 1 -- 172.21.15.133:0/2005612456 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c05b4d0 con 0x5635d308e180 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.279+0000 7f4a357fa640 1 -- 172.21.15.133:0/2005612456 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c05b820 con 0x5635d308e180 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b55b42800 1 -- 172.21.15.133:0/2005612456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 msgr2=0x5635d308e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b55b42800 1 --2- 172.21.15.133:0/2005612456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d308e5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c08d500 tx=0x7f4b3c08d530 comp rx=0 tx=0).stop 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b55b42800 1 -- 172.21.15.133:0/2005612456 shutdown_connections 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b55b42800 1 --2- 172.21.15.133:0/2005612456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d308e5a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b55b42800 1 -- 172.21.15.133:0/2005612456 >> 172.21.15.133:0/2005612456 conn(0x5635d308a4e0 msgr2=0x5635d3088540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b55b42800 1 -- 172.21.15.133:0/2005612456 shutdown_connections 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b55b42800 1 -- 172.21.15.133:0/2005612456 wait complete. 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b55b42800 1 Processor -- start 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b55b42800 1 -- start start 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b55b42800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d30950d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b55b42800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635d3095610 con 0x5635d308e180 2024-02-15T22:56:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b4904a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d30950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b4904a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d30950d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57526/0 (socket says 172.21.15.133:57526) 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.280+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 learned_addr learned my addr 172.21.15.133:0/1080272883 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.281+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635d3082660 con 0x5635d308e180 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.281+0000 7f4b4904a640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d30950d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c08d500 tx=0x7f4b3c08d1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.281+0000 7f4a237fe640 1 -- 172.21.15.133:0/1080272883 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c05b9f0 con 0x5635d308e180 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.281+0000 7f4a237fe640 1 -- 172.21.15.133:0/1080272883 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c08dab0 con 0x5635d308e180 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.281+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635d3095810 con 0x5635d308e180 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.281+0000 7f4a237fe640 1 -- 172.21.15.133:0/1080272883 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c08dd70 con 0x5635d308e180 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.281+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635d3095810 con 0x5635d308e180 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.282+0000 7f4a237fe640 1 -- 172.21.15.133:0/1080272883 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4b3c009410 con 0x5635d308e180 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.282+0000 7f4a237fe640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a1c0367e0 0x7f4a1c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.282+0000 7f4a237fe640 1 -- 172.21.15.133:0/1080272883 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4b3c098ac0 con 0x5635d308e180 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.282+0000 7f4b5204c640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a1c0367e0 0x7f4a1c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.282+0000 7f4b5204c640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a1c0367e0 0x7f4a1c038ca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00b010 tx=0x7f4b4c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.282+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.282+0000 7f4b55b42800 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5635d30a0bb0 0x5635d30a3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.282+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a37c0 con 0x5635d30a0bb0 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b5184b640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5635d30a0bb0 0x5635d30a3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b5184b640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5635d30a0bb0 0x5635d30a3070 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b55b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b55b42800 20 realm 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a3b90 con 0x5635d30a0bb0 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b55b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b55b42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a4410 con 0x5635d30a0bb0 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b55b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.283+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a4770 con 0x5635d30a0bb0 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.284+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.284+0000 7f4b55b42800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.284+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.284+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a4f70 con 0x5635d30a0bb0 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.284+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.284+0000 7f4b55b42800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.284+0000 7f4b55b42800 20 searching for the correct realm 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.284+0000 7f4b55b42800 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5635d30a6e80 0x5635d30a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.284+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a6e80 2024-02-15T22:56:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.284+0000 7f4b4904a640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5635d30a6e80 0x5635d30a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.284+0000 7f4b4904a640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5635d30a6e80 0x5635d30a9340 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.285+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.285+0000 7f4b4904a640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4b3c084410 0x7f4b3c085410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.285+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b3c084410 2024-02-15T22:56:25.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.285+0000 7f4b5204c640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4b3c084410 0x7f4b3c085410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.285+0000 7f4b5204c640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4b3c084410 0x7f4b3c085410 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.285+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a4a0 con 0x7f4b3c084410 2024-02-15T22:56:25.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.285+0000 7f4b5204c640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4b4c0141d0 0x7f4b4c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.285+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b4c0141d0 2024-02-15T22:56:25.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.286+0000 7f4b5184b640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4b4c0141d0 0x7f4b4c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.286+0000 7f4b5184b640 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4b4c0141d0 0x7f4b4c015940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.286+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x7f4b4c0141d0 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.286+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a0bb0 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.287+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.287+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a0bb0 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.287+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.287+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b4c0141d0 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.287+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x7f4b4c0141d0 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.287+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b4c0141d0 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.287+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x7f4b4c0141d0 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.287+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b3c084410 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.287+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a4a0 con 0x7f4b3c084410 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.287+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a6e80 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.288+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.288+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a0bb0 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.288+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.288+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b4c0141d0 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.289+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x7f4b4c0141d0 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.289+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a0bb0 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.289+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.289+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b3c084410 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.289+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4b4c03a040 con 0x7f4b3c084410 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.289+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a6e80 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.289+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.289+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a6e80 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.290+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.290+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b4c0141d0 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.290+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x7f4b4c0141d0 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.290+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a6e80 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.290+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.290+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a6e80 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.290+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.290+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a0bb0 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.290+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.290+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a0bb0 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.291+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.291+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b4c0141d0 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.291+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x7f4b4c0141d0 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.291+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a6e80 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.291+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.291+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b3c084410 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.291+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c03a040 con 0x7f4b3c084410 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.291+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a0bb0 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.292+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4b44014070 con 0x5635d30a0bb0 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.292+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b4c0141d0 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.292+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44014070 con 0x7f4b4c0141d0 2024-02-15T22:56:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.292+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a6e80 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.292+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.292+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b4c0141d0 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.292+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.292+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b3c084410 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.293+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c03a040 con 0x7f4b3c084410 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.293+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a6e80 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.293+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.293+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b4c0141d0 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.293+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.293+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x5635d30a0bb0 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9a10 con 0x7f4b3c084410 2024-02-15T22:56:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c03a040 con 0x7f4b3c084410 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a6440 con 0x5635d30a0bb0 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a5c90 con 0x5635d30a0bb0 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.294+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a5420 con 0x5635d30a0bb0 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 20 zone default found 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 4 Realm: () 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 20 zonegroup default 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30a9e50 con 0x7f4b4c0141d0 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30abcd0 con 0x5635d30a6e80 2024-02-15T22:56:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.295+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.296+0000 7f4b55b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.296+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.296+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30ac030 con 0x5635d30a6e80 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.296+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.296+0000 7f4b55b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.296+0000 7f4b55b42800 20 started sync module instance, tier type = 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.296+0000 7f4b55b42800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.296+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30ab160 con 0x7f4b3c084410 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.297+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c03a040 con 0x7f4b3c084410 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.297+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94789173950032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30ab160 con 0x7f4b3c084410 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.297+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30ac9a0 con 0x5635d30a0bb0 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.298+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94789173950032] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c03a040 con 0x7f4b3c084410 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.298+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.298+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94789173954272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30ab160 con 0x5635d30a0bb0 2024-02-15T22:56:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.298+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30ad3f0 con 0x5635d30a6e80 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.299+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94789173954272] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.299+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.299+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94789173947584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30ab0e0 con 0x5635d30a6e80 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.299+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30ae280 con 0x7f4b3c084410 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.300+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94789173947584] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.300+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c03a040 con 0x7f4b3c084410 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.300+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94789173960160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30ae6a0 con 0x7f4b3c084410 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.301+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30af010 con 0x5635d30a0bb0 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.302+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94789173960160] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c03a040 con 0x7f4b3c084410 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.302+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.302+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94789173964112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30ae6a0 con 0x5635d30a0bb0 2024-02-15T22:56:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.302+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30afa70 con 0x7f4b4c0141d0 2024-02-15T22:56:25.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.303+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.303+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94789173966176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30afa70 con 0x7f4b4c0141d0 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.303+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30b09b0 con 0x7f4b4c0141d0 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.303+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94789173964112] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.304+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94789173966176] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.304+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.304+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94789173970064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30afe20 con 0x7f4b4c0141d0 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.304+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30b0f80 con 0x7f4b4c0141d0 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.305+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94789173970064] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.305+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.305+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94789173967952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30b0f80 con 0x7f4b4c0141d0 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.305+0000 7f4b55b42800 20 add_watcher() i=0 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.305+0000 7f4b55b42800 20 add_watcher() i=1 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.305+0000 7f4b55b42800 20 add_watcher() i=2 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.305+0000 7f4b55b42800 20 add_watcher() i=3 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.305+0000 7f4b55b42800 20 add_watcher() i=4 2024-02-15T22:56:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.305+0000 7f4b55b42800 20 add_watcher() i=5 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.305+0000 7f4b55b42800 20 add_watcher() i=6 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.306+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94789173967952] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.306+0000 7f4b55b42800 20 add_watcher() i=7 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.306+0000 7f4b55b42800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.306+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30b4370 con 0x5635d30a0bb0 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.306+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.306+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94789173984736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30b10f0 con 0x5635d30a0bb0 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.307+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94789173984736] v30'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.307+0000 7f4a037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.307+0000 7f4b55b42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.307+0000 7f4b55b42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b55b42800 5 note: GC not initialized 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4a027fc640 20 reqs_thread_entry: start 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b55b42800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b55b42800 20 Filter name: none 2024-02-15T22:56:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4973fff640 20 reqs_thread_entry: start 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b55b42800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b55b42800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30e6440 con 0x5635d30a0bb0 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~461 out=461b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+584 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b55b42800 20 rados_obj.operate() r=0 bl.length=461 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b55b42800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b55b42800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b55b42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.308+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30ec400 con 0x5635d30a0bb0 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v30'5 uv5 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4b55b42800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4b55b42800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4b55b42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94789174214432 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30e7df0 con 0x5635d30a0bb0 2024-02-15T22:56:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 94789173964112 notify 128849018884 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x5635d3069f60 con 0x5635d30a0bb0 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4a357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94789173964112 notifier 4348 bl.length()=534 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4a357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4a357fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4a357fa640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4a14003e90 con 0x5635d30a0bb0 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(64 notify.4 [notify cookie 94789174214432 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== watch-notify(notify_complete (2) cookie 94789174214432 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5635d3069a80 con 0x5635d30a0bb0 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4b55b42800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.310+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify cookie 94789174214432 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30e7df0 con 0x5635d30a6e80 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.311+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== watch-notify(notify (1) cookie 94789173947584 notify 128849018881 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x5635d3082660 con 0x5635d30a6e80 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.311+0000 7f4a34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94789173947584 notifier 4348 bl.length()=170 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.311+0000 7f4a34ff9640 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f497c0032b0 con 0x5635d30a6e80 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.311+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(66 notify.2 [notify cookie 94789174214432 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.311+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(67 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.311+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== watch-notify(notify_complete (2) cookie 94789174214432 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5635d308eb70 con 0x5635d30a6e80 2024-02-15T22:56:25.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.311+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:68 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30eab50 con 0x7f4b4c0141d0 2024-02-15T22:56:25.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.312+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(68 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.322 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:25.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.313+0000 7f4a037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.313+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94789173984736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30b3410 con 0x5635d30a0bb0 2024-02-15T22:56:25.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.314+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94789173984736] v30'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.314+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94789173950032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30b3de0 con 0x7f4b3c084410 2024-02-15T22:56:25.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.315+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94789173950032] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c03a040 con 0x7f4b3c084410 2024-02-15T22:56:25.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.315+0000 7f4b55b42800 20 remove_watcher() i=0 2024-02-15T22:56:25.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.315+0000 7f4b55b42800 2 removed watcher, disabling cache 2024-02-15T22:56:25.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.315+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94789173954272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30b3de0 con 0x5635d30a0bb0 2024-02-15T22:56:25.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.316+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94789173954272] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.316+0000 7f4b55b42800 20 remove_watcher() i=1 2024-02-15T22:56:25.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.316+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94789173947584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30b3de0 con 0x5635d30a6e80 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.317+0000 7f4b4904a640 1 -- 172.21.15.133:0/1080272883 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94789173947584] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b3c080020 con 0x5635d30a6e80 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.317+0000 7f4b55b42800 20 remove_watcher() i=2 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.317+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94789173960160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30aacc0 con 0x7f4b3c084410 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.318+0000 7f4b5204c640 1 -- 172.21.15.133:0/1080272883 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94789173960160] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c03a040 con 0x7f4b3c084410 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.318+0000 7f4b55b42800 20 remove_watcher() i=3 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.318+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94789173964112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30aacc0 con 0x5635d30a0bb0 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.320+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94789173964112] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x5635d30a0bb0 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.320+0000 7f4b55b42800 20 remove_watcher() i=4 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.320+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94789173966176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30aed50 con 0x7f4b4c0141d0 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.321+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94789173966176] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.321+0000 7f4b55b42800 20 remove_watcher() i=5 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.321+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94789173970064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30aacc0 con 0x7f4b4c0141d0 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.322+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94789173970064] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.322+0000 7f4b55b42800 20 remove_watcher() i=6 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.322+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94789173967952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635d30af560 con 0x7f4b4c0141d0 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.322+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94789173967952] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4403d040 con 0x7f4b4c0141d0 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.322+0000 7f4b55b42800 20 remove_watcher() i=7 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4b4c0141d0 msgr2=0x7f4b4c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4b4c0141d0 0x7f4b4c015940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5635d30a0bb0 msgr2=0x5635d30a3070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5635d30a0bb0 0x5635d30a3070 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4b3c084410 msgr2=0x7f4b3c085410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4b3c084410 0x7f4b3c085410 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5635d30a6e80 msgr2=0x5635d30a9340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5635d30a6e80 0x5635d30a9340 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a1c0367e0 msgr2=0x7f4a1c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a1c0367e0 0x7f4a1c038ca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00b010 tx=0x7f4b4c020000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b5184b640 1 -- 172.21.15.133:0/1080272883 reap_dead start 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 msgr2=0x5635d30950d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d30950d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c08d500 tx=0x7f4b3c08d1f0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 shutdown_connections 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 --2- 172.21.15.133:0/1080272883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d308e180 0x5635d30950d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 >> 172.21.15.133:0/1080272883 conn(0x5635d308a4e0 msgr2=0x5635d3087b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 shutdown_connections 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/1080272883 wait complete. 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/3698810259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a2c0367e0 msgr2=0x7f4a2c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 --2- 172.21.15.133:0/3698810259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a2c0367e0 0x7f4a2c038ca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5635d3071180 tx=0x7f4b4c005840 comp rx=0 tx=0).stop 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/3698810259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d3080fc0 msgr2=0x5635d30813e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 --2- 172.21.15.133:0/3698810259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d3080fc0 0x5635d30813e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c055040 tx=0x7f4b3c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/3698810259 shutdown_connections 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 --2- 172.21.15.133:0/3698810259 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a2c0367e0 0x7f4a2c038ca0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 --2- 172.21.15.133:0/3698810259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d3080fc0 0x5635d30813e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/3698810259 >> 172.21.15.133:0/3698810259 conn(0x5635d3075060 msgr2=0x5635d3075460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/3698810259 shutdown_connections 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.323+0000 7f4b55b42800 1 -- 172.21.15.133:0/3698810259 wait complete. 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5635d2f75320 msgr2=0x5635d3070240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5635d2f75320 0x5635d3070240 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a380367e0 msgr2=0x7f4a38038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a380367e0 0x7f4a38038ca0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c054000 tx=0x7f4b3c04e000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 msgr2=0x5635d3069540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d3069540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b44001ed0 tx=0x7f4b44000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 shutdown_connections 2024-02-15T22:56:25.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5635d2f75320 0x5635d3070240 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4a380367e0 0x7f4a38038ca0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 --2- 172.21.15.133:0/2983375826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635d2f70e90 0x5635d3069540 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 >> 172.21.15.133:0/2983375826 conn(0x5635d2f6c4f0 msgr2=0x5635d305af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 shutdown_connections 2024-02-15T22:56:25.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.324+0000 7f4b55b42800 1 -- 172.21.15.133:0/2983375826 wait complete. 2024-02-15T22:56:25.334 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:25.334 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-15T22:56:25.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-15T22:56:25.335 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-02-15T22:56:25.379 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:25.379 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:25.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.377+0000 7fe4e6f33800 1 Processor -- start 2024-02-15T22:56:25.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.377+0000 7fe4e6f33800 1 -- start start 2024-02-15T22:56:25.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.377+0000 7fe4e6f33800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559f9c1713f0 0x559f9c179ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.377+0000 7fe4e6f33800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559f9c0bbba0 con 0x559f9c16f8b0 2024-02-15T22:56:25.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.377+0000 7fe4e6f33800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x559f9c073450 con 0x559f9c1713f0 2024-02-15T22:56:25.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.377+0000 7fe4e2466640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559f9c1713f0 0x559f9c179ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.377+0000 7fe4e2466640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559f9c1713f0 0x559f9c179ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57528/0 (socket says 172.21.15.133:57528) 2024-02-15T22:56:25.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.377+0000 7fe4e2466640 1 -- 172.21.15.133:0/3782806629 learned_addr learned my addr 172.21.15.133:0/3782806629 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.377+0000 7fe4e2c67640 1 --1- 172.21.15.133:0/3782806629 >> v1:172.21.15.52:6789/0 conn(0x559f9c16f8b0 0x559f9c16fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44892/0 (socket says 172.21.15.133:44892) 2024-02-15T22:56:25.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.378+0000 7fe4e2466640 1 -- 172.21.15.133:0/3782806629 >> v1:172.21.15.52:6789/0 conn(0x559f9c16f8b0 legacy=0x559f9c16fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.378+0000 7fe4e1c65640 1 -- 172.21.15.133:0/3782806629 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870155037 0 0) 0x559f9c0bbba0 con 0x559f9c16f8b0 2024-02-15T22:56:25.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.378+0000 7fe4e2466640 1 -- 172.21.15.133:0/3782806629 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f9c0e41a0 con 0x559f9c1713f0 2024-02-15T22:56:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.379+0000 7fe4e2466640 1 --2- 172.21.15.133:0/3782806629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c1713f0 0x559f9c179ef0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800a520 tx=0x7fe4d801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8583b4d0fd9b8be9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.380+0000 7fe4e1c65640 1 -- 172.21.15.133:0/3782806629 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8052570 con 0x559f9c1713f0 2024-02-15T22:56:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.380+0000 7fe4e1c65640 1 -- 172.21.15.133:0/3782806629 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d80526d0 con 0x559f9c1713f0 2024-02-15T22:56:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.380+0000 7fe4e1c65640 1 -- 172.21.15.133:0/3782806629 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8052990 con 0x559f9c1713f0 2024-02-15T22:56:25.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.380+0000 7fe4e6f33800 1 -- 172.21.15.133:0/3782806629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c1713f0 msgr2=0x559f9c179ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.380+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/3782806629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c1713f0 0x559f9c179ef0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800a520 tx=0x7fe4d801cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.380+0000 7fe4e6f33800 1 -- 172.21.15.133:0/3782806629 shutdown_connections 2024-02-15T22:56:25.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.380+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/3782806629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c1713f0 0x559f9c179ef0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.380+0000 7fe4e6f33800 1 -- 172.21.15.133:0/3782806629 >> 172.21.15.133:0/3782806629 conn(0x559f9c16b4f0 msgr2=0x559f9c16d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.380+0000 7fe4e6f33800 1 -- 172.21.15.133:0/3782806629 shutdown_connections 2024-02-15T22:56:25.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.380+0000 7fe4e6f33800 1 -- 172.21.15.133:0/3782806629 wait complete. 2024-02-15T22:56:25.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.392+0000 7fe4e6f33800 1 Processor -- start 2024-02-15T22:56:25.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.392+0000 7fe4e6f33800 1 -- start start 2024-02-15T22:56:25.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.392+0000 7fe4e6f33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c263170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.392+0000 7fe4e6f33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c070980 con 0x559f9c16f8b0 2024-02-15T22:56:25.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.392+0000 7fe4e2c67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c263170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.392+0000 7fe4e2c67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c263170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57532/0 (socket says 172.21.15.133:57532) 2024-02-15T22:56:25.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.392+0000 7fe4e2c67640 1 -- 172.21.15.133:0/1422085039 learned_addr learned my addr 172.21.15.133:0/1422085039 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.393+0000 7fe4e2c67640 1 -- 172.21.15.133:0/1422085039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8005de0 con 0x559f9c16f8b0 2024-02-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.393+0000 7fe4e2c67640 1 --2- 172.21.15.133:0/1422085039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c263170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400b210 tx=0x7fe4d400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d6686973698797 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.393+0000 7fe3d0e09640 1 -- 172.21.15.133:0/1422085039 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d4014070 con 0x559f9c16f8b0 2024-02-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.393+0000 7fe3d0e09640 1 -- 172.21.15.133:0/1422085039 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d400d500 con 0x559f9c16f8b0 2024-02-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.393+0000 7fe3d0e09640 1 -- 172.21.15.133:0/1422085039 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d400d800 con 0x559f9c16f8b0 2024-02-15T22:56:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1422085039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 msgr2=0x559f9c263170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/1422085039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c263170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400b210 tx=0x7fe4d400b6d0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1422085039 shutdown_connections 2024-02-15T22:56:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/1422085039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c263170 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1422085039 >> 172.21.15.133:0/1422085039 conn(0x559f9c16b4f0 msgr2=0x559f9c25ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1422085039 shutdown_connections 2024-02-15T22:56:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1422085039 wait complete. 2024-02-15T22:56:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e6f33800 1 Processor -- start 2024-02-15T22:56:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e6f33800 1 -- start start 2024-02-15T22:56:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e6f33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c26a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e6f33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c06c160 con 0x559f9c16f8b0 2024-02-15T22:56:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e2c67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c26a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e2c67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c26a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57544/0 (socket says 172.21.15.133:57544) 2024-02-15T22:56:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.394+0000 7fe4e2c67640 1 -- 172.21.15.133:0/1573605836 learned_addr learned my addr 172.21.15.133:0/1573605836 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.395+0000 7fe4e2c67640 1 -- 172.21.15.133:0/1573605836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d4001b70 con 0x559f9c16f8b0 2024-02-15T22:56:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.395+0000 7fe4e2c67640 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c26a830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400b210 tx=0x7fe4d4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.395+0000 7fe3cf606640 1 -- 172.21.15.133:0/1573605836 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d400f950 con 0x559f9c16f8b0 2024-02-15T22:56:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.395+0000 7fe3cf606640 1 -- 172.21.15.133:0/1573605836 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d4020070 con 0x559f9c16f8b0 2024-02-15T22:56:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.395+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f9c26ad70 con 0x559f9c16f8b0 2024-02-15T22:56:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.396+0000 7fe3cf606640 1 -- 172.21.15.133:0/1573605836 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d400fc20 con 0x559f9c16f8b0 2024-02-15T22:56:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.396+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f9c26b250 con 0x559f9c16f8b0 2024-02-15T22:56:25.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.396+0000 7fe3cf606640 1 -- 172.21.15.133:0/1573605836 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe4d400d040 con 0x559f9c16f8b0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.396+0000 7fe3cf606640 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c80367e0 0x7fe3c8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.396+0000 7fe3cf606640 1 -- 172.21.15.133:0/1573605836 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fe4d400a040 con 0x559f9c16f8b0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.397+0000 7fe4e2466640 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c80367e0 0x7fe3c8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.397+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f9c1713f0 0x559f9c271530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.397+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c271ad0 con 0x559f9c1713f0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.397+0000 7fe4e3468640 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f9c1713f0 0x559f9c271530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.397+0000 7fe4e2466640 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c80367e0 0x7fe3c8038ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8054000 tx=0x7fe4d804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.397+0000 7fe4e3468640 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f9c1713f0 0x559f9c271530 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.397+0000 7fe4e3468640 1 -- 172.21.15.133:0/1573605836 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4dc00a4a0 con 0x559f9c1713f0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.397+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c26ec40 con 0x559f9c1713f0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.398+0000 7fe4e3468640 1 -- 172.21.15.133:0/1573605836 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe4dc00a4a0 con 0x559f9c1713f0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.398+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c273830 con 0x559f9c1713f0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.398+0000 7fe4e3468640 1 -- 172.21.15.133:0/1573605836 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe4dc00a4a0 con 0x559f9c1713f0 2024-02-15T22:56:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.398+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c272b40 con 0x559f9c1713f0 2024-02-15T22:56:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.398+0000 7fe4e3468640 1 -- 172.21.15.133:0/1573605836 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe4dc00a4a0 con 0x559f9c1713f0 2024-02-15T22:56:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.398+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c272f50 con 0x559f9c1713f0 2024-02-15T22:56:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.399+0000 7fe4e3468640 1 -- 172.21.15.133:0/1573605836 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe4dc00a4a0 con 0x559f9c1713f0 2024-02-15T22:56:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.399+0000 7fe4e6f33800 1 Processor -- start 2024-02-15T22:56:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.399+0000 7fe4e6f33800 1 -- start start 2024-02-15T22:56:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.399+0000 7fe4e6f33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c2822a0 0x559f9c2826c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.399+0000 7fe4e6f33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c00ee80 con 0x559f9c2822a0 2024-02-15T22:56:25.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.400+0000 7fe4e2466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c2822a0 0x559f9c2826c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.400+0000 7fe4e2466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c2822a0 0x559f9c2826c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57556/0 (socket says 172.21.15.133:57556) 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.400+0000 7fe4e2466640 1 -- 172.21.15.133:0/4071404432 learned_addr learned my addr 172.21.15.133:0/4071404432 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.400+0000 7fe4e2466640 1 -- 172.21.15.133:0/4071404432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f9c282c00 con 0x559f9c2822a0 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.400+0000 7fe4e2466640 1 --2- 172.21.15.133:0/4071404432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c2822a0 0x559f9c2826c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8044830 tx=0x7fe4d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.400+0000 7fe3cce01640 1 -- 172.21.15.133:0/4071404432 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d805db80 con 0x559f9c2822a0 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.400+0000 7fe3cce01640 1 -- 172.21.15.133:0/4071404432 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d805dd00 con 0x559f9c2822a0 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.400+0000 7fe4e6f33800 1 -- 172.21.15.133:0/4071404432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f9c282df0 con 0x559f9c2822a0 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.400+0000 7fe3cce01640 1 -- 172.21.15.133:0/4071404432 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8069400 con 0x559f9c2822a0 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.400+0000 7fe4e6f33800 1 -- 172.21.15.133:0/4071404432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f9c283940 con 0x559f9c2822a0 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.401+0000 7fe3cce01640 1 -- 172.21.15.133:0/4071404432 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe4d8059040 con 0x559f9c2822a0 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.401+0000 7fe3cce01640 1 --2- 172.21.15.133:0/4071404432 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3bc0367e0 0x7fe3bc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.401+0000 7fe3cce01640 1 -- 172.21.15.133:0/4071404432 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fe4d808f370 con 0x559f9c2822a0 2024-02-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.401+0000 7fe4e3468640 1 --2- 172.21.15.133:0/4071404432 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3bc0367e0 0x7fe3bc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.401+0000 7fe4e6f33800 1 Processor -- start 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe4e6f33800 1 -- start start 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe4e3468640 1 --2- 172.21.15.133:0/4071404432 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3bc0367e0 0x7fe3bc038ca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x559f9c272580 tx=0x7fe4dc005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe4e6f33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 0x559f9c28f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe4e6f33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9bfe45d0 con 0x559f9c28f460 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe4e2466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 0x559f9c28f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe4e2466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 0x559f9c28f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57568/0 (socket says 172.21.15.133:57568) 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe4e2466640 1 -- 172.21.15.133:0/3206693516 learned_addr learned my addr 172.21.15.133:0/3206693516 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe4e2466640 1 -- 172.21.15.133:0/3206693516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f9c28fe50 con 0x559f9c28f460 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe4e2466640 1 --2- 172.21.15.133:0/3206693516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 0x559f9c28f880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe4d808d910 tx=0x7fe4d8068e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8312fdee1b7082ca server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe3c67fc640 1 -- 172.21.15.133:0/3206693516 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d808c070 con 0x559f9c28f460 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe3c67fc640 1 -- 172.21.15.133:0/3206693516 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d8072580 con 0x559f9c28f460 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.402+0000 7fe3c67fc640 1 -- 172.21.15.133:0/3206693516 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d80064d0 con 0x559f9c28f460 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.403+0000 7fe4e6f33800 1 -- 172.21.15.133:0/3206693516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 msgr2=0x559f9c28f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.403+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/3206693516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 0x559f9c28f880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe4d808d910 tx=0x7fe4d8068e80 comp rx=0 tx=0).stop 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.403+0000 7fe4e6f33800 1 -- 172.21.15.133:0/3206693516 shutdown_connections 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.403+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/3206693516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 0x559f9c28f880 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.403+0000 7fe4e6f33800 1 -- 172.21.15.133:0/3206693516 >> 172.21.15.133:0/3206693516 conn(0x559f9c28b7c0 msgr2=0x559f9c289820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.403+0000 7fe4e6f33800 1 -- 172.21.15.133:0/3206693516 shutdown_connections 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.403+0000 7fe4e6f33800 1 -- 172.21.15.133:0/3206693516 wait complete. 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.403+0000 7fe4e6f33800 1 Processor -- start 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.403+0000 7fe4e6f33800 1 -- start start 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.403+0000 7fe4e6f33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 0x559f9c2964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.403+0000 7fe4e6f33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c296a00 con 0x559f9c28f460 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.404+0000 7fe4e2466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 0x559f9c2964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.404+0000 7fe4e2466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 0x559f9c2964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57576/0 (socket says 172.21.15.133:57576) 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.404+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 learned_addr learned my addr 172.21.15.133:0/581195141 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.404+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f9c283940 con 0x559f9c28f460 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.404+0000 7fe4e2466640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 0x559f9c2964c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe4d808f2e0 tx=0x7fe4d808d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.404+0000 7fe3c4ff9640 1 -- 172.21.15.133:0/581195141 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d808db10 con 0x559f9c28f460 2024-02-15T22:56:25.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.404+0000 7fe3c4ff9640 1 -- 172.21.15.133:0/581195141 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d808dcb0 con 0x559f9c28f460 2024-02-15T22:56:25.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.404+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f9c283940 con 0x559f9c28f460 2024-02-15T22:56:25.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.404+0000 7fe3c4ff9640 1 -- 172.21.15.133:0/581195141 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d808c070 con 0x559f9c28f460 2024-02-15T22:56:25.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.404+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f9c283940 con 0x559f9c28f460 2024-02-15T22:56:25.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.405+0000 7fe3c4ff9640 1 -- 172.21.15.133:0/581195141 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe4d808c1d0 con 0x559f9c28f460 2024-02-15T22:56:25.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.405+0000 7fe3c4ff9640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3ac0367e0 0x7fe3ac038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.405+0000 7fe3c4ff9640 1 -- 172.21.15.133:0/581195141 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fe4d8099ab0 con 0x559f9c28f460 2024-02-15T22:56:25.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.405+0000 7fe4e3468640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3ac0367e0 0x7fe3ac038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f9c2a1d30 0x559f9c2a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e3468640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3ac0367e0 0x7fe3ac038ca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00b010 tx=0x7fe4dc020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2a4940 con 0x559f9c2a1d30 2024-02-15T22:56:25.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e2c67640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f9c2a1d30 0x559f9c2a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e2c67640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f9c2a1d30 0x559f9c2a41f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4d4016070 con 0x559f9c2a1d30 2024-02-15T22:56:25.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e6f33800 20 realm 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2a4d10 con 0x559f9c2a1d30 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4d4016070 con 0x559f9c2a1d30 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e6f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.406+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2a5590 con 0x559f9c2a1d30 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4d4016070 con 0x559f9c2a1d30 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2a58f0 con 0x559f9c2a1d30 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe4d4016070 con 0x559f9c2a1d30 2024-02-15T22:56:25.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e6f33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2a60f0 con 0x559f9c2a1d30 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe4d4016070 con 0x559f9c2a1d30 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e6f33800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e6f33800 20 searching for the correct realm 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559f9c2a8010 0x559f9c2aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a8010 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.407+0000 7fe4e2466640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559f9c2a8010 0x559f9c2aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.408+0000 7fe4e2466640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559f9c2a8010 0x559f9c2aa4b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.408+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.408+0000 7fe4e2466640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe4d8098020 0x7fe4d80729b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.408+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4d8098020 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.408+0000 7fe4e3468640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe4d8098020 0x7fe4d80729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.408+0000 7fe4e3468640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe4d8098020 0x7fe4d80729b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.409+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4dc00a4a0 con 0x7fe4d8098020 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.409+0000 7fe4e3468640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe4dc0141d0 0x7fe4dc015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.409+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4dc0141d0 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.409+0000 7fe4e2c67640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe4dc0141d0 0x7fe4dc015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.409+0000 7fe4e2c67640 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe4dc0141d0 0x7fe4dc015940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.409+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x7fe4dc0141d0 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.409+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a1d30 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.410+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x559f9c2a1d30 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.410+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a1d30 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.410+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x559f9c2a1d30 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.410+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4dc0141d0 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.410+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x7fe4dc0141d0 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.410+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4dc0141d0 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.410+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x7fe4dc0141d0 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.410+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4d8098020 2024-02-15T22:56:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.411+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4dc00a4a0 con 0x7fe4d8098020 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.411+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a8010 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.411+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.411+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a1d30 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.411+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x559f9c2a1d30 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.411+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4dc0141d0 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.411+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x7fe4dc0141d0 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.411+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a1d30 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.412+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x559f9c2a1d30 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.412+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4d8098020 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.412+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.412+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a8010 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.412+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.412+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a8010 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.412+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.412+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4dc0141d0 2024-02-15T22:56:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.413+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x7fe4dc0141d0 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.413+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a8010 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.413+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.413+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a8010 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.413+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.413+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a1d30 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.413+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x559f9c2a1d30 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.413+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a1d30 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.414+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe4d4016070 con 0x559f9c2a1d30 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.414+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4dc0141d0 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.414+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.414+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a8010 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.414+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.414+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4d8098020 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.414+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.414+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a1d30 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.414+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.415+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4dc0141d0 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.415+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.415+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a8010 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.415+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.415+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4dc0141d0 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.415+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.415+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4d8098020 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.416+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.416+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a8010 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.416+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.416+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4dc0141d0 2024-02-15T22:56:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.416+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.416+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x559f9c2a1d30 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.416+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.416+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aab80 con 0x7fe4d8098020 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2a75f0 con 0x559f9c2a1d30 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2a6e40 con 0x559f9c2a1d30 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2a65d0 con 0x559f9c2a1d30 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 zone default found 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 4 Realm: () 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 zonegroup default 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.417+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2a6e40 con 0x7fe4dc0141d0 2024-02-15T22:56:25.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ac9a0 con 0x559f9c2a8010 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2acd00 con 0x559f9c2a8010 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e6f33800 20 started sync module instance, tier type = 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e6f33800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.418+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ac280 con 0x7fe4d8098020 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.419+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.419+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94144008207840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ac630 con 0x7fe4d8098020 2024-02-15T22:56:25.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.419+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ada30 con 0x559f9c2a1d30 2024-02-15T22:56:25.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.420+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94144008207840] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.421+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.421+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94144008212992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2adb80 con 0x559f9c2a1d30 2024-02-15T22:56:25.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.421+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ae630 con 0x559f9c2a8010 2024-02-15T22:56:25.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.422+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94144008212992] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.422+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.422+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94144008216880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2aea10 con 0x559f9c2a8010 2024-02-15T22:56:25.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.422+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2af400 con 0x7fe4d8098020 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.423+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94144008216880] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.423+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.423+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94144008220384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2af7b0 con 0x7fe4d8098020 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.423+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2b0220 con 0x559f9c2a1d30 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.424+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.424+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94144008220384] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.424+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94144008224000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2b01e0 con 0x559f9c2a1d30 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.424+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ad640 con 0x7fe4dc0141d0 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.425+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.425+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94144008228032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2b01e0 con 0x7fe4dc0141d0 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.425+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2b1b90 con 0x7fe4dc0141d0 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.425+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94144008224000] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.426+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94144008228032] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.426+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.426+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94144008229088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2b16f0 con 0x7fe4dc0141d0 2024-02-15T22:56:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.426+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2b2060 con 0x7fe4dc0141d0 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.427+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.427+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94144008231872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2b24c0 con 0x7fe4dc0141d0 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.427+0000 7fe4e6f33800 20 add_watcher() i=0 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.427+0000 7fe4e6f33800 20 add_watcher() i=1 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.427+0000 7fe4e6f33800 20 add_watcher() i=2 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.427+0000 7fe4e6f33800 20 add_watcher() i=3 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.427+0000 7fe4e6f33800 20 add_watcher() i=4 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.427+0000 7fe4e6f33800 20 add_watcher() i=5 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.427+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94144008229088] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.427+0000 7fe4e6f33800 20 add_watcher() i=6 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.428+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94144008231872] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.428+0000 7fe4e6f33800 20 add_watcher() i=7 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.428+0000 7fe4e6f33800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.428+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2b0670 con 0x559f9c2a1d30 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.428+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.428+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94144008232928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2b2e30 con 0x559f9c2a1d30 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.429+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94144008232928] v30'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.429+0000 7fe3997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.429+0000 7fe4e6f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.429+0000 7fe4e6f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.429+0000 7fe4e6f33800 5 note: GC not initialized 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe313fff640 20 reqs_thread_entry: start 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 20 Filter name: none 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe311ffb640 20 reqs_thread_entry: start 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2e7530 con 0x559f9c2a1d30 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.430+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2e7a70 con 0x559f9c2a1d30 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.431+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.431+0000 7fe4e6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.431+0000 7fe4e6f33800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.431+0000 7fe4e6f33800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.431+0000 7fe4e6f33800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.431+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ed5c0 con 0x559f9c2a1d30 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~515] v30'6 uv6 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe4e6f33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe4e6f33800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe4e6f33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94144008475232 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ea2e0 con 0x559f9c2a1d30 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== watch-notify(notify (1) cookie 94144008224000 notify 128849018885 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x559f9c26b250 con 0x559f9c2a1d30 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe3c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94144008224000 notifier 4355 bl.length()=691 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe3c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe3c67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe3c67fc640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe3a8003e90 con 0x559f9c2a1d30 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(65 notify.4 [notify cookie 94144008475232 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== watch-notify(notify_complete (2) cookie 94144008475232 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559f9c26ad70 con 0x559f9c2a1d30 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.432+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ed260 con 0x559f9c2a1d30 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.433+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.433+0000 7fe4e6f33800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.433+0000 7fe4e6f33800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.433+0000 7fe4e6f33800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-15T22:56:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.433+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94144008475232 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2e7d80 con 0x7fe4d8098020 2024-02-15T22:56:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.434+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== watch-notify(notify (1) cookie 94144008207840 notify 128849018882 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x7fe4dc026c10 con 0x7fe4d8098020 2024-02-15T22:56:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.434+0000 7fe3c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94144008207840 notifier 4355 bl.length()=166 2024-02-15T22:56:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.434+0000 7fe3c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-15T22:56:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.434+0000 7fe3c5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-15T22:56:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.434+0000 7fe3c5ffb640 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe3180033f0 con 0x7fe4d8098020 2024-02-15T22:56:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.434+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(68 notify.0 [notify cookie 94144008475232 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.434+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== watch-notify(notify_complete (2) cookie 94144008475232 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe4dc026e70 con 0x7fe4d8098020 2024-02-15T22:56:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.434+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.445 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"SXk07jQjfSxAw57MtkPC5VcvNDzJE85zP2DAMOg7","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.435+0000 7fe3997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.435+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94144008232928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2b5150 con 0x559f9c2a1d30 2024-02-15T22:56:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.436+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94144008232928] v30'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.436+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94144008207840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2b1fe0 con 0x7fe4d8098020 2024-02-15T22:56:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.437+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94144008207840] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.437+0000 7fe4e6f33800 20 remove_watcher() i=0 2024-02-15T22:56:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.437+0000 7fe4e6f33800 2 removed watcher, disabling cache 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.437+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94144008212992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2abde0 con 0x559f9c2a1d30 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.438+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94144008212992] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.438+0000 7fe4e6f33800 20 remove_watcher() i=1 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.438+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94144008216880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2abde0 con 0x559f9c2a8010 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.439+0000 7fe4e2466640 1 -- 172.21.15.133:0/581195141 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94144008216880] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d8095070 con 0x559f9c2a8010 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.439+0000 7fe4e6f33800 20 remove_watcher() i=2 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.439+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94144008220384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ae130 con 0x7fe4d8098020 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.440+0000 7fe4e3468640 1 -- 172.21.15.133:0/581195141 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94144008220384] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4dc03a040 con 0x7fe4d8098020 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.440+0000 7fe4e6f33800 20 remove_watcher() i=3 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.440+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94144008224000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ad200 con 0x559f9c2a1d30 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.441+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94144008224000] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x559f9c2a1d30 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.441+0000 7fe4e6f33800 20 remove_watcher() i=4 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.441+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94144008228032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ad200 con 0x7fe4dc0141d0 2024-02-15T22:56:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.442+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94144008228032] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.442+0000 7fe4e6f33800 20 remove_watcher() i=5 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.442+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94144008229088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ad200 con 0x7fe4dc0141d0 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.443+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94144008229088] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.443+0000 7fe4e6f33800 20 remove_watcher() i=6 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.443+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94144008231872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559f9c2ad200 con 0x7fe4dc0141d0 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94144008231872] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4dc0141d0 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 20 remove_watcher() i=7 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe4dc0141d0 msgr2=0x7fe4dc015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe4dc0141d0 0x7fe4dc015940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f9c2a1d30 msgr2=0x559f9c2a41f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f9c2a1d30 0x559f9c2a41f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe4d8098020 msgr2=0x7fe4d80729b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe4d8098020 0x7fe4d80729b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559f9c2a8010 msgr2=0x559f9c2aa4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559f9c2a8010 0x559f9c2aa4b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3ac0367e0 msgr2=0x7fe3ac038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3ac0367e0 0x7fe3ac038ca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00b010 tx=0x7fe4dc020000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 msgr2=0x559f9c2964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/581195141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c28f460 0x559f9c2964c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe4d808f2e0 tx=0x7fe4d808d8a0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 reap_dead start 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e2c67640 1 -- 172.21.15.133:0/581195141 reap_dead start 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 shutdown_connections 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 >> 172.21.15.133:0/581195141 conn(0x559f9c28b7c0 msgr2=0x559f9c288e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 shutdown_connections 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.444+0000 7fe4e6f33800 1 -- 172.21.15.133:0/581195141 wait complete. 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/4071404432 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3bc0367e0 msgr2=0x7fe3bc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/4071404432 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3bc0367e0 0x7fe3bc038ca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x559f9c272580 tx=0x7fe4dc005840 comp rx=0 tx=0).stop 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/4071404432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c2822a0 msgr2=0x559f9c2826c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/4071404432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c2822a0 0x559f9c2826c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8044830 tx=0x7fe4d8002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/4071404432 shutdown_connections 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/4071404432 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3bc0367e0 0x7fe3bc038ca0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/4071404432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c2822a0 0x559f9c2826c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/4071404432 >> 172.21.15.133:0/4071404432 conn(0x559f9c276340 msgr2=0x559f9c276740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/4071404432 shutdown_connections 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/4071404432 wait complete. 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f9c1713f0 msgr2=0x559f9c271530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f9c1713f0 0x559f9c271530 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c80367e0 msgr2=0x7fe3c8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c80367e0 0x7fe3c8038ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8054000 tx=0x7fe4d804e000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 msgr2=0x559f9c26a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c26a830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400b210 tx=0x7fe4d4000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 shutdown_connections 2024-02-15T22:56:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f9c1713f0 0x559f9c271530 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c80367e0 0x7fe3c8038ca0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 --2- 172.21.15.133:0/1573605836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9c16f8b0 0x559f9c26a830 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 >> 172.21.15.133:0/1573605836 conn(0x559f9c16b4f0 msgr2=0x559f9c25d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 shutdown_connections 2024-02-15T22:56:25.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.445+0000 7fe4e6f33800 1 -- 172.21.15.133:0/1573605836 wait complete. 2024-02-15T22:56:25.456 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'SXk07jQjfSxAw57MtkPC5VcvNDzJE85zP2DAMOg7', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:25.456 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-15T22:56:25.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-15T22:56:25.456 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-02-15T22:56:25.503 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:25.503 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:25.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.501+0000 7f4cdf524800 1 Processor -- start 2024-02-15T22:56:25.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.501+0000 7f4cdf524800 1 -- start start 2024-02-15T22:56:25.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.501+0000 7f4cdf524800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c51dc35a20 0x55c51dc37e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.501+0000 7f4cdf524800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c51db7fc50 con 0x55c51dc38350 2024-02-15T22:56:25.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.501+0000 7f4cdf524800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c51db37450 con 0x55c51dc35a20 2024-02-15T22:56:25.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.502+0000 7f4cdb1c8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c51dc35a20 0x55c51dc37e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.502+0000 7f4cdb1c8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c51dc35a20 0x55c51dc37e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57578/0 (socket says 172.21.15.133:57578) 2024-02-15T22:56:25.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.502+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/2978432579 learned_addr learned my addr 172.21.15.133:0/2978432579 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.502+0000 7f4cda9c7640 1 --1- 172.21.15.133:0/2978432579 >> v1:172.21.15.52:6789/0 conn(0x55c51dc38350 0x55c51dc3a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44896/0 (socket says 172.21.15.133:44896) 2024-02-15T22:56:25.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.502+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/2978432579 >> v1:172.21.15.52:6789/0 conn(0x55c51dc38350 legacy=0x55c51dc3a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.502+0000 7f4cda1c6640 1 -- 172.21.15.133:0/2978432579 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565345803 0 0) 0x55c51db7fc50 con 0x55c51dc38350 2024-02-15T22:56:25.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.502+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/2978432579 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c51dc3ce70 con 0x55c51dc35a20 2024-02-15T22:56:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.504+0000 7f4cdb1c8640 1 --2- 172.21.15.133:0/2978432579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dc37e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00a520 tx=0x7f4ccc01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33735aa3e6bad77b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.504+0000 7f4cda1c6640 1 -- 172.21.15.133:0/2978432579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc052570 con 0x55c51dc35a20 2024-02-15T22:56:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.504+0000 7f4cda1c6640 1 -- 172.21.15.133:0/2978432579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc0526d0 con 0x55c51dc35a20 2024-02-15T22:56:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.504+0000 7f4cda1c6640 1 -- 172.21.15.133:0/2978432579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc052990 con 0x55c51dc35a20 2024-02-15T22:56:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.504+0000 7f4cdf524800 1 -- 172.21.15.133:0/2978432579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 msgr2=0x55c51dc37e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.504+0000 7f4cdf524800 1 --2- 172.21.15.133:0/2978432579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dc37e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00a520 tx=0x7f4ccc01cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.504+0000 7f4cdf524800 1 -- 172.21.15.133:0/2978432579 shutdown_connections 2024-02-15T22:56:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.504+0000 7f4cdf524800 1 --2- 172.21.15.133:0/2978432579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dc37e10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.504+0000 7f4cdf524800 1 -- 172.21.15.133:0/2978432579 >> 172.21.15.133:0/2978432579 conn(0x55c51dc2f4f0 msgr2=0x55c51dc31910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.504+0000 7f4cdf524800 1 -- 172.21.15.133:0/2978432579 shutdown_connections 2024-02-15T22:56:25.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.504+0000 7f4cdf524800 1 -- 172.21.15.133:0/2978432579 wait complete. 2024-02-15T22:56:25.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.516+0000 7f4cdf524800 1 Processor -- start 2024-02-15T22:56:25.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.516+0000 7f4cdf524800 1 -- start start 2024-02-15T22:56:25.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.516+0000 7f4cdf524800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dd24f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.516+0000 7f4cdf524800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51db34980 con 0x55c51dc35a20 2024-02-15T22:56:25.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.516+0000 7f4cdb1c8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dd24f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.516+0000 7f4cdb1c8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dd24f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57580/0 (socket says 172.21.15.133:57580) 2024-02-15T22:56:25.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.516+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/2008811047 learned_addr learned my addr 172.21.15.133:0/2008811047 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.517+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/2008811047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc005de0 con 0x55c51dc35a20 2024-02-15T22:56:25.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.517+0000 7f4cdb1c8640 1 --2- 172.21.15.133:0/2008811047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dd24f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc055040 tx=0x7f4ccc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a471501004bc0a7e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.517+0000 7f4bc960a640 1 -- 172.21.15.133:0/2008811047 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc052840 con 0x55c51dc35a20 2024-02-15T22:56:25.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.517+0000 7f4bc960a640 1 -- 172.21.15.133:0/2008811047 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc0529c0 con 0x55c51dc35a20 2024-02-15T22:56:25.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.517+0000 7f4bc960a640 1 -- 172.21.15.133:0/2008811047 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc052ca0 con 0x55c51dc35a20 2024-02-15T22:56:25.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.518+0000 7f4cdf524800 1 -- 172.21.15.133:0/2008811047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 msgr2=0x55c51dd24f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.518+0000 7f4cdf524800 1 --2- 172.21.15.133:0/2008811047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dd24f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc055040 tx=0x7f4ccc04c000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.518+0000 7f4cdf524800 1 -- 172.21.15.133:0/2008811047 shutdown_connections 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.518+0000 7f4cdf524800 1 --2- 172.21.15.133:0/2008811047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dd24f00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.518+0000 7f4cdf524800 1 -- 172.21.15.133:0/2008811047 >> 172.21.15.133:0/2008811047 conn(0x55c51dc2f4f0 msgr2=0x55c51dd20820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.518+0000 7f4cdf524800 1 -- 172.21.15.133:0/2008811047 shutdown_connections 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.518+0000 7f4cdf524800 1 -- 172.21.15.133:0/2008811047 wait complete. 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.518+0000 7f4cdf524800 1 Processor -- start 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.518+0000 7f4cdf524800 1 -- start start 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4cdf524800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dc35360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4cdf524800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51db30160 con 0x55c51dc35a20 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4cdb1c8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dc35360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4cdb1c8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dc35360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57590/0 (socket says 172.21.15.133:57590) 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/1806729137 learned_addr learned my addr 172.21.15.133:0/1806729137 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/1806729137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c51dc3ce70 con 0x55c51dc35a20 2024-02-15T22:56:25.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4cdb1c8640 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dc35360 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc01ceb0 tx=0x7f4ccc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4bc7e07640 1 -- 172.21.15.133:0/1806729137 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc06c070 con 0x55c51dc35a20 2024-02-15T22:56:25.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4bc7e07640 1 -- 172.21.15.133:0/1806729137 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc05d690 con 0x55c51dc35a20 2024-02-15T22:56:25.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c51dc33a50 con 0x55c51dc35a20 2024-02-15T22:56:25.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4bc7e07640 1 -- 172.21.15.133:0/1806729137 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc05d970 con 0x55c51dc35a20 2024-02-15T22:56:25.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.519+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c51dc33f90 con 0x55c51dc35a20 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.520+0000 7f4bc7e07640 1 -- 172.21.15.133:0/1806729137 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4ccc059040 con 0x55c51dc35a20 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.520+0000 7f4bc7e07640 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bc00367e0 0x7f4bc0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.520+0000 7f4bc7e07640 1 -- 172.21.15.133:0/1806729137 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4ccc08d690 con 0x55c51dc35a20 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.520+0000 7f4cda9c7640 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bc00367e0 0x7f4bc0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.520+0000 7f4cdf524800 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c51dc38350 0x55c51dd35790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.520+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dc34740 con 0x55c51dc38350 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.521+0000 7f4cdb9c9640 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c51dc38350 0x55c51dd35790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.521+0000 7f4cda9c7640 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bc00367e0 0x7f4bc0038ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0000c00 tx=0x7f4cd00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.521+0000 7f4cdb9c9640 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c51dc38350 0x55c51dd35790 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.521+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/1806729137 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cd400a4a0 con 0x55c51dc38350 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.521+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dc342a0 con 0x55c51dc38350 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.521+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/1806729137 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4cd400a4a0 con 0x55c51dc38350 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.521+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd376a0 con 0x55c51dc38350 2024-02-15T22:56:25.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.522+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/1806729137 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4cd400a4a0 con 0x55c51dc38350 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.522+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd368f0 con 0x55c51dc38350 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.522+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/1806729137 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4cd400a4a0 con 0x55c51dc38350 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.522+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd36d00 con 0x55c51dc38350 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.522+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/1806729137 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4cd400a4a0 con 0x55c51dc38350 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.523+0000 7f4cdf524800 1 Processor -- start 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.523+0000 7f4cdf524800 1 -- start start 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.523+0000 7f4cdf524800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd460e0 0x55c51dd46500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.523+0000 7f4cdf524800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51dad2e80 con 0x55c51dd460e0 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.523+0000 7f4cda9c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd460e0 0x55c51dd46500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.523+0000 7f4cda9c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd460e0 0x55c51dd46500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57592/0 (socket says 172.21.15.133:57592) 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.523+0000 7f4cda9c7640 1 -- 172.21.15.133:0/318702455 learned_addr learned my addr 172.21.15.133:0/318702455 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.523+0000 7f4cda9c7640 1 -- 172.21.15.133:0/318702455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c51dd46a40 con 0x55c51dd460e0 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.523+0000 7f4cda9c7640 1 --2- 172.21.15.133:0/318702455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd460e0 0x55c51dd46500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000e610 tx=0x7f4cd000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.524+0000 7f4bc5602640 1 -- 172.21.15.133:0/318702455 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd000bea0 con 0x55c51dd460e0 2024-02-15T22:56:25.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.524+0000 7f4bc5602640 1 -- 172.21.15.133:0/318702455 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd000d500 con 0x55c51dd460e0 2024-02-15T22:56:25.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.524+0000 7f4cdf524800 1 -- 172.21.15.133:0/318702455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c51dd474b0 con 0x55c51dd460e0 2024-02-15T22:56:25.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.524+0000 7f4bc5602640 1 -- 172.21.15.133:0/318702455 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd000d7a0 con 0x55c51dd460e0 2024-02-15T22:56:25.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.524+0000 7f4cdf524800 1 -- 172.21.15.133:0/318702455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c51dd47970 con 0x55c51dd460e0 2024-02-15T22:56:25.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.524+0000 7f4bc5602640 1 -- 172.21.15.133:0/318702455 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4cd001a070 con 0x55c51dd460e0 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.525+0000 7f4bc5602640 1 --2- 172.21.15.133:0/318702455 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bb40367e0 0x7f4bb4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.525+0000 7f4bc5602640 1 -- 172.21.15.133:0/318702455 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4cd0017050 con 0x55c51dd460e0 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.525+0000 7f4cdb9c9640 1 --2- 172.21.15.133:0/318702455 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bb40367e0 0x7f4bb4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.525+0000 7f4cdf524800 1 Processor -- start 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.525+0000 7f4cdf524800 1 -- start start 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.525+0000 7f4cdb9c9640 1 --2- 172.21.15.133:0/318702455 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bb40367e0 0x7f4bb4038ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55c51dd36330 tx=0x7f4cd4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.525+0000 7f4cdf524800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd53720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.525+0000 7f4cdf524800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51daa85d0 con 0x55c51dd53300 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.525+0000 7f4cda9c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd53720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.525+0000 7f4cda9c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd53720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57596/0 (socket says 172.21.15.133:57596) 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.525+0000 7f4cda9c7640 1 -- 172.21.15.133:0/942783465 learned_addr learned my addr 172.21.15.133:0/942783465 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4cda9c7640 1 -- 172.21.15.133:0/942783465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c51dd53cf0 con 0x55c51dd53300 2024-02-15T22:56:25.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4cda9c7640 1 --2- 172.21.15.133:0/942783465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd53720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4cd004b9d0 tx=0x7f4cd004bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bc8687e158f0dc server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4bbeffd640 1 -- 172.21.15.133:0/942783465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd001a320 con 0x55c51dd53300 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4bbeffd640 1 -- 172.21.15.133:0/942783465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd001a480 con 0x55c51dd53300 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4bbeffd640 1 -- 172.21.15.133:0/942783465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd001ac40 con 0x55c51dd53300 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4cdf524800 1 -- 172.21.15.133:0/942783465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 msgr2=0x55c51dd53720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4cdf524800 1 --2- 172.21.15.133:0/942783465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd53720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4cd004b9d0 tx=0x7f4cd004bc50 comp rx=0 tx=0).stop 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4cdf524800 1 -- 172.21.15.133:0/942783465 shutdown_connections 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4cdf524800 1 --2- 172.21.15.133:0/942783465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd53720 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4cdf524800 1 -- 172.21.15.133:0/942783465 >> 172.21.15.133:0/942783465 conn(0x55c51dd4f660 msgr2=0x55c51dd4d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4cdf524800 1 -- 172.21.15.133:0/942783465 shutdown_connections 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.526+0000 7f4cdf524800 1 -- 172.21.15.133:0/942783465 wait complete. 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.527+0000 7f4cdf524800 1 Processor -- start 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.527+0000 7f4cdf524800 1 -- start start 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.527+0000 7f4cdf524800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd5a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.527+0000 7f4cdf524800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51dd5a880 con 0x55c51dd53300 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.527+0000 7f4cda9c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd5a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.527+0000 7f4cda9c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd5a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57606/0 (socket says 172.21.15.133:57606) 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.527+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 learned_addr learned my addr 172.21.15.133:0/18480488 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.527+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c51dd47970 con 0x55c51dd53300 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.527+0000 7f4cda9c7640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd5a340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0048040 tx=0x7f4cd004b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.528+0000 7f4bbd7fa640 1 -- 172.21.15.133:0/18480488 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd001a320 con 0x55c51dd53300 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.528+0000 7f4bbd7fa640 1 -- 172.21.15.133:0/18480488 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd00242c0 con 0x55c51dd53300 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.528+0000 7f4bbd7fa640 1 -- 172.21.15.133:0/18480488 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd0024680 con 0x55c51dd53300 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.528+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c51dd5aa80 con 0x55c51dd53300 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.528+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c51dd5af40 con 0x55c51dd53300 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.528+0000 7f4bbd7fa640 1 -- 172.21.15.133:0/18480488 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4cd000d040 con 0x55c51dd53300 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.529+0000 7f4bbd7fa640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ba4036790 0x7f4ba4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.529+0000 7f4bbd7fa640 1 -- 172.21.15.133:0/18480488 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4cd000a040 con 0x55c51dd53300 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.529+0000 7f4cdb9c9640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ba4036790 0x7f4ba4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.529+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.529+0000 7f4cdb9c9640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ba4036790 0x7f4ba4038c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b010 tx=0x7f4cd4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.529+0000 7f4cdf524800 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c51dd66150 0x55c51dd68610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.529+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd68d60 con 0x55c51dd66150 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.529+0000 7f4cdb1c8640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c51dd66150 0x55c51dd68610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.529+0000 7f4cdb1c8640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c51dd66150 0x55c51dd68610 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 20 realm 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd69130 con 0x55c51dd66150 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd699b0 con 0x55c51dd66150 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd69d10 con 0x55c51dd66150 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.530+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6a510 con 0x55c51dd66150 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.531+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.531+0000 7f4cdf524800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.531+0000 7f4cdf524800 20 searching for the correct realm 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.531+0000 7f4cdf524800 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c51dd6c3a0 0x55c51dd6e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.531+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd6c3a0 2024-02-15T22:56:25.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.531+0000 7f4cda9c7640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c51dd6c3a0 0x55c51dd6e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.531+0000 7f4cda9c7640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c51dd6c3a0 0x55c51dd6e860 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.531+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.531+0000 7f4cda9c7640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4cd0027060 0x7f4cd001b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.531+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd0027060 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.531+0000 7f4cdb9c9640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4cd0027060 0x7f4cd001b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.532+0000 7f4cdb9c9640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4cd0027060 0x7f4cd001b6f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.532+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd400a4a0 con 0x7f4cd0027060 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.532+0000 7f4cdb9c9640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4cd40141d0 0x7f4cd4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.532+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd40141d0 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.532+0000 7f4cdb1c8640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4cd40141d0 0x7f4cd4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.533+0000 7f4cdb1c8640 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4cd40141d0 0x7f4cd4015940 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.533+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x7f4cd40141d0 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.533+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd66150 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.533+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.533+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd66150 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.533+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.533+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd40141d0 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.533+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x7f4cd40141d0 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.533+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd40141d0 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.534+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x7f4cd40141d0 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.534+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd0027060 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.534+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd400a4a0 con 0x7f4cd0027060 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.534+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd6c3a0 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.534+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.534+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd66150 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.534+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.534+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd40141d0 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.535+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x7f4cd40141d0 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.535+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd66150 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.535+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.535+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd0027060 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.535+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4cd403a040 con 0x7f4cd0027060 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.535+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd6c3a0 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.535+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.535+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd6c3a0 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.535+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.535+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd40141d0 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.536+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x7f4cd40141d0 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.536+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd6c3a0 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.536+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.536+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd6c3a0 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.536+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.536+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd66150 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.536+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.536+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd66150 2024-02-15T22:56:25.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.537+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.537+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd40141d0 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.537+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x7f4cd40141d0 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.537+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd6c3a0 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.537+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.537+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd0027060 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.537+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd403a040 con 0x7f4cd0027060 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.537+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd66150 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.538+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4ccc05dad0 con 0x55c51dd66150 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.538+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd40141d0 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.538+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc05dad0 con 0x7f4cd40141d0 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.538+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd6c3a0 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.538+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.538+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd40141d0 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.539+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.539+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd0027060 2024-02-15T22:56:25.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.539+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd403a040 con 0x7f4cd0027060 2024-02-15T22:56:25.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.539+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd6c3a0 2024-02-15T22:56:25.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.539+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.539+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd40141d0 2024-02-15T22:56:25.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.539+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.539+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x55c51dd66150 2024-02-15T22:56:25.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ef30 con 0x7f4cd0027060 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd403a040 con 0x7f4cd0027060 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6ae40 con 0x55c51dd66150 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6b690 con 0x55c51dd66150 2024-02-15T22:56:25.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.540+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6f370 con 0x55c51dd66150 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 20 zone default found 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 4 Realm: () 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 20 zonegroup default 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd6f370 con 0x7f4cd40141d0 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd711f0 con 0x55c51dd6c3a0 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd71550 con 0x55c51dd6c3a0 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 20 started sync module instance, tier type = 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.541+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd707c0 con 0x7f4cd0027060 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.542+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd403a040 con 0x7f4cd0027060 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.543+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94305097550976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd707c0 con 0x7f4cd0027060 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.543+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd71f40 con 0x55c51dd66150 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.543+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94305097550976] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd403a040 con 0x7f4cd0027060 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.544+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.544+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94305097554464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd707c0 con 0x55c51dd66150 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.544+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd729c0 con 0x55c51dd6c3a0 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.545+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94305097554464] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.545+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.545+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94305097548576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd70740 con 0x55c51dd6c3a0 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.545+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd73820 con 0x7f4cd0027060 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.546+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94305097548576] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.546+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd403a040 con 0x7f4cd0027060 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.546+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94305097560960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd73c40 con 0x7f4cd0027060 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.546+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd745b0 con 0x55c51dd66150 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.547+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.547+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94305097564432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd74570 con 0x55c51dd66150 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.547+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94305097560960] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd403a040 con 0x7f4cd0027060 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.547+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd737a0 con 0x7f4cd40141d0 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.548+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.548+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94305097564432] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.548+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94305097568336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd74570 con 0x7f4cd40141d0 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.548+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd74960 con 0x7f4cd40141d0 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.549+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.549+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94305097566560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd75f20 con 0x7f4cd40141d0 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.549+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd76940 con 0x7f4cd40141d0 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.549+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94305097568336] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.550+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94305097566560] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.550+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.550+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94305097573408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd75a80 con 0x7f4cd40141d0 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.550+0000 7f4cdf524800 20 add_watcher() i=0 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.550+0000 7f4cdf524800 20 add_watcher() i=1 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.550+0000 7f4cdf524800 20 add_watcher() i=2 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.550+0000 7f4cdf524800 20 add_watcher() i=3 2024-02-15T22:56:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.550+0000 7f4cdf524800 20 add_watcher() i=4 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.550+0000 7f4cdf524800 20 add_watcher() i=5 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.550+0000 7f4cdf524800 20 add_watcher() i=6 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.551+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94305097573408] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.551+0000 7f4cdf524800 20 add_watcher() i=7 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.551+0000 7f4cdf524800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.551+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd79a40 con 0x55c51dd66150 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.551+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.551+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94305097569392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd76f20 con 0x55c51dd66150 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.552+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94305097569392] v30'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.552+0000 7f4b91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.552+0000 7f4cdf524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.552+0000 7f4cdf524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.552+0000 7f4cdf524800 5 note: GC not initialized 2024-02-15T22:56:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.552+0000 7f4b90fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.552+0000 7f4cdf524800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.553+0000 7f4cdf524800 20 Filter name: none 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.553+0000 7f4b0a7fc640 20 reqs_thread_entry: start 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.553+0000 7f4cdf524800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.553+0000 7f4cdf524800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.553+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51ddab940 con 0x55c51dd66150 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.553+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.553+0000 7f4cdf524800 20 rados_obj.operate() r=0 bl.length=515 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.553+0000 7f4cdf524800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.553+0000 7f4cdf524800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.553+0000 7f4cdf524800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.553+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51ddb1bf0 con 0x55c51dd66150 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.554+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~515] v30'7 uv7 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4cdf524800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4cdf524800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4cdf524800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94305097815664 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51ddad320 con 0x55c51dd66150 2024-02-15T22:56:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 94305097564432 notify 128849018886 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x55c51dc33f90 con 0x55c51dd66150 2024-02-15T22:56:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4bbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94305097564432 notifier 4362 bl.length()=691 2024-02-15T22:56:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4bbeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4bbeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(64 notify.4 [notify cookie 94305097815664 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4bbeffd640 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4ba0003e90 con 0x55c51dd66150 2024-02-15T22:56:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.555+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== watch-notify(notify_complete (2) cookie 94305097815664 notify 128849018886 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c51dc33a50 con 0x55c51dd66150 2024-02-15T22:56:25.567 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:25.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.556+0000 7f4b91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.556+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94305097569392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51ddace80 con 0x55c51dd66150 2024-02-15T22:56:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.557+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94305097569392] v30'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.557+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94305097550976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd75470 con 0x7f4cd0027060 2024-02-15T22:56:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.558+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94305097550976] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd403a040 con 0x7f4cd0027060 2024-02-15T22:56:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.558+0000 7f4cdf524800 20 remove_watcher() i=0 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.558+0000 7f4cdf524800 2 removed watcher, disabling cache 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.558+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94305097554464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd75470 con 0x55c51dd66150 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.559+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94305097554464] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.559+0000 7f4cdf524800 20 remove_watcher() i=1 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.559+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94305097548576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd71a20 con 0x55c51dd6c3a0 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.560+0000 7f4cda9c7640 1 -- 172.21.15.133:0/18480488 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94305097548576] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd001c420 con 0x55c51dd6c3a0 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.560+0000 7f4cdf524800 20 remove_watcher() i=2 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.560+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94305097560960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd75470 con 0x7f4cd0027060 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.561+0000 7f4cdb9c9640 1 -- 172.21.15.133:0/18480488 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94305097560960] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd403a040 con 0x7f4cd0027060 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.561+0000 7f4cdf524800 20 remove_watcher() i=3 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.561+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94305097564432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd70320 con 0x55c51dd66150 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.562+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94305097564432] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x55c51dd66150 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.562+0000 7f4cdf524800 20 remove_watcher() i=4 2024-02-15T22:56:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.562+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94305097568336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd73380 con 0x7f4cd40141d0 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.563+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94305097568336] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.563+0000 7f4cdf524800 20 remove_watcher() i=5 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.563+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94305097566560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd74110 con 0x7f4cd40141d0 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.563+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94305097566560] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.563+0000 7f4cdf524800 20 remove_watcher() i=6 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.564+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94305097573408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c51dd70320 con 0x7f4cd40141d0 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.564+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94305097573408] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc09d040 con 0x7f4cd40141d0 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.564+0000 7f4cdf524800 20 remove_watcher() i=7 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4cd40141d0 msgr2=0x7f4cd4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4cd40141d0 0x7f4cd4015940 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c51dd66150 msgr2=0x55c51dd68610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c51dd66150 0x55c51dd68610 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4cd0027060 msgr2=0x7f4cd001b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4cd0027060 0x7f4cd001b6f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c51dd6c3a0 msgr2=0x55c51dd6e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c51dd6c3a0 0x55c51dd6e860 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ba4036790 msgr2=0x7f4ba4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ba4036790 0x7f4ba4038c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b010 tx=0x7f4cd4020000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 msgr2=0x55c51dd5a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdb1c8640 1 -- 172.21.15.133:0/18480488 reap_dead start 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd5a340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0048040 tx=0x7f4cd004b930 comp rx=0 tx=0).stop 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 shutdown_connections 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 --2- 172.21.15.133:0/18480488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd53300 0x55c51dd5a340 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 >> 172.21.15.133:0/18480488 conn(0x55c51dd4f660 msgr2=0x55c51dd4ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 shutdown_connections 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/18480488 wait complete. 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/318702455 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bb40367e0 msgr2=0x7f4bb4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 --2- 172.21.15.133:0/318702455 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bb40367e0 0x7f4bb4038ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55c51dd36330 tx=0x7f4cd4005840 comp rx=0 tx=0).stop 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/318702455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd460e0 msgr2=0x55c51dd46500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 --2- 172.21.15.133:0/318702455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd460e0 0x55c51dd46500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000e610 tx=0x7f4cd000ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/318702455 shutdown_connections 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 --2- 172.21.15.133:0/318702455 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bb40367e0 0x7f4bb4038ca0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 --2- 172.21.15.133:0/318702455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dd460e0 0x55c51dd46500 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/318702455 >> 172.21.15.133:0/318702455 conn(0x55c51dd3a180 msgr2=0x55c51dd3a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/318702455 shutdown_connections 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.565+0000 7f4cdf524800 1 -- 172.21.15.133:0/318702455 wait complete. 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c51dc38350 msgr2=0x55c51dd35790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c51dc38350 0x55c51dd35790 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bc00367e0 msgr2=0x7f4bc0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bc00367e0 0x7f4bc0038ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0000c00 tx=0x7f4cd00013b0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 msgr2=0x55c51dc35360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dc35360 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc01ceb0 tx=0x7f4ccc002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 shutdown_connections 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c51dc38350 0x55c51dd35790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4bc00367e0 0x7f4bc0038ca0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 --2- 172.21.15.133:0/1806729137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c51dc35a20 0x55c51dc35360 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 >> 172.21.15.133:0/1806729137 conn(0x55c51dc2f4f0 msgr2=0x55c51dd238f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 shutdown_connections 2024-02-15T22:56:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.566+0000 7f4cdf524800 1 -- 172.21.15.133:0/1806729137 wait complete. 2024-02-15T22:56:25.581 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:25.581 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T22:56:25.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T22:56:25.581 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T22:56:25.623 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:25.623 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:25.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.621+0000 7f6679a16800 1 Processor -- start 2024-02-15T22:56:25.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.622+0000 7f6679a16800 1 -- start start 2024-02-15T22:56:25.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.622+0000 7f6679a16800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563cc0fe5300 0x563cc0fe76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.622+0000 7f6679a16800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563cc0f2cbb0 con 0x563cc0fe0e70 2024-02-15T22:56:25.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.622+0000 7f6679a16800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x563cc0ee4450 con 0x563cc0fe5300 2024-02-15T22:56:25.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.622+0000 7f6674960640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563cc0fe5300 0x563cc0fe76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.622+0000 7f6674960640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563cc0fe5300 0x563cc0fe76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57610/0 (socket says 172.21.15.133:57610) 2024-02-15T22:56:25.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.622+0000 7f6675161640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x563cc0fe0e70 0x563cc0fe1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44912/0 (socket says 172.21.15.133:44912) 2024-02-15T22:56:25.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.622+0000 7f6674960640 1 -- 172.21.15.133:0/3365399861 learned_addr learned my addr 172.21.15.133:0/3365399861 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.622+0000 7f6674960640 1 -- 172.21.15.133:0/3365399861 >> v1:172.21.15.52:6789/0 conn(0x563cc0fe0e70 legacy=0x563cc0fe1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.622+0000 7f6674960640 1 -- 172.21.15.133:0/3365399861 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cc0fe8d20 con 0x563cc0fe5300 2024-02-15T22:56:25.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.622+0000 7f6667fff640 1 -- 172.21.15.133:0/3365399861 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459303599 0 0) 0x563cc0f2cbb0 con 0x563cc0fe0e70 2024-02-15T22:56:25.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.624+0000 7f6674960640 1 --2- 172.21.15.133:0/3365399861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe5300 0x563cc0fe76f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f666c00a520 tx=0x7f666c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fbad64227d472 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.624+0000 7f6667fff640 1 -- 172.21.15.133:0/3365399861 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c052570 con 0x563cc0fe5300 2024-02-15T22:56:25.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.624+0000 7f6667fff640 1 -- 172.21.15.133:0/3365399861 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c0526d0 con 0x563cc0fe5300 2024-02-15T22:56:25.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.624+0000 7f6667fff640 1 -- 172.21.15.133:0/3365399861 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c052990 con 0x563cc0fe5300 2024-02-15T22:56:25.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.625+0000 7f6679a16800 1 -- 172.21.15.133:0/3365399861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe5300 msgr2=0x563cc0fe76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.625+0000 7f6679a16800 1 --2- 172.21.15.133:0/3365399861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe5300 0x563cc0fe76f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f666c00a520 tx=0x7f666c01cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.625+0000 7f6679a16800 1 -- 172.21.15.133:0/3365399861 shutdown_connections 2024-02-15T22:56:25.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.625+0000 7f6679a16800 1 --2- 172.21.15.133:0/3365399861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe5300 0x563cc0fe76f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.625+0000 7f6679a16800 1 -- 172.21.15.133:0/3365399861 >> 172.21.15.133:0/3365399861 conn(0x563cc0fdc4d0 msgr2=0x563cc0fde8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.625+0000 7f6679a16800 1 -- 172.21.15.133:0/3365399861 shutdown_connections 2024-02-15T22:56:25.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.625+0000 7f6679a16800 1 -- 172.21.15.133:0/3365399861 wait complete. 2024-02-15T22:56:25.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.636+0000 7f6679a16800 1 Processor -- start 2024-02-15T22:56:25.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.637+0000 7f6679a16800 1 -- start start 2024-02-15T22:56:25.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.637+0000 7f6679a16800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.637+0000 7f6679a16800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc0ee1980 con 0x563cc0fe0e70 2024-02-15T22:56:25.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.637+0000 7f6675161640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.637+0000 7f6675161640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10d0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57616/0 (socket says 172.21.15.133:57616) 2024-02-15T22:56:25.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.637+0000 7f6675161640 1 -- 172.21.15.133:0/4288069125 learned_addr learned my addr 172.21.15.133:0/4288069125 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.637+0000 7f6675161640 1 -- 172.21.15.133:0/4288069125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c005de0 con 0x563cc0fe0e70 2024-02-15T22:56:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.638+0000 7f6675161640 1 --2- 172.21.15.133:0/4288069125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10d0ef0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f666800b240 tx=0x7f666800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89500b27a6dac84f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.638+0000 7f6563606640 1 -- 172.21.15.133:0/4288069125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6668014070 con 0x563cc0fe0e70 2024-02-15T22:56:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.638+0000 7f6563606640 1 -- 172.21.15.133:0/4288069125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666800d500 con 0x563cc0fe0e70 2024-02-15T22:56:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.638+0000 7f6563606640 1 -- 172.21.15.133:0/4288069125 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666800d820 con 0x563cc0fe0e70 2024-02-15T22:56:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.638+0000 7f6679a16800 1 -- 172.21.15.133:0/4288069125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 msgr2=0x563cc10d0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.638+0000 7f6679a16800 1 --2- 172.21.15.133:0/4288069125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10d0ef0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f666800b240 tx=0x7f666800b700 comp rx=0 tx=0).stop 2024-02-15T22:56:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.638+0000 7f6679a16800 1 -- 172.21.15.133:0/4288069125 shutdown_connections 2024-02-15T22:56:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.638+0000 7f6679a16800 1 --2- 172.21.15.133:0/4288069125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10d0ef0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.638+0000 7f6679a16800 1 -- 172.21.15.133:0/4288069125 >> 172.21.15.133:0/4288069125 conn(0x563cc0fdc4d0 msgr2=0x563cc10cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.639+0000 7f6679a16800 1 -- 172.21.15.133:0/4288069125 shutdown_connections 2024-02-15T22:56:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.639+0000 7f6679a16800 1 -- 172.21.15.133:0/4288069125 wait complete. 2024-02-15T22:56:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.639+0000 7f6679a16800 1 Processor -- start 2024-02-15T22:56:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.639+0000 7f6679a16800 1 -- start start 2024-02-15T22:56:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.639+0000 7f6679a16800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10dc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.639+0000 7f6679a16800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc0edd160 con 0x563cc0fe0e70 2024-02-15T22:56:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.639+0000 7f6675161640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10dc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.639+0000 7f6675161640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10dc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57628/0 (socket says 172.21.15.133:57628) 2024-02-15T22:56:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.639+0000 7f6675161640 1 -- 172.21.15.133:0/3651826131 learned_addr learned my addr 172.21.15.133:0/3651826131 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.640+0000 7f6675161640 1 -- 172.21.15.133:0/3651826131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668001ba0 con 0x563cc0fe0e70 2024-02-15T22:56:25.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.640+0000 7f6675161640 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10dc0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x563cc10d1b00 tx=0x7f6668000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.640+0000 7f6561e03640 1 -- 172.21.15.133:0/3651826131 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666800f980 con 0x563cc0fe0e70 2024-02-15T22:56:25.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.640+0000 7f6561e03640 1 -- 172.21.15.133:0/3651826131 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668020070 con 0x563cc0fe0e70 2024-02-15T22:56:25.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.640+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563cc0f54ff0 con 0x563cc0fe0e70 2024-02-15T22:56:25.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.640+0000 7f6561e03640 1 -- 172.21.15.133:0/3651826131 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666800fc30 con 0x563cc0fe0e70 2024-02-15T22:56:25.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.640+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cc10dc600 con 0x563cc0fe0e70 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.641+0000 7f6561e03640 1 -- 172.21.15.133:0/3651826131 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f666800d040 con 0x563cc0fe0e70 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.641+0000 7f6561e03640 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f655c0367e0 0x7f655c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.641+0000 7f6561e03640 1 -- 172.21.15.133:0/3651826131 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f666800a040 con 0x563cc0fe0e70 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.641+0000 7f6674960640 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f655c0367e0 0x7f655c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.641+0000 7f6679a16800 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563cc0fe5300 0x563cc10e0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.641+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc10e0830 con 0x563cc0fe5300 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.641+0000 7f6675962640 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563cc0fe5300 0x563cc10e0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.641+0000 7f6674960640 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f655c0367e0 0x7f655c038ca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f666c054000 tx=0x7f666c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.642+0000 7f6675962640 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563cc0fe5300 0x563cc10e0210 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.642+0000 7f6675962640 1 -- 172.21.15.133:0/3651826131 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f667000a4a0 con 0x563cc0fe5300 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.642+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc10dd7d0 con 0x563cc0fe5300 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.642+0000 7f6675962640 1 -- 172.21.15.133:0/3651826131 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f667000a4a0 con 0x563cc0fe5300 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.642+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc10e0d00 con 0x563cc0fe5300 2024-02-15T22:56:25.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.643+0000 7f6675962640 1 -- 172.21.15.133:0/3651826131 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f667000a4a0 con 0x563cc0fe5300 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.643+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc10e19f0 con 0x563cc0fe5300 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.643+0000 7f6675962640 1 -- 172.21.15.133:0/3651826131 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f667000a4a0 con 0x563cc0fe5300 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.643+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc10e1e00 con 0x563cc0fe5300 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.643+0000 7f6675962640 1 -- 172.21.15.133:0/3651826131 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f667000a4a0 con 0x563cc0fe5300 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.643+0000 7f6679a16800 1 Processor -- start 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.643+0000 7f6679a16800 1 -- start start 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.644+0000 7f6679a16800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc10d9c70 0x563cc10d80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.644+0000 7f6679a16800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc0e7fe80 con 0x563cc10d9c70 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.644+0000 7f6674960640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc10d9c70 0x563cc10d80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.644+0000 7f6674960640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc10d9c70 0x563cc10d80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57640/0 (socket says 172.21.15.133:57640) 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.644+0000 7f6674960640 1 -- 172.21.15.133:0/1273607525 learned_addr learned my addr 172.21.15.133:0/1273607525 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.644+0000 7f6674960640 1 -- 172.21.15.133:0/1273607525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cc10d8620 con 0x563cc10d9c70 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.644+0000 7f6674960640 1 --2- 172.21.15.133:0/1273607525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc10d9c70 0x563cc10d80e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f666c044940 tx=0x7f666c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.644+0000 7f655affd640 1 -- 172.21.15.133:0/1273607525 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c05db80 con 0x563cc10d9c70 2024-02-15T22:56:25.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.644+0000 7f655affd640 1 -- 172.21.15.133:0/1273607525 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c05dd00 con 0x563cc10d9c70 2024-02-15T22:56:25.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.644+0000 7f655affd640 1 -- 172.21.15.133:0/1273607525 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c069400 con 0x563cc10d9c70 2024-02-15T22:56:25.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.644+0000 7f6679a16800 1 -- 172.21.15.133:0/1273607525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563cc10d8810 con 0x563cc10d9c70 2024-02-15T22:56:25.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.645+0000 7f6679a16800 1 -- 172.21.15.133:0/1273607525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cc10d8c70 con 0x563cc10d9c70 2024-02-15T22:56:25.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.645+0000 7f655affd640 1 -- 172.21.15.133:0/1273607525 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f666c059040 con 0x563cc10d9c70 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.645+0000 7f655affd640 1 --2- 172.21.15.133:0/1273607525 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f654c0367e0 0x7f654c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.645+0000 7f655affd640 1 -- 172.21.15.133:0/1273607525 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f666c08f370 con 0x563cc10d9c70 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.645+0000 7f6675962640 1 --2- 172.21.15.133:0/1273607525 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f654c0367e0 0x7f654c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.646+0000 7f6679a16800 1 Processor -- start 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.646+0000 7f6679a16800 1 -- start start 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.646+0000 7f6679a16800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1100810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.646+0000 7f6679a16800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc0e555d0 con 0x563cc1100430 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.646+0000 7f6675962640 1 --2- 172.21.15.133:0/1273607525 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f654c0367e0 0x7f654c038ca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x563cc10dd6f0 tx=0x7f6670005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.646+0000 7f6674960640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1100810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.646+0000 7f6674960640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1100810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57642/0 (socket says 172.21.15.133:57642) 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.646+0000 7f6674960640 1 -- 172.21.15.133:0/1549604045 learned_addr learned my addr 172.21.15.133:0/1549604045 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.646+0000 7f6674960640 1 -- 172.21.15.133:0/1549604045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cc1100de0 con 0x563cc1100430 2024-02-15T22:56:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.646+0000 7f6674960640 1 --2- 172.21.15.133:0/1549604045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1100810 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f666c08d910 tx=0x7f666c068e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecae2ef38c78f90 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6558ff9640 1 -- 172.21.15.133:0/1549604045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c08c070 con 0x563cc1100430 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6558ff9640 1 -- 172.21.15.133:0/1549604045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c072580 con 0x563cc1100430 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6558ff9640 1 -- 172.21.15.133:0/1549604045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c0064d0 con 0x563cc1100430 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6679a16800 1 -- 172.21.15.133:0/1549604045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 msgr2=0x563cc1100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6679a16800 1 --2- 172.21.15.133:0/1549604045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1100810 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f666c08d910 tx=0x7f666c068e80 comp rx=0 tx=0).stop 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6679a16800 1 -- 172.21.15.133:0/1549604045 shutdown_connections 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6679a16800 1 --2- 172.21.15.133:0/1549604045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1100810 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6679a16800 1 -- 172.21.15.133:0/1549604045 >> 172.21.15.133:0/1549604045 conn(0x563cc10fc700 msgr2=0x563cc10fa760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6679a16800 1 -- 172.21.15.133:0/1549604045 shutdown_connections 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6679a16800 1 -- 172.21.15.133:0/1549604045 wait complete. 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6679a16800 1 Processor -- start 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6679a16800 1 -- start start 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6679a16800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.647+0000 7f6679a16800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc1107980 con 0x563cc1100430 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.648+0000 7f6674960640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.648+0000 7f6674960640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57656/0 (socket says 172.21.15.133:57656) 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.648+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 learned_addr learned my addr 172.21.15.133:0/2546359678 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.648+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cc10d8c70 con 0x563cc1100430 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.648+0000 7f6674960640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1107440 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f666c08f2e0 tx=0x7f666c08d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.648+0000 7f654affd640 1 -- 172.21.15.133:0/2546359678 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c08da50 con 0x563cc1100430 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.648+0000 7f654affd640 1 -- 172.21.15.133:0/2546359678 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c08dbf0 con 0x563cc1100430 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.648+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563cc10d8c70 con 0x563cc1100430 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.648+0000 7f654affd640 1 -- 172.21.15.133:0/2546359678 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c08c070 con 0x563cc1100430 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.648+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cc1107df0 con 0x563cc1100430 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.649+0000 7f654affd640 1 -- 172.21.15.133:0/2546359678 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f666c08c1d0 con 0x563cc1100430 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.649+0000 7f654affd640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f65400367e0 0x7f6540038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.649+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.649+0000 7f654affd640 1 -- 172.21.15.133:0/2546359678 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f666c099ab0 con 0x563cc1100430 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.649+0000 7f6675962640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f65400367e0 0x7f6540038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.649+0000 7f6679a16800 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563cc1112cd0 0x563cc1115170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.649+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc11158c0 con 0x563cc1112cd0 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.649+0000 7f6675161640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563cc1112cd0 0x563cc1115170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6675161640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563cc1112cd0 0x563cc1115170 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6675962640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f65400367e0 0x7f6540038ca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f667000b010 tx=0x7f6670020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6668016070 con 0x563cc1112cd0 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6679a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6679a16800 20 realm 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1115c90 con 0x563cc1112cd0 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6668016070 con 0x563cc1112cd0 2024-02-15T22:56:25.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6679a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6679a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc11164e0 con 0x563cc1112cd0 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6668016070 con 0x563cc1112cd0 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6679a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.650+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116840 con 0x563cc1112cd0 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.651+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6668016070 con 0x563cc1112cd0 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.651+0000 7f6679a16800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.651+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.651+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1112cd0 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.651+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6668016070 con 0x563cc1112cd0 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.651+0000 7f6679a16800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:25.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.651+0000 7f6679a16800 20 searching for the correct realm 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.651+0000 7f6679a16800 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563cc1118c00 0x563cc111aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.651+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111b670 con 0x563cc1118c00 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.651+0000 7f6674960640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563cc1118c00 0x563cc111aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.651+0000 7f6674960640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563cc1118c00 0x563cc111aff0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.652+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.652+0000 7f6674960640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f666c098020 0x7f666c0729b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.652+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111b670 con 0x7f666c098020 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.652+0000 7f6675962640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f666c098020 0x7f666c0729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.652+0000 7f6675962640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f666c098020 0x7f666c0729b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.652+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667000a4a0 con 0x7f666c098020 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.652+0000 7f6675962640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f66700141d0 0x7f6670015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.652+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111b670 con 0x7f66700141d0 2024-02-15T22:56:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.653+0000 7f6675161640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f66700141d0 0x7f6670015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.653+0000 7f6675161640 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f66700141d0 0x7f6670015940 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.653+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668016070 con 0x7f66700141d0 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.653+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1112cd0 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.654+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668016070 con 0x563cc1112cd0 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.654+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1112cd0 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.654+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668016070 con 0x563cc1112cd0 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.654+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f66700141d0 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.654+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668016070 con 0x7f66700141d0 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.654+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f66700141d0 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.654+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668016070 con 0x7f66700141d0 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.654+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f666c098020 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.654+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667000a4a0 con 0x7f666c098020 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.654+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1118c00 2024-02-15T22:56:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.655+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.655+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1112cd0 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.655+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668016070 con 0x563cc1112cd0 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.655+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f66700141d0 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.655+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668016070 con 0x7f66700141d0 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.655+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1112cd0 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.655+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668016070 con 0x563cc1112cd0 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.655+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f666c098020 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.656+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f667003a040 con 0x7f666c098020 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.656+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1118c00 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.656+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.656+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1118c00 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.656+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.656+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f66700141d0 2024-02-15T22:56:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.656+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668016070 con 0x7f66700141d0 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.656+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1118c00 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.657+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.657+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1118c00 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.657+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.657+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1112cd0 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.657+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668016070 con 0x563cc1112cd0 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.657+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1112cd0 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.657+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6668016070 con 0x563cc1112cd0 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.657+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f66700141d0 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.658+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.658+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1118c00 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.658+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.658+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f666c098020 2024-02-15T22:56:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.658+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667003a040 con 0x7f666c098020 2024-02-15T22:56:25.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.658+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1112cd0 2024-02-15T22:56:25.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.658+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.658+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f66700141d0 2024-02-15T22:56:25.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.659+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.659+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1118c00 2024-02-15T22:56:25.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.659+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.659+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f66700141d0 2024-02-15T22:56:25.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.659+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.660+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f666c098020 2024-02-15T22:56:25.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.660+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667003a040 con 0x7f666c098020 2024-02-15T22:56:25.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.660+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1118c00 2024-02-15T22:56:25.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.660+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.660+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f66700141d0 2024-02-15T22:56:25.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.660+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.660+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x563cc1112cd0 2024-02-15T22:56:25.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1116180 con 0x7f666c098020 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667003a040 con 0x7f666c098020 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1117570 con 0x563cc1112cd0 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1117920 con 0x563cc1112cd0 2024-02-15T22:56:25.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.661+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1117920 con 0x563cc1112cd0 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 20 zone default found 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 4 Realm: () 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 20 zonegroup default 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc11181f0 con 0x7f66700141d0 2024-02-15T22:56:25.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc11181f0 con 0x563cc1118c00 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.662+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111d520 con 0x563cc1118c00 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.663+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.663+0000 7f6679a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.663+0000 7f6679a16800 20 started sync module instance, tier type = 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.663+0000 7f6679a16800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.663+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111cd70 con 0x7f666c098020 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.664+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f667003a040 con 0x7f666c098020 2024-02-15T22:56:25.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.664+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94818937194704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111d120 con 0x7f666c098020 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.664+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111e280 con 0x563cc1112cd0 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.665+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94818937194704] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f667003a040 con 0x7f666c098020 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.665+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.665+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94818937199184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111e370 con 0x563cc1112cd0 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.665+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111ee30 con 0x563cc1118c00 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.666+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94818937199184] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.666+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.666+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94818937202928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111f190 con 0x563cc1118c00 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.666+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111fc00 con 0x7f666c098020 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.667+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94818937202928] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.667+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f667003a040 con 0x7f666c098020 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.667+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94818937206496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111ffb0 con 0x7f666c098020 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.667+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc11209e0 con 0x563cc1112cd0 2024-02-15T22:56:25.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.668+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.668+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94818937210080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc11209a0 con 0x563cc1112cd0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.668+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1121960 con 0x7f66700141d0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.668+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94818937206496] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f667003a040 con 0x7f666c098020 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.669+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.669+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94818937214080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1121960 con 0x7f66700141d0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.669+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1122360 con 0x7f66700141d0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.669+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94818937210080] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.670+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.670+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94818937212304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1122320 con 0x7f66700141d0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.670+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1122d20 con 0x7f66700141d0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.670+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94818937214080] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.671+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94818937212304] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.671+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.671+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94818937216640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc11222a0 con 0x7f66700141d0 2024-02-15T22:56:25.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.671+0000 7f6679a16800 20 add_watcher() i=0 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.671+0000 7f6679a16800 20 add_watcher() i=1 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.671+0000 7f6679a16800 20 add_watcher() i=2 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.671+0000 7f6679a16800 20 add_watcher() i=3 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.671+0000 7f6679a16800 20 add_watcher() i=4 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.671+0000 7f6679a16800 20 add_watcher() i=5 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.671+0000 7f6679a16800 20 add_watcher() i=6 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.672+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94818937216640] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.672+0000 7f6679a16800 20 add_watcher() i=7 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.672+0000 7f6679a16800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.672+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1125d50 con 0x563cc1112cd0 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.672+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.672+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94818937219200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1123220 con 0x563cc1112cd0 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.673+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94818937219200] v30'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.673+0000 7f652b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.674+0000 7f6679a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:25.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.674+0000 7f6679a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:25.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.674+0000 7f6679a16800 5 note: GC not initialized 2024-02-15T22:56:25.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.674+0000 7f652a7e4640 20 reqs_thread_entry: start 2024-02-15T22:56:25.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.674+0000 7f6679a16800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:25.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.674+0000 7f6679a16800 20 Filter name: none 2024-02-15T22:56:25.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.674+0000 7f649bfff640 20 reqs_thread_entry: start 2024-02-15T22:56:25.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.674+0000 7f6679a16800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.674+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1157790 con 0x563cc1112cd0 2024-02-15T22:56:25.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.676+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.676+0000 7f6679a16800 20 rados_obj.operate() r=0 bl.length=515 2024-02-15T22:56:25.687 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:25.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.677+0000 7f652b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.677+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94818937219200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1125640 con 0x563cc1112cd0 2024-02-15T22:56:25.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.677+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94818937219200] v30'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.677+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94818937194704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1122880 con 0x7f666c098020 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.678+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94818937194704] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f667003a040 con 0x7f666c098020 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.678+0000 7f6679a16800 20 remove_watcher() i=0 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.678+0000 7f6679a16800 2 removed watcher, disabling cache 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.678+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94818937199184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1122880 con 0x563cc1112cd0 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.679+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94818937199184] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.679+0000 7f6679a16800 20 remove_watcher() i=1 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.679+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94818937202928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111da50 con 0x563cc1118c00 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.680+0000 7f6674960640 1 -- 172.21.15.133:0/2546359678 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94818937202928] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f666c095070 con 0x563cc1118c00 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.680+0000 7f6679a16800 20 remove_watcher() i=2 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.680+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94818937206496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1122880 con 0x7f666c098020 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.681+0000 7f6675962640 1 -- 172.21.15.133:0/2546359678 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94818937206496] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f667003a040 con 0x7f666c098020 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.681+0000 7f6679a16800 20 remove_watcher() i=3 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.681+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94818937210080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111e8f0 con 0x563cc1112cd0 2024-02-15T22:56:25.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.682+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94818937210080] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x563cc1112cd0 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.682+0000 7f6679a16800 20 remove_watcher() i=4 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.682+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94818937214080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc111f6e0 con 0x7f66700141d0 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.683+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94818937214080] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.683+0000 7f6679a16800 20 remove_watcher() i=5 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.683+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94818937212304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc1122880 con 0x7f66700141d0 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.684+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94818937212304] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.684+0000 7f6679a16800 20 remove_watcher() i=6 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.684+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94818937216640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563cc11204e0 con 0x7f66700141d0 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94818937216640] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6668052040 con 0x7f66700141d0 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 20 remove_watcher() i=7 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f66700141d0 msgr2=0x7f6670015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f66700141d0 0x7f6670015940 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563cc1112cd0 msgr2=0x563cc1115170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563cc1112cd0 0x563cc1115170 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f666c098020 msgr2=0x7f666c0729b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f666c098020 0x7f666c0729b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563cc1118c00 msgr2=0x563cc111aff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563cc1118c00 0x563cc111aff0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f65400367e0 msgr2=0x7f6540038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f65400367e0 0x7f6540038ca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f667000b010 tx=0x7f6670020000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 msgr2=0x563cc1107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6675161640 1 -- 172.21.15.133:0/2546359678 reap_dead start 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1107440 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f666c08f2e0 tx=0x7f666c08d8a0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 shutdown_connections 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 --2- 172.21.15.133:0/2546359678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc1100430 0x563cc1107440 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 >> 172.21.15.133:0/2546359678 conn(0x563cc10fc700 msgr2=0x563cc10f9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 shutdown_connections 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.685+0000 7f6679a16800 1 -- 172.21.15.133:0/2546359678 wait complete. 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/1273607525 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f654c0367e0 msgr2=0x7f654c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 --2- 172.21.15.133:0/1273607525 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f654c0367e0 0x7f654c038ca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x563cc10dd6f0 tx=0x7f6670005840 comp rx=0 tx=0).stop 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/1273607525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc10d9c70 msgr2=0x563cc10d80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 --2- 172.21.15.133:0/1273607525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc10d9c70 0x563cc10d80e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f666c044940 tx=0x7f666c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/1273607525 shutdown_connections 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 --2- 172.21.15.133:0/1273607525 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f654c0367e0 0x7f654c038ca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 --2- 172.21.15.133:0/1273607525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc10d9c70 0x563cc10d80e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/1273607525 >> 172.21.15.133:0/1273607525 conn(0x563cc10e5080 msgr2=0x563cc10e5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/1273607525 shutdown_connections 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/1273607525 wait complete. 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563cc0fe5300 msgr2=0x563cc10e0210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563cc0fe5300 0x563cc10e0210 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f655c0367e0 msgr2=0x7f655c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f655c0367e0 0x7f655c038ca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f666c054000 tx=0x7f666c04e000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 msgr2=0x563cc10dc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10dc0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x563cc10d1b00 tx=0x7f6668000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 shutdown_connections 2024-02-15T22:56:25.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563cc0fe5300 0x563cc10e0210 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f655c0367e0 0x7f655c038ca0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 --2- 172.21.15.133:0/3651826131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cc0fe0e70 0x563cc10dc0c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 >> 172.21.15.133:0/3651826131 conn(0x563cc0fdc4d0 msgr2=0x563cc10caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 shutdown_connections 2024-02-15T22:56:25.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.686+0000 7f6679a16800 1 -- 172.21.15.133:0/3651826131 wait complete. 2024-02-15T22:56:25.698 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:25.698 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T22:56:25.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T22:56:25.698 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T22:56:25.781 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:25.781 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.779+0000 7f445472d800 1 Processor -- start 2024-02-15T22:56:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.779+0000 7f445472d800 1 -- start start 2024-02-15T22:56:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.779+0000 7f445472d800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e7c2aa53f0 0x55e7c2aadef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.779+0000 7f445472d800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e7c29efbb0 con 0x55e7c2aa38b0 2024-02-15T22:56:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.779+0000 7f445472d800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e7c29a7450 con 0x55e7c2aa53f0 2024-02-15T22:56:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.780+0000 7f4447fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e7c2aa53f0 0x55e7c2aadef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.780+0000 7f4450467640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55e7c2aa38b0 0x55e7c2aa3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44916/0 (socket says 172.21.15.133:44916) 2024-02-15T22:56:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.780+0000 7f4450467640 1 -- 172.21.15.133:0/149350337 learned_addr learned my addr 172.21.15.133:0/149350337 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:25.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.780+0000 7f4447fff640 1 -- 172.21.15.133:0/149350337 >> v1:172.21.15.52:6789/0 conn(0x55e7c2aa38b0 legacy=0x55e7c2aa3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.780+0000 7f444fc66640 1 -- 172.21.15.133:0/149350337 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084827844 0 0) 0x55e7c29efbb0 con 0x55e7c2aa38b0 2024-02-15T22:56:25.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.780+0000 7f4447fff640 1 -- 172.21.15.133:0/149350337 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7c2a18160 con 0x55e7c2aa53f0 2024-02-15T22:56:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.782+0000 7f4447fff640 1 --2- 172.21.15.133:0/149350337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa53f0 0x55e7c2aadef0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f443800a470 tx=0x7f443801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ed97cecb5ee21c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.782+0000 7f444fc66640 1 -- 172.21.15.133:0/149350337 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f443804ad40 con 0x55e7c2aa53f0 2024-02-15T22:56:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.782+0000 7f444fc66640 1 -- 172.21.15.133:0/149350337 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4438052440 con 0x55e7c2aa53f0 2024-02-15T22:56:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.782+0000 7f444fc66640 1 -- 172.21.15.133:0/149350337 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f443804aea0 con 0x55e7c2aa53f0 2024-02-15T22:56:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.782+0000 7f445472d800 1 -- 172.21.15.133:0/149350337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa53f0 msgr2=0x55e7c2aadef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.782+0000 7f445472d800 1 --2- 172.21.15.133:0/149350337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa53f0 0x55e7c2aadef0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f443800a470 tx=0x7f443801cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.782+0000 7f445472d800 1 -- 172.21.15.133:0/149350337 shutdown_connections 2024-02-15T22:56:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.782+0000 7f445472d800 1 --2- 172.21.15.133:0/149350337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa53f0 0x55e7c2aadef0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.782+0000 7f445472d800 1 -- 172.21.15.133:0/149350337 >> 172.21.15.133:0/149350337 conn(0x55e7c2a9f4d0 msgr2=0x55e7c2aa18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.782+0000 7f445472d800 1 -- 172.21.15.133:0/149350337 shutdown_connections 2024-02-15T22:56:25.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.782+0000 7f445472d800 1 -- 172.21.15.133:0/149350337 wait complete. 2024-02-15T22:56:25.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.794+0000 7f445472d800 1 Processor -- start 2024-02-15T22:56:25.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.794+0000 7f445472d800 1 -- start start 2024-02-15T22:56:25.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.794+0000 7f445472d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b97150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.794+0000 7f445472d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7c29a4980 con 0x55e7c2aa38b0 2024-02-15T22:56:25.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.794+0000 7f4450467640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b97150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.794+0000 7f4450467640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b97150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57684/0 (socket says 172.21.15.133:57684) 2024-02-15T22:56:25.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.794+0000 7f4450467640 1 -- 172.21.15.133:0/3999189271 learned_addr learned my addr 172.21.15.133:0/3999189271 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.795+0000 7f4450467640 1 -- 172.21.15.133:0/3999189271 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4438005d20 con 0x55e7c2aa38b0 2024-02-15T22:56:25.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.795+0000 7f4450467640 1 --2- 172.21.15.133:0/3999189271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b97150 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f444000b210 tx=0x7f444000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed44788a9fb4e12 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.795+0000 7f433e60c640 1 -- 172.21.15.133:0/3999189271 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4440014070 con 0x55e7c2aa38b0 2024-02-15T22:56:25.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.795+0000 7f433e60c640 1 -- 172.21.15.133:0/3999189271 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444000d500 con 0x55e7c2aa38b0 2024-02-15T22:56:25.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.795+0000 7f433e60c640 1 -- 172.21.15.133:0/3999189271 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f444000d800 con 0x55e7c2aa38b0 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.796+0000 7f445472d800 1 -- 172.21.15.133:0/3999189271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 msgr2=0x55e7c2b97150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.796+0000 7f445472d800 1 --2- 172.21.15.133:0/3999189271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b97150 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f444000b210 tx=0x7f444000b6d0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.796+0000 7f445472d800 1 -- 172.21.15.133:0/3999189271 shutdown_connections 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.796+0000 7f445472d800 1 --2- 172.21.15.133:0/3999189271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b97150 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.796+0000 7f445472d800 1 -- 172.21.15.133:0/3999189271 >> 172.21.15.133:0/3999189271 conn(0x55e7c2a9f4d0 msgr2=0x55e7c2b92a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.796+0000 7f445472d800 1 -- 172.21.15.133:0/3999189271 shutdown_connections 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.796+0000 7f445472d800 1 -- 172.21.15.133:0/3999189271 wait complete. 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.796+0000 7f445472d800 1 Processor -- start 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.796+0000 7f445472d800 1 -- start start 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.796+0000 7f445472d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b9e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.796+0000 7f445472d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7c29a0160 con 0x55e7c2aa38b0 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.797+0000 7f4450467640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b9e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.797+0000 7f4450467640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b9e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57692/0 (socket says 172.21.15.133:57692) 2024-02-15T22:56:25.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.797+0000 7f4450467640 1 -- 172.21.15.133:0/1262790136 learned_addr learned my addr 172.21.15.133:0/1262790136 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.797+0000 7f4450467640 1 -- 172.21.15.133:0/1262790136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4440001b70 con 0x55e7c2aa38b0 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.797+0000 7f4450467640 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b9e810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f444000b210 tx=0x7f4440000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.797+0000 7f433ce09640 1 -- 172.21.15.133:0/1262790136 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f444000f950 con 0x55e7c2aa38b0 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.797+0000 7f433ce09640 1 -- 172.21.15.133:0/1262790136 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4440020070 con 0x55e7c2aa38b0 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.797+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e7c2b9ed50 con 0x55e7c2aa38b0 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.797+0000 7f433ce09640 1 -- 172.21.15.133:0/1262790136 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f444000fc20 con 0x55e7c2aa38b0 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.797+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7c2b9f230 con 0x55e7c2aa38b0 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.798+0000 7f433ce09640 1 -- 172.21.15.133:0/1262790136 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f444000d040 con 0x55e7c2aa38b0 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.798+0000 7f433ce09640 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43380367e0 0x7f4338038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.798+0000 7f433ce09640 1 -- 172.21.15.133:0/1262790136 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f444000a040 con 0x55e7c2aa38b0 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.798+0000 7f4447fff640 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43380367e0 0x7f4338038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.798+0000 7f445472d800 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e7c2aa53f0 0x55e7c2ba5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.798+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2ba5ac0 con 0x55e7c2aa53f0 2024-02-15T22:56:25.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.798+0000 7f4450c68640 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e7c2aa53f0 0x55e7c2ba5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.799+0000 7f4447fff640 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43380367e0 0x7f4338038ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4438054000 tx=0x7f443804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.799+0000 7f4450c68640 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e7c2aa53f0 0x55e7c2ba5510 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.799+0000 7f4450c68640 1 -- 172.21.15.133:0/1262790136 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f444800a4a0 con 0x55e7c2aa53f0 2024-02-15T22:56:25.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.799+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2ba2c20 con 0x55e7c2aa53f0 2024-02-15T22:56:25.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.799+0000 7f4450c68640 1 -- 172.21.15.133:0/1262790136 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f444800a4a0 con 0x55e7c2aa53f0 2024-02-15T22:56:25.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.799+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2ba5f90 con 0x55e7c2aa53f0 2024-02-15T22:56:25.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.800+0000 7f4450c68640 1 -- 172.21.15.133:0/1262790136 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f444800a4a0 con 0x55e7c2aa53f0 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.800+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2ba6c80 con 0x55e7c2aa53f0 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.800+0000 7f4450c68640 1 -- 172.21.15.133:0/1262790136 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f444800a4a0 con 0x55e7c2aa53f0 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.800+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2ba7090 con 0x55e7c2aa53f0 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.800+0000 7f4450c68640 1 -- 172.21.15.133:0/1262790136 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f444800a4a0 con 0x55e7c2aa53f0 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.801+0000 7f445472d800 1 Processor -- start 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.801+0000 7f445472d800 1 -- start start 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.801+0000 7f445472d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bb6270 0x55e7c2bb6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.801+0000 7f445472d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7c2942e80 con 0x55e7c2bb6270 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.801+0000 7f4447fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bb6270 0x55e7c2bb6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.801+0000 7f4447fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bb6270 0x55e7c2bb6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57698/0 (socket says 172.21.15.133:57698) 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.801+0000 7f4447fff640 1 -- 172.21.15.133:0/2144295321 learned_addr learned my addr 172.21.15.133:0/2144295321 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.801+0000 7f4447fff640 1 -- 172.21.15.133:0/2144295321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7c2bb6bd0 con 0x55e7c2bb6270 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.801+0000 7f4447fff640 1 --2- 172.21.15.133:0/2144295321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bb6270 0x55e7c2bb6690 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f443804bfd0 tx=0x7f4438002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.802+0000 7f4335ffb640 1 -- 172.21.15.133:0/2144295321 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4438067770 con 0x55e7c2bb6270 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.802+0000 7f4335ffb640 1 -- 172.21.15.133:0/2144295321 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44380678d0 con 0x55e7c2bb6270 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.802+0000 7f4335ffb640 1 -- 172.21.15.133:0/2144295321 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4438067b70 con 0x55e7c2bb6270 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.802+0000 7f445472d800 1 -- 172.21.15.133:0/2144295321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e7c2bb6dc0 con 0x55e7c2bb6270 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.802+0000 7f445472d800 1 -- 172.21.15.133:0/2144295321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7c2bb7910 con 0x55e7c2bb6270 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.802+0000 7f4335ffb640 1 -- 172.21.15.133:0/2144295321 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4438065040 con 0x55e7c2bb6270 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.802+0000 7f4335ffb640 1 --2- 172.21.15.133:0/2144295321 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43280367e0 0x7f4328038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.803+0000 7f4335ffb640 1 -- 172.21.15.133:0/2144295321 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4438062040 con 0x55e7c2bb6270 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.803+0000 7f4450c68640 1 --2- 172.21.15.133:0/2144295321 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43280367e0 0x7f4328038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.803+0000 7f445472d800 1 Processor -- start 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.803+0000 7f445472d800 1 -- start start 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.803+0000 7f4450c68640 1 --2- 172.21.15.133:0/2144295321 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43280367e0 0x7f4328038ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55e7c2ba2b40 tx=0x7f4448005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.803+0000 7f445472d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 0x55e7c2bc3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.803+0000 7f445472d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7c29185d0 con 0x55e7c2bc3410 2024-02-15T22:56:25.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.803+0000 7f4447fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 0x55e7c2bc3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.803+0000 7f4447fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 0x55e7c2bc3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57714/0 (socket says 172.21.15.133:57714) 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.803+0000 7f4447fff640 1 -- 172.21.15.133:0/1365026404 learned_addr learned my addr 172.21.15.133:0/1365026404 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.803+0000 7f4447fff640 1 -- 172.21.15.133:0/1365026404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7c2bc3e00 con 0x55e7c2bc3410 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f4447fff640 1 --2- 172.21.15.133:0/1365026404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 0x55e7c2bc3830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f443806fd10 tx=0x7f443805bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2fee9536f446f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f43277fe640 1 -- 172.21.15.133:0/1365026404 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f443808c070 con 0x55e7c2bc3410 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f43277fe640 1 -- 172.21.15.133:0/1365026404 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443806f3a0 con 0x55e7c2bc3410 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f43277fe640 1 -- 172.21.15.133:0/1365026404 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4438066c90 con 0x55e7c2bc3410 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f445472d800 1 -- 172.21.15.133:0/1365026404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 msgr2=0x55e7c2bc3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f445472d800 1 --2- 172.21.15.133:0/1365026404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 0x55e7c2bc3830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f443806fd10 tx=0x7f443805bee0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f445472d800 1 -- 172.21.15.133:0/1365026404 shutdown_connections 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f445472d800 1 --2- 172.21.15.133:0/1365026404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 0x55e7c2bc3830 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f445472d800 1 -- 172.21.15.133:0/1365026404 >> 172.21.15.133:0/1365026404 conn(0x55e7c2bbf730 msgr2=0x55e7c2bbd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f445472d800 1 -- 172.21.15.133:0/1365026404 shutdown_connections 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f445472d800 1 -- 172.21.15.133:0/1365026404 wait complete. 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.804+0000 7f445472d800 1 Processor -- start 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f445472d800 1 -- start start 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f445472d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 0x55e7c2bca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f445472d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7c2bcaa20 con 0x55e7c2bc3410 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f4447fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 0x55e7c2bca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f4447fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 0x55e7c2bca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57726/0 (socket says 172.21.15.133:57726) 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 learned_addr learned my addr 172.21.15.133:0/473891841 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7c2bb7910 con 0x55e7c2bc3410 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f4447fff640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 0x55e7c2bca4e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f443805cfd0 tx=0x7f443808ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f4325ffb640 1 -- 172.21.15.133:0/473891841 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f443806f510 con 0x55e7c2bc3410 2024-02-15T22:56:25.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f4325ffb640 1 -- 172.21.15.133:0/473891841 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443808f960 con 0x55e7c2bc3410 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e7c2bcac20 con 0x55e7c2bc3410 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f4325ffb640 1 -- 172.21.15.133:0/473891841 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f443808fc20 con 0x55e7c2bc3410 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.805+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7c2bcb080 con 0x55e7c2bc3410 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.806+0000 7f4325ffb640 1 -- 172.21.15.133:0/473891841 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f443808f070 con 0x55e7c2bc3410 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.806+0000 7f4325ffb640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43180367e0 0x7f4318038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.806+0000 7f4325ffb640 1 -- 172.21.15.133:0/473891841 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f443809e830 con 0x55e7c2bc3410 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.806+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.806+0000 7f4450c68640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43180367e0 0x7f4318038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.806+0000 7f445472d800 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e7c2bd5eb0 0x55e7c2bd8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bd8ac0 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f4450467640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e7c2bd5eb0 0x55e7c2bd8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f4450c68640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43180367e0 0x7f4318038ca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f444800b010 tx=0x7f4448020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f4450467640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e7c2bd5eb0 0x55e7c2bd8370 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4440016070 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f445472d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f445472d800 20 realm 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bd8e90 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4440016070 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f445472d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f445472d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.807+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bd96e0 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4440016070 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f445472d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bd9a40 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4440016070 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f445472d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bd9380 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4440016070 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f445472d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f445472d800 20 searching for the correct realm 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f445472d800 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55e7c2bdbe00 0x55e7c2bde1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bdbe00 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.808+0000 7f4447fff640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55e7c2bdbe00 0x55e7c2bde1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.809+0000 7f4447fff640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55e7c2bdbe00 0x55e7c2bde1f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.809+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.809+0000 7f4447fff640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f443808f410 0x7f4438009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.809+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f443808f410 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.809+0000 7f4450c68640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f443808f410 0x7f4438009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.809+0000 7f4450c68640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f443808f410 0x7f4438009410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.810+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x7f443808f410 2024-02-15T22:56:25.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.810+0000 7f4450c68640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f44480141d0 0x7f4448015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.810+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f44480141d0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.810+0000 7f4450467640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f44480141d0 0x7f4448015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.810+0000 7f4450467640 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f44480141d0 0x7f4448015940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.810+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440016070 con 0x7f44480141d0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.810+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.811+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440016070 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.811+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.811+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440016070 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.811+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f44480141d0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.811+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440016070 con 0x7f44480141d0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.811+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f44480141d0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.811+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440016070 con 0x7f44480141d0 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.811+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f443808f410 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.811+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f444800a4a0 con 0x7f443808f410 2024-02-15T22:56:25.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.811+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bdbe00 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.812+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.812+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.812+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440016070 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.812+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f44480141d0 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.812+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440016070 con 0x7f44480141d0 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.812+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.812+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440016070 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.812+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f443808f410 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.813+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f444803a040 con 0x7f443808f410 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.813+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bdbe00 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.813+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.813+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bdbe00 2024-02-15T22:56:25.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.813+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.813+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f44480141d0 2024-02-15T22:56:25.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.814+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440016070 con 0x7f44480141d0 2024-02-15T22:56:25.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.814+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bdbe00 2024-02-15T22:56:25.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.814+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.814+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bdbe00 2024-02-15T22:56:25.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.814+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.814+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.814+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440016070 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.814+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.815+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4440016070 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.815+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f44480141d0 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.815+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.815+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bdbe00 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.815+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.815+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f443808f410 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.815+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f444803a040 con 0x7f443808f410 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.815+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.816+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.816+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f44480141d0 2024-02-15T22:56:25.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.816+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.816+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bdbe00 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.816+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.816+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f44480141d0 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.816+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.816+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f443808f410 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.817+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f444803a040 con 0x7f443808f410 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.817+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bdbe00 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.817+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.817+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f44480141d0 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.817+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.817+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bde870 con 0x7f443808f410 2024-02-15T22:56:25.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f444803a040 con 0x7f443808f410 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bda910 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bda590 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.818+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bdb1e0 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 20 zone default found 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 4 Realm: () 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 20 zonegroup default 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bdb1e0 con 0x7f44480141d0 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be0690 con 0x55e7c2bdbe00 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be0a10 con 0x55e7c2bdbe00 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 20 started sync module instance, tier type = 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.819+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bdff70 con 0x7f443808f410 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.820+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f444803a040 con 0x7f443808f410 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.820+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94453893036752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be0320 con 0x7f443808f410 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.820+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be1770 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.821+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94453893036752] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f444803a040 con 0x7f443808f410 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.822+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.822+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94453893041984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be1980 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.822+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be2450 con 0x55e7c2bdbe00 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.823+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94453893041984] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.823+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.823+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94453893046064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be2800 con 0x55e7c2bdbe00 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.823+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be31f0 con 0x7f443808f410 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.824+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f444803a040 con 0x7f443808f410 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.824+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94453893049552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be3a40 con 0x7f443808f410 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.824+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be4510 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.824+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94453893046064] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.825+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94453893049552] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f444803a040 con 0x7f443808f410 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.825+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.825+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94453893054448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be35a0 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.825+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be4d60 con 0x7f44480141d0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.826+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.826+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94453893054448] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.826+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94453893056480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be50a0 con 0x7f44480141d0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.826+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be5400 con 0x7f44480141d0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.827+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94453893056480] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.827+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.827+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94453893057536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be54c0 con 0x7f44480141d0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.827+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be5e30 con 0x7f44480141d0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.828+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94453893057536] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.828+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.828+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94453893058864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be5e30 con 0x7f44480141d0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.828+0000 7f445472d800 20 add_watcher() i=0 2024-02-15T22:56:25.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.828+0000 7f445472d800 20 add_watcher() i=1 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.828+0000 7f445472d800 20 add_watcher() i=2 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.828+0000 7f445472d800 20 add_watcher() i=3 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.828+0000 7f445472d800 20 add_watcher() i=4 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.828+0000 7f445472d800 20 add_watcher() i=5 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.828+0000 7f445472d800 20 add_watcher() i=6 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.829+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94453893058864] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.829+0000 7f445472d800 20 add_watcher() i=7 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.829+0000 7f445472d800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.829+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be5e20 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.829+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.829+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94453893063104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be6b20 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.830+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94453893063104] v30'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.830+0000 7f43067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.830+0000 7f445472d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.830+0000 7f445472d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:25.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.830+0000 7f445472d800 5 note: GC not initialized 2024-02-15T22:56:25.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.831+0000 7f43057e2640 20 reqs_thread_entry: start 2024-02-15T22:56:25.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.831+0000 7f445472d800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:25.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.831+0000 7f445472d800 20 Filter name: none 2024-02-15T22:56:25.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.831+0000 7f4276ffd640 20 reqs_thread_entry: start 2024-02-15T22:56:25.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.831+0000 7f445472d800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.831+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2c1b150 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.831+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.831+0000 7f445472d800 20 rados_obj.operate() r=0 bl.length=515 2024-02-15T22:56:25.844 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:25.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.832+0000 7f43067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:25.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.832+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94453893063104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bcfd60 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.833+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94453893063104] v30'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.833+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94453893036752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bcf8c0 con 0x7f443808f410 2024-02-15T22:56:25.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.834+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94453893036752] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f444803a040 con 0x7f443808f410 2024-02-15T22:56:25.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.834+0000 7f445472d800 20 remove_watcher() i=0 2024-02-15T22:56:25.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.834+0000 7f445472d800 2 removed watcher, disabling cache 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.834+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94453893041984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bdfad0 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.835+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94453893041984] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.835+0000 7f445472d800 20 remove_watcher() i=1 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.835+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94453893046064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2bdfad0 con 0x55e7c2bdbe00 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.836+0000 7f4447fff640 1 -- 172.21.15.133:0/473891841 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94453893046064] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4438095020 con 0x55e7c2bdbe00 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.836+0000 7f445472d800 20 remove_watcher() i=2 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.836+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94453893049552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be0f40 con 0x7f443808f410 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.837+0000 7f4450c68640 1 -- 172.21.15.133:0/473891841 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94453893049552] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f444803a040 con 0x7f443808f410 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.837+0000 7f445472d800 20 remove_watcher() i=3 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.837+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94453893054448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be0f40 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.838+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94453893054448] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x55e7c2bd5eb0 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.838+0000 7f445472d800 20 remove_watcher() i=4 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.838+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94453893056480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be0f40 con 0x7f44480141d0 2024-02-15T22:56:25.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.839+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94453893056480] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.839+0000 7f445472d800 20 remove_watcher() i=5 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.839+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94453893057536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be0f40 con 0x7f44480141d0 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.840+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94453893057536] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.840+0000 7f445472d800 20 remove_watcher() i=6 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.840+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94453893058864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e7c2be0f40 con 0x7f44480141d0 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94453893058864] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4440052040 con 0x7f44480141d0 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 20 remove_watcher() i=7 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f44480141d0 msgr2=0x7f4448015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f44480141d0 0x7f4448015940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e7c2bd5eb0 msgr2=0x55e7c2bd8370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e7c2bd5eb0 0x55e7c2bd8370 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f443808f410 msgr2=0x7f4438009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f443808f410 0x7f4438009410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55e7c2bdbe00 msgr2=0x55e7c2bde1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55e7c2bdbe00 0x55e7c2bde1f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43180367e0 msgr2=0x7f4318038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43180367e0 0x7f4318038ca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f444800b010 tx=0x7f4448020000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 msgr2=0x55e7c2bca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 --2- 172.21.15.133:0/473891841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bc3410 0x55e7c2bca4e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f443805cfd0 tx=0x7f443808ddc0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f4450467640 1 -- 172.21.15.133:0/473891841 reap_dead start 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 shutdown_connections 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 >> 172.21.15.133:0/473891841 conn(0x55e7c2bbf730 msgr2=0x55e7c2bbcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 shutdown_connections 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/473891841 wait complete. 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/2144295321 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43280367e0 msgr2=0x7f4328038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 --2- 172.21.15.133:0/2144295321 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43280367e0 0x7f4328038ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55e7c2ba2b40 tx=0x7f4448005840 comp rx=0 tx=0).stop 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/2144295321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bb6270 msgr2=0x55e7c2bb6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 --2- 172.21.15.133:0/2144295321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bb6270 0x55e7c2bb6690 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f443804bfd0 tx=0x7f4438002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/2144295321 shutdown_connections 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 --2- 172.21.15.133:0/2144295321 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43280367e0 0x7f4328038ca0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 --2- 172.21.15.133:0/2144295321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2bb6270 0x55e7c2bb6690 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/2144295321 >> 172.21.15.133:0/2144295321 conn(0x55e7c2baa310 msgr2=0x55e7c2baa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/2144295321 shutdown_connections 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.841+0000 7f445472d800 1 -- 172.21.15.133:0/2144295321 wait complete. 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e7c2aa53f0 msgr2=0x55e7c2ba5510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e7c2aa53f0 0x55e7c2ba5510 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43380367e0 msgr2=0x7f4338038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43380367e0 0x7f4338038ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4438054000 tx=0x7f443804e000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 msgr2=0x55e7c2b9e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b9e810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f444000b210 tx=0x7f4440000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 shutdown_connections 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55e7c2aa53f0 0x55e7c2ba5510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f43380367e0 0x7f4338038ca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 --2- 172.21.15.133:0/1262790136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7c2aa38b0 0x55e7c2b9e810 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 >> 172.21.15.133:0/1262790136 conn(0x55e7c2a9f4d0 msgr2=0x55e7c2b91350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 shutdown_connections 2024-02-15T22:56:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.842+0000 7f445472d800 1 -- 172.21.15.133:0/1262790136 wait complete. 2024-02-15T22:56:25.855 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:25.855 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-15T22:56:25.855 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-15T22:56:25.855 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-02-15T22:56:25.944 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:25.944 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:25.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.942+0000 7fcc75931800 1 Processor -- start 2024-02-15T22:56:25.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.942+0000 7fcc75931800 1 -- start start 2024-02-15T22:56:25.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.942+0000 7fcc75931800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561984825260 0x561984823720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.942+0000 7fcc75931800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5619847fac50 con 0x561984823c60 2024-02-15T22:56:25.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.942+0000 7fcc75931800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5619847b2450 con 0x561984825260 2024-02-15T22:56:25.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.942+0000 7fcc716f2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561984825260 0x561984823720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.942+0000 7fcc70ef1640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x561984823c60 0x5619848b7ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44930/0 (socket says 172.21.15.133:44930) 2024-02-15T22:56:25.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.942+0000 7fcc70ef1640 1 -- 172.21.15.133:0/4240994175 learned_addr learned my addr 172.21.15.133:0/4240994175 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:25.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.942+0000 7fcc716f2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561984825260 0x561984823720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57734/0 (socket says 172.21.15.133:57734) 2024-02-15T22:56:25.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.943+0000 7fcc716f2640 1 -- 172.21.15.133:0/4240994175 >> v1:172.21.15.52:6789/0 conn(0x561984823c60 legacy=0x5619848b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.943+0000 7fcc716f2640 1 -- 172.21.15.133:0/4240994175 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561984824200 con 0x561984825260 2024-02-15T22:56:25.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.944+0000 7fcc716f2640 1 --2- 172.21.15.133:0/4240994175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984825260 0x561984823720 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400a470 tx=0x7fcc6401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31eb2593c26c36b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.945+0000 7fcc63fff640 1 -- 172.21.15.133:0/4240994175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc64052570 con 0x561984825260 2024-02-15T22:56:25.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.945+0000 7fcc63fff640 1 -- 172.21.15.133:0/4240994175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc640526d0 con 0x561984825260 2024-02-15T22:56:25.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.945+0000 7fcc63fff640 1 -- 172.21.15.133:0/4240994175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc64052990 con 0x561984825260 2024-02-15T22:56:25.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.945+0000 7fcc75931800 1 -- 172.21.15.133:0/4240994175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984825260 msgr2=0x561984823720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.945+0000 7fcc75931800 1 --2- 172.21.15.133:0/4240994175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984825260 0x561984823720 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400a470 tx=0x7fcc6401cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:25.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.945+0000 7fcc75931800 1 -- 172.21.15.133:0/4240994175 shutdown_connections 2024-02-15T22:56:25.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.945+0000 7fcc75931800 1 --2- 172.21.15.133:0/4240994175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984825260 0x561984823720 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.945+0000 7fcc75931800 1 -- 172.21.15.133:0/4240994175 >> 172.21.15.133:0/4240994175 conn(0x5619848ab5e0 msgr2=0x5619848ada00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.945+0000 7fcc75931800 1 -- 172.21.15.133:0/4240994175 shutdown_connections 2024-02-15T22:56:25.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.945+0000 7fcc75931800 1 -- 172.21.15.133:0/4240994175 wait complete. 2024-02-15T22:56:25.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.957+0000 7fcc75931800 1 Processor -- start 2024-02-15T22:56:25.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.957+0000 7fcc75931800 1 -- start start 2024-02-15T22:56:25.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.957+0000 7fcc75931800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.957+0000 7fcc75931800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619847af980 con 0x561984823c60 2024-02-15T22:56:25.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.957+0000 7fcc716f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.957+0000 7fcc716f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57748/0 (socket says 172.21.15.133:57748) 2024-02-15T22:56:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.957+0000 7fcc716f2640 1 -- 172.21.15.133:0/3734252607 learned_addr learned my addr 172.21.15.133:0/3734252607 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.957+0000 7fcc716f2640 1 -- 172.21.15.133:0/3734252607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc64005d20 con 0x561984823c60 2024-02-15T22:56:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.958+0000 7fcc716f2640 1 --2- 172.21.15.133:0/3734252607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a2570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcc64000c00 tx=0x7fcc6404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4650d82131f8ab43 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.958+0000 7fcb5f606640 1 -- 172.21.15.133:0/3734252607 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc6400a180 con 0x561984823c60 2024-02-15T22:56:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.958+0000 7fcb5f606640 1 -- 172.21.15.133:0/3734252607 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6400a2e0 con 0x561984823c60 2024-02-15T22:56:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.958+0000 7fcb5f606640 1 -- 172.21.15.133:0/3734252607 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc64052990 con 0x561984823c60 2024-02-15T22:56:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.958+0000 7fcc75931800 1 -- 172.21.15.133:0/3734252607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 msgr2=0x5619849a2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.958+0000 7fcc75931800 1 --2- 172.21.15.133:0/3734252607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a2570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcc64000c00 tx=0x7fcc6404c000 comp rx=0 tx=0).stop 2024-02-15T22:56:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc75931800 1 -- 172.21.15.133:0/3734252607 shutdown_connections 2024-02-15T22:56:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc75931800 1 --2- 172.21.15.133:0/3734252607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a2570 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc75931800 1 -- 172.21.15.133:0/3734252607 >> 172.21.15.133:0/3734252607 conn(0x5619848ab5e0 msgr2=0x56198499de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc75931800 1 -- 172.21.15.133:0/3734252607 shutdown_connections 2024-02-15T22:56:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc75931800 1 -- 172.21.15.133:0/3734252607 wait complete. 2024-02-15T22:56:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc75931800 1 Processor -- start 2024-02-15T22:56:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc75931800 1 -- start start 2024-02-15T22:56:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc75931800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc75931800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619847ab160 con 0x561984823c60 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc716f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc716f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57756/0 (socket says 172.21.15.133:57756) 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc716f2640 1 -- 172.21.15.133:0/2678892443 learned_addr learned my addr 172.21.15.133:0/2678892443 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.959+0000 7fcc716f2640 1 -- 172.21.15.133:0/2678892443 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561984824200 con 0x561984823c60 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.960+0000 7fcc716f2640 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a9b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400a470 tx=0x7fcc64002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.960+0000 7fcb5de03640 1 -- 172.21.15.133:0/2678892443 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc6406a070 con 0x561984823c60 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.960+0000 7fcb5de03640 1 -- 172.21.15.133:0/2678892443 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc64052da0 con 0x561984823c60 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.960+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619849aa090 con 0x561984823c60 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.960+0000 7fcb5de03640 1 -- 172.21.15.133:0/2678892443 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc6405d590 con 0x561984823c60 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.960+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619849aa570 con 0x561984823c60 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.961+0000 7fcb5de03640 1 -- 172.21.15.133:0/2678892443 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcc6405d6f0 con 0x561984823c60 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.961+0000 7fcb5de03640 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb580367e0 0x7fcb58038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.961+0000 7fcb5de03640 1 -- 172.21.15.133:0/2678892443 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fcc6408d740 con 0x561984823c60 2024-02-15T22:56:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.961+0000 7fcc70ef1640 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb580367e0 0x7fcb58038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.961+0000 7fcc75931800 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561984825260 0x5619849b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.961+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849b0e30 con 0x561984825260 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.961+0000 7fcc71ef3640 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561984825260 0x5619849b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.961+0000 7fcc70ef1640 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb580367e0 0x7fcb58038ca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc68000f60 tx=0x7fcc680012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.961+0000 7fcc71ef3640 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561984825260 0x5619849b0810 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.962+0000 7fcc71ef3640 1 -- 172.21.15.133:0/2678892443 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcc6c00a4a0 con 0x561984825260 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.962+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849adf40 con 0x561984825260 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.962+0000 7fcc71ef3640 1 -- 172.21.15.133:0/2678892443 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcc6c00a4a0 con 0x561984825260 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.962+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849b2b60 con 0x561984825260 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.962+0000 7fcc71ef3640 1 -- 172.21.15.133:0/2678892443 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fcc6c00a4a0 con 0x561984825260 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.962+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849b1d60 con 0x561984825260 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.962+0000 7fcc71ef3640 1 -- 172.21.15.133:0/2678892443 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcc6c00a4a0 con 0x561984825260 2024-02-15T22:56:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.962+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849b2170 con 0x561984825260 2024-02-15T22:56:25.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.963+0000 7fcc71ef3640 1 -- 172.21.15.133:0/2678892443 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fcc6c00a4a0 con 0x561984825260 2024-02-15T22:56:25.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.963+0000 7fcc75931800 1 Processor -- start 2024-02-15T22:56:25.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.963+0000 7fcc75931800 1 -- start start 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.963+0000 7fcc75931800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849c15e0 0x5619849c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.963+0000 7fcc75931800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198474de80 con 0x5619849c15e0 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.963+0000 7fcc70ef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849c15e0 0x5619849c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.963+0000 7fcc70ef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849c15e0 0x5619849c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57768/0 (socket says 172.21.15.133:57768) 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.963+0000 7fcc70ef1640 1 -- 172.21.15.133:0/1066082606 learned_addr learned my addr 172.21.15.133:0/1066082606 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.964+0000 7fcc70ef1640 1 -- 172.21.15.133:0/1066082606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619849c1f40 con 0x5619849c15e0 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.964+0000 7fcc70ef1640 1 --2- 172.21.15.133:0/1066082606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849c15e0 0x5619849c1a00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcc68001ed0 tx=0x7fcc6800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.964+0000 7fcb56ffd640 1 -- 172.21.15.133:0/1066082606 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc68020070 con 0x5619849c15e0 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.964+0000 7fcb56ffd640 1 -- 172.21.15.133:0/1066082606 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6801b550 con 0x5619849c15e0 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.964+0000 7fcb56ffd640 1 -- 172.21.15.133:0/1066082606 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc68013040 con 0x5619849c15e0 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.964+0000 7fcc75931800 1 -- 172.21.15.133:0/1066082606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619849c29b0 con 0x5619849c15e0 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.964+0000 7fcc75931800 1 -- 172.21.15.133:0/1066082606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619849c2e70 con 0x5619849c15e0 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.965+0000 7fcb56ffd640 1 -- 172.21.15.133:0/1066082606 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcc6801b8c0 con 0x5619849c15e0 2024-02-15T22:56:25.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.965+0000 7fcb56ffd640 1 --2- 172.21.15.133:0/1066082606 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb48036790 0x7fcb48038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.965+0000 7fcb56ffd640 1 -- 172.21.15.133:0/1066082606 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fcc6804e220 con 0x5619849c15e0 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.965+0000 7fcc71ef3640 1 --2- 172.21.15.133:0/1066082606 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb48036790 0x7fcb48038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.965+0000 7fcc75931800 1 Processor -- start 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.965+0000 7fcc75931800 1 -- start start 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.965+0000 7fcc71ef3640 1 --2- 172.21.15.133:0/1066082606 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb48036790 0x7fcb48038c50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5619849b17a0 tx=0x7fcc6c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.966+0000 7fcc75931800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.966+0000 7fcc75931800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619847235d0 con 0x5619849ce860 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.966+0000 7fcc70ef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.966+0000 7fcc70ef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57776/0 (socket says 172.21.15.133:57776) 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.966+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3659126194 learned_addr learned my addr 172.21.15.133:0/3659126194 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.966+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3659126194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619849cf250 con 0x5619849ce860 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.966+0000 7fcc70ef1640 1 --2- 172.21.15.133:0/3659126194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849cec80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcc6804c7c0 tx=0x7fcc68019bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e7d2158387217d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.966+0000 7fcb54ff9640 1 -- 172.21.15.133:0/3659126194 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc6801bd50 con 0x5619849ce860 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.966+0000 7fcb54ff9640 1 -- 172.21.15.133:0/3659126194 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc68025930 con 0x5619849ce860 2024-02-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.966+0000 7fcb54ff9640 1 -- 172.21.15.133:0/3659126194 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc68025aa0 con 0x5619849ce860 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc75931800 1 -- 172.21.15.133:0/3659126194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 msgr2=0x5619849cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc75931800 1 --2- 172.21.15.133:0/3659126194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849cec80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcc6804c7c0 tx=0x7fcc68019bb0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc75931800 1 -- 172.21.15.133:0/3659126194 shutdown_connections 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc75931800 1 --2- 172.21.15.133:0/3659126194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849cec80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc75931800 1 -- 172.21.15.133:0/3659126194 >> 172.21.15.133:0/3659126194 conn(0x5619849cabc0 msgr2=0x5619849c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc75931800 1 -- 172.21.15.133:0/3659126194 shutdown_connections 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc75931800 1 -- 172.21.15.133:0/3659126194 wait complete. 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc75931800 1 Processor -- start 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc75931800 1 -- start start 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc75931800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849d58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc75931800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619849d5e00 con 0x5619849ce860 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc70ef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849d58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc70ef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849d58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57786/0 (socket says 172.21.15.133:57786) 2024-02-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.967+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 learned_addr learned my addr 172.21.15.133:0/3082875612 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.968+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619849c2e70 con 0x5619849ce860 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.968+0000 7fcc70ef1640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849d58c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcc6804b690 tx=0x7fcc68019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.968+0000 7fcb46ffd640 1 -- 172.21.15.133:0/3082875612 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc68032070 con 0x5619849ce860 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.968+0000 7fcb46ffd640 1 -- 172.21.15.133:0/3082875612 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6804b260 con 0x5619849ce860 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.968+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619849d6000 con 0x5619849ce860 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.968+0000 7fcb46ffd640 1 -- 172.21.15.133:0/3082875612 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc6804b3d0 con 0x5619849ce860 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.968+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619849d6000 con 0x5619849ce860 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.969+0000 7fcb46ffd640 1 -- 172.21.15.133:0/3082875612 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcc6800cc60 con 0x5619849ce860 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.969+0000 7fcb46ffd640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb3c0367e0 0x7fcb3c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.969+0000 7fcb46ffd640 1 -- 172.21.15.133:0/3082875612 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fcc6802fb00 con 0x5619849ce860 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.969+0000 7fcc71ef3640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb3c0367e0 0x7fcb3c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.969+0000 7fcc71ef3640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb3c0367e0 0x7fcb3c038ca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00b010 tx=0x7fcc6c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.969+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.969+0000 7fcc75931800 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5619849e1250 0x5619849e3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.969+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849e3e60 con 0x5619849e1250 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.969+0000 7fcc716f2640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5619849e1250 0x5619849e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc716f2640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5619849e1250 0x5619849e3710 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcc64059040 con 0x5619849e1250 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc75931800 20 realm 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849e4230 con 0x5619849e1250 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcc64059040 con 0x5619849e1250 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc75931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849e4ab0 con 0x5619849e1250 2024-02-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcc64059040 con 0x5619849e1250 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.970+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849e4e10 con 0x5619849e1250 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.971+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcc64059040 con 0x5619849e1250 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.971+0000 7fcc75931800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.971+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.971+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849e5610 con 0x5619849e1250 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.971+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.971+0000 7fcc75931800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.971+0000 7fcc75931800 20 searching for the correct realm 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.971+0000 7fcc75931800 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5619849e7530 0x5619849e99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.971+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e7530 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.971+0000 7fcc70ef1640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5619849e7530 0x5619849e99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.971+0000 7fcc70ef1640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5619849e7530 0x5619849e99d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.972+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6803cdb0 con 0x5619849e7530 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.972+0000 7fcc70ef1640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcc68023be0 0x7fcc6800c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.972+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc68023be0 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.972+0000 7fcc71ef3640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcc68023be0 0x7fcc6800c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.972+0000 7fcc71ef3640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcc68023be0 0x7fcc6800c6a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.972+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6c00a4a0 con 0x7fcc68023be0 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.973+0000 7fcc71ef3640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcc6c0141d0 0x7fcc6c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.973+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc6c0141d0 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.973+0000 7fcc716f2640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcc6c0141d0 0x7fcc6c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.973+0000 7fcc716f2640 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcc6c0141d0 0x7fcc6c015940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.973+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.973+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e1250 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.974+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.974+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e1250 2024-02-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.974+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.974+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc6c0141d0 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.974+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.974+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc6c0141d0 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.974+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.974+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc68023be0 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.974+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6c00a4a0 con 0x7fcc68023be0 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.974+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e7530 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.975+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6803cdb0 con 0x5619849e7530 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.975+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e1250 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.975+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.975+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc6c0141d0 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.975+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.975+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e1250 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.976+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.976+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc68023be0 2024-02-15T22:56:25.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.976+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.976+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e7530 2024-02-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.976+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6803cdb0 con 0x5619849e7530 2024-02-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.976+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e7530 2024-02-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.976+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6803cdb0 con 0x5619849e7530 2024-02-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.976+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc6c0141d0 2024-02-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.977+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.977+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e7530 2024-02-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.977+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6803cdb0 con 0x5619849e7530 2024-02-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.977+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e7530 2024-02-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.977+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6803cdb0 con 0x5619849e7530 2024-02-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.977+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e1250 2024-02-15T22:56:26.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.977+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.977+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e1250 2024-02-15T22:56:26.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.978+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.978+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc6c0141d0 2024-02-15T22:56:26.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.978+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.978+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e7530 2024-02-15T22:56:26.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.978+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6803cdb0 con 0x5619849e7530 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.978+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc68023be0 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.978+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.978+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e1250 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.978+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.978+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc6c0141d0 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.979+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.979+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e7530 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.979+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6803cdb0 con 0x5619849e7530 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.979+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc6c0141d0 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.979+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.979+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc68023be0 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.979+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.979+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e7530 2024-02-15T22:56:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6803cdb0 con 0x5619849e7530 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc6c0141d0 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x5619849e1250 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea0a0 con 0x7fcc68023be0 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc75931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc75931800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc75931800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc75931800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc75931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc75931800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.980+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849e6b40 con 0x5619849e1250 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849e6360 con 0x5619849e1250 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea4e0 con 0x5619849e1250 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 20 zone default found 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 4 Realm: () 2024-02-15T22:56:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 20 zonegroup default 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.981+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ea840 con 0x7fcc6c0141d0 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ec6c0 con 0x5619849e7530 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcc68064040 con 0x5619849e7530 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849eca20 con 0x5619849e7530 2024-02-15T22:56:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcc68064040 con 0x5619849e7530 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc75931800 20 started sync module instance, tier type = 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc75931800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.982+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ebc90 con 0x7fcc68023be0 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.983+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.983+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94667599167856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ebc90 con 0x7fcc68023be0 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.983+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ed440 con 0x5619849e1250 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.984+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94667599167856] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.984+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.984+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94667599171360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ebc90 con 0x5619849e1250 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.984+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849edeb0 con 0x5619849e7530 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.985+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94667599171360] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.985+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc68064040 con 0x5619849e7530 2024-02-15T22:56:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.985+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94667599165424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ebc10 con 0x5619849e7530 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.985+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849eed10 con 0x7fcc68023be0 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.986+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94667599165424] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc68064040 con 0x5619849e7530 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.986+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.986+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94667599177840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849ef130 con 0x7fcc68023be0 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.986+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849efaa0 con 0x5619849e1250 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.987+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.987+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94667599181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849efa60 con 0x5619849e1250 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.988+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849f0a00 con 0x7fcc6c0141d0 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.988+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94667599177840] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.988+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.988+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94667599185216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849f0a00 con 0x7fcc6c0141d0 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.989+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849f1400 con 0x7fcc6c0141d0 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.989+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94667599181312] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94667599185216] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94667599183392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849f13c0 con 0x7fcc6c0141d0 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849eecd0 con 0x7fcc6c0141d0 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94667599178960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849f1d30 con 0x7fcc6c0141d0 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc75931800 20 add_watcher() i=0 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc75931800 20 add_watcher() i=1 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc75931800 20 add_watcher() i=2 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc75931800 20 add_watcher() i=3 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc75931800 20 add_watcher() i=4 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.990+0000 7fcc75931800 20 add_watcher() i=5 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.991+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94667599183392] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.991+0000 7fcc75931800 20 add_watcher() i=6 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.991+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94667599178960] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.991+0000 7fcc75931800 20 add_watcher() i=7 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.991+0000 7fcc75931800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.991+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849f1010 con 0x5619849e1250 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.992+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.992+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94667599190160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619849f2620 con 0x5619849e1250 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94667599190160] v30'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fcb277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fcc75931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fcc75931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fcc75931800 5 note: GC not initialized 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fcb267e4640 20 reqs_thread_entry: start 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fcc75931800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fcc75931800 20 Filter name: none 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fca97fff640 20 reqs_thread_entry: start 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fcc75931800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.993+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a26ea0 con 0x5619849e1250 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 20 rados_obj.operate() r=0 bl.length=515 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a27840 con 0x7fcc68023be0 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-15T22:56:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.994+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~624 in=624b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a2d4b0 con 0x5619849e1250 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.995+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~624] v30'8 uv8 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.995+0000 7fcc75931800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.995+0000 7fcc75931800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.995+0000 7fcc75931800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.995+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94667599433520 in=812b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28b10 con 0x5619849e1250 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.995+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 94667599181312 notify 128849018887 ret 0) v3 ==== 842+0+0 (crc 0 0 0) 0x5619849aa570 con 0x5619849e1250 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.995+0000 7fcb54ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94667599181312 notifier 4383 bl.length()=800 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.995+0000 7fcb54ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.995+0000 7fcb54ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.995+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(65 notify.4 [notify cookie 94667599433520 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.995+0000 7fcb54ff9640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fcb34003e90 con 0x5619849e1250 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.996+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.996+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== watch-notify(notify_complete (2) cookie 94667599433520 notify 128849018887 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5619849aa090 con 0x5619849e1250 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.996+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28f00 con 0x7fcc68023be0 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.997+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.997+0000 7fcc75931800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.997+0000 7fcc75931800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.997+0000 7fcc75931800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.997+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94667599433520 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28f00 con 0x7fcc68023be0 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.998+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== watch-notify(notify (1) cookie 94667599167856 notify 128849018883 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x7fcc6c026bc0 con 0x7fcc68023be0 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.998+0000 7fcb54ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94667599167856 notifier 4383 bl.length()=166 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.998+0000 7fcb54ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.998+0000 7fcb54ff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.998+0000 7fcb54ff9640 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fcb34003e90 con 0x7fcc68023be0 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.998+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(68 notify.0 [notify cookie 94667599433520 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.998+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.998+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== watch-notify(notify_complete (2) cookie 94667599433520 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcc6c026e20 con 0x7fcc68023be0 2024-02-15T22:56:26.013 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.999+0000 7fcb277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:25.999+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94667599190160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28f00 con 0x5619849e1250 2024-02-15T22:56:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.000+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94667599190160] v30'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.000+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94667599167856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28f00 con 0x7fcc68023be0 2024-02-15T22:56:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.001+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94667599167856] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.001+0000 7fcc75931800 20 remove_watcher() i=0 2024-02-15T22:56:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.001+0000 7fcc75931800 2 removed watcher, disabling cache 2024-02-15T22:56:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.001+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94667599171360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28f00 con 0x5619849e1250 2024-02-15T22:56:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.002+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94667599171360] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.002+0000 7fcc75931800 20 remove_watcher() i=1 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.002+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94667599165424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28f00 con 0x5619849e7530 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.003+0000 7fcc70ef1640 1 -- 172.21.15.133:0/3082875612 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94667599165424] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc68064040 con 0x5619849e7530 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.003+0000 7fcc75931800 20 remove_watcher() i=2 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.003+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94667599177840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28b10 con 0x7fcc68023be0 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.004+0000 7fcc71ef3640 1 -- 172.21.15.133:0/3082875612 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94667599177840] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6c03a040 con 0x7fcc68023be0 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.004+0000 7fcc75931800 20 remove_watcher() i=3 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.004+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94667599181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28b10 con 0x5619849e1250 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.005+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94667599181312] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x5619849e1250 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.005+0000 7fcc75931800 20 remove_watcher() i=4 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.005+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94667599185216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28b10 con 0x7fcc6c0141d0 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.006+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94667599185216] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.006+0000 7fcc75931800 20 remove_watcher() i=5 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.006+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94667599183392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28b10 con 0x7fcc6c0141d0 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.007+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94667599183392] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.007+0000 7fcc75931800 20 remove_watcher() i=6 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.007+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94667599178960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561984a28b10 con 0x7fcc6c0141d0 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94667599178960] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcc6407e040 con 0x7fcc6c0141d0 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 20 remove_watcher() i=7 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcc6c0141d0 msgr2=0x7fcc6c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcc6c0141d0 0x7fcc6c015940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5619849e1250 msgr2=0x5619849e3710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5619849e1250 0x5619849e3710 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcc68023be0 msgr2=0x7fcc6800c6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcc68023be0 0x7fcc6800c6a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5619849e7530 msgr2=0x5619849e99d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5619849e7530 0x5619849e99d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb3c0367e0 msgr2=0x7fcb3c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb3c0367e0 0x7fcb3c038ca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00b010 tx=0x7fcc6c020000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 msgr2=0x5619849d58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc716f2640 1 -- 172.21.15.133:0/3082875612 reap_dead start 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849d58c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcc6804b690 tx=0x7fcc68019ce0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 shutdown_connections 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 --2- 172.21.15.133:0/3082875612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849ce860 0x5619849d58c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 >> 172.21.15.133:0/3082875612 conn(0x5619849cabc0 msgr2=0x5619849c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 shutdown_connections 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.008+0000 7fcc75931800 1 -- 172.21.15.133:0/3082875612 wait complete. 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/1066082606 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb48036790 msgr2=0x7fcb48038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 --2- 172.21.15.133:0/1066082606 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb48036790 0x7fcb48038c50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5619849b17a0 tx=0x7fcc6c005840 comp rx=0 tx=0).stop 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/1066082606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849c15e0 msgr2=0x5619849c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 --2- 172.21.15.133:0/1066082606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849c15e0 0x5619849c1a00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcc68001ed0 tx=0x7fcc6800d7a0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/1066082606 shutdown_connections 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 --2- 172.21.15.133:0/1066082606 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb48036790 0x7fcb48038c50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 --2- 172.21.15.133:0/1066082606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619849c15e0 0x5619849c1a00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/1066082606 >> 172.21.15.133:0/1066082606 conn(0x5619849b5680 msgr2=0x5619849b5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/1066082606 shutdown_connections 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/1066082606 wait complete. 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561984825260 msgr2=0x5619849b0810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561984825260 0x5619849b0810 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb580367e0 msgr2=0x7fcb58038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb580367e0 0x7fcb58038ca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc68000f60 tx=0x7fcc680012b0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 msgr2=0x5619849a9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a9b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400a470 tx=0x7fcc64002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 shutdown_connections 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561984825260 0x5619849b0810 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb580367e0 0x7fcb58038ca0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 --2- 172.21.15.133:0/2678892443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561984823c60 0x5619849a9b50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 >> 172.21.15.133:0/2678892443 conn(0x5619848ab5e0 msgr2=0x5619849a0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 shutdown_connections 2024-02-15T22:56:26.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.009+0000 7fcc75931800 1 -- 172.21.15.133:0/2678892443 wait complete. 2024-02-15T22:56:26.024 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:26.024 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T22:56:26.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T22:56:26.024 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T22:56:26.067 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:26.067 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:26.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.065+0000 7ff385733800 1 Processor -- start 2024-02-15T22:56:26.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.065+0000 7ff385733800 1 -- start start 2024-02-15T22:56:26.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.065+0000 7ff385733800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55688e9cd3f0 0x55688e9d5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.065+0000 7ff385733800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55688e917bb0 con 0x55688e9cb8b0 2024-02-15T22:56:26.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.065+0000 7ff385733800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55688e8cf450 con 0x55688e9cd3f0 2024-02-15T22:56:26.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.066+0000 7ff380c91640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55688e9cd3f0 0x55688e9d5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.066+0000 7ff381492640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55688e9cb8b0 0x55688e9cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44944/0 (socket says 172.21.15.133:44944) 2024-02-15T22:56:26.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.066+0000 7ff381492640 1 -- 172.21.15.133:0/1957018900 learned_addr learned my addr 172.21.15.133:0/1957018900 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:26.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.066+0000 7ff373fff640 1 -- 172.21.15.133:0/1957018900 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124013888 0 0) 0x55688e917bb0 con 0x55688e9cb8b0 2024-02-15T22:56:26.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.066+0000 7ff373fff640 1 -- 172.21.15.133:0/1957018900 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff36c001e10 con 0x55688e9cb8b0 2024-02-15T22:56:26.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.066+0000 7ff380c91640 1 -- 172.21.15.133:0/1957018900 >> v1:172.21.15.52:6789/0 conn(0x55688e9cb8b0 legacy=0x55688e9cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.066+0000 7ff380c91640 1 -- 172.21.15.133:0/1957018900 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55688e940160 con 0x55688e9cd3f0 2024-02-15T22:56:26.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.068+0000 7ff380c91640 1 --2- 172.21.15.133:0/1957018900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cd3f0 0x55688e9d5ef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff37800a470 tx=0x7ff37801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134a9e64c29fcda3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.068+0000 7ff373fff640 1 -- 172.21.15.133:0/1957018900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff37804ac50 con 0x55688e9cd3f0 2024-02-15T22:56:26.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.068+0000 7ff373fff640 1 -- 172.21.15.133:0/1957018900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37804adb0 con 0x55688e9cd3f0 2024-02-15T22:56:26.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.068+0000 7ff373fff640 1 -- 172.21.15.133:0/1957018900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff378052590 con 0x55688e9cd3f0 2024-02-15T22:56:26.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.068+0000 7ff385733800 1 -- 172.21.15.133:0/1957018900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cd3f0 msgr2=0x55688e9d5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.068+0000 7ff385733800 1 --2- 172.21.15.133:0/1957018900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cd3f0 0x55688e9d5ef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff37800a470 tx=0x7ff37801cc80 comp rx=0 tx=0).stop 2024-02-15T22:56:26.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.068+0000 7ff385733800 1 -- 172.21.15.133:0/1957018900 shutdown_connections 2024-02-15T22:56:26.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.068+0000 7ff385733800 1 --2- 172.21.15.133:0/1957018900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cd3f0 0x55688e9d5ef0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.068+0000 7ff385733800 1 -- 172.21.15.133:0/1957018900 >> 172.21.15.133:0/1957018900 conn(0x55688e9c74d0 msgr2=0x55688e9c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.068+0000 7ff385733800 1 -- 172.21.15.133:0/1957018900 shutdown_connections 2024-02-15T22:56:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.068+0000 7ff385733800 1 -- 172.21.15.133:0/1957018900 wait complete. 2024-02-15T22:56:26.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.080+0000 7ff385733800 1 Processor -- start 2024-02-15T22:56:26.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.080+0000 7ff385733800 1 -- start start 2024-02-15T22:56:26.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.080+0000 7ff385733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688e9d1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.080+0000 7ff385733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688e8cc980 con 0x55688e9cb8b0 2024-02-15T22:56:26.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.080+0000 7ff381492640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688e9d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.080+0000 7ff381492640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688e9d1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57800/0 (socket says 172.21.15.133:57800) 2024-02-15T22:56:26.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.080+0000 7ff381492640 1 -- 172.21.15.133:0/4123633089 learned_addr learned my addr 172.21.15.133:0/4123633089 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.081+0000 7ff381492640 1 -- 172.21.15.133:0/4123633089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378005d20 con 0x55688e9cb8b0 2024-02-15T22:56:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.081+0000 7ff381492640 1 --2- 172.21.15.133:0/4123633089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688e9d1340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff374001c50 tx=0x7ff37400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96646b525bf4a328 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.081+0000 7ff26f606640 1 -- 172.21.15.133:0/4123633089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff37400e470 con 0x55688e9cb8b0 2024-02-15T22:56:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.081+0000 7ff26f606640 1 -- 172.21.15.133:0/4123633089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37400e5d0 con 0x55688e9cb8b0 2024-02-15T22:56:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.081+0000 7ff26f606640 1 -- 172.21.15.133:0/4123633089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff37400e8b0 con 0x55688e9cb8b0 2024-02-15T22:56:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.082+0000 7ff385733800 1 -- 172.21.15.133:0/4123633089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 msgr2=0x55688e9d1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.082+0000 7ff385733800 1 --2- 172.21.15.133:0/4123633089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688e9d1340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff374001c50 tx=0x7ff37400b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.082+0000 7ff385733800 1 -- 172.21.15.133:0/4123633089 shutdown_connections 2024-02-15T22:56:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.082+0000 7ff385733800 1 --2- 172.21.15.133:0/4123633089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688e9d1340 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.082+0000 7ff385733800 1 -- 172.21.15.133:0/4123633089 >> 172.21.15.133:0/4123633089 conn(0x55688e9c74d0 msgr2=0x55688eabaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.082+0000 7ff385733800 1 -- 172.21.15.133:0/4123633089 shutdown_connections 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.082+0000 7ff385733800 1 -- 172.21.15.133:0/4123633089 wait complete. 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.082+0000 7ff385733800 1 Processor -- start 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.082+0000 7ff385733800 1 -- start start 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.082+0000 7ff385733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688eacabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.082+0000 7ff385733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688e8c8160 con 0x55688e9cb8b0 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.083+0000 7ff381492640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688eacabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.083+0000 7ff381492640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688eacabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57808/0 (socket says 172.21.15.133:57808) 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.083+0000 7ff381492640 1 -- 172.21.15.133:0/3577282200 learned_addr learned my addr 172.21.15.133:0/3577282200 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.083+0000 7ff381492640 1 -- 172.21.15.133:0/3577282200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c001e10 con 0x55688e9cb8b0 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.083+0000 7ff381492640 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688eacabd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff374000c00 tx=0x7ff374000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.083+0000 7ff26de03640 1 -- 172.21.15.133:0/3577282200 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff37401f070 con 0x55688e9cb8b0 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.083+0000 7ff26de03640 1 -- 172.21.15.133:0/3577282200 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374018830 con 0x55688e9cb8b0 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.083+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55688eacb110 con 0x55688e9cb8b0 2024-02-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.083+0000 7ff26de03640 1 -- 172.21.15.133:0/3577282200 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff374018ad0 con 0x55688e9cb8b0 2024-02-15T22:56:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.083+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55688eacb5f0 con 0x55688e9cb8b0 2024-02-15T22:56:26.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.084+0000 7ff26de03640 1 -- 172.21.15.133:0/3577282200 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff374018c30 con 0x55688e9cb8b0 2024-02-15T22:56:26.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.084+0000 7ff26de03640 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2680367e0 0x7ff268038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.084+0000 7ff26de03640 1 -- 172.21.15.133:0/3577282200 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7ff37404c1c0 con 0x55688e9cb8b0 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.084+0000 7ff380c91640 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2680367e0 0x7ff268038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.084+0000 7ff385733800 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55688e9cd3f0 0x55688ead1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.084+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688ead1df0 con 0x55688e9cd3f0 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.084+0000 7ff381c93640 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55688e9cd3f0 0x55688ead1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.085+0000 7ff380c91640 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2680367e0 0x7ff268038ca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff378054000 tx=0x7ff37804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.085+0000 7ff381c93640 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55688e9cd3f0 0x55688ead1840 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.085+0000 7ff381c93640 1 -- 172.21.15.133:0/3577282200 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff37c00a4a0 con 0x55688e9cd3f0 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.085+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eacef70 con 0x55688e9cd3f0 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.085+0000 7ff381c93640 1 -- 172.21.15.133:0/3577282200 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff37c00a4a0 con 0x55688e9cd3f0 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.085+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688ead3b20 con 0x55688e9cd3f0 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.086+0000 7ff381c93640 1 -- 172.21.15.133:0/3577282200 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff37c00a4a0 con 0x55688e9cd3f0 2024-02-15T22:56:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.086+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688ead2d20 con 0x55688e9cd3f0 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.086+0000 7ff381c93640 1 -- 172.21.15.133:0/3577282200 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff37c00a4a0 con 0x55688e9cd3f0 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.086+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688ead3130 con 0x55688e9cd3f0 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.086+0000 7ff381c93640 1 -- 172.21.15.133:0/3577282200 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff37c00a4a0 con 0x55688e9cd3f0 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.087+0000 7ff385733800 1 Processor -- start 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.087+0000 7ff385733800 1 -- start start 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.087+0000 7ff385733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eae25a0 0x55688eae29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.087+0000 7ff385733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688e86ae80 con 0x55688eae25a0 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.087+0000 7ff380c91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eae25a0 0x55688eae29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.087+0000 7ff380c91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eae25a0 0x55688eae29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57814/0 (socket says 172.21.15.133:57814) 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.087+0000 7ff380c91640 1 -- 172.21.15.133:0/2742953816 learned_addr learned my addr 172.21.15.133:0/2742953816 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.088+0000 7ff380c91640 1 -- 172.21.15.133:0/2742953816 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55688eae2f00 con 0x55688eae25a0 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.088+0000 7ff380c91640 1 --2- 172.21.15.133:0/2742953816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eae25a0 0x55688eae29c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff378055040 tx=0x7ff378002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.088+0000 7ff266ffd640 1 -- 172.21.15.133:0/2742953816 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff378052e60 con 0x55688eae25a0 2024-02-15T22:56:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.088+0000 7ff266ffd640 1 -- 172.21.15.133:0/2742953816 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378065410 con 0x55688eae25a0 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.088+0000 7ff385733800 1 -- 172.21.15.133:0/2742953816 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55688eae30f0 con 0x55688eae25a0 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.088+0000 7ff266ffd640 1 -- 172.21.15.133:0/2742953816 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3780656b0 con 0x55688eae25a0 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.088+0000 7ff385733800 1 -- 172.21.15.133:0/2742953816 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55688eae3ca0 con 0x55688eae25a0 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.089+0000 7ff266ffd640 1 -- 172.21.15.133:0/2742953816 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff3780658a0 con 0x55688eae25a0 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.089+0000 7ff266ffd640 1 --2- 172.21.15.133:0/2742953816 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff258036790 0x7ff258038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.089+0000 7ff266ffd640 1 -- 172.21.15.133:0/2742953816 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7ff37808ee70 con 0x55688eae25a0 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.089+0000 7ff381c93640 1 --2- 172.21.15.133:0/2742953816 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff258036790 0x7ff258038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.089+0000 7ff385733800 1 Processor -- start 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.089+0000 7ff385733800 1 -- start start 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.089+0000 7ff381c93640 1 --2- 172.21.15.133:0/2742953816 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff258036790 0x7ff258038c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55688ead2760 tx=0x7ff37c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.089+0000 7ff385733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaefb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.089+0000 7ff385733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688e8405d0 con 0x55688eaef700 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.089+0000 7ff380c91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaefb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff380c91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaefb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57828/0 (socket says 172.21.15.133:57828) 2024-02-15T22:56:26.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff380c91640 1 -- 172.21.15.133:0/845174925 learned_addr learned my addr 172.21.15.133:0/845174925 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff380c91640 1 -- 172.21.15.133:0/845174925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55688eaf00f0 con 0x55688eaef700 2024-02-15T22:56:26.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff380c91640 1 --2- 172.21.15.133:0/845174925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaefb20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff37801ccc0 tx=0x7ff378065d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f948b2d64606aa server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff264ff9640 1 -- 172.21.15.133:0/845174925 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff378076960 con 0x55688eaef700 2024-02-15T22:56:26.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff264ff9640 1 -- 172.21.15.133:0/845174925 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378076ac0 con 0x55688eaef700 2024-02-15T22:56:26.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff264ff9640 1 -- 172.21.15.133:0/845174925 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff378076d60 con 0x55688eaef700 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff385733800 1 -- 172.21.15.133:0/845174925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 msgr2=0x55688eaefb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff385733800 1 --2- 172.21.15.133:0/845174925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaefb20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff37801ccc0 tx=0x7ff378065d30 comp rx=0 tx=0).stop 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff385733800 1 -- 172.21.15.133:0/845174925 shutdown_connections 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff385733800 1 --2- 172.21.15.133:0/845174925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaefb20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.090+0000 7ff385733800 1 -- 172.21.15.133:0/845174925 >> 172.21.15.133:0/845174925 conn(0x55688eaeba60 msgr2=0x55688eae9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.091+0000 7ff385733800 1 -- 172.21.15.133:0/845174925 shutdown_connections 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.091+0000 7ff385733800 1 -- 172.21.15.133:0/845174925 wait complete. 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.091+0000 7ff385733800 1 Processor -- start 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.091+0000 7ff385733800 1 -- start start 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.091+0000 7ff385733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaf6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.091+0000 7ff385733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688eaf6bc0 con 0x55688eaef700 2024-02-15T22:56:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.091+0000 7ff380c91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaf6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.091+0000 7ff380c91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaf6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57830/0 (socket says 172.21.15.133:57830) 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.091+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 learned_addr learned my addr 172.21.15.133:0/2682147112 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.091+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55688eae3ca0 con 0x55688eaef700 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.092+0000 7ff380c91640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaf6680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff378052b70 tx=0x7ff37808d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.092+0000 7ff256ffd640 1 -- 172.21.15.133:0/2682147112 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff378064b90 con 0x55688eaef700 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.092+0000 7ff256ffd640 1 -- 172.21.15.133:0/2682147112 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378064cf0 con 0x55688eaef700 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.092+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55688eaf6dc0 con 0x55688eaef700 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.092+0000 7ff256ffd640 1 -- 172.21.15.133:0/2682147112 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff378053020 con 0x55688eaef700 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.092+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55688eaf7280 con 0x55688eaef700 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.093+0000 7ff256ffd640 1 -- 172.21.15.133:0/2682147112 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff378053180 con 0x55688eaef700 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.093+0000 7ff256ffd640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff24c0367e0 0x7ff24c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.093+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.093+0000 7ff256ffd640 1 -- 172.21.15.133:0/2682147112 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7ff378096b10 con 0x55688eaef700 2024-02-15T22:56:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.093+0000 7ff381c93640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff24c0367e0 0x7ff24c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.093+0000 7ff385733800 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55688eb02290 0x55688eb04720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.093+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb04e70 con 0x55688eb02290 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.093+0000 7ff381492640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55688eb02290 0x55688eb04720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.093+0000 7ff381c93640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff24c0367e0 0x7ff24c038ca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00b010 tx=0x7ff37c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.093+0000 7ff381492640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55688eb02290 0x55688eb04720 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 20 realm 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb05240 con 0x55688eb02290 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb05ac0 con 0x55688eb02290 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb05e20 con 0x55688eb02290 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.094+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb05720 con 0x55688eb02290 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.095+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.095+0000 7ff385733800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.095+0000 7ff385733800 20 searching for the correct realm 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.095+0000 7ff385733800 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55688eb081a0 0x55688eb0a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.095+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb081a0 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.095+0000 7ff380c91640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55688eb081a0 0x55688eb0a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.095+0000 7ff380c91640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55688eb081a0 0x55688eb0a590 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.095+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.095+0000 7ff380c91640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ff378064370 0x7ff378055120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.095+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff378064370 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.096+0000 7ff381c93640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ff378064370 0x7ff378055120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.096+0000 7ff381c93640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ff378064370 0x7ff378055120 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.096+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff37c00a4a0 con 0x7ff378064370 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.096+0000 7ff381c93640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ff37c0141d0 0x7ff37c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.096+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff37c0141d0 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.096+0000 7ff381492640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ff37c0141d0 0x7ff37c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.097+0000 7ff381492640 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ff37c0141d0 0x7ff37c015940 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.097+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x7ff37c0141d0 2024-02-15T22:56:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.097+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb02290 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.097+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.097+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb02290 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.097+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.097+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff37c0141d0 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.098+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x7ff37c0141d0 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.098+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff37c0141d0 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.098+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x7ff37c0141d0 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.098+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff378064370 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.098+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff37c00a4a0 con 0x7ff378064370 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.098+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb081a0 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.098+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.098+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb02290 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.098+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.098+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff37c0141d0 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.099+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x7ff37c0141d0 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.099+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb02290 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.099+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.099+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff378064370 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.099+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff37c03a040 con 0x7ff378064370 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.099+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb081a0 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.099+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.099+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb081a0 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.100+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.100+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff37c0141d0 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.100+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x7ff37c0141d0 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.100+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb081a0 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.100+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.100+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb081a0 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.100+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.100+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb02290 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.101+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.101+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb02290 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.101+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.101+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff37c0141d0 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.101+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x7ff37c0141d0 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.101+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb081a0 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.101+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.101+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff378064370 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.101+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff37c03a040 con 0x7ff378064370 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.102+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb02290 2024-02-15T22:56:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.102+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff374014070 con 0x55688eb02290 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.102+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff37c0141d0 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.102+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374014070 con 0x7ff37c0141d0 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.102+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb081a0 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.102+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.102+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff37c0141d0 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.103+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.103+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff378064370 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.103+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff37c03a040 con 0x7ff378064370 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.103+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb081a0 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.103+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.103+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff37c0141d0 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.103+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.103+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x55688eb02290 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ac60 con 0x7ff378064370 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff37c03a040 con 0x7ff378064370 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb06c40 con 0x55688eb02290 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb068c0 con 0x55688eb02290 2024-02-15T22:56:26.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.104+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb075d0 con 0x55688eb02290 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 20 zone default found 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 4 Realm: () 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 20 zonegroup default 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0b0f0 con 0x7ff37c0141d0 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0cf70 con 0x55688eb081a0 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0d2d0 con 0x55688eb081a0 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 20 started sync module instance, tier type = 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.105+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0c540 con 0x7ff378064370 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.106+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff37c03a040 con 0x7ff378064370 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.106+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93907558910496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0c540 con 0x7ff378064370 2024-02-15T22:56:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.106+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0dd20 con 0x55688eb02290 2024-02-15T22:56:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.107+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93907558910496] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff37c03a040 con 0x7ff378064370 2024-02-15T22:56:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.108+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.108+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93907558914080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0c540 con 0x55688eb02290 2024-02-15T22:56:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.108+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0e7c0 con 0x55688eb081a0 2024-02-15T22:56:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.109+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93907558914080] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.109+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.109+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93907558908064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0c4c0 con 0x55688eb081a0 2024-02-15T22:56:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.109+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0f620 con 0x7ff378064370 2024-02-15T22:56:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.110+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93907558908064] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.110+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff37c03a040 con 0x7ff378064370 2024-02-15T22:56:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.110+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93907558920576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0fa40 con 0x7ff378064370 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.110+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb103b0 con 0x55688eb02290 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.111+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.111+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93907558924048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb10870 con 0x55688eb02290 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.111+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb11340 con 0x7ff37c0141d0 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.111+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93907558920576] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff37c03a040 con 0x7ff378064370 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.112+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.112+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93907558927904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb11300 con 0x7ff37c0141d0 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.112+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb11d60 con 0x7ff37c0141d0 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.112+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93907558924048] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.113+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93907558927904] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.113+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.113+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93907558921632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb10330 con 0x7ff37c0141d0 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.113+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb121c0 con 0x7ff37c0141d0 2024-02-15T22:56:26.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.114+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.114+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93907558921632] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.114+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93907558931744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb12640 con 0x7ff37c0141d0 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.114+0000 7ff385733800 20 add_watcher() i=0 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.114+0000 7ff385733800 20 add_watcher() i=1 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.114+0000 7ff385733800 20 add_watcher() i=2 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.114+0000 7ff385733800 20 add_watcher() i=3 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.114+0000 7ff385733800 20 add_watcher() i=4 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.114+0000 7ff385733800 20 add_watcher() i=5 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.114+0000 7ff385733800 20 add_watcher() i=6 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.115+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93907558931744] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.115+0000 7ff385733800 20 add_watcher() i=7 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.115+0000 7ff385733800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:26.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.115+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb15a80 con 0x55688eb02290 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.115+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.115+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93907558932800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb12ef0 con 0x55688eb02290 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.116+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93907558932800] v30'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.116+0000 7ff2377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.116+0000 7ff385733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.116+0000 7ff385733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.116+0000 7ff385733800 5 note: GC not initialized 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.117+0000 7ff2367e4640 20 reqs_thread_entry: start 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.117+0000 7ff385733800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.117+0000 7ff385733800 20 Filter name: none 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.117+0000 7ff1a7fff640 20 reqs_thread_entry: start 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.117+0000 7ff385733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.117+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb47290 con 0x55688eb02290 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.119+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~624 out=624b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+747 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.119+0000 7ff385733800 20 rados_obj.operate() r=0 bl.length=624 2024-02-15T22:56:26.130 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:26.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.120+0000 7ff2377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.120+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93907558932800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb46360 con 0x55688eb02290 2024-02-15T22:56:26.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.120+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93907558932800] v30'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.121+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93907558910496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb12140 con 0x7ff378064370 2024-02-15T22:56:26.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.121+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93907558910496] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff37c03a040 con 0x7ff378064370 2024-02-15T22:56:26.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.121+0000 7ff385733800 20 remove_watcher() i=0 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.121+0000 7ff385733800 2 removed watcher, disabling cache 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.121+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93907558914080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb12140 con 0x55688eb02290 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.123+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93907558914080] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.123+0000 7ff385733800 20 remove_watcher() i=1 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.123+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93907558908064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb12140 con 0x55688eb081a0 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.124+0000 7ff380c91640 1 -- 172.21.15.133:0/2682147112 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93907558908064] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff378091020 con 0x55688eb081a0 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.124+0000 7ff385733800 20 remove_watcher() i=2 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.124+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93907558920576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0c0a0 con 0x7ff378064370 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.125+0000 7ff381c93640 1 -- 172.21.15.133:0/2682147112 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93907558920576] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff37c03a040 con 0x7ff378064370 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.125+0000 7ff385733800 20 remove_watcher() i=3 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.125+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93907558924048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0c0a0 con 0x55688eb02290 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.126+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93907558924048] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x55688eb02290 2024-02-15T22:56:26.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.126+0000 7ff385733800 20 remove_watcher() i=4 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.126+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93907558927904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0ff10 con 0x7ff37c0141d0 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.127+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93907558927904] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.127+0000 7ff385733800 20 remove_watcher() i=5 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.127+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93907558921632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb0c0a0 con 0x7ff37c0141d0 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.127+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93907558921632] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.127+0000 7ff385733800 20 remove_watcher() i=6 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.127+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93907558931744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55688eb10e20 con 0x7ff37c0141d0 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.128+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93907558931744] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff374052040 con 0x7ff37c0141d0 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.128+0000 7ff385733800 20 remove_watcher() i=7 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ff37c0141d0 msgr2=0x7ff37c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ff37c0141d0 0x7ff37c015940 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55688eb02290 msgr2=0x55688eb04720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55688eb02290 0x55688eb04720 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ff378064370 msgr2=0x7ff378055120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ff378064370 0x7ff378055120 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55688eb081a0 msgr2=0x55688eb0a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55688eb081a0 0x55688eb0a590 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff24c0367e0 msgr2=0x7ff24c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff24c0367e0 0x7ff24c038ca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00b010 tx=0x7ff37c020000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 msgr2=0x55688eaf6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaf6680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff378052b70 tx=0x7ff37808d3a0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff381492640 1 -- 172.21.15.133:0/2682147112 reap_dead start 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 shutdown_connections 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/2682147112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eaef700 0x55688eaf6680 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 >> 172.21.15.133:0/2682147112 conn(0x55688eaeba60 msgr2=0x55688eae90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 shutdown_connections 2024-02-15T22:56:26.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2682147112 wait complete. 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2742953816 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff258036790 msgr2=0x7ff258038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/2742953816 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff258036790 0x7ff258038c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55688ead2760 tx=0x7ff37c005840 comp rx=0 tx=0).stop 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2742953816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eae25a0 msgr2=0x55688eae29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/2742953816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eae25a0 0x55688eae29c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff378055040 tx=0x7ff378002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2742953816 shutdown_connections 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/2742953816 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff258036790 0x7ff258038c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/2742953816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688eae25a0 0x55688eae29c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2742953816 >> 172.21.15.133:0/2742953816 conn(0x55688ead6640 msgr2=0x55688ead6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2742953816 shutdown_connections 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/2742953816 wait complete. 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55688e9cd3f0 msgr2=0x55688ead1840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.129+0000 7ff385733800 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55688e9cd3f0 0x55688ead1840 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.130+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2680367e0 msgr2=0x7ff268038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.130+0000 7ff385733800 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2680367e0 0x7ff268038ca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff378054000 tx=0x7ff37804e000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.130+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 msgr2=0x55688eacabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.130+0000 7ff385733800 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688eacabd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff374000c00 tx=0x7ff374000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.130+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 shutdown_connections 2024-02-15T22:56:26.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.130+0000 7ff385733800 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55688e9cd3f0 0x55688ead1840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.130+0000 7ff385733800 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2680367e0 0x7ff268038ca0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.130+0000 7ff385733800 1 --2- 172.21.15.133:0/3577282200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55688e9cb8b0 0x55688eacabd0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.130+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 >> 172.21.15.133:0/3577282200 conn(0x55688e9c74d0 msgr2=0x55688eaba610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.130+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 shutdown_connections 2024-02-15T22:56:26.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.130+0000 7ff385733800 1 -- 172.21.15.133:0/3577282200 wait complete. 2024-02-15T22:56:26.141 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:26.141 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-15T22:56:26.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-15T22:56:26.142 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-02-15T22:56:26.225 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:26.226 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:26.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.224+0000 7f1525410800 1 Processor -- start 2024-02-15T22:56:26.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.224+0000 7f1525410800 1 -- start start 2024-02-15T22:56:26.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.224+0000 7f1525410800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55cb368195b0 0x55cb3681b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.224+0000 7f1525410800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cb3675fba0 con 0x55cb36815aa0 2024-02-15T22:56:26.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.224+0000 7f1525410800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cb36717450 con 0x55cb368195b0 2024-02-15T22:56:26.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.224+0000 7f15201f2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55cb368195b0 0x55cb3681b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.224+0000 7f15209f3640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55cb36815aa0 0x55cb36817e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44958/0 (socket says 172.21.15.133:44958) 2024-02-15T22:56:26.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.224+0000 7f15209f3640 1 -- 172.21.15.133:0/3262960074 learned_addr learned my addr 172.21.15.133:0/3262960074 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:26.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.225+0000 7f151f9f1640 1 -- 172.21.15.133:0/3262960074 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269784618 0 0) 0x55cb3675fba0 con 0x55cb36815aa0 2024-02-15T22:56:26.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.225+0000 7f151f9f1640 1 -- 172.21.15.133:0/3262960074 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f150c001e10 con 0x55cb36815aa0 2024-02-15T22:56:26.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.225+0000 7f15201f2640 1 -- 172.21.15.133:0/3262960074 >> v1:172.21.15.52:6789/0 conn(0x55cb36815aa0 legacy=0x55cb36817e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.225+0000 7f15201f2640 1 -- 172.21.15.133:0/3262960074 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb3681cef0 con 0x55cb368195b0 2024-02-15T22:56:26.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.226+0000 7f15201f2640 1 --2- 172.21.15.133:0/3262960074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb368195b0 0x55cb3681b9a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f150800a470 tx=0x7f150801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73dc33cb2c2ae11 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.227+0000 7f151f9f1640 1 -- 172.21.15.133:0/3262960074 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f150804ad60 con 0x55cb368195b0 2024-02-15T22:56:26.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.227+0000 7f151f9f1640 1 -- 172.21.15.133:0/3262960074 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1508052440 con 0x55cb368195b0 2024-02-15T22:56:26.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.227+0000 7f151f9f1640 1 -- 172.21.15.133:0/3262960074 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15080526e0 con 0x55cb368195b0 2024-02-15T22:56:26.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.227+0000 7f1525410800 1 -- 172.21.15.133:0/3262960074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb368195b0 msgr2=0x55cb3681b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.227+0000 7f1525410800 1 --2- 172.21.15.133:0/3262960074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb368195b0 0x55cb3681b9a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f150800a470 tx=0x7f150801cc80 comp rx=0 tx=0).stop 2024-02-15T22:56:26.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.227+0000 7f1525410800 1 -- 172.21.15.133:0/3262960074 shutdown_connections 2024-02-15T22:56:26.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.227+0000 7f1525410800 1 --2- 172.21.15.133:0/3262960074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb368195b0 0x55cb3681b9a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.227+0000 7f1525410800 1 -- 172.21.15.133:0/3262960074 >> 172.21.15.133:0/3262960074 conn(0x55cb3680f4f0 msgr2=0x55cb36811910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.227+0000 7f1525410800 1 -- 172.21.15.133:0/3262960074 shutdown_connections 2024-02-15T22:56:26.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.227+0000 7f1525410800 1 -- 172.21.15.133:0/3262960074 wait complete. 2024-02-15T22:56:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.239+0000 7f1525410800 1 Processor -- start 2024-02-15T22:56:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.239+0000 7f1525410800 1 -- start start 2024-02-15T22:56:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.239+0000 7f1525410800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36904f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.239+0000 7f1525410800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb36714980 con 0x55cb36815aa0 2024-02-15T22:56:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.239+0000 7f15209f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36904f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.239+0000 7f15209f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36904f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57840/0 (socket says 172.21.15.133:57840) 2024-02-15T22:56:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.239+0000 7f15209f3640 1 -- 172.21.15.133:0/4033354 learned_addr learned my addr 172.21.15.133:0/4033354 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.239+0000 7f15209f3640 1 -- 172.21.15.133:0/4033354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508005d20 con 0x55cb36815aa0 2024-02-15T22:56:26.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.240+0000 7f15209f3640 1 --2- 172.21.15.133:0/4033354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36904f00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1510006dd0 tx=0x7f1510001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26268956bf97fe2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.240+0000 7f140ee0d640 1 -- 172.21.15.133:0/4033354 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1510004520 con 0x55cb36815aa0 2024-02-15T22:56:26.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.240+0000 7f140ee0d640 1 -- 172.21.15.133:0/4033354 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15100046a0 con 0x55cb36815aa0 2024-02-15T22:56:26.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.240+0000 7f140ee0d640 1 -- 172.21.15.133:0/4033354 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1510004a00 con 0x55cb36815aa0 2024-02-15T22:56:26.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.240+0000 7f1525410800 1 -- 172.21.15.133:0/4033354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 msgr2=0x55cb36904f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.240+0000 7f1525410800 1 --2- 172.21.15.133:0/4033354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36904f00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1510006dd0 tx=0x7f1510001a20 comp rx=0 tx=0).stop 2024-02-15T22:56:26.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.240+0000 7f1525410800 1 -- 172.21.15.133:0/4033354 shutdown_connections 2024-02-15T22:56:26.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.240+0000 7f1525410800 1 --2- 172.21.15.133:0/4033354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36904f00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.240+0000 7f1525410800 1 -- 172.21.15.133:0/4033354 >> 172.21.15.133:0/4033354 conn(0x55cb3680f4f0 msgr2=0x55cb369006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.240+0000 7f1525410800 1 -- 172.21.15.133:0/4033354 shutdown_connections 2024-02-15T22:56:26.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.240+0000 7f1525410800 1 -- 172.21.15.133:0/4033354 wait complete. 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.241+0000 7f1525410800 1 Processor -- start 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.241+0000 7f1525410800 1 -- start start 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.241+0000 7f1525410800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36815390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.241+0000 7f1525410800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb36710160 con 0x55cb36815aa0 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.241+0000 7f15209f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36815390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.241+0000 7f15209f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36815390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57848/0 (socket says 172.21.15.133:57848) 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.241+0000 7f15209f3640 1 -- 172.21.15.133:0/157153258 learned_addr learned my addr 172.21.15.133:0/157153258 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.242+0000 7f15209f3640 1 -- 172.21.15.133:0/157153258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c001e10 con 0x55cb36815aa0 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.242+0000 7f15209f3640 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36815390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1510006dd0 tx=0x7f1510000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.242+0000 7f140d60a640 1 -- 172.21.15.133:0/157153258 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1510022070 con 0x55cb36815aa0 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.242+0000 7f140d60a640 1 -- 172.21.15.133:0/157153258 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1510013860 con 0x55cb36815aa0 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.242+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cb368158d0 con 0x55cb36815aa0 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.242+0000 7f140d60a640 1 -- 172.21.15.133:0/157153258 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1510013b40 con 0x55cb36815aa0 2024-02-15T22:56:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.242+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb36813e20 con 0x55cb36815aa0 2024-02-15T22:56:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.243+0000 7f140d60a640 1 -- 172.21.15.133:0/157153258 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1510013ca0 con 0x55cb36815aa0 2024-02-15T22:56:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.243+0000 7f140d60a640 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14080367e0 0x7f1408038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.243+0000 7f140d60a640 1 -- 172.21.15.133:0/157153258 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f151004baf0 con 0x55cb36815aa0 2024-02-15T22:56:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.243+0000 7f15201f2640 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14080367e0 0x7f1408038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.243+0000 7f1525410800 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cb368195b0 0x55cb36915850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.243+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb368147b0 con 0x55cb368195b0 2024-02-15T22:56:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.243+0000 7f15211f4640 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cb368195b0 0x55cb36915850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.243+0000 7f15201f2640 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14080367e0 0x7f1408038ca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1508054000 tx=0x7f150804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.243+0000 7f15211f4640 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cb368195b0 0x55cb36915850 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.244+0000 7f15211f4640 1 -- 172.21.15.133:0/157153258 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f15180083e0 con 0x55cb368195b0 2024-02-15T22:56:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.244+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36814150 con 0x55cb368195b0 2024-02-15T22:56:26.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.244+0000 7f15211f4640 1 -- 172.21.15.133:0/157153258 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f15180083e0 con 0x55cb368195b0 2024-02-15T22:56:26.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.244+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36917730 con 0x55cb368195b0 2024-02-15T22:56:26.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.244+0000 7f15211f4640 1 -- 172.21.15.133:0/157153258 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f15180083e0 con 0x55cb368195b0 2024-02-15T22:56:26.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.244+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36916a40 con 0x55cb368195b0 2024-02-15T22:56:26.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.245+0000 7f15211f4640 1 -- 172.21.15.133:0/157153258 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f15180083e0 con 0x55cb368195b0 2024-02-15T22:56:26.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.245+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36916e50 con 0x55cb368195b0 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.245+0000 7f15211f4640 1 -- 172.21.15.133:0/157153258 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1518012040 con 0x55cb368195b0 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.245+0000 7f1525410800 1 Processor -- start 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.245+0000 7f1525410800 1 -- start start 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.245+0000 7f1525410800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36926160 0x55cb36926580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.245+0000 7f1525410800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb366b2e80 con 0x55cb36926160 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.246+0000 7f15201f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36926160 0x55cb36926580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.246+0000 7f15201f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36926160 0x55cb36926580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57856/0 (socket says 172.21.15.133:57856) 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.246+0000 7f15201f2640 1 -- 172.21.15.133:0/1313094459 learned_addr learned my addr 172.21.15.133:0/1313094459 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.246+0000 7f15201f2640 1 -- 172.21.15.133:0/1313094459 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb36926ac0 con 0x55cb36926160 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.247+0000 7f15201f2640 1 --2- 172.21.15.133:0/1313094459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36926160 0x55cb36926580 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f15080446d0 tx=0x7f1508002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.247+0000 7f14067fc640 1 -- 172.21.15.133:0/1313094459 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f150805c540 con 0x55cb36926160 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.247+0000 7f14067fc640 1 -- 172.21.15.133:0/1313094459 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150805c6a0 con 0x55cb36926160 2024-02-15T22:56:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.247+0000 7f1525410800 1 -- 172.21.15.133:0/1313094459 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cb36926cb0 con 0x55cb36926160 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.247+0000 7f14067fc640 1 -- 172.21.15.133:0/1313094459 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f150805c940 con 0x55cb36926160 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.247+0000 7f1525410800 1 -- 172.21.15.133:0/1313094459 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb36927800 con 0x55cb36926160 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.247+0000 7f14067fc640 1 -- 172.21.15.133:0/1313094459 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f150805ccb0 con 0x55cb36926160 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.248+0000 7f14067fc640 1 --2- 172.21.15.133:0/1313094459 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f13f80367e0 0x7f13f8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.248+0000 7f14067fc640 1 -- 172.21.15.133:0/1313094459 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f150808efe0 con 0x55cb36926160 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.248+0000 7f15211f4640 1 --2- 172.21.15.133:0/1313094459 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f13f80367e0 0x7f13f8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.248+0000 7f1525410800 1 Processor -- start 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.248+0000 7f15211f4640 1 --2- 172.21.15.133:0/1313094459 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f13f80367e0 0x7f13f8038ca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55cb36916480 tx=0x7f1518000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.248+0000 7f1525410800 1 -- start start 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.248+0000 7f1525410800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb36933770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.248+0000 7f1525410800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb366885d0 con 0x55cb36933350 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.248+0000 7f15201f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb36933770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.248+0000 7f15201f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb36933770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57866/0 (socket says 172.21.15.133:57866) 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.248+0000 7f15201f2640 1 -- 172.21.15.133:0/401006801 learned_addr learned my addr 172.21.15.133:0/401006801 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f15201f2640 1 -- 172.21.15.133:0/401006801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb36933d40 con 0x55cb36933350 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f15201f2640 1 --2- 172.21.15.133:0/401006801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb36933770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f150808d4e0 tx=0x7f1508067490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d48d106ba08c36 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f13f7fff640 1 -- 172.21.15.133:0/401006801 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1508071ca0 con 0x55cb36933350 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f13f7fff640 1 -- 172.21.15.133:0/401006801 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1508071e00 con 0x55cb36933350 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f13f7fff640 1 -- 172.21.15.133:0/401006801 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15080043d0 con 0x55cb36933350 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f1525410800 1 -- 172.21.15.133:0/401006801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 msgr2=0x55cb36933770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f1525410800 1 --2- 172.21.15.133:0/401006801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb36933770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f150808d4e0 tx=0x7f1508067490 comp rx=0 tx=0).stop 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f1525410800 1 -- 172.21.15.133:0/401006801 shutdown_connections 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f1525410800 1 --2- 172.21.15.133:0/401006801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb36933770 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f1525410800 1 -- 172.21.15.133:0/401006801 >> 172.21.15.133:0/401006801 conn(0x55cb3692f6b0 msgr2=0x55cb3692d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f1525410800 1 -- 172.21.15.133:0/401006801 shutdown_connections 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.249+0000 7f1525410800 1 -- 172.21.15.133:0/401006801 wait complete. 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.250+0000 7f1525410800 1 Processor -- start 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.250+0000 7f1525410800 1 -- start start 2024-02-15T22:56:26.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.250+0000 7f1525410800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb3693a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.250+0000 7f1525410800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3693a8c0 con 0x55cb36933350 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.250+0000 7f15201f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb3693a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.250+0000 7f15201f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb3693a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57870/0 (socket says 172.21.15.133:57870) 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.250+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 learned_addr learned my addr 172.21.15.133:0/2682497812 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.250+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb36927800 con 0x55cb36933350 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.251+0000 7f15201f2640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb3693a380 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1508067930 tx=0x7f150808d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.251+0000 7f13f67fc640 1 -- 172.21.15.133:0/2682497812 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1508071400 con 0x55cb36933350 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.251+0000 7f13f67fc640 1 -- 172.21.15.133:0/2682497812 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1508071560 con 0x55cb36933350 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.251+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cb3693aac0 con 0x55cb36933350 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.251+0000 7f13f67fc640 1 -- 172.21.15.133:0/2682497812 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1508071880 con 0x55cb36933350 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.251+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb3693aac0 con 0x55cb36933350 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.251+0000 7f13f67fc640 1 -- 172.21.15.133:0/2682497812 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1508082050 con 0x55cb36933350 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.252+0000 7f13f67fc640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f13ec0367e0 0x7f13ec038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.252+0000 7f13f67fc640 1 -- 172.21.15.133:0/2682497812 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f1508094b20 con 0x55cb36933350 2024-02-15T22:56:26.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.252+0000 7f15211f4640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f13ec0367e0 0x7f13ec038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.252+0000 7f15211f4640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f13ec0367e0 0x7f13ec038ca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55cb36916540 tx=0x7f151800c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.252+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.252+0000 7f1525410800 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cb36945d80 0x55cb36948240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.252+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36948990 con 0x55cb36945d80 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.252+0000 7f15209f3640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cb36945d80 0x55cb36948240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.252+0000 7f15209f3640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cb36945d80 0x55cb36948240 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1510024070 con 0x55cb36945d80 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 20 realm 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36948d60 con 0x55cb36945d80 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1510024070 con 0x55cb36945d80 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb369495e0 con 0x55cb36945d80 2024-02-15T22:56:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1510024070 con 0x55cb36945d80 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36949940 con 0x55cb36945d80 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1510024070 con 0x55cb36945d80 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.253+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694a140 con 0x55cb36945d80 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.254+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1510024070 con 0x55cb36945d80 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.254+0000 7f1525410800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.254+0000 7f1525410800 20 searching for the correct realm 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.254+0000 7f1525410800 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55cb3694c060 0x55cb3694e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.254+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb3694c060 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.254+0000 7f15201f2640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55cb3694c060 0x55cb3694e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.254+0000 7f15201f2640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55cb3694c060 0x55cb3694e520 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.255+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.255+0000 7f15201f2640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1508057c20 0x7f150807e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.255+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1508057c20 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.255+0000 7f15211f4640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1508057c20 0x7f150807e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.255+0000 7f15211f4640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1508057c20 0x7f150807e120 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.255+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f151802c040 con 0x7f1508057c20 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.255+0000 7f15211f4640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f1518027940 0x7f15180333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.255+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1518027940 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.255+0000 7f15209f3640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f1518027940 0x7f15180333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.256+0000 7f15209f3640 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f1518027940 0x7f15180333c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.256+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1510024070 con 0x7f1518027940 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.256+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb36945d80 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.256+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1510024070 con 0x55cb36945d80 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.256+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb36945d80 2024-02-15T22:56:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.256+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1510024070 con 0x55cb36945d80 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.256+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1518027940 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.257+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1510024070 con 0x7f1518027940 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.257+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1518027940 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.257+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1510024070 con 0x7f1518027940 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.257+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1508057c20 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.257+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f151802c040 con 0x7f1508057c20 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.257+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb3694c060 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.257+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.257+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb36945d80 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.258+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1510024070 con 0x55cb36945d80 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.258+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1518027940 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.258+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1510024070 con 0x7f1518027940 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.258+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb36945d80 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.258+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1510024070 con 0x55cb36945d80 2024-02-15T22:56:26.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.258+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1508057c20 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.258+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f151802c040 con 0x7f1508057c20 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.258+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb3694c060 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.259+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.259+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb3694c060 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.259+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.259+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1518027940 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.259+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1510024070 con 0x7f1518027940 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.259+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb3694c060 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.259+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.259+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb3694c060 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.260+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.260+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb36945d80 2024-02-15T22:56:26.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.260+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1510024070 con 0x55cb36945d80 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.260+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb36945d80 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.260+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1510024070 con 0x55cb36945d80 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.260+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1518027940 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.261+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.261+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb3694c060 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.261+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.261+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1508057c20 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.261+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f151802c040 con 0x7f1508057c20 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.261+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb36945d80 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.261+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.261+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1518027940 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.262+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.262+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb3694c060 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.262+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.262+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1518027940 2024-02-15T22:56:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.262+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.262+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1508057c20 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.262+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f151802c040 con 0x7f1508057c20 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.262+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb3694c060 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1518027940 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x55cb36945d80 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ebf0 con 0x7f1508057c20 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f151802c040 con 0x7f1508057c20 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f1525410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f1525410800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f1525410800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f1525410800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f1525410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f1525410800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.263+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694b670 con 0x55cb36945d80 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694ae90 con 0x55cb36945d80 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694f030 con 0x55cb36945d80 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 20 zone default found 2024-02-15T22:56:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 4 Realm: () 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 20 zonegroup default 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.264+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694f390 con 0x7f1518027940 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f1525410800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36951210 con 0x55cb3694c060 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f1525410800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36951570 con 0x55cb3694c060 2024-02-15T22:56:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f1525410800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f1525410800 20 started sync module instance, tier type = 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f1525410800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.265+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb369507e0 con 0x7f1508057c20 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.266+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151803f040 con 0x7f1508057c20 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.266+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94331282459888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb369507e0 con 0x7f1508057c20 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.266+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36951fe0 con 0x55cb36945d80 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.267+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94331282459888] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151803f040 con 0x7f1508057c20 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.267+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.267+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94331282463424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb369507e0 con 0x55cb36945d80 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.267+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36952ac0 con 0x55cb3694c060 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.269+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94331282463424] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.269+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.269+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94331282457408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36950760 con 0x55cb3694c060 2024-02-15T22:56:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.269+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36953920 con 0x7f1508057c20 2024-02-15T22:56:26.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.270+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151803f040 con 0x7f1508057c20 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.270+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94331282470496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb369540e0 con 0x7f1508057c20 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.270+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94331282457408] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.270+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36954bb0 con 0x55cb36945d80 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.271+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.271+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94331282474640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36954b70 con 0x55cb36945d80 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.271+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb369555e0 con 0x7f1518027940 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.271+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94331282470496] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151803f040 con 0x7f1508057c20 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.272+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.272+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94331282471744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb369555a0 con 0x7f1518027940 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.272+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36955fc0 con 0x7f1518027940 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.272+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94331282474640] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.273+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94331282471744] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.273+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.273+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94331282479776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36955100 con 0x7f1518027940 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.273+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36956640 con 0x7f1518027940 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.274+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94331282479776] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.274+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.274+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94331282468464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36956640 con 0x7f1518027940 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.274+0000 7f1525410800 20 add_watcher() i=0 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.274+0000 7f1525410800 20 add_watcher() i=1 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.274+0000 7f1525410800 20 add_watcher() i=2 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.274+0000 7f1525410800 20 add_watcher() i=3 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.274+0000 7f1525410800 20 add_watcher() i=4 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.274+0000 7f1525410800 20 add_watcher() i=5 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.274+0000 7f1525410800 20 add_watcher() i=6 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.275+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94331282468464] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.275+0000 7f1525410800 20 add_watcher() i=7 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.275+0000 7f1525410800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.275+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36959970 con 0x55cb36945d80 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.275+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.275+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94331282494368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36956640 con 0x55cb36945d80 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.276+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94331282494368] v30'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.276+0000 7f13d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.276+0000 7f1525410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.276+0000 7f1525410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.276+0000 7f1525410800 5 note: GC not initialized 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f13d5fe3640 20 reqs_thread_entry: start 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f1525410800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f1525410800 20 Filter name: none 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f13477fe640 20 reqs_thread_entry: start 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f1525410800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f1525410800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3698b930 con 0x55cb36945d80 2024-02-15T22:56:26.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~624 out=624b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+747 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f1525410800 20 rados_obj.operate() r=0 bl.length=624 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f1525410800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f1525410800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f1525410800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.277+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~541 in=541b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36991fc0 con 0x55cb36945d80 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~541] v30'9 uv9 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f1525410800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f1525410800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f1525410800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94331282725536 in=729b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3698d790 con 0x55cb36945d80 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 94331282474640 notify 128849018888 ret 0) v3 ==== 759+0+0 (crc 0 0 0) 0x55cb36813e20 con 0x55cb36945d80 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f13f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94331282474640 notifier 4397 bl.length()=717 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f13f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f13f7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f13f7fff640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f13e4003e90 con 0x55cb36945d80 2024-02-15T22:56:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(64 notify.4 [notify cookie 94331282725536 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== watch-notify(notify_complete (2) cookie 94331282725536 notify 128849018888 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f151002c070 con 0x55cb36945d80 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f1525410800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.279+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94331282725536 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3698d2f0 con 0x7f1508057c20 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.280+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== watch-notify(notify (1) cookie 94331282459888 notify 128849018884 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7f151801a970 con 0x7f1508057c20 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.280+0000 7f13f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94331282459888 notifier 4397 bl.length()=159 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.280+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(66 notify.0 [notify cookie 94331282725536 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f151803f040 con 0x7f1508057c20 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.280+0000 7f13f77fe640 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f13540032b0 con 0x7f1508057c20 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.280+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151803f040 con 0x7f1508057c20 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.280+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== watch-notify(notify_complete (2) cookie 94331282725536 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f151801abd0 con 0x7f1508057c20 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.280+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36991aa0 con 0x55cb36945d80 2024-02-15T22:56:26.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.281+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(68 foo:foo1 [delete] v30'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.293 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.282+0000 7f13d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.282+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94331282494368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3698d760 con 0x55cb36945d80 2024-02-15T22:56:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.283+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94331282494368] v30'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.283+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94331282459888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3698d710 con 0x7f1508057c20 2024-02-15T22:56:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.283+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94331282459888] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151803f040 con 0x7f1508057c20 2024-02-15T22:56:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.284+0000 7f1525410800 20 remove_watcher() i=0 2024-02-15T22:56:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.284+0000 7f1525410800 2 removed watcher, disabling cache 2024-02-15T22:56:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.284+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94331282463424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694f030 con 0x55cb36945d80 2024-02-15T22:56:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.284+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94331282463424] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.285+0000 7f1525410800 20 remove_watcher() i=1 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.285+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94331282457408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3694f030 con 0x55cb3694c060 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.286+0000 7f15201f2640 1 -- 172.21.15.133:0/2682497812 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94331282457408] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1508094d80 con 0x55cb3694c060 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.286+0000 7f1525410800 20 remove_watcher() i=2 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.286+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94331282470496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3698d710 con 0x7f1508057c20 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.286+0000 7f15211f4640 1 -- 172.21.15.133:0/2682497812 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94331282470496] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151803f040 con 0x7f1508057c20 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.286+0000 7f1525410800 20 remove_watcher() i=3 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.286+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94331282474640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb3698d710 con 0x55cb36945d80 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.287+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94331282474640] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x55cb36945d80 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.287+0000 7f1525410800 20 remove_watcher() i=4 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.287+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94331282471744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36954690 con 0x7f1518027940 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.288+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94331282471744] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.288+0000 7f1525410800 20 remove_watcher() i=5 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.288+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94331282479776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36954690 con 0x7f1518027940 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.289+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94331282479776] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.289+0000 7f1525410800 20 remove_watcher() i=6 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.289+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94331282468464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55cb36955aa0 con 0x7f1518027940 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94331282468464] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f151005b040 con 0x7f1518027940 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 20 remove_watcher() i=7 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f1518027940 msgr2=0x7f15180333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f1518027940 0x7f15180333c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cb36945d80 msgr2=0x55cb36948240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cb36945d80 0x55cb36948240 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1508057c20 msgr2=0x7f150807e120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1508057c20 0x7f150807e120 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55cb3694c060 msgr2=0x55cb3694e520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55cb3694c060 0x55cb3694e520 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f13ec0367e0 msgr2=0x7f13ec038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f13ec0367e0 0x7f13ec038ca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55cb36916540 tx=0x7f151800c040 comp rx=0 tx=0).stop 2024-02-15T22:56:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 msgr2=0x55cb3693a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f15209f3640 1 -- 172.21.15.133:0/2682497812 reap_dead start 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb3693a380 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1508067930 tx=0x7f150808d470 comp rx=0 tx=0).stop 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 shutdown_connections 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 --2- 172.21.15.133:0/2682497812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36933350 0x55cb3693a380 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.290+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 >> 172.21.15.133:0/2682497812 conn(0x55cb3692f6b0 msgr2=0x55cb3692cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 shutdown_connections 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/2682497812 wait complete. 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/1313094459 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f13f80367e0 msgr2=0x7f13f8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 --2- 172.21.15.133:0/1313094459 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f13f80367e0 0x7f13f8038ca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55cb36916480 tx=0x7f1518000f90 comp rx=0 tx=0).stop 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/1313094459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36926160 msgr2=0x55cb36926580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 --2- 172.21.15.133:0/1313094459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36926160 0x55cb36926580 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f15080446d0 tx=0x7f1508002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/1313094459 shutdown_connections 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 --2- 172.21.15.133:0/1313094459 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f13f80367e0 0x7f13f8038ca0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 --2- 172.21.15.133:0/1313094459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36926160 0x55cb36926580 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/1313094459 >> 172.21.15.133:0/1313094459 conn(0x55cb3691a200 msgr2=0x55cb3691a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/1313094459 shutdown_connections 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/1313094459 wait complete. 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cb368195b0 msgr2=0x55cb36915850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cb368195b0 0x55cb36915850 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14080367e0 msgr2=0x7f1408038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14080367e0 0x7f1408038ca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1508054000 tx=0x7f150804e000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 msgr2=0x55cb36815390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36815390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1510006dd0 tx=0x7f1510000f40 comp rx=0 tx=0).stop 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 shutdown_connections 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cb368195b0 0x55cb36915850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f14080367e0 0x7f1408038ca0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 --2- 172.21.15.133:0/157153258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb36815aa0 0x55cb36815390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 >> 172.21.15.133:0/157153258 conn(0x55cb3680f4f0 msgr2=0x55cb368fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 shutdown_connections 2024-02-15T22:56:26.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.291+0000 7f1525410800 1 -- 172.21.15.133:0/157153258 wait complete. 2024-02-15T22:56:26.303 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:26.303 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-15T22:56:26.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-15T22:56:26.304 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-02-15T22:56:26.346 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:26.347 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:26.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.345+0000 7fc2c6d20800 1 Processor -- start 2024-02-15T22:56:26.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.345+0000 7fc2c6d20800 1 -- start start 2024-02-15T22:56:26.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.345+0000 7fc2c6d20800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56479d1d7a80 0x56479d1d9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.345+0000 7fc2c6d20800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56479d121bb0 con 0x56479d1da3b0 2024-02-15T22:56:26.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.345+0000 7fc2c6d20800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x56479d0d9450 con 0x56479d1d7a80 2024-02-15T22:56:26.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.345+0000 7fc2c2a84640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56479d1d7a80 0x56479d1d9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.345+0000 7fc2c2283640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x56479d1da3b0 0x56479d1dc7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44966/0 (socket says 172.21.15.133:44966) 2024-02-15T22:56:26.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.345+0000 7fc2c2283640 1 -- 172.21.15.133:0/564376082 learned_addr learned my addr 172.21.15.133:0/564376082 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:26.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.346+0000 7fc2c2a84640 1 -- 172.21.15.133:0/564376082 >> v1:172.21.15.52:6789/0 conn(0x56479d1da3b0 legacy=0x56479d1dc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.346+0000 7fc2c1a82640 1 -- 172.21.15.133:0/564376082 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810160269 0 0) 0x56479d121bb0 con 0x56479d1da3b0 2024-02-15T22:56:26.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.346+0000 7fc2c2a84640 1 -- 172.21.15.133:0/564376082 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56479d1deed0 con 0x56479d1d7a80 2024-02-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.347+0000 7fc2c2a84640 1 --2- 172.21.15.133:0/564376082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d1d9e70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400a470 tx=0x7fc2b401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abb1d557a199849 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.347+0000 7fc2c1a82640 1 -- 172.21.15.133:0/564376082 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b4052570 con 0x56479d1d7a80 2024-02-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.347+0000 7fc2c1a82640 1 -- 172.21.15.133:0/564376082 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b40526d0 con 0x56479d1d7a80 2024-02-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.348+0000 7fc2c1a82640 1 -- 172.21.15.133:0/564376082 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b4052990 con 0x56479d1d7a80 2024-02-15T22:56:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.348+0000 7fc2c6d20800 1 -- 172.21.15.133:0/564376082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 msgr2=0x56479d1d9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.348+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/564376082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d1d9e70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400a470 tx=0x7fc2b401cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.348+0000 7fc2c6d20800 1 -- 172.21.15.133:0/564376082 shutdown_connections 2024-02-15T22:56:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.348+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/564376082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d1d9e70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.348+0000 7fc2c6d20800 1 -- 172.21.15.133:0/564376082 >> 172.21.15.133:0/564376082 conn(0x56479d1d14d0 msgr2=0x56479d1d38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.348+0000 7fc2c6d20800 1 -- 172.21.15.133:0/564376082 shutdown_connections 2024-02-15T22:56:26.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.348+0000 7fc2c6d20800 1 -- 172.21.15.133:0/564376082 wait complete. 2024-02-15T22:56:26.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.360+0000 7fc2c6d20800 1 Processor -- start 2024-02-15T22:56:26.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.360+0000 7fc2c6d20800 1 -- start start 2024-02-15T22:56:26.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.360+0000 7fc2c6d20800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d2c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.360+0000 7fc2c6d20800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56479d0d6980 con 0x56479d1d7a80 2024-02-15T22:56:26.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.360+0000 7fc2c2a84640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d2c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.360+0000 7fc2c2a84640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d2c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57894/0 (socket says 172.21.15.133:57894) 2024-02-15T22:56:26.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.360+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3747678000 learned_addr learned my addr 172.21.15.133:0/3747678000 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.361+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3747678000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b4005d20 con 0x56479d1d7a80 2024-02-15T22:56:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.361+0000 7fc2c2a84640 1 --2- 172.21.15.133:0/3747678000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d2c6ed0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4055040 tx=0x7fc2b404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc2addc19413924 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.361+0000 7fc1b0e09640 1 -- 172.21.15.133:0/3747678000 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b400a170 con 0x56479d1d7a80 2024-02-15T22:56:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.361+0000 7fc1b0e09640 1 -- 172.21.15.133:0/3747678000 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b400a2d0 con 0x56479d1d7a80 2024-02-15T22:56:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.361+0000 7fc1b0e09640 1 -- 172.21.15.133:0/3747678000 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b4052990 con 0x56479d1d7a80 2024-02-15T22:56:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.362+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3747678000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 msgr2=0x56479d2c6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.362+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/3747678000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d2c6ed0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4055040 tx=0x7fc2b404c000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.362+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3747678000 shutdown_connections 2024-02-15T22:56:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.362+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/3747678000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d2c6ed0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.362+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3747678000 >> 172.21.15.133:0/3747678000 conn(0x56479d1d14d0 msgr2=0x56479d2c26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.362+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3747678000 shutdown_connections 2024-02-15T22:56:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.362+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3747678000 wait complete. 2024-02-15T22:56:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.362+0000 7fc2c6d20800 1 Processor -- start 2024-02-15T22:56:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.362+0000 7fc2c6d20800 1 -- start start 2024-02-15T22:56:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.362+0000 7fc2c6d20800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d1d73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.362+0000 7fc2c6d20800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56479d0d2160 con 0x56479d1d7a80 2024-02-15T22:56:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.363+0000 7fc2c2a84640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d1d73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.363+0000 7fc2c2a84640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d1d73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57896/0 (socket says 172.21.15.133:57896) 2024-02-15T22:56:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.363+0000 7fc2c2a84640 1 -- 172.21.15.133:0/2972118401 learned_addr learned my addr 172.21.15.133:0/2972118401 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.363+0000 7fc2c2a84640 1 -- 172.21.15.133:0/2972118401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56479d1deed0 con 0x56479d1d7a80 2024-02-15T22:56:26.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.363+0000 7fc2c2a84640 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d1d73c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4000c00 tx=0x7fc2b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.363+0000 7fc1af606640 1 -- 172.21.15.133:0/2972118401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b4068780 con 0x56479d1d7a80 2024-02-15T22:56:26.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.363+0000 7fc1af606640 1 -- 172.21.15.133:0/2972118401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b4068900 con 0x56479d1d7a80 2024-02-15T22:56:26.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.363+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56479d1d5ab0 con 0x56479d1d7a80 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.363+0000 7fc1af606640 1 -- 172.21.15.133:0/2972118401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b4068be0 con 0x56479d1d7a80 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.363+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56479d1d5ff0 con 0x56479d1d7a80 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.364+0000 7fc1af606640 1 -- 172.21.15.133:0/2972118401 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc2b4068d40 con 0x56479d1d7a80 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.364+0000 7fc1af606640 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc1a80367e0 0x7fc1a8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.364+0000 7fc1af606640 1 -- 172.21.15.133:0/2972118401 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fc2b408df70 con 0x56479d1d7a80 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.364+0000 7fc2c2283640 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc1a80367e0 0x7fc1a8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.364+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56479d1da3b0 0x56479d2d7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.364+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d1d6790 con 0x56479d1da3b0 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.365+0000 7fc2c3285640 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56479d1da3b0 0x56479d2d7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.365+0000 7fc2c2283640 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc1a80367e0 0x7fc1a8038ca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8000c00 tx=0x7fc2b80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.365+0000 7fc2c3285640 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56479d1da3b0 0x56479d2d7640 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.365+0000 7fc2c3285640 1 -- 172.21.15.133:0/2972118401 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2bc00a4a0 con 0x56479d1da3b0 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.365+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d1d6300 con 0x56479d1da3b0 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.365+0000 7fc2c3285640 1 -- 172.21.15.133:0/2972118401 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc2bc00a4a0 con 0x56479d1da3b0 2024-02-15T22:56:26.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.366+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d2d9520 con 0x56479d1da3b0 2024-02-15T22:56:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.366+0000 7fc2c3285640 1 -- 172.21.15.133:0/2972118401 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc2bc00a4a0 con 0x56479d1da3b0 2024-02-15T22:56:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.366+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d2d8770 con 0x56479d1da3b0 2024-02-15T22:56:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.366+0000 7fc2c3285640 1 -- 172.21.15.133:0/2972118401 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc2bc00a4a0 con 0x56479d1da3b0 2024-02-15T22:56:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.366+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d2d8b80 con 0x56479d1da3b0 2024-02-15T22:56:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.366+0000 7fc2c3285640 1 -- 172.21.15.133:0/2972118401 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc2bc00a4a0 con 0x56479d1da3b0 2024-02-15T22:56:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.367+0000 7fc2c6d20800 1 Processor -- start 2024-02-15T22:56:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.367+0000 7fc2c6d20800 1 -- start start 2024-02-15T22:56:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.367+0000 7fc2c6d20800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2e7f60 0x56479d2e8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.367+0000 7fc2c6d20800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56479d074e80 con 0x56479d2e7f60 2024-02-15T22:56:26.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.367+0000 7fc2c2283640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2e7f60 0x56479d2e8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.367+0000 7fc2c2283640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2e7f60 0x56479d2e8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57908/0 (socket says 172.21.15.133:57908) 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.367+0000 7fc2c2283640 1 -- 172.21.15.133:0/2076553722 learned_addr learned my addr 172.21.15.133:0/2076553722 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.368+0000 7fc2c2283640 1 -- 172.21.15.133:0/2076553722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56479d2e88c0 con 0x56479d2e7f60 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.368+0000 7fc2c2283640 1 --2- 172.21.15.133:0/2076553722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2e7f60 0x56479d2e8380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800e610 tx=0x7fc2b800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.368+0000 7fc1ace01640 1 -- 172.21.15.133:0/2076553722 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b800bea0 con 0x56479d2e7f60 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.368+0000 7fc1ace01640 1 -- 172.21.15.133:0/2076553722 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b800d500 con 0x56479d2e7f60 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.368+0000 7fc1ace01640 1 -- 172.21.15.133:0/2076553722 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b800d7a0 con 0x56479d2e7f60 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.368+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2076553722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56479d2e9330 con 0x56479d2e7f60 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.368+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2076553722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56479d2e97f0 con 0x56479d2e7f60 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.369+0000 7fc1ace01640 1 -- 172.21.15.133:0/2076553722 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc2b801a070 con 0x56479d2e7f60 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.369+0000 7fc1ace01640 1 --2- 172.21.15.133:0/2076553722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc19c0367e0 0x7fc19c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.369+0000 7fc1ace01640 1 -- 172.21.15.133:0/2076553722 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fc2b8017050 con 0x56479d2e7f60 2024-02-15T22:56:26.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.369+0000 7fc2c3285640 1 --2- 172.21.15.133:0/2076553722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc19c0367e0 0x7fc19c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.369+0000 7fc2c6d20800 1 Processor -- start 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.369+0000 7fc2c6d20800 1 -- start start 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.369+0000 7fc2c3285640 1 --2- 172.21.15.133:0/2076553722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc19c0367e0 0x7fc19c038ca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x56479d2d81b0 tx=0x7fc2bc005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.370+0000 7fc2c6d20800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.370+0000 7fc2c6d20800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56479d04a5d0 con 0x56479d2f51c0 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.370+0000 7fc2c2283640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.370+0000 7fc2c2283640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57914/0 (socket says 172.21.15.133:57914) 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.370+0000 7fc2c2283640 1 -- 172.21.15.133:0/4032691272 learned_addr learned my addr 172.21.15.133:0/4032691272 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.370+0000 7fc2c2283640 1 -- 172.21.15.133:0/4032691272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56479d2f5bb0 con 0x56479d2f51c0 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.370+0000 7fc2c2283640 1 --2- 172.21.15.133:0/4032691272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2f55e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc2b804b9d0 tx=0x7fc2b804bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f56ac0ba918a3bd server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.370+0000 7fc1a67fc640 1 -- 172.21.15.133:0/4032691272 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b801a530 con 0x56479d2f51c0 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.370+0000 7fc1a67fc640 1 -- 172.21.15.133:0/4032691272 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b804d0d0 con 0x56479d2f51c0 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.370+0000 7fc1a67fc640 1 -- 172.21.15.133:0/4032691272 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b801ac40 con 0x56479d2f51c0 2024-02-15T22:56:26.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c6d20800 1 -- 172.21.15.133:0/4032691272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 msgr2=0x56479d2f55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/4032691272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2f55e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc2b804b9d0 tx=0x7fc2b804bc50 comp rx=0 tx=0).stop 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c6d20800 1 -- 172.21.15.133:0/4032691272 shutdown_connections 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/4032691272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2f55e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c6d20800 1 -- 172.21.15.133:0/4032691272 >> 172.21.15.133:0/4032691272 conn(0x56479d2f14e0 msgr2=0x56479d2ef540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c6d20800 1 -- 172.21.15.133:0/4032691272 shutdown_connections 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c6d20800 1 -- 172.21.15.133:0/4032691272 wait complete. 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c6d20800 1 Processor -- start 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c6d20800 1 -- start start 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c6d20800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2fc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c6d20800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56479d2fc760 con 0x56479d2f51c0 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.371+0000 7fc2c2283640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2fc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.372+0000 7fc2c2283640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2fc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57924/0 (socket says 172.21.15.133:57924) 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.372+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 learned_addr learned my addr 172.21.15.133:0/3855443722 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.372+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56479d2e97f0 con 0x56479d2f51c0 2024-02-15T22:56:26.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.372+0000 7fc2c2283640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2fc220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8048040 tx=0x7fc2b804b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.372+0000 7fc1a4ff9640 1 -- 172.21.15.133:0/3855443722 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b80242c0 con 0x56479d2f51c0 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.372+0000 7fc1a4ff9640 1 -- 172.21.15.133:0/3855443722 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b8024680 con 0x56479d2f51c0 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.372+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56479d2fc960 con 0x56479d2f51c0 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.372+0000 7fc1a4ff9640 1 -- 172.21.15.133:0/3855443722 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b801a7e0 con 0x56479d2f51c0 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.372+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56479d2fce20 con 0x56479d2f51c0 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.373+0000 7fc1a4ff9640 1 -- 172.21.15.133:0/3855443722 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc2b800d040 con 0x56479d2f51c0 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.373+0000 7fc1a4ff9640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc18c036740 0x7fc18c038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.373+0000 7fc1a4ff9640 1 -- 172.21.15.133:0/3855443722 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fc2b800a040 con 0x56479d2f51c0 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.373+0000 7fc2c3285640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc18c036740 0x7fc18c038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.373+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.373+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56479d308030 0x56479d30a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.373+0000 7fc2c3285640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc18c036740 0x7fc18c038c00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00b010 tx=0x7fc2bc020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.373+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d30ac40 con 0x56479d308030 2024-02-15T22:56:26.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c2a84640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56479d308030 0x56479d30a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c2a84640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56479d308030 0x56479d30a4f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c6d20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c6d20800 20 realm 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d30b010 con 0x56479d308030 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c6d20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c6d20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d30b890 con 0x56479d308030 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c6d20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.374+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d30bbf0 con 0x56479d308030 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.375+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.375+0000 7fc2c6d20800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.375+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.375+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d30c3f0 con 0x56479d308030 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.375+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.375+0000 7fc2c6d20800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.375+0000 7fc2c6d20800 20 searching for the correct realm 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.375+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x56479d30e310 0x56479d3107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.375+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d30e310 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.375+0000 7fc2c2283640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x56479d30e310 0x56479d3107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.375+0000 7fc2c2283640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x56479d30e310 0x56479d3107d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.376+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.376+0000 7fc2c2283640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fc2b8027060 0x7fc2b803a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.376+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2b8027060 2024-02-15T22:56:26.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.376+0000 7fc2c3285640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fc2b8027060 0x7fc2b803a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.376+0000 7fc2c3285640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fc2b8027060 0x7fc2b803a4e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.376+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2bc00a4a0 con 0x7fc2b8027060 2024-02-15T22:56:26.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.376+0000 7fc2c3285640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fc2bc0141d0 0x7fc2bc015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.376+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.377+0000 7fc2c2a84640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fc2bc0141d0 0x7fc2bc015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.377+0000 7fc2c2a84640 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fc2bc0141d0 0x7fc2bc015940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.377+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b4063070 con 0x7fc2bc0141d0 2024-02-15T22:56:26.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.377+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d308030 2024-02-15T22:56:26.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.378+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.378+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d308030 2024-02-15T22:56:26.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.378+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.378+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.378+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b4063070 con 0x7fc2bc0141d0 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.378+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.378+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b4063070 con 0x7fc2bc0141d0 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.378+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2b8027060 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.378+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2bc00a4a0 con 0x7fc2b8027060 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.379+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d30e310 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.379+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.379+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d308030 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.379+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.379+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.379+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b4063070 con 0x7fc2bc0141d0 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.379+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d308030 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.379+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.379+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2b8027060 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.380+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc2bc03a040 con 0x7fc2b8027060 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.380+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d30e310 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.380+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.380+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d30e310 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.380+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.380+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.381+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b4063070 con 0x7fc2bc0141d0 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.381+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d30e310 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.381+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.381+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d30e310 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.381+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.381+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d308030 2024-02-15T22:56:26.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.381+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.381+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d308030 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.382+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.382+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.382+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b4063070 con 0x7fc2bc0141d0 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.382+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d30e310 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.382+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.382+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2b8027060 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.382+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2bc03a040 con 0x7fc2b8027060 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.382+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d308030 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.383+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc2b4063070 con 0x56479d308030 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.383+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.383+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.383+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d30e310 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.383+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.383+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.384+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.384+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2b8027060 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.384+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2bc03a040 con 0x7fc2b8027060 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.384+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d30e310 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.384+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.384+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x56479d308030 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d310ea0 con 0x7fc2b8027060 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2bc03a040 con 0x7fc2b8027060 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c6d20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:26.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c6d20800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c6d20800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c6d20800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c6d20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c6d20800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d30d920 con 0x56479d308030 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c6d20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.385+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d30d140 con 0x56479d308030 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d3112e0 con 0x56479d308030 2024-02-15T22:56:26.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 20 zone default found 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 4 Realm: () 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 20 zonegroup default 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d311640 con 0x7fc2bc0141d0 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d3134c0 con 0x56479d30e310 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.386+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d313820 con 0x56479d30e310 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.387+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.387+0000 7fc2c6d20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.387+0000 7fc2c6d20800 20 started sync module instance, tier type = 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.387+0000 7fc2c6d20800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.387+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d312a90 con 0x7fc2b8027060 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.388+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2bc03a040 con 0x7fc2b8027060 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.388+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94865579913040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d312a90 con 0x7fc2b8027060 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.388+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d314290 con 0x56479d308030 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.389+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94865579913040] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2bc03a040 con 0x7fc2b8027060 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.389+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.389+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94865579916656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d312a90 con 0x56479d308030 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.389+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d314d30 con 0x56479d30e310 2024-02-15T22:56:26.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.390+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.390+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94865579919376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d315580 con 0x56479d30e310 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.390+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d316030 con 0x7fc2b8027060 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.390+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94865579916656] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.391+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94865579919376] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.391+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2bc03a040 con 0x7fc2b8027060 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.392+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94865579921632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d3125f0 con 0x7fc2b8027060 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.392+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d3169f0 con 0x56479d308030 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.392+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94865579921632] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2bc03a040 con 0x7fc2b8027060 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.393+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.393+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94865579924272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d3169f0 con 0x56479d308030 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.393+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d317360 con 0x7fc2bc0141d0 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.394+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.394+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94865579924272] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.394+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94865579929280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d3172e0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.394+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d316590 con 0x7fc2bc0141d0 2024-02-15T22:56:26.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.395+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94865579929280] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.395+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.395+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94865579926928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d317d80 con 0x7fc2bc0141d0 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.395+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d318750 con 0x7fc2bc0141d0 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.396+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.396+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94865579934288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d318bb0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.396+0000 7fc2c6d20800 20 add_watcher() i=0 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.396+0000 7fc2c6d20800 20 add_watcher() i=1 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.396+0000 7fc2c6d20800 20 add_watcher() i=2 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.396+0000 7fc2c6d20800 20 add_watcher() i=3 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.396+0000 7fc2c6d20800 20 add_watcher() i=4 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.396+0000 7fc2c6d20800 20 add_watcher() i=5 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.396+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94865579926928] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.396+0000 7fc2c6d20800 20 add_watcher() i=6 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.397+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94865579934288] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.397+0000 7fc2c6d20800 20 add_watcher() i=7 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.397+0000 7fc2c6d20800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:26.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.397+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d318bb0 con 0x56479d308030 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.397+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.397+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94865579935504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d319520 con 0x56479d308030 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.398+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94865579935504] v30'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.398+0000 7fc1797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.398+0000 7fc2c6d20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.398+0000 7fc2c6d20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.398+0000 7fc2c6d20800 5 note: GC not initialized 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.398+0000 7fc0f3fff640 20 reqs_thread_entry: start 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.398+0000 7fc2c6d20800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.399+0000 7fc2c6d20800 20 Filter name: none 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.399+0000 7fc0f1ffb640 20 reqs_thread_entry: start 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.399+0000 7fc2c6d20800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.399+0000 7fc2c6d20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.399+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d34dc20 con 0x56479d308030 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.399+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~541 out=541b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+664 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.399+0000 7fc2c6d20800 20 rados_obj.operate() r=0 bl.length=541 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.399+0000 7fc2c6d20800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.399+0000 7fc2c6d20800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.399+0000 7fc2c6d20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.399+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d354060 con 0x56479d308030 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.400+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~515] v30'10 uv10 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.400+0000 7fc2c6d20800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.400+0000 7fc2c6d20800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.400+0000 7fc2c6d20800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.400+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94865580178272 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d34f770 con 0x56479d308030 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.401+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 94865579924272 notify 128849018889 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x56479d1d5ff0 con 0x56479d308030 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.401+0000 7fc1a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94865579924272 notifier 4404 bl.length()=691 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.401+0000 7fc1a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.401+0000 7fc1a67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.401+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(64 notify.4 [notify cookie 94865580178272 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.401+0000 7fc1a67fc640 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc188003e90 con 0x56479d308030 2024-02-15T22:56:26.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.401+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.401+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== watch-notify(notify_complete (2) cookie 94865580178272 notify 128849018889 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56479d1d5ab0 con 0x56479d308030 2024-02-15T22:56:26.412 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:26.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.402+0000 7fc1797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.402+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94865579935504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d352bb0 con 0x56479d308030 2024-02-15T22:56:26.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.403+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94865579935504] v30'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.403+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94865579913040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d318710 con 0x7fc2b8027060 2024-02-15T22:56:26.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.404+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94865579913040] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2bc03a040 con 0x7fc2b8027060 2024-02-15T22:56:26.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.404+0000 7fc2c6d20800 20 remove_watcher() i=0 2024-02-15T22:56:26.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.404+0000 7fc2c6d20800 2 removed watcher, disabling cache 2024-02-15T22:56:26.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.404+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94865579916656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d318710 con 0x56479d308030 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.405+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94865579916656] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.405+0000 7fc2c6d20800 20 remove_watcher() i=1 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.405+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94865579919376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d313d70 con 0x56479d30e310 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.406+0000 7fc2c2283640 1 -- 172.21.15.133:0/3855443722 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94865579919376] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b8053040 con 0x56479d30e310 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.406+0000 7fc2c6d20800 20 remove_watcher() i=2 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.406+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94865579921632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d318710 con 0x7fc2b8027060 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.407+0000 7fc2c3285640 1 -- 172.21.15.133:0/3855443722 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94865579921632] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2bc03a040 con 0x7fc2b8027060 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.407+0000 7fc2c6d20800 20 remove_watcher() i=3 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.407+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94865579924272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d314810 con 0x56479d308030 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.408+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94865579924272] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x56479d308030 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.408+0000 7fc2c6d20800 20 remove_watcher() i=4 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.408+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94865579929280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d3150e0 con 0x7fc2bc0141d0 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.409+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94865579929280] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.409+0000 7fc2c6d20800 20 remove_watcher() i=5 2024-02-15T22:56:26.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.409+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94865579926928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d318710 con 0x7fc2bc0141d0 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.410+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94865579926928] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.410+0000 7fc2c6d20800 20 remove_watcher() i=6 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.410+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94865579934288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56479d314810 con 0x7fc2bc0141d0 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94865579934288] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b409a040 con 0x7fc2bc0141d0 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 20 remove_watcher() i=7 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fc2bc0141d0 msgr2=0x7fc2bc015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fc2bc0141d0 0x7fc2bc015940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56479d308030 msgr2=0x56479d30a4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56479d308030 0x56479d30a4f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fc2b8027060 msgr2=0x7fc2b803a4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fc2b8027060 0x7fc2b803a4e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x56479d30e310 msgr2=0x56479d3107d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x56479d30e310 0x56479d3107d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc18c036740 msgr2=0x7fc18c038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc18c036740 0x7fc18c038c00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00b010 tx=0x7fc2bc020000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 msgr2=0x56479d2fc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c2a84640 1 -- 172.21.15.133:0/3855443722 reap_dead start 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2fc220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8048040 tx=0x7fc2b804b930 comp rx=0 tx=0).stop 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 shutdown_connections 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/3855443722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2f51c0 0x56479d2fc220 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 >> 172.21.15.133:0/3855443722 conn(0x56479d2f14e0 msgr2=0x56479d2eeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 shutdown_connections 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.411+0000 7fc2c6d20800 1 -- 172.21.15.133:0/3855443722 wait complete. 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2076553722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc19c0367e0 msgr2=0x7fc19c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/2076553722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc19c0367e0 0x7fc19c038ca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x56479d2d81b0 tx=0x7fc2bc005840 comp rx=0 tx=0).stop 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2076553722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2e7f60 msgr2=0x56479d2e8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/2076553722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2e7f60 0x56479d2e8380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800e610 tx=0x7fc2b800ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2076553722 shutdown_connections 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/2076553722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc19c0367e0 0x7fc19c038ca0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/2076553722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d2e7f60 0x56479d2e8380 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2076553722 >> 172.21.15.133:0/2076553722 conn(0x56479d2dc000 msgr2=0x56479d2dc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2076553722 shutdown_connections 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2076553722 wait complete. 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56479d1da3b0 msgr2=0x56479d2d7640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56479d1da3b0 0x56479d2d7640 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc1a80367e0 msgr2=0x7fc1a8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc1a80367e0 0x7fc1a8038ca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8000c00 tx=0x7fc2b80013b0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 msgr2=0x56479d1d73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d1d73c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4000c00 tx=0x7fc2b4002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 shutdown_connections 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56479d1da3b0 0x56479d2d7640 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc1a80367e0 0x7fc1a8038ca0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 --2- 172.21.15.133:0/2972118401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56479d1d7a80 0x56479d1d73c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 >> 172.21.15.133:0/2972118401 conn(0x56479d1d14d0 msgr2=0x56479d2c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 shutdown_connections 2024-02-15T22:56:26.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.412+0000 7fc2c6d20800 1 -- 172.21.15.133:0/2972118401 wait complete. 2024-02-15T22:56:26.423 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:26.423 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-15T22:56:26.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-15T22:56:26.423 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-02-15T22:56:26.508 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:26.508 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:26.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.507+0000 7fde3e733800 1 Processor -- start 2024-02-15T22:56:26.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.507+0000 7fde3e733800 1 -- start start 2024-02-15T22:56:26.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.507+0000 7fde3e733800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564d046c3320 0x564d046c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.507+0000 7fde3e733800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564d0460ac50 con 0x564d046bee90 2024-02-15T22:56:26.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.507+0000 7fde3e733800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x564d045c2450 con 0x564d046c3320 2024-02-15T22:56:26.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.507+0000 7fde39cf1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564d046c3320 0x564d046c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.507+0000 7fde3a4f2640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x564d046bee90 0x564d046bf2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44974/0 (socket says 172.21.15.133:44974) 2024-02-15T22:56:26.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.507+0000 7fde3a4f2640 1 -- 172.21.15.133:0/3447481204 learned_addr learned my addr 172.21.15.133:0/3447481204 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:26.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.507+0000 7fde39cf1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564d046c3320 0x564d046c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57928/0 (socket says 172.21.15.133:57928) 2024-02-15T22:56:26.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.508+0000 7fde39cf1640 1 -- 172.21.15.133:0/3447481204 >> v1:172.21.15.52:6789/0 conn(0x564d046bee90 legacy=0x564d046bf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.508+0000 7fde39cf1640 1 -- 172.21.15.133:0/3447481204 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d046c6d40 con 0x564d046c3320 2024-02-15T22:56:26.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.509+0000 7fde39cf1640 1 --2- 172.21.15.133:0/3447481204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046c3320 0x564d046c5710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fde3000a470 tx=0x7fde3001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1a5245d7b8685f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.510+0000 7fde394f0640 1 -- 172.21.15.133:0/3447481204 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde30052570 con 0x564d046c3320 2024-02-15T22:56:26.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.510+0000 7fde394f0640 1 -- 172.21.15.133:0/3447481204 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde300526d0 con 0x564d046c3320 2024-02-15T22:56:26.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.510+0000 7fde394f0640 1 -- 172.21.15.133:0/3447481204 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde30052990 con 0x564d046c3320 2024-02-15T22:56:26.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.510+0000 7fde3e733800 1 -- 172.21.15.133:0/3447481204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046c3320 msgr2=0x564d046c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.510+0000 7fde3e733800 1 --2- 172.21.15.133:0/3447481204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046c3320 0x564d046c5710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fde3000a470 tx=0x7fde3001cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:26.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.510+0000 7fde3e733800 1 -- 172.21.15.133:0/3447481204 shutdown_connections 2024-02-15T22:56:26.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.510+0000 7fde3e733800 1 --2- 172.21.15.133:0/3447481204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046c3320 0x564d046c5710 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.510+0000 7fde3e733800 1 -- 172.21.15.133:0/3447481204 >> 172.21.15.133:0/3447481204 conn(0x564d046ba4f0 msgr2=0x564d046bc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.510+0000 7fde3e733800 1 -- 172.21.15.133:0/3447481204 shutdown_connections 2024-02-15T22:56:26.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.510+0000 7fde3e733800 1 -- 172.21.15.133:0/3447481204 wait complete. 2024-02-15T22:56:26.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.521+0000 7fde3e733800 1 Processor -- start 2024-02-15T22:56:26.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.522+0000 7fde3e733800 1 -- start start 2024-02-15T22:56:26.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.522+0000 7fde3e733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d04632f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.522+0000 7fde3e733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d045bf980 con 0x564d046bee90 2024-02-15T22:56:26.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.522+0000 7fde3a4f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d04632f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.522+0000 7fde3a4f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d04632f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57938/0 (socket says 172.21.15.133:57938) 2024-02-15T22:56:26.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.522+0000 7fde3a4f2640 1 -- 172.21.15.133:0/711389527 learned_addr learned my addr 172.21.15.133:0/711389527 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.522+0000 7fde3a4f2640 1 -- 172.21.15.133:0/711389527 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde30005d20 con 0x564d046bee90 2024-02-15T22:56:26.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.522+0000 7fde3a4f2640 1 --2- 172.21.15.133:0/711389527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d04632f50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fde2c001c80 tx=0x7fde2c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5028aa3a7ade7d3b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.523+0000 7fdd28608640 1 -- 172.21.15.133:0/711389527 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde2c00e470 con 0x564d046bee90 2024-02-15T22:56:26.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.523+0000 7fdd28608640 1 -- 172.21.15.133:0/711389527 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c00e5d0 con 0x564d046bee90 2024-02-15T22:56:26.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.523+0000 7fdd28608640 1 -- 172.21.15.133:0/711389527 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde2c00e8d0 con 0x564d046bee90 2024-02-15T22:56:26.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.523+0000 7fde3e733800 1 -- 172.21.15.133:0/711389527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 msgr2=0x564d04632f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.523+0000 7fde3e733800 1 --2- 172.21.15.133:0/711389527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d04632f50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fde2c001c80 tx=0x7fde2c00b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.523+0000 7fde3e733800 1 -- 172.21.15.133:0/711389527 shutdown_connections 2024-02-15T22:56:26.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.523+0000 7fde3e733800 1 --2- 172.21.15.133:0/711389527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d04632f50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.523+0000 7fde3e733800 1 -- 172.21.15.133:0/711389527 >> 172.21.15.133:0/711389527 conn(0x564d046ba4f0 msgr2=0x564d047aa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.523+0000 7fde3e733800 1 -- 172.21.15.133:0/711389527 shutdown_connections 2024-02-15T22:56:26.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.523+0000 7fde3e733800 1 -- 172.21.15.133:0/711389527 wait complete. 2024-02-15T22:56:26.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.524+0000 7fde3e733800 1 Processor -- start 2024-02-15T22:56:26.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.524+0000 7fde3e733800 1 -- start start 2024-02-15T22:56:26.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.524+0000 7fde3e733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d047b98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.524+0000 7fde3e733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d045bb160 con 0x564d046bee90 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.524+0000 7fde3a4f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d047b98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.524+0000 7fde3a4f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d047b98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57948/0 (socket says 172.21.15.133:57948) 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.524+0000 7fde3a4f2640 1 -- 172.21.15.133:0/2057730196 learned_addr learned my addr 172.21.15.133:0/2057730196 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.524+0000 7fde3a4f2640 1 -- 172.21.15.133:0/2057730196 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d0460ac50 con 0x564d046bee90 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.524+0000 7fde3a4f2640 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d047b98a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fde2c001c80 tx=0x7fde2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.525+0000 7fdd26e05640 1 -- 172.21.15.133:0/2057730196 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde2c01f070 con 0x564d046bee90 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.525+0000 7fdd26e05640 1 -- 172.21.15.133:0/2057730196 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c018640 con 0x564d046bee90 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.525+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d047b9de0 con 0x564d046bee90 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.525+0000 7fdd26e05640 1 -- 172.21.15.133:0/2057730196 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde2c0188e0 con 0x564d046bee90 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.525+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d047ba2c0 con 0x564d046bee90 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.525+0000 7fdd26e05640 1 -- 172.21.15.133:0/2057730196 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fde2c018a40 con 0x564d046bee90 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.525+0000 7fdd26e05640 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd200367e0 0x7fdd20038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.526+0000 7fdd26e05640 1 -- 172.21.15.133:0/2057730196 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fde2c04c130 con 0x564d046bee90 2024-02-15T22:56:26.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.526+0000 7fde39cf1640 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd200367e0 0x7fdd20038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.526+0000 7fde3e733800 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564d046c3320 0x564d047c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.526+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047c0b70 con 0x564d046c3320 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.526+0000 7fde3acf3640 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564d046c3320 0x564d047c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.526+0000 7fde39cf1640 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd200367e0 0x7fdd20038ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde30054000 tx=0x7fde3004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.526+0000 7fde3acf3640 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564d046c3320 0x564d047c05a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.526+0000 7fde3acf3640 1 -- 172.21.15.133:0/2057730196 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde3400a4a0 con 0x564d046c3320 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.526+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047bdcb0 con 0x564d046c3320 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.527+0000 7fde3acf3640 1 -- 172.21.15.133:0/2057730196 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fde3400a4a0 con 0x564d046c3320 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.527+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047c28d0 con 0x564d046c3320 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.527+0000 7fde3acf3640 1 -- 172.21.15.133:0/2057730196 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fde3400a4a0 con 0x564d046c3320 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.527+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047c1be0 con 0x564d046c3320 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.527+0000 7fde3acf3640 1 -- 172.21.15.133:0/2057730196 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fde3400a4a0 con 0x564d046c3320 2024-02-15T22:56:26.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.527+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047c1ff0 con 0x564d046c3320 2024-02-15T22:56:26.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.528+0000 7fde3acf3640 1 -- 172.21.15.133:0/2057730196 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fde3400a4a0 con 0x564d046c3320 2024-02-15T22:56:26.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.528+0000 7fde3e733800 1 Processor -- start 2024-02-15T22:56:26.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.528+0000 7fde3e733800 1 -- start start 2024-02-15T22:56:26.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.528+0000 7fde3e733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047d1330 0x564d047d1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.528+0000 7fde3e733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d0455de80 con 0x564d047d1330 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.528+0000 7fde39cf1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047d1330 0x564d047d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.528+0000 7fde39cf1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047d1330 0x564d047d1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57962/0 (socket says 172.21.15.133:57962) 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.528+0000 7fde39cf1640 1 -- 172.21.15.133:0/1014069508 learned_addr learned my addr 172.21.15.133:0/1014069508 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.529+0000 7fde39cf1640 1 -- 172.21.15.133:0/1014069508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d047d1c90 con 0x564d047d1330 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.529+0000 7fde39cf1640 1 --2- 172.21.15.133:0/1014069508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047d1330 0x564d047d1750 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fde300447c0 tx=0x7fde30002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.529+0000 7fdd1ffff640 1 -- 172.21.15.133:0/1014069508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde30052e40 con 0x564d047d1330 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.529+0000 7fdd1ffff640 1 -- 172.21.15.133:0/1014069508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3005d890 con 0x564d047d1330 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.529+0000 7fde3e733800 1 -- 172.21.15.133:0/1014069508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d047d1e80 con 0x564d047d1330 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.529+0000 7fdd1ffff640 1 -- 172.21.15.133:0/1014069508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde3005db30 con 0x564d047d1330 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.529+0000 7fde3e733800 1 -- 172.21.15.133:0/1014069508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d047d2a30 con 0x564d047d1330 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.530+0000 7fdd1ffff640 1 -- 172.21.15.133:0/1014069508 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fde3005dc90 con 0x564d047d1330 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.530+0000 7fdd1ffff640 1 --2- 172.21.15.133:0/1014069508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd140367e0 0x7fdd14038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.530+0000 7fdd1ffff640 1 -- 172.21.15.133:0/1014069508 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fde3008f590 con 0x564d047d1330 2024-02-15T22:56:26.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.530+0000 7fde3acf3640 1 --2- 172.21.15.133:0/1014069508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd140367e0 0x7fdd14038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fde3e733800 1 Processor -- start 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fde3e733800 1 -- start start 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fde3acf3640 1 --2- 172.21.15.133:0/1014069508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd140367e0 0x7fdd14038ca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x564d047c1620 tx=0x7fde34005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fde3e733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047de8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fde3e733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d045335d0 con 0x564d047de4c0 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fde39cf1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047de8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fde39cf1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047de8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57968/0 (socket says 172.21.15.133:57968) 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fde39cf1640 1 -- 172.21.15.133:0/1593485082 learned_addr learned my addr 172.21.15.133:0/1593485082 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fde39cf1640 1 -- 172.21.15.133:0/1593485082 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d047deeb0 con 0x564d047de4c0 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fde39cf1640 1 --2- 172.21.15.133:0/1593485082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047de8e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fde3008db60 tx=0x7fde3006df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8042e1474ca194d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fdd1dffb640 1 -- 172.21.15.133:0/1593485082 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde3008f200 con 0x564d047de4c0 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.531+0000 7fdd1dffb640 1 -- 172.21.15.133:0/1593485082 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3008f360 con 0x564d047de4c0 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fdd1dffb640 1 -- 172.21.15.133:0/1593485082 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde30009a50 con 0x564d047de4c0 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fde3e733800 1 -- 172.21.15.133:0/1593485082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 msgr2=0x564d047de8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fde3e733800 1 --2- 172.21.15.133:0/1593485082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047de8e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fde3008db60 tx=0x7fde3006df50 comp rx=0 tx=0).stop 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fde3e733800 1 -- 172.21.15.133:0/1593485082 shutdown_connections 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fde3e733800 1 --2- 172.21.15.133:0/1593485082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047de8e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fde3e733800 1 -- 172.21.15.133:0/1593485082 >> 172.21.15.133:0/1593485082 conn(0x564d047da820 msgr2=0x564d047d8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fde3e733800 1 -- 172.21.15.133:0/1593485082 shutdown_connections 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fde3e733800 1 -- 172.21.15.133:0/1593485082 wait complete. 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fde3e733800 1 Processor -- start 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fde3e733800 1 -- start start 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fde3e733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047e54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.532+0000 7fde3e733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d047e5a30 con 0x564d047de4c0 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.533+0000 7fde39cf1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047e54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.533+0000 7fde39cf1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047e54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57982/0 (socket says 172.21.15.133:57982) 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.533+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 learned_addr learned my addr 172.21.15.133:0/614992725 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.533+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d047d2a30 con 0x564d047de4c0 2024-02-15T22:56:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.533+0000 7fde39cf1640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047e54f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fde3006d8e0 tx=0x7fde3008dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.533+0000 7fdd0bfff640 1 -- 172.21.15.133:0/614992725 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde3008c300 con 0x564d047de4c0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.533+0000 7fdd0bfff640 1 -- 172.21.15.133:0/614992725 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3008c460 con 0x564d047de4c0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.533+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d047e5c30 con 0x564d047de4c0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.533+0000 7fdd0bfff640 1 -- 172.21.15.133:0/614992725 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde3008c700 con 0x564d047de4c0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.533+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d047e6090 con 0x564d047de4c0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.534+0000 7fdd0bfff640 1 -- 172.21.15.133:0/614992725 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fde3008f820 con 0x564d047de4c0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.534+0000 7fdd0bfff640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd040367e0 0x7fdd04038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.534+0000 7fdd0bfff640 1 -- 172.21.15.133:0/614992725 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fde3009d810 con 0x564d047de4c0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.534+0000 7fde3acf3640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd040367e0 0x7fdd04038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.535+0000 7fde3acf3640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd040367e0 0x7fdd04038ca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde3400b010 tx=0x7fde34020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.535+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.535+0000 7fde3e733800 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564d047f10d0 0x564d047f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.535+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f3ce0 con 0x564d047f10d0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.535+0000 7fde3a4f2640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564d047f10d0 0x564d047f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.535+0000 7fde3a4f2640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564d047f10d0 0x564d047f3590 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.535+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde2c014070 con 0x564d047f10d0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.535+0000 7fde3e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.535+0000 7fde3e733800 20 realm 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.535+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.535+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f40b0 con 0x564d047f10d0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde2c014070 con 0x564d047f10d0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f4930 con 0x564d047f10d0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde2c014070 con 0x564d047f10d0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f4c90 con 0x564d047f10d0 2024-02-15T22:56:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fde2c014070 con 0x564d047f10d0 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f5490 con 0x564d047f10d0 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fde2c014070 con 0x564d047f10d0 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 20 searching for the correct realm 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564d047f7320 0x564d047f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f7320 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.536+0000 7fde39cf1640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564d047f7320 0x564d047f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.537+0000 7fde39cf1640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564d047f7320 0x564d047f97e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.537+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.537+0000 7fde39cf1640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fde3006f070 0x7fde30065510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.537+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde3006f070 2024-02-15T22:56:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.537+0000 7fde3acf3640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fde3006f070 0x7fde30065510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.538+0000 7fde3acf3640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fde3006f070 0x7fde30065510 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.538+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde3400a4a0 con 0x7fde3006f070 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.538+0000 7fde3acf3640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fde340141d0 0x7fde34015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.538+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde340141d0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.538+0000 7fde3a4f2640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fde340141d0 0x7fde34015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.538+0000 7fde3a4f2640 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fde340141d0 0x7fde34015940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.539+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c014070 con 0x7fde340141d0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.539+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f10d0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.539+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c014070 con 0x564d047f10d0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.539+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f10d0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.539+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.539+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde340141d0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.539+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.539+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde340141d0 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.540+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.540+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde3006f070 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.540+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde3400a4a0 con 0x7fde3006f070 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.540+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f7320 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.540+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.540+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f10d0 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.540+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.540+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde340141d0 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.541+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.541+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f10d0 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.541+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.541+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde3006f070 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.541+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.541+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f7320 2024-02-15T22:56:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.541+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.541+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f7320 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.542+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.542+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde340141d0 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.542+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.542+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f7320 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.542+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.542+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f7320 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.542+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.542+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f10d0 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.543+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.543+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f10d0 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.543+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.543+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde340141d0 2024-02-15T22:56:26.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.543+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.543+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f7320 2024-02-15T22:56:26.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.543+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.544+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde3006f070 2024-02-15T22:56:26.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.544+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.544+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f10d0 2024-02-15T22:56:26.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.544+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.544+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde340141d0 2024-02-15T22:56:26.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.544+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.544+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f7320 2024-02-15T22:56:26.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.545+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.545+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde340141d0 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.545+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.545+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde3006f070 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.545+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.545+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f7320 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.545+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.545+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde340141d0 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x564d047f10d0 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f9eb0 con 0x7fde3006f070 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3e733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:26.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3e733800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3e733800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3e733800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3e733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3e733800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.546+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f5df0 con 0x564d047f10d0 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047f6640 con 0x564d047f10d0 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fa2f0 con 0x564d047f10d0 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 20 zone default found 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 4 Realm: () 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 20 zonegroup default 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.547+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fa2f0 con 0x7fde340141d0 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde3e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fc170 con 0x564d047f7320 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde3e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fc4d0 con 0x564d047f7320 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde3e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde3e733800 20 started sync module instance, tier type = 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde3e733800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.548+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fb6f0 con 0x7fde3006f070 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.549+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.549+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94888787950592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fb6f0 con 0x7fde3006f070 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.549+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fcf20 con 0x564d047f10d0 2024-02-15T22:56:26.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.550+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94888787950592] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.550+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.550+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94888787954176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fb6f0 con 0x564d047f10d0 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.550+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fda10 con 0x564d047f7320 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.551+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94888787954176] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.552+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.552+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94888787948112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fb670 con 0x564d047f7320 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.552+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fe870 con 0x7fde3006f070 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.553+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.553+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94888787948112] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.553+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94888787961264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047feff0 con 0x7fde3006f070 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.553+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fde00 con 0x564d047f10d0 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.553+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94888787961264] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.554+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.554+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94888787962448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fefb0 con 0x564d047f10d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.554+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d04800050 con 0x7fde340141d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.555+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.555+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94888787962448] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.555+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94888787966896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d04800470 con 0x7fde340141d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.555+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047ff5e0 con 0x7fde340141d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.556+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.556+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94888787965344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d04800e90 con 0x7fde340141d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.556+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d048018b0 con 0x7fde340141d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.556+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94888787966896] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.557+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94888787965344] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.557+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.557+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94888787973008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d048009f0 con 0x7fde340141d0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.557+0000 7fde3e733800 20 add_watcher() i=0 2024-02-15T22:56:26.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.557+0000 7fde3e733800 20 add_watcher() i=1 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.557+0000 7fde3e733800 20 add_watcher() i=2 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.557+0000 7fde3e733800 20 add_watcher() i=3 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.557+0000 7fde3e733800 20 add_watcher() i=4 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.557+0000 7fde3e733800 20 add_watcher() i=5 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.557+0000 7fde3e733800 20 add_watcher() i=6 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.558+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94888787973008] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.558+0000 7fde3e733800 20 add_watcher() i=7 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.558+0000 7fde3e733800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.558+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d048049b0 con 0x564d047f10d0 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.558+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.558+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94888787967952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d04801e90 con 0x564d047f10d0 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.559+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94888787967952] v30'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.559+0000 7fdcf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.560+0000 7fde3e733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.560+0000 7fde3e733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.560+0000 7fde3e733800 5 note: GC not initialized 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.560+0000 7fdc6b7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.560+0000 7fde3e733800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.560+0000 7fde3e733800 20 Filter name: none 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.560+0000 7fdc697fa640 20 reqs_thread_entry: start 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.560+0000 7fde3e733800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.560+0000 7fde3e733800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.560+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d04836860 con 0x564d047f10d0 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.561+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.561+0000 7fde3e733800 20 rados_obj.operate() r=0 bl.length=515 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.561+0000 7fde3e733800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.561+0000 7fde3e733800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.561+0000 7fde3e733800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.561+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d0483cad0 con 0x564d047f10d0 2024-02-15T22:56:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.562+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v30'11 uv11 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.562+0000 7fde3e733800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.562+0000 7fde3e733800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.562+0000 7fde3e733800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.562+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94888788215120 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d04838240 con 0x564d047f10d0 2024-02-15T22:56:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.562+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 94888787962448 notify 128849018890 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x564d047ba2c0 con 0x564d047f10d0 2024-02-15T22:56:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.562+0000 7fdd1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94888787962448 notifier 4411 bl.length()=534 2024-02-15T22:56:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.562+0000 7fdd1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.562+0000 7fdd1dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.562+0000 7fdd1dffb640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fdd00003e90 con 0x564d047f10d0 2024-02-15T22:56:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.562+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(64 notify.4 [notify cookie 94888788215120 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.563+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== watch-notify(notify_complete (2) cookie 94888788215120 notify 128849018890 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564d047b9de0 con 0x564d047f10d0 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.563+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.563+0000 7fde3e733800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.563+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94888788215120 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d04837da0 con 0x7fde3006f070 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.563+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== watch-notify(notify (1) cookie 94888787950592 notify 128849018885 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7fde34026ae0 con 0x7fde3006f070 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.563+0000 7fdd1d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94888787950592 notifier 4411 bl.length()=159 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.563+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(66 notify.0 [notify cookie 94888788215120 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.563+0000 7fdd1d7fa640 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fdc700032b0 con 0x7fde3006f070 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.563+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.563+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== watch-notify(notify_complete (2) cookie 94888788215120 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fde34026d40 con 0x7fde3006f070 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.563+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d0483c550 con 0x7fde3006f070 2024-02-15T22:56:26.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.564+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(68 foo:foo2 [delete] v30'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.577 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.565+0000 7fdcf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.565+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94888787967952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d04804000 con 0x564d047f10d0 2024-02-15T22:56:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.566+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94888787967952] v30'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.566+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94888787950592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fffd0 con 0x7fde3006f070 2024-02-15T22:56:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.567+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94888787950592] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.567+0000 7fde3e733800 20 remove_watcher() i=0 2024-02-15T22:56:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.567+0000 7fde3e733800 2 removed watcher, disabling cache 2024-02-15T22:56:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.567+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94888787954176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fffd0 con 0x564d047f10d0 2024-02-15T22:56:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.568+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94888787954176] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.568+0000 7fde3e733800 20 remove_watcher() i=1 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.568+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94888787948112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fca00 con 0x564d047f7320 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.569+0000 7fde39cf1640 1 -- 172.21.15.133:0/614992725 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94888787948112] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde30059040 con 0x564d047f7320 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.569+0000 7fde3e733800 20 remove_watcher() i=2 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.569+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94888787961264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fffd0 con 0x7fde3006f070 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.570+0000 7fde3acf3640 1 -- 172.21.15.133:0/614992725 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94888787961264] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde3403a040 con 0x7fde3006f070 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.570+0000 7fde3e733800 20 remove_watcher() i=3 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.570+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94888787962448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fb250 con 0x564d047f10d0 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.571+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94888787962448] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x564d047f10d0 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.571+0000 7fde3e733800 20 remove_watcher() i=4 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.571+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94888787966896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fe5b0 con 0x7fde340141d0 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.572+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94888787966896] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.572+0000 7fde3e733800 20 remove_watcher() i=5 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.572+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94888787965344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047fb250 con 0x7fde340141d0 2024-02-15T22:56:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.573+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94888787965344] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.573+0000 7fde3e733800 20 remove_watcher() i=6 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.573+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94888787973008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564d047ff5a0 con 0x7fde340141d0 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94888787973008] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde2c035040 con 0x7fde340141d0 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 20 remove_watcher() i=7 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fde340141d0 msgr2=0x7fde34015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fde340141d0 0x7fde34015940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564d047f10d0 msgr2=0x564d047f3590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564d047f10d0 0x564d047f3590 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fde3006f070 msgr2=0x7fde30065510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fde3006f070 0x7fde30065510 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564d047f7320 msgr2=0x564d047f97e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564d047f7320 0x564d047f97e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd040367e0 msgr2=0x7fdd04038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd040367e0 0x7fdd04038ca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde3400b010 tx=0x7fde34020000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 msgr2=0x564d047e54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3a4f2640 1 -- 172.21.15.133:0/614992725 reap_dead start 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047e54f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fde3006d8e0 tx=0x7fde3008dac0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 shutdown_connections 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 --2- 172.21.15.133:0/614992725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047de4c0 0x564d047e54f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 >> 172.21.15.133:0/614992725 conn(0x564d047da820 msgr2=0x564d047d7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 shutdown_connections 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.574+0000 7fde3e733800 1 -- 172.21.15.133:0/614992725 wait complete. 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/1014069508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd140367e0 msgr2=0x7fdd14038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 --2- 172.21.15.133:0/1014069508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd140367e0 0x7fdd14038ca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x564d047c1620 tx=0x7fde34005840 comp rx=0 tx=0).stop 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/1014069508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047d1330 msgr2=0x564d047d1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 --2- 172.21.15.133:0/1014069508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047d1330 0x564d047d1750 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fde300447c0 tx=0x7fde30002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/1014069508 shutdown_connections 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 --2- 172.21.15.133:0/1014069508 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd140367e0 0x7fdd14038ca0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 --2- 172.21.15.133:0/1014069508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d047d1330 0x564d047d1750 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/1014069508 >> 172.21.15.133:0/1014069508 conn(0x564d047c53d0 msgr2=0x564d047c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/1014069508 shutdown_connections 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/1014069508 wait complete. 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564d046c3320 msgr2=0x564d047c05a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564d046c3320 0x564d047c05a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd200367e0 msgr2=0x7fdd20038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd200367e0 0x7fdd20038ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde30054000 tx=0x7fde3004e000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 msgr2=0x564d047b98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d047b98a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fde2c001c80 tx=0x7fde2c000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 shutdown_connections 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564d046c3320 0x564d047c05a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdd200367e0 0x7fdd20038ca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 --2- 172.21.15.133:0/2057730196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564d046bee90 0x564d047b98a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 >> 172.21.15.133:0/2057730196 conn(0x564d046ba4f0 msgr2=0x564d047a90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 shutdown_connections 2024-02-15T22:56:26.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.575+0000 7fde3e733800 1 -- 172.21.15.133:0/2057730196 wait complete. 2024-02-15T22:56:26.588 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:26.588 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-15T22:56:26.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-15T22:56:26.588 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-15T22:56:26.630 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:26.630 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:26.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.628+0000 7f7bee720800 1 Processor -- start 2024-02-15T22:56:26.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.628+0000 7f7bee720800 1 -- start start 2024-02-15T22:56:26.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.629+0000 7f7bee720800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560ff300ee70 0x560ff300f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.629+0000 7f7bee720800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560ff2f5abb0 con 0x560ff30100d0 2024-02-15T22:56:26.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.629+0000 7f7bee720800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x560ff2f12450 con 0x560ff300ee70 2024-02-15T22:56:26.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.629+0000 7f7bea47d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560ff300ee70 0x560ff300f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.629+0000 7f7bea47d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560ff300ee70 0x560ff300f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57990/0 (socket says 172.21.15.133:57990) 2024-02-15T22:56:26.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.629+0000 7f7bea47d640 1 -- 172.21.15.133:0/3478534248 learned_addr learned my addr 172.21.15.133:0/3478534248 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.629+0000 7f7be9c7c640 1 --1- 172.21.15.133:0/3478534248 >> v1:172.21.15.52:6789/0 conn(0x560ff30100d0 0x560ff3010550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44982/0 (socket says 172.21.15.133:44982) 2024-02-15T22:56:26.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.629+0000 7f7bea47d640 1 -- 172.21.15.133:0/3478534248 >> v1:172.21.15.52:6789/0 conn(0x560ff30100d0 legacy=0x560ff3010550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.629+0000 7f7bea47d640 1 -- 172.21.15.133:0/3478534248 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ff300f960 con 0x560ff300ee70 2024-02-15T22:56:26.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.631+0000 7f7bea47d640 1 --2- 172.21.15.133:0/3478534248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff300f290 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00a6b0 tx=0x7f7bdc01eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6291db60216d371a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.631+0000 7f7be947b640 1 -- 172.21.15.133:0/3478534248 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bdc00a200 con 0x560ff300ee70 2024-02-15T22:56:26.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.631+0000 7f7be947b640 1 -- 172.21.15.133:0/3478534248 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc00a360 con 0x560ff300ee70 2024-02-15T22:56:26.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.631+0000 7f7be947b640 1 -- 172.21.15.133:0/3478534248 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bdc0086e0 con 0x560ff300ee70 2024-02-15T22:56:26.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.632+0000 7f7bee720800 1 -- 172.21.15.133:0/3478534248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 msgr2=0x560ff300f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.632+0000 7f7bee720800 1 --2- 172.21.15.133:0/3478534248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff300f290 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00a6b0 tx=0x7f7bdc01eda0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.632+0000 7f7bee720800 1 -- 172.21.15.133:0/3478534248 shutdown_connections 2024-02-15T22:56:26.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.632+0000 7f7bee720800 1 --2- 172.21.15.133:0/3478534248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff300f290 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.632+0000 7f7bee720800 1 -- 172.21.15.133:0/3478534248 >> 172.21.15.133:0/3478534248 conn(0x560ff300a4d0 msgr2=0x560ff300c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.632+0000 7f7bee720800 1 -- 172.21.15.133:0/3478534248 shutdown_connections 2024-02-15T22:56:26.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.632+0000 7f7bee720800 1 -- 172.21.15.133:0/3478534248 wait complete. 2024-02-15T22:56:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.643+0000 7f7bee720800 1 Processor -- start 2024-02-15T22:56:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.644+0000 7f7bee720800 1 -- start start 2024-02-15T22:56:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.644+0000 7f7bee720800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff30fe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.644+0000 7f7bee720800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff2f0f980 con 0x560ff300ee70 2024-02-15T22:56:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.644+0000 7f7bea47d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff30fe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.644+0000 7f7bea47d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff30fe1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:57998/0 (socket says 172.21.15.133:57998) 2024-02-15T22:56:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.644+0000 7f7bea47d640 1 -- 172.21.15.133:0/3629543543 learned_addr learned my addr 172.21.15.133:0/3629543543 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.644+0000 7f7bea47d640 1 -- 172.21.15.133:0/3629543543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc005de0 con 0x560ff300ee70 2024-02-15T22:56:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.644+0000 7f7bea47d640 1 --2- 172.21.15.133:0/3629543543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff30fe1b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc01f610 tx=0x7f7bdc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a9753b03fce334 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.645+0000 7f7ad8608640 1 -- 172.21.15.133:0/3629543543 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bdc00a200 con 0x560ff300ee70 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.645+0000 7f7ad8608640 1 -- 172.21.15.133:0/3629543543 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc008590 con 0x560ff300ee70 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.645+0000 7f7ad8608640 1 -- 172.21.15.133:0/3629543543 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bdc008910 con 0x560ff300ee70 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.645+0000 7f7bee720800 1 -- 172.21.15.133:0/3629543543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 msgr2=0x560ff30fe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.645+0000 7f7bee720800 1 --2- 172.21.15.133:0/3629543543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff30fe1b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc01f610 tx=0x7f7bdc04e000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.645+0000 7f7bee720800 1 -- 172.21.15.133:0/3629543543 shutdown_connections 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.645+0000 7f7bee720800 1 --2- 172.21.15.133:0/3629543543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff30fe1b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.645+0000 7f7bee720800 1 -- 172.21.15.133:0/3629543543 >> 172.21.15.133:0/3629543543 conn(0x560ff300a4d0 msgr2=0x560ff30f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.645+0000 7f7bee720800 1 -- 172.21.15.133:0/3629543543 shutdown_connections 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.645+0000 7f7bee720800 1 -- 172.21.15.133:0/3629543543 wait complete. 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.646+0000 7f7bee720800 1 Processor -- start 2024-02-15T22:56:26.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.646+0000 7f7bee720800 1 -- start start 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.646+0000 7f7bee720800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff3105840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.646+0000 7f7bee720800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff2f0b160 con 0x560ff300ee70 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.646+0000 7f7bea47d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff3105840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.646+0000 7f7bea47d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff3105840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58000/0 (socket says 172.21.15.133:58000) 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.646+0000 7f7bea47d640 1 -- 172.21.15.133:0/1970872228 learned_addr learned my addr 172.21.15.133:0/1970872228 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.646+0000 7f7bea47d640 1 -- 172.21.15.133:0/1970872228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc050070 con 0x560ff300ee70 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.646+0000 7f7bea47d640 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff3105840 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc01f610 tx=0x7f7bdc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.647+0000 7f7ad6e05640 1 -- 172.21.15.133:0/1970872228 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bdc060470 con 0x560ff300ee70 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.647+0000 7f7ad6e05640 1 -- 172.21.15.133:0/1970872228 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc0605d0 con 0x560ff300ee70 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.647+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ff3105d80 con 0x560ff300ee70 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.647+0000 7f7ad6e05640 1 -- 172.21.15.133:0/1970872228 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bdc060870 con 0x560ff300ee70 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.647+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ff31062c0 con 0x560ff300ee70 2024-02-15T22:56:26.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.647+0000 7f7ad6e05640 1 -- 172.21.15.133:0/1970872228 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7bdc005020 con 0x560ff300ee70 2024-02-15T22:56:26.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.648+0000 7f7ad6e05640 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ad0036790 0x7f7ad0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.648+0000 7f7ad6e05640 1 -- 172.21.15.133:0/1970872228 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f7bdc08f760 con 0x560ff300ee70 2024-02-15T22:56:26.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.648+0000 7f7be9c7c640 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ad0036790 0x7f7ad0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.648+0000 7f7bee720800 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560ff30100d0 0x560ff310c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.648+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff310c9f0 con 0x560ff30100d0 2024-02-15T22:56:26.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.648+0000 7f7beac7e640 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560ff30100d0 0x560ff310c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.648+0000 7f7be9c7c640 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ad0036790 0x7f7ad0038c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7be0000f60 tx=0x7f7be0001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.648+0000 7f7beac7e640 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560ff30100d0 0x560ff310c4b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.648+0000 7f7beac7e640 1 -- 172.21.15.133:0/1970872228 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7be400a4a0 con 0x560ff30100d0 2024-02-15T22:56:26.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.648+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3109bb0 con 0x560ff30100d0 2024-02-15T22:56:26.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.649+0000 7f7beac7e640 1 -- 172.21.15.133:0/1970872228 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7be400a4a0 con 0x560ff30100d0 2024-02-15T22:56:26.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.649+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff310e6f0 con 0x560ff30100d0 2024-02-15T22:56:26.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.649+0000 7f7beac7e640 1 -- 172.21.15.133:0/1970872228 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f7be400a4a0 con 0x560ff30100d0 2024-02-15T22:56:26.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.649+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff310da00 con 0x560ff30100d0 2024-02-15T22:56:26.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.649+0000 7f7beac7e640 1 -- 172.21.15.133:0/1970872228 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7be400a4a0 con 0x560ff30100d0 2024-02-15T22:56:26.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.649+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff310de10 con 0x560ff30100d0 2024-02-15T22:56:26.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.650+0000 7f7beac7e640 1 -- 172.21.15.133:0/1970872228 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7be400a4a0 con 0x560ff30100d0 2024-02-15T22:56:26.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.650+0000 7f7bee720800 1 Processor -- start 2024-02-15T22:56:26.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.650+0000 7f7bee720800 1 -- start start 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.650+0000 7f7bee720800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff311d130 0x560ff311d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.650+0000 7f7bee720800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff2eade80 con 0x560ff311d130 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.650+0000 7f7be9c7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff311d130 0x560ff311d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.650+0000 7f7be9c7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff311d130 0x560ff311d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58014/0 (socket says 172.21.15.133:58014) 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.650+0000 7f7be9c7c640 1 -- 172.21.15.133:0/1093290713 learned_addr learned my addr 172.21.15.133:0/1093290713 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.651+0000 7f7be9c7c640 1 -- 172.21.15.133:0/1093290713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ff311da90 con 0x560ff311d130 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.651+0000 7f7be9c7c640 1 --2- 172.21.15.133:0/1093290713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff311d130 0x560ff311d550 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7be0001ed0 tx=0x7f7be000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.651+0000 7f7acffff640 1 -- 172.21.15.133:0/1093290713 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be000bec0 con 0x560ff311d130 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.651+0000 7f7acffff640 1 -- 172.21.15.133:0/1093290713 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be000d520 con 0x560ff311d130 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.651+0000 7f7bee720800 1 -- 172.21.15.133:0/1093290713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ff311e500 con 0x560ff311d130 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.651+0000 7f7acffff640 1 -- 172.21.15.133:0/1093290713 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be000d7c0 con 0x560ff311d130 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.651+0000 7f7bee720800 1 -- 172.21.15.133:0/1093290713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ff311e9c0 con 0x560ff311d130 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.652+0000 7f7acffff640 1 -- 172.21.15.133:0/1093290713 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7be001a070 con 0x560ff311d130 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.652+0000 7f7acffff640 1 --2- 172.21.15.133:0/1093290713 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ac40367e0 0x7f7ac4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.652+0000 7f7acffff640 1 -- 172.21.15.133:0/1093290713 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f7be0017050 con 0x560ff311d130 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.652+0000 7f7beac7e640 1 --2- 172.21.15.133:0/1093290713 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ac40367e0 0x7f7ac4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.652+0000 7f7bee720800 1 Processor -- start 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.652+0000 7f7bee720800 1 -- start start 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.652+0000 7f7beac7e640 1 --2- 172.21.15.133:0/1093290713 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ac40367e0 0x7f7ac4038ca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x560ff310d440 tx=0x7f7be4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.653+0000 7f7bee720800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 0x560ff312ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.653+0000 7f7bee720800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff2e835d0 con 0x560ff312e7f0 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.653+0000 7f7be9c7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 0x560ff312ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.653+0000 7f7be9c7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 0x560ff312ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58024/0 (socket says 172.21.15.133:58024) 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.653+0000 7f7be9c7c640 1 -- 172.21.15.133:0/2394707926 learned_addr learned my addr 172.21.15.133:0/2394707926 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.653+0000 7f7be9c7c640 1 -- 172.21.15.133:0/2394707926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ff312f1c0 con 0x560ff312e7f0 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.653+0000 7f7be9c7c640 1 --2- 172.21.15.133:0/2394707926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 0x560ff312ebf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7be0027030 tx=0x7f7be0024560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49339cc19223a61e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.653+0000 7f7acdffb640 1 -- 172.21.15.133:0/2394707926 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be004d0d0 con 0x560ff312e7f0 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.653+0000 7f7acdffb640 1 -- 172.21.15.133:0/2394707926 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be004d230 con 0x560ff312e7f0 2024-02-15T22:56:26.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.653+0000 7f7acdffb640 1 -- 172.21.15.133:0/2394707926 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be004a340 con 0x560ff312e7f0 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7bee720800 1 -- 172.21.15.133:0/2394707926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 msgr2=0x560ff312ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7bee720800 1 --2- 172.21.15.133:0/2394707926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 0x560ff312ebf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7be0027030 tx=0x7f7be0024560 comp rx=0 tx=0).stop 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7bee720800 1 -- 172.21.15.133:0/2394707926 shutdown_connections 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7bee720800 1 --2- 172.21.15.133:0/2394707926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 0x560ff312ebf0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7bee720800 1 -- 172.21.15.133:0/2394707926 >> 172.21.15.133:0/2394707926 conn(0x560ff31266b0 msgr2=0x560ff3124710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7bee720800 1 -- 172.21.15.133:0/2394707926 shutdown_connections 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7bee720800 1 -- 172.21.15.133:0/2394707926 wait complete. 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7bee720800 1 Processor -- start 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7bee720800 1 -- start start 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7bee720800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 0x560ff31357f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7bee720800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff3135d30 con 0x560ff312e7f0 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7be9c7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 0x560ff31357f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7be9c7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 0x560ff31357f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58028/0 (socket says 172.21.15.133:58028) 2024-02-15T22:56:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.654+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 learned_addr learned my addr 172.21.15.133:0/3552259980 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.655+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ff311e9c0 con 0x560ff312e7f0 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.655+0000 7f7be9c7c640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 0x560ff31357f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7be004a910 tx=0x7f7be004b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.655+0000 7f7abbfff640 1 -- 172.21.15.133:0/3552259980 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be004d0d0 con 0x560ff312e7f0 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.655+0000 7f7abbfff640 1 -- 172.21.15.133:0/3552259980 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be001a320 con 0x560ff312e7f0 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.655+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ff3135f30 con 0x560ff312e7f0 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.655+0000 7f7abbfff640 1 -- 172.21.15.133:0/3552259980 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be001a600 con 0x560ff312e7f0 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.655+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ff31363f0 con 0x560ff312e7f0 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.656+0000 7f7abbfff640 1 -- 172.21.15.133:0/3552259980 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7be001a760 con 0x560ff312e7f0 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.656+0000 7f7abbfff640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ab40367e0 0x7f7ab4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.656+0000 7f7abbfff640 1 -- 172.21.15.133:0/3552259980 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f7be004eb80 con 0x560ff312e7f0 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.656+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.656+0000 7f7beac7e640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ab40367e0 0x7f7ab4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.656+0000 7f7bee720800 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560ff3141400 0x560ff31438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.656+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3143ff0 con 0x560ff3141400 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.656+0000 7f7bea47d640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560ff3141400 0x560ff31438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.656+0000 7f7beac7e640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ab40367e0 0x7f7ab4038ca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7be400b010 tx=0x7f7be4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.656+0000 7f7bea47d640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560ff3141400 0x560ff31438a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bdc0545b0 con 0x560ff3141400 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 20 realm 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff31443c0 con 0x560ff3141400 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bdc0545b0 con 0x560ff3141400 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3144c40 con 0x560ff3141400 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bdc0545b0 con 0x560ff3141400 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3144fa0 con 0x560ff3141400 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7bdc0545b0 con 0x560ff3141400 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff31448a0 con 0x560ff3141400 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.657+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f7bdc0545b0 con 0x560ff3141400 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.658+0000 7f7bee720800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.658+0000 7f7bee720800 20 searching for the correct realm 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.658+0000 7f7bee720800 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560ff3147320 0x560ff3149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.658+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x560ff3147320 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.658+0000 7f7be9c7c640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560ff3147320 0x560ff3149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.658+0000 7f7be9c7c640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560ff3147320 0x560ff3149710 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.658+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.658+0000 7f7be9c7c640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f7be0027060 0x7f7be0027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.658+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x7f7be0027060 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.658+0000 7f7beac7e640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f7be0027060 0x7f7be0027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.659+0000 7f7beac7e640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f7be0027060 0x7f7be0027440 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.659+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be400a4a0 con 0x7f7be0027060 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.659+0000 7f7beac7e640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f7be40141d0 0x7f7be4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.659+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x7f7be40141d0 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.659+0000 7f7bea47d640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f7be40141d0 0x7f7be4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.660+0000 7f7bea47d640 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f7be40141d0 0x7f7be4015940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.660+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc0545b0 con 0x7f7be40141d0 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.660+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x560ff3141400 2024-02-15T22:56:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.660+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc0545b0 con 0x560ff3141400 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.660+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x560ff3141400 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.660+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc0545b0 con 0x560ff3141400 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.660+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x7f7be40141d0 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.661+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc0545b0 con 0x7f7be40141d0 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.661+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x7f7be40141d0 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.661+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc086040 con 0x7f7be40141d0 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.661+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x7f7be0027060 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.661+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be400a4a0 con 0x7f7be0027060 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.661+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x560ff3147320 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.661+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.661+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x560ff3141400 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.661+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc086040 con 0x560ff3141400 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.661+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x7f7be40141d0 2024-02-15T22:56:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.662+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc086040 con 0x7f7be40141d0 2024-02-15T22:56:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.662+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x560ff3141400 2024-02-15T22:56:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.662+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc086040 con 0x560ff3141400 2024-02-15T22:56:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.662+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x7f7be0027060 2024-02-15T22:56:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.662+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7be403a040 con 0x7f7be0027060 2024-02-15T22:56:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.662+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x560ff3147320 2024-02-15T22:56:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.662+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.662+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3149dc0 con 0x560ff3147320 2024-02-15T22:56:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.663+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.663+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x7f7be40141d0 2024-02-15T22:56:26.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.663+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc086040 con 0x7f7be40141d0 2024-02-15T22:56:26.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.663+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x560ff3147320 2024-02-15T22:56:26.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.663+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.663+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x560ff3147320 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.663+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.663+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x560ff3141400 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.664+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc086040 con 0x560ff3141400 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.664+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x560ff3141400 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.664+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7bdc086040 con 0x560ff3141400 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.664+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x7f7be40141d0 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.664+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc086040 con 0x7f7be40141d0 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.664+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x560ff3147320 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.665+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.665+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x7f7be0027060 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.665+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be403a040 con 0x7f7be0027060 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.665+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x560ff3141400 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.665+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7bdc086040 con 0x560ff3141400 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.665+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x7f7be40141d0 2024-02-15T22:56:26.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.665+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc086040 con 0x7f7be40141d0 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.665+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x560ff3147320 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.666+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.666+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x7f7be40141d0 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.666+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc086040 con 0x7f7be40141d0 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.666+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x7f7be0027060 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.666+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be403a040 con 0x7f7be0027060 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.666+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x560ff3147320 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.666+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.666+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x7f7be40141d0 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bdc097040 con 0x7f7be40141d0 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x560ff3141400 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7be0059040 con 0x7f7be0027060 2024-02-15T22:56:26.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be403a040 con 0x7f7be0027060 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bee720800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bee720800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bee720800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bee720800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bee720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bee720800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3145d90 con 0x560ff3141400 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bee720800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.667+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3145a10 con 0x560ff3141400 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3146720 con 0x560ff3141400 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 20 zone default found 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 4 Realm: () 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 20 zonegroup default 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314a250 con 0x7f7be40141d0 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x7f7be40141d0 2024-02-15T22:56:26.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.668+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314c0d0 con 0x560ff3147320 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.669+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.669+0000 7f7bee720800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.669+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.669+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314c430 con 0x560ff3147320 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.669+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.669+0000 7f7bee720800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.669+0000 7f7bee720800 20 started sync module instance, tier type = 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.669+0000 7f7bee720800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.669+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314b6a0 con 0x7f7be0027060 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.670+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be403a040 con 0x7f7be0027060 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.670+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94626502720080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314b6a0 con 0x7f7be0027060 2024-02-15T22:56:26.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.670+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314ce70 con 0x560ff3141400 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.671+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94626502720080] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be403a040 con 0x7f7be0027060 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.671+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.671+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94626502723920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314b6a0 con 0x560ff3141400 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.671+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314d8f0 con 0x560ff3147320 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.672+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.672+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94626502726640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314e170 con 0x560ff3147320 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.672+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314ec00 con 0x7f7be0027060 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.673+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94626502723920] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.673+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94626502726640] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.673+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be403a040 con 0x7f7be0027060 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.674+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94626502728912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314b200 con 0x7f7be0027060 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.674+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314f5c0 con 0x560ff3141400 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.674+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.674+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94626502734112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314f9e0 con 0x560ff3141400 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.675+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3150480 con 0x7f7be40141d0 2024-02-15T22:56:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.675+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94626502728912] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be403a040 con 0x7f7be0027060 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.675+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94626502734112] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.676+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x7f7be40141d0 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.676+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94626502735168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314e720 con 0x7f7be40141d0 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.676+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3150a50 con 0x7f7be40141d0 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.677+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94626502735168] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x7f7be40141d0 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.677+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x7f7be40141d0 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.677+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94626502737760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3150a50 con 0x7f7be40141d0 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.677+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff31513c0 con 0x7f7be40141d0 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.678+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94626502737760] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x7f7be40141d0 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.678+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x7f7be40141d0 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.678+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94626502739680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff31513c0 con 0x7f7be40141d0 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.678+0000 7f7bee720800 20 add_watcher() i=0 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.678+0000 7f7bee720800 20 add_watcher() i=1 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.678+0000 7f7bee720800 20 add_watcher() i=2 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.678+0000 7f7bee720800 20 add_watcher() i=3 2024-02-15T22:56:26.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.678+0000 7f7bee720800 20 add_watcher() i=4 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.678+0000 7f7bee720800 20 add_watcher() i=5 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.678+0000 7f7bee720800 20 add_watcher() i=6 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.680+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94626502739680] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x7f7be40141d0 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.680+0000 7f7bee720800 20 add_watcher() i=7 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.680+0000 7f7bee720800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.680+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3154980 con 0x560ff3141400 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.680+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.680+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94626502755136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff31515e0 con 0x560ff3141400 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.681+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94626502755136] v30'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.681+0000 7f7aa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.681+0000 7f7bee720800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.681+0000 7f7bee720800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.681+0000 7f7bee720800 5 note: GC not initialized 2024-02-15T22:56:26.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.681+0000 7f7a1b7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:26.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.682+0000 7f7bee720800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:26.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.682+0000 7f7bee720800 20 Filter name: none 2024-02-15T22:56:26.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.682+0000 7f7a197fa640 20 reqs_thread_entry: start 2024-02-15T22:56:26.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.682+0000 7f7bee720800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.682+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3186320 con 0x560ff3141400 2024-02-15T22:56:26.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.682+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.682+0000 7f7bee720800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.682+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff3186320 con 0x7f7be0027060 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.683+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f7be403a040 con 0x7f7be0027060 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.683+0000 7f7aa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.683+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94626502755136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff31862e0 con 0x560ff3141400 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.684+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94626502755136] v30'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.684+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94626502720080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff31862e0 con 0x7f7be0027060 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.685+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94626502720080] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be403a040 con 0x7f7be0027060 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.685+0000 7f7bee720800 20 remove_watcher() i=0 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.685+0000 7f7bee720800 2 removed watcher, disabling cache 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.685+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94626502723920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff31862e0 con 0x560ff3141400 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.687+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94626502723920] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.687+0000 7f7bee720800 20 remove_watcher() i=1 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.687+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94626502726640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff31862e0 con 0x560ff3147320 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.687+0000 7f7be9c7c640 1 -- 172.21.15.133:0/3552259980 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94626502726640] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be004ede0 con 0x560ff3147320 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.688+0000 7f7bee720800 20 remove_watcher() i=2 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.688+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94626502728912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314c950 con 0x7f7be0027060 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.688+0000 7f7beac7e640 1 -- 172.21.15.133:0/3552259980 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94626502728912] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be403a040 con 0x7f7be0027060 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.688+0000 7f7bee720800 20 remove_watcher() i=3 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.688+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94626502734112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314d3f0 con 0x560ff3141400 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.689+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94626502734112] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x560ff3141400 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.689+0000 7f7bee720800 20 remove_watcher() i=4 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.689+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94626502735168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314c950 con 0x7f7be40141d0 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.690+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94626502735168] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x7f7be40141d0 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.690+0000 7f7bee720800 20 remove_watcher() i=5 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.690+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94626502737760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314d3f0 con 0x7f7be40141d0 2024-02-15T22:56:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.691+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94626502737760] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x7f7be40141d0 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.691+0000 7f7bee720800 20 remove_watcher() i=6 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.691+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94626502739680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff314c950 con 0x7f7be40141d0 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.692+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94626502739680] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bdc097040 con 0x7f7be40141d0 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.692+0000 7f7bee720800 20 remove_watcher() i=7 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.692+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f7be40141d0 msgr2=0x7f7be4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.692+0000 7f7bee720800 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f7be40141d0 0x7f7be4015940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.692+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560ff3141400 msgr2=0x560ff31438a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.692+0000 7f7bee720800 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560ff3141400 0x560ff31438a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.692+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f7be0027060 msgr2=0x7f7be0027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.692+0000 7f7bee720800 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f7be0027060 0x7f7be0027440 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.692+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560ff3147320 msgr2=0x560ff3149710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.692+0000 7f7bee720800 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560ff3147320 0x560ff3149710 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ab40367e0 msgr2=0x7f7ab4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ab40367e0 0x7f7ab4038ca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7be400b010 tx=0x7f7be4020000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 msgr2=0x560ff31357f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 --2- 172.21.15.133:0/3552259980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff312e7f0 0x560ff31357f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7be004a910 tx=0x7f7be004b930 comp rx=0 tx=0).stop 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 reap_dead start 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bea47d640 1 -- 172.21.15.133:0/3552259980 reap_dead start 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 shutdown_connections 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 >> 172.21.15.133:0/3552259980 conn(0x560ff31266b0 msgr2=0x560ff3123d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 shutdown_connections 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/3552259980 wait complete. 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/1093290713 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ac40367e0 msgr2=0x7f7ac4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 --2- 172.21.15.133:0/1093290713 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ac40367e0 0x7f7ac4038ca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x560ff310d440 tx=0x7f7be4005840 comp rx=0 tx=0).stop 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/1093290713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff311d130 msgr2=0x560ff311d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 --2- 172.21.15.133:0/1093290713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff311d130 0x560ff311d550 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7be0001ed0 tx=0x7f7be000ea00 comp rx=0 tx=0).stop 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/1093290713 shutdown_connections 2024-02-15T22:56:26.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 --2- 172.21.15.133:0/1093290713 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ac40367e0 0x7f7ac4038ca0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 --2- 172.21.15.133:0/1093290713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff311d130 0x560ff311d550 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/1093290713 >> 172.21.15.133:0/1093290713 conn(0x560ff31111d0 msgr2=0x560ff31115d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/1093290713 shutdown_connections 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/1093290713 wait complete. 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560ff30100d0 msgr2=0x560ff310c4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560ff30100d0 0x560ff310c4b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ad0036790 msgr2=0x7f7ad0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.693+0000 7f7bee720800 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ad0036790 0x7f7ad0038c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7be0000f60 tx=0x7f7be0001370 comp rx=0 tx=0).stop 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.694+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 msgr2=0x560ff3105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.694+0000 7f7bee720800 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff3105840 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc01f610 tx=0x7f7bdc002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.694+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 shutdown_connections 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.694+0000 7f7bee720800 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560ff30100d0 0x560ff310c4b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.694+0000 7f7bee720800 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7ad0036790 0x7f7ad0038c50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.694+0000 7f7bee720800 1 --2- 172.21.15.133:0/1970872228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ff300ee70 0x560ff3105840 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.694+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 >> 172.21.15.133:0/1970872228 conn(0x560ff300a4d0 msgr2=0x560ff30f8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.694+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 shutdown_connections 2024-02-15T22:56:26.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.694+0000 7f7bee720800 1 -- 172.21.15.133:0/1970872228 wait complete. 2024-02-15T22:56:26.704 INFO:teuthology.orchestra.run.smithi133.stdout:[] 2024-02-15T22:56:26.705 DEBUG:tasks.util.rgw: json result: [] 2024-02-15T22:56:26.705 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-15T22:56:26.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-15T22:56:26.705 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-15T22:56:26.788 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:26.788 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.786+0000 7f0e12d35800 1 Processor -- start 2024-02-15T22:56:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.786+0000 7f0e12d35800 1 -- start start 2024-02-15T22:56:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.786+0000 7f0e12d35800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563c73dc23f0 0x563c73dcaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.786+0000 7f0e12d35800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563c73d0cbb0 con 0x563c73dc08b0 2024-02-15T22:56:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.786+0000 7f0e12d35800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x563c73cc4450 con 0x563c73dc23f0 2024-02-15T22:56:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.787+0000 7f0e061dc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563c73dc23f0 0x563c73dcaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.787+0000 7f0e0e9dd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x563c73dc08b0 0x563c73dc0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:44994/0 (socket says 172.21.15.133:44994) 2024-02-15T22:56:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.787+0000 7f0e061dc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563c73dc23f0 0x563c73dcaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58042/0 (socket says 172.21.15.133:58042) 2024-02-15T22:56:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.787+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2483104596 learned_addr learned my addr 172.21.15.133:0/2483104596 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.787+0000 7f0e0e1dc640 1 -- 172.21.15.133:0/2483104596 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535441935 0 0) 0x563c73d0cbb0 con 0x563c73dc08b0 2024-02-15T22:56:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.787+0000 7f0e0e1dc640 1 -- 172.21.15.133:0/2483104596 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dfc001e10 con 0x563c73dc08b0 2024-02-15T22:56:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.787+0000 7f0e061dc640 1 -- 172.21.15.133:0/2483104596 >> v1:172.21.15.52:6789/0 conn(0x563c73dc08b0 legacy=0x563c73dc0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.787+0000 7f0e061dc640 1 -- 172.21.15.133:0/2483104596 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c73d35160 con 0x563c73dc23f0 2024-02-15T22:56:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.789+0000 7f0e061dc640 1 --2- 172.21.15.133:0/2483104596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc23f0 0x563c73dcaef0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0df800a470 tx=0x7f0df801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc150849a156181a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.789+0000 7f0e0e1dc640 1 -- 172.21.15.133:0/2483104596 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0df804ac50 con 0x563c73dc23f0 2024-02-15T22:56:26.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.789+0000 7f0e0e1dc640 1 -- 172.21.15.133:0/2483104596 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df804adb0 con 0x563c73dc23f0 2024-02-15T22:56:26.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.789+0000 7f0e0e1dc640 1 -- 172.21.15.133:0/2483104596 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0df8052590 con 0x563c73dc23f0 2024-02-15T22:56:26.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.790+0000 7f0e12d35800 1 -- 172.21.15.133:0/2483104596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc23f0 msgr2=0x563c73dcaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.790+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2483104596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc23f0 0x563c73dcaef0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0df800a470 tx=0x7f0df801cc80 comp rx=0 tx=0).stop 2024-02-15T22:56:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.790+0000 7f0e12d35800 1 -- 172.21.15.133:0/2483104596 shutdown_connections 2024-02-15T22:56:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.790+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2483104596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc23f0 0x563c73dcaef0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.790+0000 7f0e12d35800 1 -- 172.21.15.133:0/2483104596 >> 172.21.15.133:0/2483104596 conn(0x563c73dbc4d0 msgr2=0x563c73dbe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.790+0000 7f0e12d35800 1 -- 172.21.15.133:0/2483104596 shutdown_connections 2024-02-15T22:56:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.790+0000 7f0e12d35800 1 -- 172.21.15.133:0/2483104596 wait complete. 2024-02-15T22:56:26.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.801+0000 7f0e12d35800 1 Processor -- start 2024-02-15T22:56:26.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.801+0000 7f0e12d35800 1 -- start start 2024-02-15T22:56:26.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.802+0000 7f0e12d35800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73eb4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.802+0000 7f0e12d35800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c73cc1980 con 0x563c73dc08b0 2024-02-15T22:56:26.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.802+0000 7f0e0e9dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73eb4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.802+0000 7f0e0e9dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73eb4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58044/0 (socket says 172.21.15.133:58044) 2024-02-15T22:56:26.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.802+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/1655529252 learned_addr learned my addr 172.21.15.133:0/1655529252 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.802+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/1655529252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df8005d20 con 0x563c73dc08b0 2024-02-15T22:56:26.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.802+0000 7f0e0e9dd640 1 --2- 172.21.15.133:0/1655529252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73eb4120 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0e00001c50 tx=0x7f0e0000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6a466ce2c5961d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.802+0000 7f0cfce09640 1 -- 172.21.15.133:0/1655529252 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e0000e470 con 0x563c73dc08b0 2024-02-15T22:56:26.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.803+0000 7f0cfce09640 1 -- 172.21.15.133:0/1655529252 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0000e5d0 con 0x563c73dc08b0 2024-02-15T22:56:26.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.803+0000 7f0cfce09640 1 -- 172.21.15.133:0/1655529252 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e0000e8b0 con 0x563c73dc08b0 2024-02-15T22:56:26.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.803+0000 7f0e12d35800 1 -- 172.21.15.133:0/1655529252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 msgr2=0x563c73eb4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.803+0000 7f0e12d35800 1 --2- 172.21.15.133:0/1655529252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73eb4120 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0e00001c50 tx=0x7f0e0000b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.803+0000 7f0e12d35800 1 -- 172.21.15.133:0/1655529252 shutdown_connections 2024-02-15T22:56:26.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.803+0000 7f0e12d35800 1 --2- 172.21.15.133:0/1655529252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73eb4120 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.803+0000 7f0e12d35800 1 -- 172.21.15.133:0/1655529252 >> 172.21.15.133:0/1655529252 conn(0x563c73dbc4d0 msgr2=0x563c73eafa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.803+0000 7f0e12d35800 1 -- 172.21.15.133:0/1655529252 shutdown_connections 2024-02-15T22:56:26.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.803+0000 7f0e12d35800 1 -- 172.21.15.133:0/1655529252 wait complete. 2024-02-15T22:56:26.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.804+0000 7f0e12d35800 1 Processor -- start 2024-02-15T22:56:26.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.804+0000 7f0e12d35800 1 -- start start 2024-02-15T22:56:26.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.804+0000 7f0e12d35800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73ebb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.804+0000 7f0e12d35800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c73cbd160 con 0x563c73dc08b0 2024-02-15T22:56:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.804+0000 7f0e0e9dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73ebb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.804+0000 7f0e0e9dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73ebb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58056/0 (socket says 172.21.15.133:58056) 2024-02-15T22:56:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.804+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/3102626863 learned_addr learned my addr 172.21.15.133:0/3102626863 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.805+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/3102626863 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc001e10 con 0x563c73dc08b0 2024-02-15T22:56:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.805+0000 7f0e0e9dd640 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73ebb7d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0e00000c00 tx=0x7f0e00000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.805+0000 7f0cfb606640 1 -- 172.21.15.133:0/3102626863 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e0001f070 con 0x563c73dc08b0 2024-02-15T22:56:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.805+0000 7f0cfb606640 1 -- 172.21.15.133:0/3102626863 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e00018830 con 0x563c73dc08b0 2024-02-15T22:56:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.805+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c73ebbd10 con 0x563c73dc08b0 2024-02-15T22:56:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.805+0000 7f0cfb606640 1 -- 172.21.15.133:0/3102626863 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e00018ad0 con 0x563c73dc08b0 2024-02-15T22:56:26.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.805+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c73ebc1f0 con 0x563c73dc08b0 2024-02-15T22:56:26.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.806+0000 7f0cfb606640 1 -- 172.21.15.133:0/3102626863 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0e00018c30 con 0x563c73dc08b0 2024-02-15T22:56:26.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.806+0000 7f0cfb606640 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0cf40367e0 0x7f0cf4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.806+0000 7f0cfb606640 1 -- 172.21.15.133:0/3102626863 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f0e0004c1a0 con 0x563c73dc08b0 2024-02-15T22:56:26.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.806+0000 7f0e061dc640 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0cf40367e0 0x7f0cf4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.806+0000 7f0e12d35800 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563c73dc23f0 0x563c73ec2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.806+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ec2a30 con 0x563c73dc23f0 2024-02-15T22:56:26.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.806+0000 7f0e0f1de640 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563c73dc23f0 0x563c73ec2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.807+0000 7f0e061dc640 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0cf40367e0 0x7f0cf4038ca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0df8054000 tx=0x7f0df804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.807+0000 7f0e0f1de640 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563c73dc23f0 0x563c73ec2460 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.807+0000 7f0e0f1de640 1 -- 172.21.15.133:0/3102626863 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e0800a4a0 con 0x563c73dc23f0 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.807+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ebfb90 con 0x563c73dc23f0 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.807+0000 7f0e0f1de640 1 -- 172.21.15.133:0/3102626863 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0e0800a4a0 con 0x563c73dc23f0 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.807+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ec4790 con 0x563c73dc23f0 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.807+0000 7f0e0f1de640 1 -- 172.21.15.133:0/3102626863 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0e0800a4a0 con 0x563c73dc23f0 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.807+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ec3aa0 con 0x563c73dc23f0 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.808+0000 7f0e0f1de640 1 -- 172.21.15.133:0/3102626863 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0e0800a4a0 con 0x563c73dc23f0 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.808+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ec3eb0 con 0x563c73dc23f0 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.808+0000 7f0e0f1de640 1 -- 172.21.15.133:0/3102626863 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0e0800a4a0 con 0x563c73dc23f0 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.808+0000 7f0e12d35800 1 Processor -- start 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.808+0000 7f0e12d35800 1 -- start start 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.808+0000 7f0e12d35800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ed3200 0x563c73ed3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.809+0000 7f0e12d35800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c73c5fe80 con 0x563c73ed3200 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.809+0000 7f0e061dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ed3200 0x563c73ed3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.809+0000 7f0e061dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ed3200 0x563c73ed3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58062/0 (socket says 172.21.15.133:58062) 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.809+0000 7f0e061dc640 1 -- 172.21.15.133:0/4057897359 learned_addr learned my addr 172.21.15.133:0/4057897359 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.809+0000 7f0e061dc640 1 -- 172.21.15.133:0/4057897359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c73ed3b60 con 0x563c73ed3200 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.809+0000 7f0e061dc640 1 --2- 172.21.15.133:0/4057897359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ed3200 0x563c73ed3620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0df8055040 tx=0x7f0df8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.809+0000 7f0cf8e01640 1 -- 172.21.15.133:0/4057897359 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0df8052e60 con 0x563c73ed3200 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.809+0000 7f0cf8e01640 1 -- 172.21.15.133:0/4057897359 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df8065410 con 0x563c73ed3200 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.809+0000 7f0e12d35800 1 -- 172.21.15.133:0/4057897359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c73ed3d50 con 0x563c73ed3200 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.809+0000 7f0cf8e01640 1 -- 172.21.15.133:0/4057897359 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0df80656b0 con 0x563c73ed3200 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.809+0000 7f0e12d35800 1 -- 172.21.15.133:0/4057897359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c73ed4900 con 0x563c73ed3200 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.810+0000 7f0cf8e01640 1 -- 172.21.15.133:0/4057897359 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0df8065810 con 0x563c73ed3200 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.810+0000 7f0cf8e01640 1 --2- 172.21.15.133:0/4057897359 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0ce80367e0 0x7f0ce8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.810+0000 7f0cf8e01640 1 -- 172.21.15.133:0/4057897359 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f0df808ee20 con 0x563c73ed3200 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.810+0000 7f0e0f1de640 1 --2- 172.21.15.133:0/4057897359 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0ce80367e0 0x7f0ce8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.810+0000 7f0e12d35800 1 Processor -- start 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.811+0000 7f0e12d35800 1 -- start start 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.811+0000 7f0e0f1de640 1 --2- 172.21.15.133:0/4057897359 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0ce80367e0 0x7f0ce8038ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x563c73ec34e0 tx=0x7f0e08005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.811+0000 7f0e12d35800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.811+0000 7f0e12d35800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c73c355d0 con 0x563c73ee0360 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.811+0000 7f0e061dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.811+0000 7f0e061dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58072/0 (socket says 172.21.15.133:58072) 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.811+0000 7f0e061dc640 1 -- 172.21.15.133:0/2870599035 learned_addr learned my addr 172.21.15.133:0/2870599035 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.811+0000 7f0e061dc640 1 -- 172.21.15.133:0/2870599035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c73ee0d50 con 0x563c73ee0360 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.811+0000 7f0e061dc640 1 --2- 172.21.15.133:0/2870599035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee0780 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0df808d3f0 tx=0x7f0df80644e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bb53dfcc154e94 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.811+0000 7f0cf27fc640 1 -- 172.21.15.133:0/2870599035 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0df8086dc0 con 0x563c73ee0360 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.811+0000 7f0cf27fc640 1 -- 172.21.15.133:0/2870599035 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df8086f20 con 0x563c73ee0360 2024-02-15T22:56:26.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0cf27fc640 1 -- 172.21.15.133:0/2870599035 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0df80871c0 con 0x563c73ee0360 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0e12d35800 1 -- 172.21.15.133:0/2870599035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 msgr2=0x563c73ee0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2870599035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee0780 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0df808d3f0 tx=0x7f0df80644e0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0e12d35800 1 -- 172.21.15.133:0/2870599035 shutdown_connections 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2870599035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee0780 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0e12d35800 1 -- 172.21.15.133:0/2870599035 >> 172.21.15.133:0/2870599035 conn(0x563c73edc6c0 msgr2=0x563c73eda720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0e12d35800 1 -- 172.21.15.133:0/2870599035 shutdown_connections 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0e12d35800 1 -- 172.21.15.133:0/2870599035 wait complete. 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0e12d35800 1 Processor -- start 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0e12d35800 1 -- start start 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0e12d35800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.812+0000 7f0e12d35800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c73ee7820 con 0x563c73ee0360 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.813+0000 7f0e061dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.813+0000 7f0e061dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58076/0 (socket says 172.21.15.133:58076) 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.813+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 learned_addr learned my addr 172.21.15.133:0/2529463532 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.813+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c73ed4900 con 0x563c73ee0360 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.813+0000 7f0e061dc640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee72e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0df808c290 tx=0x7f0df808d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.813+0000 7f0cf0ff9640 1 -- 172.21.15.133:0/2529463532 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0df808d500 con 0x563c73ee0360 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.813+0000 7f0cf0ff9640 1 -- 172.21.15.133:0/2529463532 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df808d680 con 0x563c73ee0360 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.813+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c73ee7a20 con 0x563c73ee0360 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.813+0000 7f0cf0ff9640 1 -- 172.21.15.133:0/2529463532 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0df808d960 con 0x563c73ee0360 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.813+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c73ee7a20 con 0x563c73ee0360 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.814+0000 7f0cf0ff9640 1 -- 172.21.15.133:0/2529463532 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0df808dac0 con 0x563c73ee0360 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.814+0000 7f0cf0ff9640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0cd80367e0 0x7f0cd8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.814+0000 7f0cf0ff9640 1 -- 172.21.15.133:0/2529463532 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f0df8097af0 con 0x563c73ee0360 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.814+0000 7f0e0f1de640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0cd80367e0 0x7f0cd8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.814+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.814+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563c73ef2d20 0x563c73ef51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.814+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ef5930 con 0x563c73ef2d20 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.814+0000 7f0e0e9dd640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563c73ef2d20 0x563c73ef51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e0f1de640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0cd80367e0 0x7f0cd8038ca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800b010 tx=0x7f0e08020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e0e9dd640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563c73ef2d20 0x563c73ef51e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e12d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e12d35800 20 realm 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ef5d00 con 0x563c73ef2d20 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e12d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e12d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ef6580 con 0x563c73ef2d20 2024-02-15T22:56:26.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e12d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.815+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ef68e0 con 0x563c73ef2d20 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.816+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.816+0000 7f0e12d35800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.816+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.816+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ef61e0 con 0x563c73ef2d20 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.816+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.816+0000 7f0e12d35800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.816+0000 7f0e12d35800 20 searching for the correct realm 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.816+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563c73ef8c60 0x563c73efb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.816+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef8c60 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.816+0000 7f0e061dc640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563c73ef8c60 0x563c73efb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.816+0000 7f0e061dc640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563c73ef8c60 0x563c73efb050 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.817+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.817+0000 7f0e061dc640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0df8084070 0x7f0df806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.817+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0df8084070 2024-02-15T22:56:26.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.817+0000 7f0e0f1de640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0df8084070 0x7f0df806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.817+0000 7f0e0f1de640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0df8084070 0x7f0df806e5f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.817+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e0800a4a0 con 0x7f0df8084070 2024-02-15T22:56:26.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.817+0000 7f0e0f1de640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f0e080141d0 0x7f0e08015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.817+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0e080141d0 2024-02-15T22:56:26.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.818+0000 7f0e0e9dd640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f0e080141d0 0x7f0e08015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.818+0000 7f0e0e9dd640 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f0e080141d0 0x7f0e08015940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.818+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x7f0e080141d0 2024-02-15T22:56:26.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.818+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef2d20 2024-02-15T22:56:26.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.818+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.818+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef2d20 2024-02-15T22:56:26.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.819+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.819+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0e080141d0 2024-02-15T22:56:26.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.819+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x7f0e080141d0 2024-02-15T22:56:26.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.819+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0e080141d0 2024-02-15T22:56:26.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.819+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x7f0e080141d0 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.819+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0df8084070 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.819+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e0800a4a0 con 0x7f0df8084070 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.819+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef8c60 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.820+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.820+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef2d20 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.820+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.820+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0e080141d0 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.820+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x7f0e080141d0 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.820+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef2d20 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.821+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.821+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0df8084070 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.821+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0e0803a040 con 0x7f0df8084070 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.821+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef8c60 2024-02-15T22:56:26.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.821+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.821+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef8c60 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.821+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.821+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0e080141d0 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.822+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x7f0e080141d0 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.822+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef8c60 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.822+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.822+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef8c60 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.822+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.822+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef2d20 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.822+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.822+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef2d20 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.822+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.823+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0e080141d0 2024-02-15T22:56:26.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.823+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x7f0e080141d0 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.823+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef8c60 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.823+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.823+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0df8084070 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.823+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e0803a040 con 0x7f0df8084070 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.823+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef2d20 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.823+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0e00014070 con 0x563c73ef2d20 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.823+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0e080141d0 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.824+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00014070 con 0x7f0e080141d0 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.824+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef8c60 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.824+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.824+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0e080141d0 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.824+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.824+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0df8084070 2024-02-15T22:56:26.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.824+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e0803a040 con 0x7f0df8084070 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.824+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef8c60 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0e080141d0 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x563c73ef2d20 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efb720 con 0x7f0df8084070 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e0803a040 con 0x7f0df8084070 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e12d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e12d35800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e12d35800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e12d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:26.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e12d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.825+0000 7f0e12d35800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ef7730 con 0x563c73ef2d20 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ef73b0 con 0x563c73ef2d20 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73ef80c0 con 0x563c73ef2d20 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 20 zone default found 2024-02-15T22:56:26.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 4 Realm: () 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 20 zonegroup default 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.826+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efbbb0 con 0x7f0e080141d0 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e12d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efd940 con 0x563c73ef8c60 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e12d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efdca0 con 0x563c73ef8c60 2024-02-15T22:56:26.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e12d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e12d35800 20 started sync module instance, tier type = 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e12d35800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.827+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efd220 con 0x7f0df8084070 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.828+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e0803a040 con 0x7f0df8084070 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.828+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94817643122048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efd5d0 con 0x7f0df8084070 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.828+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efe9b0 con 0x563c73ef2d20 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.829+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94817643122048] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e0803a040 con 0x7f0df8084070 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.829+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.829+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94817643127168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efeb20 con 0x563c73ef2d20 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.830+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73eff5a0 con 0x563c73ef8c60 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.830+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94817643127168] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.831+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.831+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94817643131040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73eff980 con 0x563c73ef8c60 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.831+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f00350 con 0x7f0df8084070 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.832+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e0803a040 con 0x7f0df8084070 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.832+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94817643134544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f00ba0 con 0x7f0df8084070 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.832+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f01650 con 0x563c73ef2d20 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.832+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94817643131040] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.833+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.833+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94817643139408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f01610 con 0x563c73ef2d20 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.833+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f020c0 con 0x7f0e080141d0 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.833+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94817643134544] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e0803a040 con 0x7f0df8084070 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.834+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.834+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94817643136768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f020c0 con 0x7f0e080141d0 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.834+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f02ac0 con 0x7f0e080141d0 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.834+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94817643139408] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.835+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94817643136768] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.835+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.835+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94817643128224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f025e0 con 0x7f0e080141d0 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.835+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f02f90 con 0x7f0e080141d0 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.836+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.836+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94817643145904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f033b0 con 0x7f0e080141d0 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.836+0000 7f0e12d35800 20 add_watcher() i=0 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.836+0000 7f0e12d35800 20 add_watcher() i=1 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.836+0000 7f0e12d35800 20 add_watcher() i=2 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.836+0000 7f0e12d35800 20 add_watcher() i=3 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.836+0000 7f0e12d35800 20 add_watcher() i=4 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.836+0000 7f0e12d35800 20 add_watcher() i=5 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.836+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94817643128224] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.836+0000 7f0e12d35800 20 add_watcher() i=6 2024-02-15T22:56:26.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.837+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94817643145904] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.837+0000 7f0e12d35800 20 add_watcher() i=7 2024-02-15T22:56:26.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.837+0000 7f0e12d35800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:26.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.837+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f01ce0 con 0x563c73ef2d20 2024-02-15T22:56:26.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.837+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.837+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94817643146960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f03d20 con 0x563c73ef2d20 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.838+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94817643146960] v30'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.838+0000 7f0cc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0e12d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0e12d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0e12d35800 5 note: GC not initialized 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0c3ffff640 20 reqs_thread_entry: start 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0e12d35800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0e12d35800 20 Filter name: none 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0c3dffb640 20 reqs_thread_entry: start 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0e12d35800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f37f70 con 0x563c73ef2d20 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0e12d35800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.839+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f37f70 con 0x7f0df8084070 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.840+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f0e0803a040 con 0x7f0df8084070 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.840+0000 7f0cc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.840+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94817643146960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f37f30 con 0x563c73ef2d20 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.841+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94817643146960] v30'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.841+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94817643122048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f37f30 con 0x7f0df8084070 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.842+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94817643122048] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e0803a040 con 0x7f0df8084070 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.842+0000 7f0e12d35800 20 remove_watcher() i=0 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.842+0000 7f0e12d35800 2 removed watcher, disabling cache 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.842+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94817643127168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f37f30 con 0x563c73ef2d20 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.844+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94817643127168] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.844+0000 7f0e12d35800 20 remove_watcher() i=1 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.844+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94817643131040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f37f30 con 0x563c73ef8c60 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.845+0000 7f0e061dc640 1 -- 172.21.15.133:0/2529463532 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94817643131040] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0df80785f0 con 0x563c73ef8c60 2024-02-15T22:56:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.845+0000 7f0e12d35800 20 remove_watcher() i=2 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.845+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94817643134544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efcd80 con 0x7f0df8084070 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.846+0000 7f0e0f1de640 1 -- 172.21.15.133:0/2529463532 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94817643134544] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e0803a040 con 0x7f0df8084070 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.846+0000 7f0e12d35800 20 remove_watcher() i=3 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.846+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94817643139408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efe180 con 0x563c73ef2d20 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.847+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94817643139408] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x563c73ef2d20 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.847+0000 7f0e12d35800 20 remove_watcher() i=4 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.847+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94817643136768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efcd80 con 0x7f0e080141d0 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.848+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94817643136768] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.848+0000 7f0e12d35800 20 remove_watcher() i=5 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.848+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94817643128224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73f01150 con 0x7f0e080141d0 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.849+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94817643128224] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.849+0000 7f0e12d35800 20 remove_watcher() i=6 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.849+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94817643145904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c73efcd80 con 0x7f0e080141d0 2024-02-15T22:56:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.849+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94817643145904] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e00052040 con 0x7f0e080141d0 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.849+0000 7f0e12d35800 20 remove_watcher() i=7 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f0e080141d0 msgr2=0x7f0e08015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f0e080141d0 0x7f0e08015940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563c73ef2d20 msgr2=0x563c73ef51e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563c73ef2d20 0x563c73ef51e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0df8084070 msgr2=0x7f0df806e5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0df8084070 0x7f0df806e5f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563c73ef8c60 msgr2=0x563c73efb050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563c73ef8c60 0x563c73efb050 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0cd80367e0 msgr2=0x7f0cd8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0cd80367e0 0x7f0cd8038ca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800b010 tx=0x7f0e08020000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 msgr2=0x563c73ee72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e0e9dd640 1 -- 172.21.15.133:0/2529463532 reap_dead start 2024-02-15T22:56:26.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee72e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0df808c290 tx=0x7f0df808d350 comp rx=0 tx=0).stop 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 shutdown_connections 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 --2- 172.21.15.133:0/2529463532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ee0360 0x563c73ee72e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 >> 172.21.15.133:0/2529463532 conn(0x563c73edc6c0 msgr2=0x563c73ed9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 shutdown_connections 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/2529463532 wait complete. 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/4057897359 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0ce80367e0 msgr2=0x7f0ce8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 --2- 172.21.15.133:0/4057897359 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0ce80367e0 0x7f0ce8038ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x563c73ec34e0 tx=0x7f0e08005840 comp rx=0 tx=0).stop 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/4057897359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ed3200 msgr2=0x563c73ed3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 --2- 172.21.15.133:0/4057897359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ed3200 0x563c73ed3620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0df8055040 tx=0x7f0df8002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/4057897359 shutdown_connections 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 --2- 172.21.15.133:0/4057897359 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0ce80367e0 0x7f0ce8038ca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 --2- 172.21.15.133:0/4057897359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73ed3200 0x563c73ed3620 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/4057897359 >> 172.21.15.133:0/4057897359 conn(0x563c73ec72a0 msgr2=0x563c73ec76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/4057897359 shutdown_connections 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.850+0000 7f0e12d35800 1 -- 172.21.15.133:0/4057897359 wait complete. 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563c73dc23f0 msgr2=0x563c73ec2460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563c73dc23f0 0x563c73ec2460 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0cf40367e0 msgr2=0x7f0cf4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0cf40367e0 0x7f0cf4038ca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0df8054000 tx=0x7f0df804e000 comp rx=0 tx=0).stop 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 msgr2=0x563c73ebb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73ebb7d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0e00000c00 tx=0x7f0e00000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 shutdown_connections 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563c73dc23f0 0x563c73ec2460 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0cf40367e0 0x7f0cf4038ca0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 --2- 172.21.15.133:0/3102626863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c73dc08b0 0x563c73ebb7d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 >> 172.21.15.133:0/3102626863 conn(0x563c73dbc4d0 msgr2=0x563c73eae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 shutdown_connections 2024-02-15T22:56:26.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.851+0000 7f0e12d35800 1 -- 172.21.15.133:0/3102626863 wait complete. 2024-02-15T22:56:26.863 INFO:teuthology.orchestra.run.smithi133.stdout:[] 2024-02-15T22:56:26.864 DEBUG:tasks.util.rgw: json result: [] 2024-02-15T22:56:26.880 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:26.880 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-15T22:56:26.880 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-15T22:56:26.881 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-15T22:56:26.947 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:26.948 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.945+0000 7f138f72f800 1 Processor -- start 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.945+0000 7f138f72f800 1 -- start start 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.945+0000 7f138f72f800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a5bce733f0 0x55a5bce7bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.945+0000 7f138f72f800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a5bcdbdbb0 con 0x55a5bce718b0 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.945+0000 7f138f72f800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a5bcd75450 con 0x55a5bce733f0 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.945+0000 7f138acc4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a5bce733f0 0x55a5bce7bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.945+0000 7f138b4c5640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55a5bce718b0 0x55a5bce71cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45010/0 (socket says 172.21.15.133:45010) 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.945+0000 7f138b4c5640 1 -- 172.21.15.133:0/1676016556 learned_addr learned my addr 172.21.15.133:0/1676016556 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.946+0000 7f138a4c3640 1 -- 172.21.15.133:0/1676016556 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869636277 0 0) 0x55a5bcdbdbb0 con 0x55a5bce718b0 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.946+0000 7f138a4c3640 1 -- 172.21.15.133:0/1676016556 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1374001e10 con 0x55a5bce718b0 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.946+0000 7f138acc4640 1 -- 172.21.15.133:0/1676016556 >> v1:172.21.15.52:6789/0 conn(0x55a5bce718b0 legacy=0x55a5bce71cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.946+0000 7f138acc4640 1 -- 172.21.15.133:0/1676016556 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5bcde6160 con 0x55a5bce733f0 2024-02-15T22:56:26.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.948+0000 7f138acc4640 1 --2- 172.21.15.133:0/1676016556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce733f0 0x55a5bce7bef0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f138000a470 tx=0x7f138001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3017e3c520765a93 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.948+0000 7f138a4c3640 1 -- 172.21.15.133:0/1676016556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f138004ac50 con 0x55a5bce733f0 2024-02-15T22:56:26.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.948+0000 7f138a4c3640 1 -- 172.21.15.133:0/1676016556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138004adb0 con 0x55a5bce733f0 2024-02-15T22:56:26.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.948+0000 7f138a4c3640 1 -- 172.21.15.133:0/1676016556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1380052590 con 0x55a5bce733f0 2024-02-15T22:56:26.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.948+0000 7f138f72f800 1 -- 172.21.15.133:0/1676016556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce733f0 msgr2=0x55a5bce7bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.948+0000 7f138f72f800 1 --2- 172.21.15.133:0/1676016556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce733f0 0x55a5bce7bef0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f138000a470 tx=0x7f138001cc80 comp rx=0 tx=0).stop 2024-02-15T22:56:26.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.948+0000 7f138f72f800 1 -- 172.21.15.133:0/1676016556 shutdown_connections 2024-02-15T22:56:26.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.948+0000 7f138f72f800 1 --2- 172.21.15.133:0/1676016556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce733f0 0x55a5bce7bef0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.948+0000 7f138f72f800 1 -- 172.21.15.133:0/1676016556 >> 172.21.15.133:0/1676016556 conn(0x55a5bce6d4d0 msgr2=0x55a5bce6f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.948+0000 7f138f72f800 1 -- 172.21.15.133:0/1676016556 shutdown_connections 2024-02-15T22:56:26.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.948+0000 7f138f72f800 1 -- 172.21.15.133:0/1676016556 wait complete. 2024-02-15T22:56:26.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.960+0000 7f138f72f800 1 Processor -- start 2024-02-15T22:56:26.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.960+0000 7f138f72f800 1 -- start start 2024-02-15T22:56:26.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.960+0000 7f138f72f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf65120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.960+0000 7f138f72f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcd72980 con 0x55a5bce718b0 2024-02-15T22:56:26.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.960+0000 7f138b4c5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf65120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.960+0000 7f138b4c5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf65120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58096/0 (socket says 172.21.15.133:58096) 2024-02-15T22:56:26.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.960+0000 7f138b4c5640 1 -- 172.21.15.133:0/2768920984 learned_addr learned my addr 172.21.15.133:0/2768920984 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.961+0000 7f138b4c5640 1 -- 172.21.15.133:0/2768920984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380005d20 con 0x55a5bce718b0 2024-02-15T22:56:26.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.961+0000 7f138b4c5640 1 --2- 172.21.15.133:0/2768920984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf65120 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f137c001c50 tx=0x7f137c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b199f4f71ee18ee server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.961+0000 7f127960a640 1 -- 172.21.15.133:0/2768920984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c00e470 con 0x55a5bce718b0 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.961+0000 7f127960a640 1 -- 172.21.15.133:0/2768920984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c00e5d0 con 0x55a5bce718b0 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.961+0000 7f127960a640 1 -- 172.21.15.133:0/2768920984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c00e8b0 con 0x55a5bce718b0 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.962+0000 7f138f72f800 1 -- 172.21.15.133:0/2768920984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 msgr2=0x55a5bcf65120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.962+0000 7f138f72f800 1 --2- 172.21.15.133:0/2768920984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf65120 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f137c001c50 tx=0x7f137c00b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.962+0000 7f138f72f800 1 -- 172.21.15.133:0/2768920984 shutdown_connections 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.962+0000 7f138f72f800 1 --2- 172.21.15.133:0/2768920984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf65120 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.962+0000 7f138f72f800 1 -- 172.21.15.133:0/2768920984 >> 172.21.15.133:0/2768920984 conn(0x55a5bce6d4d0 msgr2=0x55a5bcf60a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.962+0000 7f138f72f800 1 -- 172.21.15.133:0/2768920984 shutdown_connections 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.962+0000 7f138f72f800 1 -- 172.21.15.133:0/2768920984 wait complete. 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.962+0000 7f138f72f800 1 Processor -- start 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.962+0000 7f138f72f800 1 -- start start 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.962+0000 7f138f72f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf6c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.962+0000 7f138f72f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcd6e160 con 0x55a5bce718b0 2024-02-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.963+0000 7f138b4c5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf6c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.963+0000 7f138b4c5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf6c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58112/0 (socket says 172.21.15.133:58112) 2024-02-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.963+0000 7f138b4c5640 1 -- 172.21.15.133:0/4158065011 learned_addr learned my addr 172.21.15.133:0/4158065011 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.963+0000 7f138b4c5640 1 -- 172.21.15.133:0/4158065011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374001e10 con 0x55a5bce718b0 2024-02-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.963+0000 7f138b4c5640 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf6c7d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f137c000c00 tx=0x7f137c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.963+0000 7f1277e07640 1 -- 172.21.15.133:0/4158065011 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c01f070 con 0x55a5bce718b0 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.963+0000 7f1277e07640 1 -- 172.21.15.133:0/4158065011 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c018830 con 0x55a5bce718b0 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.963+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a5bcf6cd10 con 0x55a5bce718b0 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.963+0000 7f1277e07640 1 -- 172.21.15.133:0/4158065011 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c018ad0 con 0x55a5bce718b0 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.963+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5bcf6d1f0 con 0x55a5bce718b0 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.964+0000 7f1277e07640 1 -- 172.21.15.133:0/4158065011 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f137c018d40 con 0x55a5bce718b0 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.964+0000 7f1277e07640 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12700367e0 0x7f1270038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.964+0000 7f1277e07640 1 -- 172.21.15.133:0/4158065011 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f137c04c210 con 0x55a5bce718b0 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.964+0000 7f138acc4640 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12700367e0 0x7f1270038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.964+0000 7f138f72f800 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a5bce733f0 0x55a5bcf73480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.964+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcf73a50 con 0x55a5bce733f0 2024-02-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.964+0000 7f138bcc6640 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a5bce733f0 0x55a5bcf73480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.965+0000 7f138acc4640 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12700367e0 0x7f1270038ca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1380054000 tx=0x7f138004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.965+0000 7f138bcc6640 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a5bce733f0 0x55a5bcf73480 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.965+0000 7f138bcc6640 1 -- 172.21.15.133:0/4158065011 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55a5bce733f0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.965+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcf70b70 con 0x55a5bce733f0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.965+0000 7f138bcc6640 1 -- 172.21.15.133:0/4158065011 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f138400a4a0 con 0x55a5bce733f0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.965+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcf75780 con 0x55a5bce733f0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.966+0000 7f138bcc6640 1 -- 172.21.15.133:0/4158065011 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f138400a4a0 con 0x55a5bce733f0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.966+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcf74980 con 0x55a5bce733f0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.966+0000 7f138bcc6640 1 -- 172.21.15.133:0/4158065011 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f138400a4a0 con 0x55a5bce733f0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.966+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcf74d90 con 0x55a5bce733f0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.966+0000 7f138bcc6640 1 -- 172.21.15.133:0/4158065011 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f138400a4a0 con 0x55a5bce733f0 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.967+0000 7f138f72f800 1 Processor -- start 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.967+0000 7f138f72f800 1 -- start start 2024-02-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.967+0000 7f138f72f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf84200 0x55a5bcf84620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.967+0000 7f138f72f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcd10e80 con 0x55a5bcf84200 2024-02-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.967+0000 7f138acc4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf84200 0x55a5bcf84620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.967+0000 7f138acc4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf84200 0x55a5bcf84620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58124/0 (socket says 172.21.15.133:58124) 2024-02-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.967+0000 7f138acc4640 1 -- 172.21.15.133:0/2694800405 learned_addr learned my addr 172.21.15.133:0/2694800405 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.968+0000 7f138acc4640 1 -- 172.21.15.133:0/2694800405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5bcf84b60 con 0x55a5bcf84200 2024-02-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.968+0000 7f138acc4640 1 --2- 172.21.15.133:0/2694800405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf84200 0x55a5bcf84620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1380055040 tx=0x7f1380002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.968+0000 7f1275602640 1 -- 172.21.15.133:0/2694800405 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1380052e60 con 0x55a5bcf84200 2024-02-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.968+0000 7f1275602640 1 -- 172.21.15.133:0/2694800405 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1380065410 con 0x55a5bcf84200 2024-02-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.968+0000 7f138f72f800 1 -- 172.21.15.133:0/2694800405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a5bcf84d50 con 0x55a5bcf84200 2024-02-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.968+0000 7f1275602640 1 -- 172.21.15.133:0/2694800405 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13800656b0 con 0x55a5bcf84200 2024-02-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.968+0000 7f138f72f800 1 -- 172.21.15.133:0/2694800405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5bcf85900 con 0x55a5bcf84200 2024-02-15T22:56:26.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.969+0000 7f1275602640 1 -- 172.21.15.133:0/2694800405 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1380065810 con 0x55a5bcf84200 2024-02-15T22:56:26.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.969+0000 7f1275602640 1 --2- 172.21.15.133:0/2694800405 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12640367e0 0x7f1264038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.969+0000 7f1275602640 1 -- 172.21.15.133:0/2694800405 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f138008ee20 con 0x55a5bcf84200 2024-02-15T22:56:26.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.969+0000 7f138bcc6640 1 --2- 172.21.15.133:0/2694800405 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12640367e0 0x7f1264038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.969+0000 7f138f72f800 1 Processor -- start 2024-02-15T22:56:26.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.969+0000 7f138f72f800 1 -- start start 2024-02-15T22:56:26.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.969+0000 7f138bcc6640 1 --2- 172.21.15.133:0/2694800405 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12640367e0 0x7f1264038ca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55a5bcf743c0 tx=0x7f1384005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.969+0000 7f138f72f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf91780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.969+0000 7f138f72f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcce65d0 con 0x55a5bcf91360 2024-02-15T22:56:26.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.969+0000 7f138acc4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf91780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.970+0000 7f138acc4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf91780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58132/0 (socket says 172.21.15.133:58132) 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.970+0000 7f138acc4640 1 -- 172.21.15.133:0/2157179673 learned_addr learned my addr 172.21.15.133:0/2157179673 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.970+0000 7f138acc4640 1 -- 172.21.15.133:0/2157179673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5bcf91d50 con 0x55a5bcf91360 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.970+0000 7f138acc4640 1 --2- 172.21.15.133:0/2157179673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf91780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f138008d3f0 tx=0x7f13800644e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98046fe6b68df540 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.970+0000 7f126effd640 1 -- 172.21.15.133:0/2157179673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1380086dc0 con 0x55a5bcf91360 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.970+0000 7f126effd640 1 -- 172.21.15.133:0/2157179673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1380086f20 con 0x55a5bcf91360 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.970+0000 7f126effd640 1 -- 172.21.15.133:0/2157179673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13800871c0 con 0x55a5bcf91360 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.970+0000 7f138f72f800 1 -- 172.21.15.133:0/2157179673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 msgr2=0x55a5bcf91780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.970+0000 7f138f72f800 1 --2- 172.21.15.133:0/2157179673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf91780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f138008d3f0 tx=0x7f13800644e0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138f72f800 1 -- 172.21.15.133:0/2157179673 shutdown_connections 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138f72f800 1 --2- 172.21.15.133:0/2157179673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf91780 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138f72f800 1 -- 172.21.15.133:0/2157179673 >> 172.21.15.133:0/2157179673 conn(0x55a5bcf8d6c0 msgr2=0x55a5bcf8b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138f72f800 1 -- 172.21.15.133:0/2157179673 shutdown_connections 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138f72f800 1 -- 172.21.15.133:0/2157179673 wait complete. 2024-02-15T22:56:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138f72f800 1 Processor -- start 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138f72f800 1 -- start start 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138f72f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138f72f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcf98820 con 0x55a5bcf91360 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138acc4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138acc4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58134/0 (socket says 172.21.15.133:58134) 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 learned_addr learned my addr 172.21.15.133:0/726989313 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.971+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5bcf85900 con 0x55a5bcf91360 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.972+0000 7f138acc4640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf982e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f138008c290 tx=0x7f138008d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.972+0000 7f126d7fa640 1 -- 172.21.15.133:0/726989313 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f138008d500 con 0x55a5bcf91360 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.972+0000 7f126d7fa640 1 -- 172.21.15.133:0/726989313 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138008d680 con 0x55a5bcf91360 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.972+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a5bcf98a20 con 0x55a5bcf91360 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.972+0000 7f126d7fa640 1 -- 172.21.15.133:0/726989313 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f138008d960 con 0x55a5bcf91360 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.972+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5bcf98a20 con 0x55a5bcf91360 2024-02-15T22:56:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.973+0000 7f126d7fa640 1 -- 172.21.15.133:0/726989313 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f138008dac0 con 0x55a5bcf91360 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.973+0000 7f126d7fa640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12540367e0 0x7f1254038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.973+0000 7f126d7fa640 1 -- 172.21.15.133:0/726989313 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f1380097af0 con 0x55a5bcf91360 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.973+0000 7f138bcc6640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12540367e0 0x7f1254038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.973+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.973+0000 7f138f72f800 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a5bcfa3d30 0x55a5bcfa61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.973+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfa6940 con 0x55a5bcfa3d30 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.973+0000 7f138b4c5640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a5bcfa3d30 0x55a5bcfa61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.973+0000 7f138bcc6640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12540367e0 0x7f1254038ca0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f138400b010 tx=0x7f1384020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.973+0000 7f138b4c5640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a5bcfa3d30 0x55a5bcfa61f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f137c014070 con 0x55a5bcfa3d30 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 20 realm 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfa6d10 con 0x55a5bcfa3d30 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f137c014070 con 0x55a5bcfa3d30 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfa7590 con 0x55a5bcfa3d30 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f137c014070 con 0x55a5bcfa3d30 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfa78f0 con 0x55a5bcfa3d30 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f137c014070 con 0x55a5bcfa3d30 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.974+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfa71f0 con 0x55a5bcfa3d30 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.975+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f137c014070 con 0x55a5bcfa3d30 2024-02-15T22:56:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.975+0000 7f138f72f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.975+0000 7f138f72f800 20 searching for the correct realm 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.975+0000 7f138f72f800 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a5bcfa9c70 0x55a5bcfac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.975+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.975+0000 7f138acc4640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a5bcfa9c70 0x55a5bcfac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.975+0000 7f138acc4640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a5bcfa9c70 0x55a5bcfac060 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.975+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.975+0000 7f138acc4640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1380084070 0x7f138006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.975+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f1380084070 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.975+0000 7f138bcc6640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1380084070 0x7f138006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.976+0000 7f138bcc6640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1380084070 0x7f138006e5f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.976+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x7f1380084070 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.976+0000 7f138bcc6640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f13840141d0 0x7f1384015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.976+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f13840141d0 2024-02-15T22:56:26.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.976+0000 7f138b4c5640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f13840141d0 0x7f1384015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.977+0000 7f138b4c5640 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f13840141d0 0x7f1384015940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.977+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c035040 con 0x7f13840141d0 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.977+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa3d30 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.977+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c035040 con 0x55a5bcfa3d30 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.977+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa3d30 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.977+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c035040 con 0x55a5bcfa3d30 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.977+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f13840141d0 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.978+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c035040 con 0x7f13840141d0 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.978+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f13840141d0 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.978+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c035040 con 0x7f13840141d0 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.978+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f1380084070 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.978+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x7f1380084070 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.978+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.978+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.978+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa3d30 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.978+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c035040 con 0x55a5bcfa3d30 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.978+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f13840141d0 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.979+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c035040 con 0x7f13840141d0 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.979+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa3d30 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.979+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c035040 con 0x55a5bcfa3d30 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.979+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f1380084070 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.979+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f138403a040 con 0x7f1380084070 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.979+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.979+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.979+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.980+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.980+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f13840141d0 2024-02-15T22:56:26.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.980+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c035040 con 0x7f13840141d0 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.980+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.980+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.980+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.980+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.980+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa3d30 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.981+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c035040 con 0x55a5bcfa3d30 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.981+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa3d30 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.981+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f137c035040 con 0x55a5bcfa3d30 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.981+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f13840141d0 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.981+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.981+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.981+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.981+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f1380084070 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.981+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138403a040 con 0x7f1380084070 2024-02-15T22:56:26.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.982+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa3d30 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.982+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.982+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f13840141d0 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.982+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.982+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.982+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.982+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f13840141d0 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.983+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.983+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f1380084070 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.983+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138403a040 con 0x7f1380084070 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.983+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.983+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.983+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f13840141d0 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.983+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:26.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.983+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x55a5bcfa3d30 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfac6e0 con 0x7f1380084070 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138403a040 con 0x7f1380084070 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfa8740 con 0x55a5bcfa3d30 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:26.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfa83c0 con 0x55a5bcfa3d30 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.984+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfa90d0 con 0x55a5bcfa3d30 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 20 zone default found 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 4 Realm: () 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 20 zonegroup default 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfacb70 con 0x7f13840141d0 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.985+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfae900 con 0x55a5bcfa9c70 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.986+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.986+0000 7f138f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.986+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.986+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfaec60 con 0x55a5bcfa9c70 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.986+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.986+0000 7f138f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.986+0000 7f138f72f800 20 started sync module instance, tier type = 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.986+0000 7f138f72f800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:27.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.986+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfae1e0 con 0x7f1380084070 2024-02-15T22:56:27.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.987+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138403a040 con 0x7f1380084070 2024-02-15T22:56:27.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.987+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94170328522048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfae590 con 0x7f1380084070 2024-02-15T22:56:27.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.987+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfaf970 con 0x55a5bcfa3d30 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.988+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94170328522048] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138403a040 con 0x7f1380084070 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.988+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.988+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94170328527168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfafac0 con 0x55a5bcfa3d30 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.988+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb0570 con 0x55a5bcfa9c70 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.989+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94170328527168] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.990+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.990+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94170328531056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb0950 con 0x55a5bcfa9c70 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.990+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb1300 con 0x7f1380084070 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.991+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138403a040 con 0x7f1380084070 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.991+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94170328531056] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.991+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94170328528224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb16b0 con 0x7f1380084070 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.991+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb2120 con 0x55a5bcfa3d30 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.992+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94170328528224] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138403a040 con 0x7f1380084070 2024-02-15T22:56:27.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.992+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.992+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94170328538112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb20e0 con 0x55a5bcfa3d30 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.992+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb2b80 con 0x7f13840141d0 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.993+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.993+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94170328540784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb2b80 con 0x7f13840141d0 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.993+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb3aa0 con 0x7f13840141d0 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.993+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94170328538112] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.994+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.994+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94170328544672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb3a60 con 0x7f13840141d0 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.994+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb4460 con 0x7f13840141d0 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.994+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94170328540784] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.995+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94170328544672] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.995+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.995+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94170328534560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb2eb0 con 0x7f13840141d0 2024-02-15T22:56:27.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.995+0000 7f138f72f800 20 add_watcher() i=0 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.995+0000 7f138f72f800 20 add_watcher() i=1 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.995+0000 7f138f72f800 20 add_watcher() i=2 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.995+0000 7f138f72f800 20 add_watcher() i=3 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.995+0000 7f138f72f800 20 add_watcher() i=4 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.995+0000 7f138f72f800 20 add_watcher() i=5 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.995+0000 7f138f72f800 20 add_watcher() i=6 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.996+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94170328534560] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.996+0000 7f138f72f800 20 add_watcher() i=7 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.996+0000 7f138f72f800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.996+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb7480 con 0x55a5bcfa3d30 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.996+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.996+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94170328547168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb48c0 con 0x55a5bcfa3d30 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.997+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94170328547168] v30'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.997+0000 7f1241fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.997+0000 7f138f72f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:27.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.997+0000 7f138f72f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:27.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.997+0000 7f138f72f800 5 note: GC not initialized 2024-02-15T22:56:27.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.997+0000 7f1240fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:27.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.998+0000 7f138f72f800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:27.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.998+0000 7f138f72f800 20 Filter name: none 2024-02-15T22:56:27.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.998+0000 7f11ba7fc640 20 reqs_thread_entry: start 2024-02-15T22:56:27.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.998+0000 7f138f72f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.998+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfe8fb0 con 0x55a5bcfa3d30 2024-02-15T22:56:27.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.998+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.998+0000 7f138f72f800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:27.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.998+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfe8fb0 con 0x7f1380084070 2024-02-15T22:56:27.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.998+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f138403a040 con 0x7f1380084070 2024-02-15T22:56:27.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.999+0000 7f1241fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:26.999+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94170328547168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb6510 con 0x55a5bcfa3d30 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.000+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94170328547168] v30'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.000+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94170328522048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb3f60 con 0x7f1380084070 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.001+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94170328522048] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138403a040 con 0x7f1380084070 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.001+0000 7f138f72f800 20 remove_watcher() i=0 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.001+0000 7f138f72f800 2 removed watcher, disabling cache 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.001+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94170328527168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfadd40 con 0x55a5bcfa3d30 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.002+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94170328527168] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.002+0000 7f138f72f800 20 remove_watcher() i=1 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.002+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94170328531056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfadd40 con 0x55a5bcfa9c70 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.003+0000 7f138acc4640 1 -- 172.21.15.133:0/726989313 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94170328531056] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13800785f0 con 0x55a5bcfa9c70 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.003+0000 7f138f72f800 20 remove_watcher() i=2 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.003+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94170328528224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb0070 con 0x7f1380084070 2024-02-15T22:56:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.004+0000 7f138bcc6640 1 -- 172.21.15.133:0/726989313 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94170328528224] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138403a040 con 0x7f1380084070 2024-02-15T22:56:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.004+0000 7f138f72f800 20 remove_watcher() i=3 2024-02-15T22:56:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.004+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94170328538112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb3f60 con 0x55a5bcfa3d30 2024-02-15T22:56:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.005+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94170328538112] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x55a5bcfa3d30 2024-02-15T22:56:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.005+0000 7f138f72f800 20 remove_watcher() i=4 2024-02-15T22:56:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.005+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94170328540784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb1c00 con 0x7f13840141d0 2024-02-15T22:56:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.006+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94170328540784] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.006+0000 7f138f72f800 20 remove_watcher() i=5 2024-02-15T22:56:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.006+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94170328544672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb2670 con 0x7f13840141d0 2024-02-15T22:56:27.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.007+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94170328544672] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:27.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.007+0000 7f138f72f800 20 remove_watcher() i=6 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.007+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94170328534560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a5bcfb2670 con 0x7f13840141d0 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94170328534560] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c052040 con 0x7f13840141d0 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 20 remove_watcher() i=7 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f13840141d0 msgr2=0x7f1384015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f13840141d0 0x7f1384015940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a5bcfa3d30 msgr2=0x55a5bcfa61f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a5bcfa3d30 0x55a5bcfa61f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1380084070 msgr2=0x7f138006e5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1380084070 0x7f138006e5f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a5bcfa9c70 msgr2=0x55a5bcfac060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a5bcfa9c70 0x55a5bcfac060 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12540367e0 msgr2=0x7f1254038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12540367e0 0x7f1254038ca0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f138400b010 tx=0x7f1384020000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 msgr2=0x55a5bcf982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138b4c5640 1 -- 172.21.15.133:0/726989313 reap_dead start 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf982e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f138008c290 tx=0x7f138008d350 comp rx=0 tx=0).stop 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 shutdown_connections 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 --2- 172.21.15.133:0/726989313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf91360 0x55a5bcf982e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 >> 172.21.15.133:0/726989313 conn(0x55a5bcf8d6c0 msgr2=0x55a5bcf8ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 shutdown_connections 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 -- 172.21.15.133:0/726989313 wait complete. 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 -- 172.21.15.133:0/2694800405 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12640367e0 msgr2=0x7f1264038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.008+0000 7f138f72f800 1 --2- 172.21.15.133:0/2694800405 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12640367e0 0x7f1264038ca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55a5bcf743c0 tx=0x7f1384005840 comp rx=0 tx=0).stop 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/2694800405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf84200 msgr2=0x55a5bcf84620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 --2- 172.21.15.133:0/2694800405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf84200 0x55a5bcf84620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1380055040 tx=0x7f1380002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/2694800405 shutdown_connections 2024-02-15T22:56:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 --2- 172.21.15.133:0/2694800405 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12640367e0 0x7f1264038ca0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 --2- 172.21.15.133:0/2694800405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bcf84200 0x55a5bcf84620 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/2694800405 >> 172.21.15.133:0/2694800405 conn(0x55a5bcf782a0 msgr2=0x55a5bcf786a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/2694800405 shutdown_connections 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/2694800405 wait complete. 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a5bce733f0 msgr2=0x55a5bcf73480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a5bce733f0 0x55a5bcf73480 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12700367e0 msgr2=0x7f1270038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12700367e0 0x7f1270038ca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1380054000 tx=0x7f138004e000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 msgr2=0x55a5bcf6c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf6c7d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f137c000c00 tx=0x7f137c000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 shutdown_connections 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a5bce733f0 0x55a5bcf73480 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f12700367e0 0x7f1270038ca0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 --2- 172.21.15.133:0/4158065011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5bce718b0 0x55a5bcf6c7d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 >> 172.21.15.133:0/4158065011 conn(0x55a5bce6d4d0 msgr2=0x55a5bcf5f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 shutdown_connections 2024-02-15T22:56:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.009+0000 7f138f72f800 1 -- 172.21.15.133:0/4158065011 wait complete. 2024-02-15T22:56:27.024 INFO:teuthology.orchestra.run.smithi133.stdout:["myfoo"] 2024-02-15T22:56:27.025 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-15T22:56:27.073 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:27.073 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-15T22:56:27.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-15T22:56:27.074 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-15T22:56:27.114 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:27.114 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.113+0000 7ffbf9f33800 1 Processor -- start 2024-02-15T22:56:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.113+0000 7ffbf9f33800 1 -- start start 2024-02-15T22:56:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.113+0000 7ffbf9f33800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562171d6e5f0 0x562171d709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.113+0000 7ffbf9f33800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562171cb2ba0 con 0x562171d6a1b0 2024-02-15T22:56:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.113+0000 7ffbf9f33800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x562171c6a450 con 0x562171d6e5f0 2024-02-15T22:56:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.113+0000 7ffbf5466640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562171d6e5f0 0x562171d709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.113+0000 7ffbf5c67640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x562171d6a1b0 0x562171d6a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45016/0 (socket says 172.21.15.133:45016) 2024-02-15T22:56:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.113+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4183547882 learned_addr learned my addr 172.21.15.133:0/4183547882 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.113+0000 7ffbf5466640 1 --2- 172.21.15.133:0/4183547882 >> v2:172.21.15.52:3300/0 conn(0x562171d6e5f0 0x562171d709e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58148/0 (socket says 172.21.15.133:58148) 2024-02-15T22:56:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.113+0000 7ffbf5466640 1 -- 172.21.15.133:0/4183547882 >> v1:172.21.15.52:6789/0 conn(0x562171d6a1b0 legacy=0x562171d6a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.113+0000 7ffbf5466640 1 -- 172.21.15.133:0/4183547882 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562171d72010 con 0x562171d6e5f0 2024-02-15T22:56:27.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.115+0000 7ffbf5466640 1 --2- 172.21.15.133:0/4183547882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6e5f0 0x562171d709e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffbec00a470 tx=0x7ffbec01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33794091ed18184d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.115+0000 7ffbf4c65640 1 -- 172.21.15.133:0/4183547882 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbec052570 con 0x562171d6e5f0 2024-02-15T22:56:27.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.115+0000 7ffbf4c65640 1 -- 172.21.15.133:0/4183547882 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbec0526d0 con 0x562171d6e5f0 2024-02-15T22:56:27.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.115+0000 7ffbf4c65640 1 -- 172.21.15.133:0/4183547882 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbec052990 con 0x562171d6e5f0 2024-02-15T22:56:27.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.116+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4183547882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6e5f0 msgr2=0x562171d709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.116+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/4183547882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6e5f0 0x562171d709e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffbec00a470 tx=0x7ffbec01cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:27.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.116+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4183547882 shutdown_connections 2024-02-15T22:56:27.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.116+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/4183547882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6e5f0 0x562171d709e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.116+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4183547882 >> 172.21.15.133:0/4183547882 conn(0x562171d658d0 msgr2=0x562171d67cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.116+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4183547882 shutdown_connections 2024-02-15T22:56:27.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.116+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4183547882 wait complete. 2024-02-15T22:56:27.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.128+0000 7ffbf9f33800 1 Processor -- start 2024-02-15T22:56:27.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.128+0000 7ffbf9f33800 1 -- start start 2024-02-15T22:56:27.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.128+0000 7ffbf9f33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e5a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.128+0000 7ffbf9f33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562171c67980 con 0x562171d6a1b0 2024-02-15T22:56:27.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.128+0000 7ffbf5c67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e5a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.128+0000 7ffbf5c67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e5a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58160/0 (socket says 172.21.15.133:58160) 2024-02-15T22:56:27.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.128+0000 7ffbf5c67640 1 -- 172.21.15.133:0/64731356 learned_addr learned my addr 172.21.15.133:0/64731356 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.128+0000 7ffbf5c67640 1 -- 172.21.15.133:0/64731356 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbec005d20 con 0x562171d6a1b0 2024-02-15T22:56:27.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.128+0000 7ffbf5c67640 1 --2- 172.21.15.133:0/64731356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e5a1d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8001c80 tx=0x7ffbe800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a1d1c7af227141 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.129+0000 7ffae3e07640 1 -- 172.21.15.133:0/64731356 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbe800e470 con 0x562171d6a1b0 2024-02-15T22:56:27.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.129+0000 7ffae3e07640 1 -- 172.21.15.133:0/64731356 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe800e5d0 con 0x562171d6a1b0 2024-02-15T22:56:27.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.129+0000 7ffae3e07640 1 -- 172.21.15.133:0/64731356 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbe800e8d0 con 0x562171d6a1b0 2024-02-15T22:56:27.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.129+0000 7ffbf9f33800 1 -- 172.21.15.133:0/64731356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 msgr2=0x562171e5a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.129+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/64731356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e5a1d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8001c80 tx=0x7ffbe800b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.129+0000 7ffbf9f33800 1 -- 172.21.15.133:0/64731356 shutdown_connections 2024-02-15T22:56:27.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.129+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/64731356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e5a1d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.129+0000 7ffbf9f33800 1 -- 172.21.15.133:0/64731356 >> 172.21.15.133:0/64731356 conn(0x562171d658d0 msgr2=0x562171e55af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.129+0000 7ffbf9f33800 1 -- 172.21.15.133:0/64731356 shutdown_connections 2024-02-15T22:56:27.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.129+0000 7ffbf9f33800 1 -- 172.21.15.133:0/64731356 wait complete. 2024-02-15T22:56:27.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.130+0000 7ffbf9f33800 1 Processor -- start 2024-02-15T22:56:27.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.130+0000 7ffbf9f33800 1 -- start start 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.130+0000 7ffbf9f33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.130+0000 7ffbf9f33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562171c63160 con 0x562171d6a1b0 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.130+0000 7ffbf5c67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.130+0000 7ffbf5c67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58168/0 (socket says 172.21.15.133:58168) 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.130+0000 7ffbf5c67640 1 -- 172.21.15.133:0/1182078464 learned_addr learned my addr 172.21.15.133:0/1182078464 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.130+0000 7ffbf5c67640 1 -- 172.21.15.133:0/1182078464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562171cb2ba0 con 0x562171d6a1b0 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.130+0000 7ffbf5c67640 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e618e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8001c80 tx=0x7ffbe8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.131+0000 7ffae2604640 1 -- 172.21.15.133:0/1182078464 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbe801f070 con 0x562171d6a1b0 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.131+0000 7ffae2604640 1 -- 172.21.15.133:0/1182078464 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe8018640 con 0x562171d6a1b0 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.131+0000 7ffae2604640 1 -- 172.21.15.133:0/1182078464 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbe80188e0 con 0x562171d6a1b0 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.131+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562171e61e20 con 0x562171d6a1b0 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.131+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562171e62300 con 0x562171d6a1b0 2024-02-15T22:56:27.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.132+0000 7ffae2604640 1 -- 172.21.15.133:0/1182078464 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ffbe8018b10 con 0x562171d6a1b0 2024-02-15T22:56:27.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.132+0000 7ffae2604640 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffadc0367e0 0x7ffadc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.132+0000 7ffae2604640 1 -- 172.21.15.133:0/1182078464 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7ffbe804c1b0 con 0x562171d6a1b0 2024-02-15T22:56:27.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.132+0000 7ffbf5466640 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffadc0367e0 0x7ffadc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.132+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562171d6e5f0 0x562171e685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.132+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e68bb0 con 0x562171d6e5f0 2024-02-15T22:56:27.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.132+0000 7ffbf6468640 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562171d6e5f0 0x562171e685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.132+0000 7ffbf5466640 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffadc0367e0 0x7ffadc038ca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffbec054000 tx=0x7ffbec04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.132+0000 7ffbf6468640 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562171d6e5f0 0x562171e685e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.133+0000 7ffbf6468640 1 -- 172.21.15.133:0/1182078464 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffbf000a4a0 con 0x562171d6e5f0 2024-02-15T22:56:27.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.133+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e65cf0 con 0x562171d6e5f0 2024-02-15T22:56:27.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.133+0000 7ffbf6468640 1 -- 172.21.15.133:0/1182078464 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffbf000a4a0 con 0x562171d6e5f0 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.133+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e6a910 con 0x562171d6e5f0 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.133+0000 7ffbf6468640 1 -- 172.21.15.133:0/1182078464 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ffbf000a4a0 con 0x562171d6e5f0 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.133+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e69c20 con 0x562171d6e5f0 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.133+0000 7ffbf6468640 1 -- 172.21.15.133:0/1182078464 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffbf000a4a0 con 0x562171d6e5f0 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.134+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e6a030 con 0x562171d6e5f0 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.134+0000 7ffbf6468640 1 -- 172.21.15.133:0/1182078464 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ffbf000a4a0 con 0x562171d6e5f0 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.134+0000 7ffbf9f33800 1 Processor -- start 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.134+0000 7ffbf9f33800 1 -- start start 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.134+0000 7ffbf9f33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e79310 0x562171e79730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.134+0000 7ffbf9f33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562171c05e80 con 0x562171e79310 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.134+0000 7ffbf5466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e79310 0x562171e79730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.135+0000 7ffbf5466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e79310 0x562171e79730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58170/0 (socket says 172.21.15.133:58170) 2024-02-15T22:56:27.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.135+0000 7ffbf5466640 1 -- 172.21.15.133:0/3973021036 learned_addr learned my addr 172.21.15.133:0/3973021036 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.135+0000 7ffbf5466640 1 -- 172.21.15.133:0/3973021036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562171e79c70 con 0x562171e79310 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.135+0000 7ffbf5466640 1 --2- 172.21.15.133:0/3973021036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e79310 0x562171e79730 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffbec0447c0 tx=0x7ffbec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.135+0000 7ffadb7fe640 1 -- 172.21.15.133:0/3973021036 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbec052e40 con 0x562171e79310 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.135+0000 7ffadb7fe640 1 -- 172.21.15.133:0/3973021036 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbec05d890 con 0x562171e79310 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.135+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3973021036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562171e79e60 con 0x562171e79310 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.135+0000 7ffadb7fe640 1 -- 172.21.15.133:0/3973021036 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbec05db30 con 0x562171e79310 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.135+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3973021036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562171e7aa10 con 0x562171e79310 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.136+0000 7ffadb7fe640 1 -- 172.21.15.133:0/3973021036 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ffbec05dc90 con 0x562171e79310 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.136+0000 7ffadb7fe640 1 --2- 172.21.15.133:0/3973021036 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffad00367e0 0x7ffad0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.136+0000 7ffadb7fe640 1 -- 172.21.15.133:0/3973021036 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7ffbec08f650 con 0x562171e79310 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.136+0000 7ffbf6468640 1 --2- 172.21.15.133:0/3973021036 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffad00367e0 0x7ffad0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.136+0000 7ffbf9f33800 1 Processor -- start 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.136+0000 7ffbf6468640 1 --2- 172.21.15.133:0/3973021036 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffad00367e0 0x7ffad0038ca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x562171e69660 tx=0x7ffbf0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.136+0000 7ffbf9f33800 1 -- start start 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.136+0000 7ffbf9f33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e868c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.136+0000 7ffbf9f33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562171bdb5d0 con 0x562171e864a0 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.137+0000 7ffbf5466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e868c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.137+0000 7ffbf5466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e868c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58184/0 (socket says 172.21.15.133:58184) 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.137+0000 7ffbf5466640 1 -- 172.21.15.133:0/3613712818 learned_addr learned my addr 172.21.15.133:0/3613712818 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.137+0000 7ffbf5466640 1 -- 172.21.15.133:0/3613712818 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562171e86e90 con 0x562171e864a0 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.137+0000 7ffbf5466640 1 --2- 172.21.15.133:0/3613712818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e868c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffbec08db60 tx=0x7ffbec06df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c172609572a367d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.137+0000 7ffad97fa640 1 -- 172.21.15.133:0/3613712818 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbec065e80 con 0x562171e864a0 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.137+0000 7ffad97fa640 1 -- 172.21.15.133:0/3613712818 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbec08f070 con 0x562171e864a0 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.137+0000 7ffad97fa640 1 -- 172.21.15.133:0/3613712818 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbec08f310 con 0x562171e864a0 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3613712818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 msgr2=0x562171e868c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/3613712818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e868c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffbec08db60 tx=0x7ffbec06df50 comp rx=0 tx=0).stop 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3613712818 shutdown_connections 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/3613712818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e868c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3613712818 >> 172.21.15.133:0/3613712818 conn(0x562171e82800 msgr2=0x562171e80860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3613712818 shutdown_connections 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3613712818 wait complete. 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf9f33800 1 Processor -- start 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf9f33800 1 -- start start 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf9f33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e8d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf9f33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562171e8da10 con 0x562171e864a0 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf5466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e8d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf5466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e8d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58196/0 (socket says 172.21.15.133:58196) 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.138+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 learned_addr learned my addr 172.21.15.133:0/4076773313 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.139+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562171e7aa10 con 0x562171e864a0 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.139+0000 7ffbf5466640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e8d4d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffbec06d8e0 tx=0x7ffbec08dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.139+0000 7ffac77fe640 1 -- 172.21.15.133:0/4076773313 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbec065e80 con 0x562171e864a0 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.139+0000 7ffac77fe640 1 -- 172.21.15.133:0/4076773313 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbec06d720 con 0x562171e864a0 2024-02-15T22:56:27.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.139+0000 7ffac77fe640 1 -- 172.21.15.133:0/4076773313 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbec08c1b0 con 0x562171e864a0 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.139+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562171e8dc10 con 0x562171e864a0 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.139+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562171e8e070 con 0x562171e864a0 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.140+0000 7ffac77fe640 1 -- 172.21.15.133:0/4076773313 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ffbec08c310 con 0x562171e864a0 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.140+0000 7ffac77fe640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffac00367e0 0x7ffac0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.140+0000 7ffac77fe640 1 -- 172.21.15.133:0/4076773313 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7ffbec09d810 con 0x562171e864a0 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.140+0000 7ffbf6468640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffac00367e0 0x7ffac0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.140+0000 7ffbf9f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.140+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562171e99050 0x562171e9b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.140+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e9bc60 con 0x562171e99050 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.140+0000 7ffbf5c67640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562171e99050 0x562171e9b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.140+0000 7ffbf6468640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffac00367e0 0x7ffac0038ca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffbf000b010 tx=0x7ffbf0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.140+0000 7ffbf5c67640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562171e99050 0x562171e9b510 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffbe8014070 con 0x562171e99050 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 20 realm 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e9c030 con 0x562171e99050 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffbe8014070 con 0x562171e99050 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e9c8b0 con 0x562171e99050 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffbe8014070 con 0x562171e99050 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e9cc10 con 0x562171e99050 2024-02-15T22:56:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffbe8014070 con 0x562171e99050 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.141+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e9c510 con 0x562171e99050 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.142+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ffbe8014070 con 0x562171e99050 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.142+0000 7ffbf9f33800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.142+0000 7ffbf9f33800 20 searching for the correct realm 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.142+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562171e9ef90 0x562171ea1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.142+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.142+0000 7ffbf5466640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562171e9ef90 0x562171ea1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.142+0000 7ffbf5466640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562171e9ef90 0x562171ea1380 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.142+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.142+0000 7ffbf5466640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ffbec06f070 0x7ffbec09da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.142+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbec06f070 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.142+0000 7ffbf6468640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ffbec06f070 0x7ffbec09da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.143+0000 7ffbf6468640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ffbec06f070 0x7ffbec09da70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.143+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbf000a4a0 con 0x7ffbec06f070 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.143+0000 7ffbf6468640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ffbf00141d0 0x7ffbf0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.143+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.143+0000 7ffbf5c67640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ffbf00141d0 0x7ffbf0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.144+0000 7ffbf5c67640 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ffbf00141d0 0x7ffbf0015940 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.144+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8014070 con 0x7ffbf00141d0 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.144+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.144+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8014070 con 0x562171e99050 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.144+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.144+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.144+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.145+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.145+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.145+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.145+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbec06f070 2024-02-15T22:56:27.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.145+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbf000a4a0 con 0x7ffbec06f070 2024-02-15T22:56:27.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.145+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.145+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.145+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.145+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.145+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.146+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.146+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.146+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.146+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbec06f070 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.146+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.146+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.146+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.146+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.147+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.147+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.147+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.147+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.147+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.147+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.147+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.147+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.147+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.148+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.148+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.148+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.148+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.148+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.148+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.148+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbec06f070 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.148+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.148+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.149+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.149+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.149+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.149+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.149+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.149+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.150+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.150+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbec06f070 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.150+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.150+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.150+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.150+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbec06f070 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf9f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf9f33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf9f33800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf9f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf9f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf9f33800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf9f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e9da00 con 0x562171e99050 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf9f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.151+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e9d680 con 0x562171e99050 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e9e390 con 0x562171e99050 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 20 zone default found 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 4 Realm: () 2024-02-15T22:56:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 20 zonegroup default 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1ea0 con 0x7ffbf00141d0 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea3d20 con 0x562171e9ef90 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.152+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea4080 con 0x562171e9ef90 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.153+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.153+0000 7ffbf9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.153+0000 7ffbf9f33800 20 started sync module instance, tier type = 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.153+0000 7ffbf9f33800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.153+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea32f0 con 0x7ffbec06f070 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.154+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.154+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94701645084624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea43e0 con 0x7ffbec06f070 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.154+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea4be0 con 0x562171e99050 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.155+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94701645084624] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.155+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.155+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94701645087712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea4ca0 con 0x562171e99050 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.155+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea5610 con 0x562171e9ef90 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.156+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.156+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94701645091184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea5e60 con 0x562171e9ef90 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.156+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea68d0 con 0x7ffbec06f070 2024-02-15T22:56:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.156+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94701645087712] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.157+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94701645091184] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.157+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.157+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94701645093312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea4800 con 0x7ffbec06f070 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.157+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea7290 con 0x562171e99050 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.158+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.158+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94701645098480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea76b0 con 0x562171e99050 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.158+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94701645093312] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.158+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea7f60 con 0x7ffbf00141d0 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.159+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.159+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94701645101760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea8380 con 0x7ffbf00141d0 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.159+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea8b80 con 0x7ffbf00141d0 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.159+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94701645098480] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.160+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94701645101760] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.160+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.160+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94701645102816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea87a0 con 0x7ffbf00141d0 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.160+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea8fa0 con 0x7ffbf00141d0 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.161+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.161+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94701645102816] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.161+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94701645105536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea8420 con 0x7ffbf00141d0 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.161+0000 7ffbf9f33800 20 add_watcher() i=0 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.161+0000 7ffbf9f33800 20 add_watcher() i=1 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.161+0000 7ffbf9f33800 20 add_watcher() i=2 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.161+0000 7ffbf9f33800 20 add_watcher() i=3 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.161+0000 7ffbf9f33800 20 add_watcher() i=4 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.161+0000 7ffbf9f33800 20 add_watcher() i=5 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.161+0000 7ffbf9f33800 20 add_watcher() i=6 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.162+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94701645105536] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.162+0000 7ffbf9f33800 20 add_watcher() i=7 2024-02-15T22:56:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.162+0000 7ffbf9f33800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.162+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171eac500 con 0x562171e99050 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.163+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.163+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94701645106592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea9880 con 0x562171e99050 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.163+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94701645106592] v30'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.164+0000 7ffaa77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.164+0000 7ffbf9f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.164+0000 7ffbf9f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.164+0000 7ffbf9f33800 5 note: GC not initialized 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.164+0000 7ffaa67fc640 20 reqs_thread_entry: start 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.164+0000 7ffbf9f33800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.164+0000 7ffbf9f33800 20 Filter name: none 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.164+0000 7ffa17fff640 20 reqs_thread_entry: start 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.164+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171eddb40 con 0x562171e9ef90 2024-02-15T22:56:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.165+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.165+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171eddb40 con 0x562171e9ef90 2024-02-15T22:56:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.165+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.165+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171eddb40 con 0x562171e99050 2024-02-15T22:56:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.165+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.165+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e9d680 con 0x562171e99050 2024-02-15T22:56:27.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.165+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.165+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e9d680 con 0x7ffbec06f070 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.166+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.166+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.166+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.166+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.166+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.166+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.166+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.166+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbec06f070 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.167+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.167+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.167+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.167+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.167+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.167+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.168+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.168+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.168+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.168+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.168+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=127b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.168+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.168+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.168+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.168+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.169+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.169+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.169+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.169+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.169+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbec06f070 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.169+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.169+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.169+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.169+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.170+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.170+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.170+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.170+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbec06f070 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.170+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.170+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.171+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.171+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.171+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.171+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.171+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.171+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.171+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.172+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbec06f070 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.172+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.172+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbf00141d0 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.172+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.172+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e99050 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.172+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.172+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x562171e9ef90 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.173+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.173+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea1a30 con 0x7ffbec06f070 2024-02-15T22:56:27.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.173+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.173+0000 7ffbf9f33800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.173+0000 7ffbf9f33800 20 RGWRados::pool_iterate: got myfoo 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.174+0000 7ffaa77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.174+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94701645106592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171e9d680 con 0x562171e99050 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.174+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94701645106592] v30'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.175+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94701645084624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea8da0 con 0x7ffbec06f070 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.175+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94701645084624] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.175+0000 7ffbf9f33800 20 remove_watcher() i=0 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.175+0000 7ffbf9f33800 2 removed watcher, disabling cache 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.175+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94701645087712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea37d0 con 0x562171e99050 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.177+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94701645087712] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.177+0000 7ffbf9f33800 20 remove_watcher() i=1 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.177+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94701645091184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea37d0 con 0x562171e9ef90 2024-02-15T22:56:27.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.178+0000 7ffbf5466640 1 -- 172.21.15.133:0/4076773313 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94701645091184] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbec059040 con 0x562171e9ef90 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.178+0000 7ffbf9f33800 20 remove_watcher() i=2 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.178+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94701645093312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea5170 con 0x7ffbec06f070 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.179+0000 7ffbf6468640 1 -- 172.21.15.133:0/4076773313 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94701645093312] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbf003a040 con 0x7ffbec06f070 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.179+0000 7ffbf9f33800 20 remove_watcher() i=3 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.179+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94701645098480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea59c0 con 0x562171e99050 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.180+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94701645098480] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x562171e99050 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.180+0000 7ffbf9f33800 20 remove_watcher() i=4 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.180+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94701645101760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea5170 con 0x7ffbf00141d0 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.181+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94701645101760] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.181+0000 7ffbf9f33800 20 remove_watcher() i=5 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.181+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94701645102816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea6df0 con 0x7ffbf00141d0 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.182+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94701645102816] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.182+0000 7ffbf9f33800 20 remove_watcher() i=6 2024-02-15T22:56:27.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.182+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94701645105536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562171ea59c0 con 0x7ffbf00141d0 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94701645105536] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffbe8035040 con 0x7ffbf00141d0 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 20 remove_watcher() i=7 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ffbf00141d0 msgr2=0x7ffbf0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ffbf00141d0 0x7ffbf0015940 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562171e99050 msgr2=0x562171e9b510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562171e99050 0x562171e9b510 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ffbec06f070 msgr2=0x7ffbec09da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ffbec06f070 0x7ffbec09da70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562171e9ef90 msgr2=0x562171ea1380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562171e9ef90 0x562171ea1380 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffac00367e0 msgr2=0x7ffac0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffac00367e0 0x7ffac0038ca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffbf000b010 tx=0x7ffbf0020000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 msgr2=0x562171e8d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf5c67640 1 -- 172.21.15.133:0/4076773313 reap_dead start 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e8d4d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffbec06d8e0 tx=0x7ffbec08dac0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 shutdown_connections 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/4076773313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e864a0 0x562171e8d4d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 >> 172.21.15.133:0/4076773313 conn(0x562171e82800 msgr2=0x562171e7fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 shutdown_connections 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/4076773313 wait complete. 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3973021036 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffad00367e0 msgr2=0x7ffad0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/3973021036 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffad00367e0 0x7ffad0038ca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x562171e69660 tx=0x7ffbf0005840 comp rx=0 tx=0).stop 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3973021036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e79310 msgr2=0x562171e79730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/3973021036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e79310 0x562171e79730 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffbec0447c0 tx=0x7ffbec002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3973021036 shutdown_connections 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/3973021036 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffad00367e0 0x7ffad0038ca0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/3973021036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171e79310 0x562171e79730 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3973021036 >> 172.21.15.133:0/3973021036 conn(0x562171e6d3b0 msgr2=0x562171e6d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.183+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3973021036 shutdown_connections 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 -- 172.21.15.133:0/3973021036 wait complete. 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562171d6e5f0 msgr2=0x562171e685e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562171d6e5f0 0x562171e685e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffadc0367e0 msgr2=0x7ffadc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffadc0367e0 0x7ffadc038ca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffbec054000 tx=0x7ffbec04e000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 msgr2=0x562171e618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e618e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8001c80 tx=0x7ffbe8000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 shutdown_connections 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562171d6e5f0 0x562171e685e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ffadc0367e0 0x7ffadc038ca0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 --2- 172.21.15.133:0/1182078464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562171d6a1b0 0x562171e618e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 >> 172.21.15.133:0/1182078464 conn(0x562171d658d0 msgr2=0x562171e58bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 shutdown_connections 2024-02-15T22:56:27.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.184+0000 7ffbf9f33800 1 -- 172.21.15.133:0/1182078464 wait complete. 2024-02-15T22:56:27.198 INFO:teuthology.orchestra.run.smithi133.stdout:["myfoo"] 2024-02-15T22:56:27.199 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-15T22:56:27.213 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:27.228 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:27.243 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:27.288 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-02-15T22:56:27.314 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:27.342 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:27.369 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:27.369 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T22:56:27.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T22:56:27.370 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-15T22:56:27.412 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:27.412 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.411+0000 7fb700b1f800 1 Processor -- start 2024-02-15T22:56:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.411+0000 7fb700b1f800 1 -- start start 2024-02-15T22:56:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.411+0000 7fb700b1f800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557e6ed9f020 0x557e6ed9f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.411+0000 7fb700b1f800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557e6ece9bb0 con 0x557e6eda0280 2024-02-15T22:56:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.411+0000 7fb700b1f800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x557e6eca1450 con 0x557e6ed9f020 2024-02-15T22:56:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.411+0000 7fb6fc7ec640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557e6ed9f020 0x557e6ed9f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.411+0000 7fb6fc7ec640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557e6ed9f020 0x557e6ed9f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58206/0 (socket says 172.21.15.133:58206) 2024-02-15T22:56:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.411+0000 7fb6fbfeb640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x557e6eda0280 0x557e6eda0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45018/0 (socket says 172.21.15.133:45018) 2024-02-15T22:56:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.411+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3555266388 learned_addr learned my addr 172.21.15.133:0/3555266388 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.411+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3555266388 >> v1:172.21.15.52:6789/0 conn(0x557e6eda0280 legacy=0x557e6eda0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.411+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3555266388 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e6ed9fb10 con 0x557e6ed9f020 2024-02-15T22:56:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.413+0000 7fb6fc7ec640 1 --2- 172.21.15.133:0/3555266388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed9f020 0x557e6ed9f440 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00a520 tx=0x7fb6ec01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9278db502f6048e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.413+0000 7fb6fb7ea640 1 -- 172.21.15.133:0/3555266388 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec052570 con 0x557e6ed9f020 2024-02-15T22:56:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.413+0000 7fb6fb7ea640 1 -- 172.21.15.133:0/3555266388 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec0526d0 con 0x557e6ed9f020 2024-02-15T22:56:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.413+0000 7fb6fb7ea640 1 -- 172.21.15.133:0/3555266388 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec052990 con 0x557e6ed9f020 2024-02-15T22:56:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.414+0000 7fb700b1f800 1 -- 172.21.15.133:0/3555266388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed9f020 msgr2=0x557e6ed9f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.414+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3555266388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed9f020 0x557e6ed9f440 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00a520 tx=0x7fb6ec01cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.414+0000 7fb700b1f800 1 -- 172.21.15.133:0/3555266388 shutdown_connections 2024-02-15T22:56:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.414+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3555266388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed9f020 0x557e6ed9f440 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.414+0000 7fb700b1f800 1 -- 172.21.15.133:0/3555266388 >> 172.21.15.133:0/3555266388 conn(0x557e6ed9a5c0 msgr2=0x557e6ed9c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.414+0000 7fb700b1f800 1 -- 172.21.15.133:0/3555266388 shutdown_connections 2024-02-15T22:56:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.414+0000 7fb700b1f800 1 -- 172.21.15.133:0/3555266388 wait complete. 2024-02-15T22:56:27.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.425+0000 7fb700b1f800 1 Processor -- start 2024-02-15T22:56:27.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.425+0000 7fb700b1f800 1 -- start start 2024-02-15T22:56:27.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.426+0000 7fb700b1f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed9f020 0x557e6ee8f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.426+0000 7fb700b1f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e6ec9e980 con 0x557e6ed9f020 2024-02-15T22:56:27.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.426+0000 7fb6fc7ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed9f020 0x557e6ee8f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.426+0000 7fb6fc7ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed9f020 0x557e6ee8f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58216/0 (socket says 172.21.15.133:58216) 2024-02-15T22:56:27.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.426+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3230302593 learned_addr learned my addr 172.21.15.133:0/3230302593 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.426+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3230302593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec005de0 con 0x557e6ed9f020 2024-02-15T22:56:27.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.426+0000 7fb6fc7ec640 1 --2- 172.21.15.133:0/3230302593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed9f020 0x557e6ee8f3b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec055040 tx=0x7fb6ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7f6554ebae7d97 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.426+0000 7fb5ea60c640 1 -- 172.21.15.133:0/3230302593 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec052840 con 0x557e6ed9f020 2024-02-15T22:56:27.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.426+0000 7fb5ea60c640 1 -- 172.21.15.133:0/3230302593 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec0529c0 con 0x557e6ed9f020 2024-02-15T22:56:27.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.427+0000 7fb5ea60c640 1 -- 172.21.15.133:0/3230302593 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec052ca0 con 0x557e6ed9f020 2024-02-15T22:56:27.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.427+0000 7fb700b1f800 1 -- 172.21.15.133:0/3230302593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed9f020 msgr2=0x557e6ee8f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.427+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3230302593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed9f020 0x557e6ee8f3b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec055040 tx=0x7fb6ec04c000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.427+0000 7fb700b1f800 1 -- 172.21.15.133:0/3230302593 shutdown_connections 2024-02-15T22:56:27.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.427+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3230302593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed9f020 0x557e6ee8f3b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.427+0000 7fb700b1f800 1 -- 172.21.15.133:0/3230302593 >> 172.21.15.133:0/3230302593 conn(0x557e6ed9a5c0 msgr2=0x557e6ee8acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.427+0000 7fb700b1f800 1 -- 172.21.15.133:0/3230302593 shutdown_connections 2024-02-15T22:56:27.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.427+0000 7fb700b1f800 1 -- 172.21.15.133:0/3230302593 wait complete. 2024-02-15T22:56:27.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.428+0000 7fb700b1f800 1 Processor -- start 2024-02-15T22:56:27.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.428+0000 7fb700b1f800 1 -- start start 2024-02-15T22:56:27.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.428+0000 7fb700b1f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eda0280 0x557e6ee96c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.428+0000 7fb700b1f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e6ec9a160 con 0x557e6eda0280 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.428+0000 7fb6fc7ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eda0280 0x557e6ee96c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.428+0000 7fb6fc7ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eda0280 0x557e6ee96c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58226/0 (socket says 172.21.15.133:58226) 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.428+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/2188791612 learned_addr learned my addr 172.21.15.133:0/2188791612 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.428+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/2188791612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec04e070 con 0x557e6eda0280 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.429+0000 7fb6fc7ec640 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eda0280 0x557e6ee96c20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec055040 tx=0x7fb6ec003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.429+0000 7fb5e8e09640 1 -- 172.21.15.133:0/2188791612 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec05d480 con 0x557e6eda0280 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.429+0000 7fb5e8e09640 1 -- 172.21.15.133:0/2188791612 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec05d5e0 con 0x557e6eda0280 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.429+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e6ee97160 con 0x557e6eda0280 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.429+0000 7fb5e8e09640 1 -- 172.21.15.133:0/2188791612 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec05d8a0 con 0x557e6eda0280 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.429+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e6ee976a0 con 0x557e6eda0280 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.429+0000 7fb5e8e09640 1 -- 172.21.15.133:0/2188791612 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb6ec059040 con 0x557e6eda0280 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.430+0000 7fb5e8e09640 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5e4036790 0x7fb5e4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.430+0000 7fb5e8e09640 1 -- 172.21.15.133:0/2188791612 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fb6ec08d2e0 con 0x557e6eda0280 2024-02-15T22:56:27.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.430+0000 7fb6fbfeb640 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5e4036790 0x7fb5e4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.430+0000 7fb700b1f800 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557e6ee9b880 0x557e6ee9dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.430+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ee9e1b0 con 0x557e6ee9b880 2024-02-15T22:56:27.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.430+0000 7fb6fcfed640 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557e6ee9b880 0x557e6ee9dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.430+0000 7fb6fbfeb640 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5e4036790 0x7fb5e4038c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0000f60 tx=0x7fb6f0001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.430+0000 7fb6fcfed640 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557e6ee9b880 0x557e6ee9dc70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.430+0000 7fb6fcfed640 1 -- 172.21.15.133:0/2188791612 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6f400a4a0 con 0x557e6ee9b880 2024-02-15T22:56:27.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.431+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ee9e5a0 con 0x557e6ee9b880 2024-02-15T22:56:27.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.431+0000 7fb6fcfed640 1 -- 172.21.15.133:0/2188791612 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb6f400a4a0 con 0x557e6ee9b880 2024-02-15T22:56:27.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.431+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ee9fe50 con 0x557e6ee9b880 2024-02-15T22:56:27.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.431+0000 7fb6fcfed640 1 -- 172.21.15.133:0/2188791612 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb6f400a4a0 con 0x557e6ee9b880 2024-02-15T22:56:27.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.431+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ee9f050 con 0x557e6ee9b880 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.431+0000 7fb6fcfed640 1 -- 172.21.15.133:0/2188791612 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb6f400a4a0 con 0x557e6ee9b880 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.431+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ee9f460 con 0x557e6ee9b880 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.432+0000 7fb6fcfed640 1 -- 172.21.15.133:0/2188791612 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb6f400a4a0 con 0x557e6ee9b880 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.432+0000 7fb700b1f800 1 Processor -- start 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.432+0000 7fb700b1f800 1 -- start start 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.432+0000 7fb700b1f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed142d0 0x557e6ed12740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.432+0000 7fb700b1f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e6ec3ce80 con 0x557e6ed142d0 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.432+0000 7fb6fbfeb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed142d0 0x557e6ed12740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.432+0000 7fb6fbfeb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed142d0 0x557e6ed12740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58228/0 (socket says 172.21.15.133:58228) 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.432+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/1485705461 learned_addr learned my addr 172.21.15.133:0/1485705461 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.433+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/1485705461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e6ed12c80 con 0x557e6ed142d0 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.433+0000 7fb6fbfeb640 1 --2- 172.21.15.133:0/1485705461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed142d0 0x557e6ed12740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0001ed0 tx=0x7fb6f000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.433+0000 7fb5e1ffb640 1 -- 172.21.15.133:0/1485705461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f000bec0 con 0x557e6ed142d0 2024-02-15T22:56:27.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.433+0000 7fb5e1ffb640 1 -- 172.21.15.133:0/1485705461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f000d520 con 0x557e6ed142d0 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.433+0000 7fb700b1f800 1 -- 172.21.15.133:0/1485705461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e6ed12ed0 con 0x557e6ed142d0 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.433+0000 7fb5e1ffb640 1 -- 172.21.15.133:0/1485705461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f000d7c0 con 0x557e6ed142d0 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.433+0000 7fb700b1f800 1 -- 172.21.15.133:0/1485705461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e6ed13390 con 0x557e6ed142d0 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.434+0000 7fb5e1ffb640 1 -- 172.21.15.133:0/1485705461 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb6f001a070 con 0x557e6ed142d0 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.434+0000 7fb5e1ffb640 1 --2- 172.21.15.133:0/1485705461 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5d40367e0 0x7fb5d4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.434+0000 7fb5e1ffb640 1 -- 172.21.15.133:0/1485705461 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fb6f0017050 con 0x557e6ed142d0 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.434+0000 7fb6fcfed640 1 --2- 172.21.15.133:0/1485705461 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5d40367e0 0x7fb5d4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.434+0000 7fb700b1f800 1 Processor -- start 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.434+0000 7fb6fcfed640 1 --2- 172.21.15.133:0/1485705461 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5d40367e0 0x7fb5d4038ca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x557e6ee9ea90 tx=0x7fb6f4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.434+0000 7fb700b1f800 1 -- start start 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.435+0000 7fb700b1f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eebe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.435+0000 7fb700b1f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e6ec125d0 con 0x557e6eebdd00 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.435+0000 7fb6fbfeb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eebe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.435+0000 7fb6fbfeb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eebe120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58238/0 (socket says 172.21.15.133:58238) 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.435+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/2077370167 learned_addr learned my addr 172.21.15.133:0/2077370167 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.435+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/2077370167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e6eebe6f0 con 0x557e6eebdd00 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.435+0000 7fb6fbfeb640 1 --2- 172.21.15.133:0/2077370167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eebe120 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0027030 tx=0x7fb6f0024560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c142cb088b3760af server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.435+0000 7fb5db7fe640 1 -- 172.21.15.133:0/2077370167 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f004d0d0 con 0x557e6eebdd00 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.435+0000 7fb5db7fe640 1 -- 172.21.15.133:0/2077370167 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f004d230 con 0x557e6eebdd00 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.435+0000 7fb5db7fe640 1 -- 172.21.15.133:0/2077370167 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f004a340 con 0x557e6eebdd00 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.436+0000 7fb700b1f800 1 -- 172.21.15.133:0/2077370167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 msgr2=0x557e6eebe120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.436+0000 7fb700b1f800 1 --2- 172.21.15.133:0/2077370167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eebe120 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0027030 tx=0x7fb6f0024560 comp rx=0 tx=0).stop 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.436+0000 7fb700b1f800 1 -- 172.21.15.133:0/2077370167 shutdown_connections 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.436+0000 7fb700b1f800 1 --2- 172.21.15.133:0/2077370167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eebe120 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.436+0000 7fb700b1f800 1 -- 172.21.15.133:0/2077370167 >> 172.21.15.133:0/2077370167 conn(0x557e6eeba060 msgr2=0x557e6eeb80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.436+0000 7fb700b1f800 1 -- 172.21.15.133:0/2077370167 shutdown_connections 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.436+0000 7fb700b1f800 1 -- 172.21.15.133:0/2077370167 wait complete. 2024-02-15T22:56:27.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.436+0000 7fb700b1f800 1 Processor -- start 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.436+0000 7fb700b1f800 1 -- start start 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.436+0000 7fb700b1f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eec4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.436+0000 7fb700b1f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e6eec5250 con 0x557e6eebdd00 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.437+0000 7fb6fbfeb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eec4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.437+0000 7fb6fbfeb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eec4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58244/0 (socket says 172.21.15.133:58244) 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.437+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 learned_addr learned my addr 172.21.15.133:0/3861888053 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.437+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e6ed13390 con 0x557e6eebdd00 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.437+0000 7fb6fbfeb640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eec4d10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0025750 tx=0x7fb6f004b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.437+0000 7fb5d9ffb640 1 -- 172.21.15.133:0/3861888053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f004d0d0 con 0x557e6eebdd00 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.437+0000 7fb5d9ffb640 1 -- 172.21.15.133:0/3861888053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f001a320 con 0x557e6eebdd00 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.437+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e6eec5450 con 0x557e6eebdd00 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.437+0000 7fb5d9ffb640 1 -- 172.21.15.133:0/3861888053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f001a5e0 con 0x557e6eebdd00 2024-02-15T22:56:27.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.437+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e6eec5910 con 0x557e6eebdd00 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.438+0000 7fb5d9ffb640 1 -- 172.21.15.133:0/3861888053 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb6f001a740 con 0x557e6eebdd00 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.438+0000 7fb5d9ffb640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5cc0367e0 0x7fb5cc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.438+0000 7fb5d9ffb640 1 -- 172.21.15.133:0/3861888053 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fb6f0046bd0 con 0x557e6eebdd00 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.438+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.438+0000 7fb6fcfed640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5cc0367e0 0x7fb5cc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.438+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557e6eed0920 0x557e6eed2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.438+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed3510 con 0x557e6eed0920 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.438+0000 7fb6fc7ec640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557e6eed0920 0x557e6eed2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb6fcfed640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5cc0367e0 0x7fb5cc038ca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400b010 tx=0x7fb6f4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb6fc7ec640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557e6eed0920 0x557e6eed2dc0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6ec05dd80 con 0x557e6eed0920 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb700b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb700b1f800 20 realm 2024-02-15T22:56:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed38e0 con 0x557e6eed0920 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6ec05dd80 con 0x557e6eed0920 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb700b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb700b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed4160 con 0x557e6eed0920 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6ec05dd80 con 0x557e6eed0920 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb700b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.439+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed44c0 con 0x557e6eed0920 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.440+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb6ec05dd80 con 0x557e6eed0920 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.440+0000 7fb700b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.440+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.440+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed3dc0 con 0x557e6eed0920 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.440+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb6ec05dd80 con 0x557e6eed0920 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.440+0000 7fb700b1f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.440+0000 7fb700b1f800 20 searching for the correct realm 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.440+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557e6eed6840 0x557e6eed8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.440+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed92e0 con 0x557e6eed6840 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.440+0000 7fb6fbfeb640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557e6eed6840 0x557e6eed8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.440+0000 7fb6fbfeb640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557e6eed6840 0x557e6eed8c30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.441+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.441+0000 7fb6fbfeb640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb6f0027060 0x7fb6f0027660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.441+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed92e0 con 0x7fb6f0027060 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.441+0000 7fb6fcfed640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb6f0027060 0x7fb6f0027660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.441+0000 7fb6fcfed640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb6f0027060 0x7fb6f0027660 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.441+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f400a4a0 con 0x7fb6f0027060 2024-02-15T22:56:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.441+0000 7fb6fcfed640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb6f40141d0 0x7fb6f4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.441+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed92e0 con 0x7fb6f40141d0 2024-02-15T22:56:27.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.442+0000 7fb6fc7ec640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb6f40141d0 0x7fb6f4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.442+0000 7fb6fc7ec640 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb6f40141d0 0x7fb6f4015940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.442+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec05dd80 con 0x7fb6f40141d0 2024-02-15T22:56:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.442+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed92e0 con 0x557e6eed0920 2024-02-15T22:56:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.443+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.443+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed92e0 con 0x557e6eed0920 2024-02-15T22:56:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.443+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.443+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed92e0 con 0x7fb6f40141d0 2024-02-15T22:56:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.443+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.443+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed92e0 con 0x7fb6f40141d0 2024-02-15T22:56:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.443+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.443+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed92e0 con 0x7fb6f0027060 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.443+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f400a4a0 con 0x7fb6f0027060 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.443+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed92e0 con 0x557e6eed6840 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.444+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.444+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed0920 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.444+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.444+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x7fb6f40141d0 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.444+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.444+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed0920 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.444+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.444+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x7fb6f0027060 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.445+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.445+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed6840 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.445+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.445+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed6840 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.445+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.445+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x7fb6f40141d0 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.445+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.445+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed6840 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.446+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.446+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed6840 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.446+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.446+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed0920 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.446+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.446+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed0920 2024-02-15T22:56:27.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.446+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.446+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x7fb6f40141d0 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.447+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.447+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed6840 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.447+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.447+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x7fb6f0027060 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.447+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.447+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed0920 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.447+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.447+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x7fb6f40141d0 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.448+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.448+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed6840 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.448+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.448+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x7fb6f40141d0 2024-02-15T22:56:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.448+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.448+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x7fb6f0027060 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.448+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.448+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed6840 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x7fb6f40141d0 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x557e6eed0920 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb6f0059040 con 0x7fb6f0027060 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb700b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb700b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb700b1f800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb700b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb700b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb700b1f800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.449+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed52e0 con 0x557e6eed0920 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed4f60 con 0x557e6eed0920 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed5c70 con 0x557e6eed0920 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 20 zone default found 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 4 Realm: () 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 20 zonegroup default 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.450+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eed9750 con 0x7fb6f40141d0 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb700b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedb5d0 con 0x557e6eed6840 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb700b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedb930 con 0x557e6eed6840 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb700b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb700b1f800 20 started sync module instance, tier type = 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb700b1f800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.451+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedaba0 con 0x7fb6f0027060 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.452+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.452+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94001515311200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedaba0 con 0x7fb6f0027060 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.452+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedc3d0 con 0x557e6eed0920 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.453+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94001515311200] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.453+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.454+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94001515314864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedaba0 con 0x557e6eed0920 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.454+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedceb0 con 0x557e6eed6840 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.455+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94001515314864] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.455+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.455+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94001515308800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedab20 con 0x557e6eed6840 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.455+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eeddd10 con 0x7fb6f0027060 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.456+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94001515308800] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.456+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.456+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94001515321456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eede130 con 0x7fb6f0027060 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.456+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedeaa0 con 0x557e6eed0920 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.457+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.457+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94001515324928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedef00 con 0x557e6eed0920 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.457+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedf9d0 con 0x7fb6f40141d0 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.457+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94001515321456] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.458+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.458+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94001515328688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eedf990 con 0x7fb6f40141d0 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.458+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eee03c0 con 0x7fb6f40141d0 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.458+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94001515324928] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.459+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.459+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94001515325984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eee03c0 con 0x7fb6f40141d0 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.459+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eee0d90 con 0x7fb6f40141d0 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.459+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94001515328688] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.460+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94001515325984] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.460+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.460+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94001515331360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eeddc90 con 0x7fb6f40141d0 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.460+0000 7fb700b1f800 20 add_watcher() i=0 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.460+0000 7fb700b1f800 20 add_watcher() i=1 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.460+0000 7fb700b1f800 20 add_watcher() i=2 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.460+0000 7fb700b1f800 20 add_watcher() i=3 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.460+0000 7fb700b1f800 20 add_watcher() i=4 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.460+0000 7fb700b1f800 20 add_watcher() i=5 2024-02-15T22:56:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.460+0000 7fb700b1f800 20 add_watcher() i=6 2024-02-15T22:56:27.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.461+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94001515331360] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.461+0000 7fb700b1f800 20 add_watcher() i=7 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.461+0000 7fb700b1f800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.461+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eee3db0 con 0x557e6eed0920 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.461+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.461+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94001515333776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eee11f0 con 0x557e6eed0920 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.462+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94001515333776] v30'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.462+0000 7fb5b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.463+0000 7fb700b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.463+0000 7fb700b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.463+0000 7fb700b1f800 5 note: GC not initialized 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.463+0000 7fb5b17e2640 20 reqs_thread_entry: start 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.463+0000 7fb700b1f800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.463+0000 7fb700b1f800 20 Filter name: none 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.463+0000 7fb522ffd640 20 reqs_thread_entry: start 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.463+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.463+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef15d70 con 0x7fb6f0027060 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.464+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.464+0000 7fb700b1f800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.464+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.464+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:63 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef153f0 con 0x557e6eed6840 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.464+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(63 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.464+0000 7fb700b1f800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.464+0000 7fb700b1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.464+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.464+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef16570 con 0x7fb6f0027060 2024-02-15T22:56:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.464+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:65 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef14ea0 con 0x557e6eed6840 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(65 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:66 4.26 4:64dd6fe8:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef17b30 con 0x7fb6f40141d0 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 4.1a 4:5969fa1d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef1c8e0 con 0x7fb6f0027060 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 4.3c 4:3d7776b5:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef1f1f0 con 0x557e6eed0920 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 4.16 4:69b66c2d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef21b20 con 0x557e6eed6840 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 4.c 4:32ea204e:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef24340 con 0x557e6eed0920 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 4.2a 4:550e1cd1:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef26db0 con 0x557e6eed0920 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 4.4 4:21b7c93c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef29670 con 0x7fb6f40141d0 2024-02-15T22:56:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 4.3a 4:5eac6251:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef2c4e0 con 0x557e6eed6840 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(66 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 4.18 4:1830de7d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef2eed0 con 0x7fb6f0027060 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 4.14 4:29b37fcc:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef198b0 con 0x557e6eed6840 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:76 4.1d 4:b9a64d9c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef32700 con 0x557e6eed6840 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(68 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.465+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(70 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(67 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(69 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(73 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(72 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(71 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(75 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(76 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb700b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.2 6:44d22c7c:::pubsub..bucket.myfoo%2fb92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6ef198b0 con 0x557e6eed6840 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.466+0000 7fb700b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.467+0000 7fb5b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.467+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94001515333776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eeff9f0 con 0x557e6eed0920 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.468+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94001515333776] v30'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.468+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94001515311200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eeff9f0 con 0x7fb6f0027060 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.469+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94001515311200] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.469+0000 7fb700b1f800 20 remove_watcher() i=0 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.469+0000 7fb700b1f800 2 removed watcher, disabling cache 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.469+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94001515314864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eeff9f0 con 0x557e6eed0920 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.470+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94001515314864] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.470+0000 7fb700b1f800 20 remove_watcher() i=1 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.470+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94001515308800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eeff9f0 con 0x557e6eed6840 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.471+0000 7fb6fbfeb640 1 -- 172.21.15.133:0/3861888053 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94001515308800] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f004bdb0 con 0x557e6eed6840 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.471+0000 7fb700b1f800 20 remove_watcher() i=2 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.471+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94001515321456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eeff9f0 con 0x7fb6f0027060 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.472+0000 7fb6fcfed640 1 -- 172.21.15.133:0/3861888053 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94001515321456] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f403a040 con 0x7fb6f0027060 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.472+0000 7fb700b1f800 20 remove_watcher() i=3 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.472+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94001515324928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eeff9f0 con 0x557e6eed0920 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.473+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94001515324928] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x557e6eed0920 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.473+0000 7fb700b1f800 20 remove_watcher() i=4 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.473+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94001515328688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eeff9f0 con 0x7fb6f40141d0 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.474+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94001515328688] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.474+0000 7fb700b1f800 20 remove_watcher() i=5 2024-02-15T22:56:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.474+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94001515325984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eeff9f0 con 0x7fb6f40141d0 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.475+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94001515325984] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.475+0000 7fb700b1f800 20 remove_watcher() i=6 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.475+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94001515331360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557e6eeff9f0 con 0x7fb6f40141d0 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94001515331360] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec08a040 con 0x7fb6f40141d0 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 20 remove_watcher() i=7 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb6f40141d0 msgr2=0x7fb6f4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb6f40141d0 0x7fb6f4015940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557e6eed0920 msgr2=0x557e6eed2dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557e6eed0920 0x557e6eed2dc0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb6f0027060 msgr2=0x7fb6f0027660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb6f0027060 0x7fb6f0027660 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557e6eed6840 msgr2=0x557e6eed8c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557e6eed6840 0x557e6eed8c30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5cc0367e0 msgr2=0x7fb5cc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5cc0367e0 0x7fb5cc038ca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400b010 tx=0x7fb6f4020000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 msgr2=0x557e6eec4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb6fc7ec640 1 -- 172.21.15.133:0/3861888053 reap_dead start 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eec4d10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0025750 tx=0x7fb6f004b930 comp rx=0 tx=0).stop 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 shutdown_connections 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 --2- 172.21.15.133:0/3861888053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eebdd00 0x557e6eec4d10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.476+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 >> 172.21.15.133:0/3861888053 conn(0x557e6eeba060 msgr2=0x557e6eeb76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 shutdown_connections 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/3861888053 wait complete. 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/1485705461 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5d40367e0 msgr2=0x7fb5d4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 --2- 172.21.15.133:0/1485705461 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5d40367e0 0x7fb5d4038ca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x557e6ee9ea90 tx=0x7fb6f4005840 comp rx=0 tx=0).stop 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/1485705461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed142d0 msgr2=0x557e6ed12740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 --2- 172.21.15.133:0/1485705461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed142d0 0x557e6ed12740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0001ed0 tx=0x7fb6f000ea00 comp rx=0 tx=0).stop 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/1485705461 shutdown_connections 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 --2- 172.21.15.133:0/1485705461 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5d40367e0 0x7fb5d4038ca0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 --2- 172.21.15.133:0/1485705461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6ed142d0 0x557e6ed12740 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/1485705461 >> 172.21.15.133:0/1485705461 conn(0x557e6eea2970 msgr2=0x557e6eea2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/1485705461 shutdown_connections 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/1485705461 wait complete. 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557e6ee9b880 msgr2=0x557e6ee9dc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557e6ee9b880 0x557e6ee9dc70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5e4036790 msgr2=0x7fb5e4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5e4036790 0x7fb5e4038c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0000f60 tx=0x7fb6f0001370 comp rx=0 tx=0).stop 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eda0280 msgr2=0x557e6ee96c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eda0280 0x557e6ee96c20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec055040 tx=0x7fb6ec003020 comp rx=0 tx=0).stop 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 shutdown_connections 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557e6ee9b880 0x557e6ee9dc70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb5e4036790 0x7fb5e4038c50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 --2- 172.21.15.133:0/2188791612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e6eda0280 0x557e6ee96c20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 >> 172.21.15.133:0/2188791612 conn(0x557e6ed9a5c0 msgr2=0x557e6ee8dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 shutdown_connections 2024-02-15T22:56:27.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.477+0000 7fb700b1f800 1 -- 172.21.15.133:0/2188791612 wait complete. 2024-02-15T22:56:27.492 INFO:teuthology.orchestra.run.smithi133.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f2cd5859-7c57-45d7-89f3-01e23ceddfe0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","marker":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-15T22:56:26.874042Z","creation_time":"2024-02-15T22:56:26.869244Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-15T22:56:27.493 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f2cd5859-7c57-45d7-89f3-01e23ceddfe0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'marker': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-15T22:56:26.874042Z', 'creation_time': '2024-02-15T22:56:26.869244Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-15T22:56:27.493 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-15T22:56:27.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-15T22:56:27.493 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-15T22:56:27.576 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:27.576 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.574+0000 7f189e52f800 1 Processor -- start 2024-02-15T22:56:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.574+0000 7f189e52f800 1 -- start start 2024-02-15T22:56:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.574+0000 7f189e52f800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x555f9757d3f0 0x555f97585ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.574+0000 7f189e52f800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555f974c7bb0 con 0x555f9757b8b0 2024-02-15T22:56:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.574+0000 7f189e52f800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x555f9747f450 con 0x555f9757d3f0 2024-02-15T22:56:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.574+0000 7f18999b2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x555f9757d3f0 0x555f97585ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.574+0000 7f18999b2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x555f9757d3f0 0x555f97585ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58250/0 (socket says 172.21.15.133:58250) 2024-02-15T22:56:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.574+0000 7f18999b2640 1 -- 172.21.15.133:0/1502350682 learned_addr learned my addr 172.21.15.133:0/1502350682 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.575+0000 7f18999b2640 1 -- 172.21.15.133:0/1502350682 >> v1:172.21.15.52:6789/0 conn(0x555f9757b8b0 legacy=0x555f9757bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.575+0000 7f18999b2640 1 -- 172.21.15.133:0/1502350682 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f974f0160 con 0x555f9757d3f0 2024-02-15T22:56:27.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.575+0000 7f18991b1640 1 -- 172.21.15.133:0/1502350682 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977562601 0 0) 0x555f974c7bb0 con 0x555f9757b8b0 2024-02-15T22:56:27.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.576+0000 7f18999b2640 1 --2- 172.21.15.133:0/1502350682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757d3f0 0x555f97585ef0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f189000a520 tx=0x7f189001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892519e8a0fdceed server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.577+0000 7f18991b1640 1 -- 172.21.15.133:0/1502350682 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1890052570 con 0x555f9757d3f0 2024-02-15T22:56:27.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.577+0000 7f18991b1640 1 -- 172.21.15.133:0/1502350682 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18900526d0 con 0x555f9757d3f0 2024-02-15T22:56:27.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.577+0000 7f18991b1640 1 -- 172.21.15.133:0/1502350682 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1890052990 con 0x555f9757d3f0 2024-02-15T22:56:27.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.577+0000 7f189e52f800 1 -- 172.21.15.133:0/1502350682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757d3f0 msgr2=0x555f97585ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.577+0000 7f189e52f800 1 --2- 172.21.15.133:0/1502350682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757d3f0 0x555f97585ef0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f189000a520 tx=0x7f189001cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.577+0000 7f189e52f800 1 -- 172.21.15.133:0/1502350682 shutdown_connections 2024-02-15T22:56:27.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.577+0000 7f189e52f800 1 --2- 172.21.15.133:0/1502350682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757d3f0 0x555f97585ef0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.577+0000 7f189e52f800 1 -- 172.21.15.133:0/1502350682 >> 172.21.15.133:0/1502350682 conn(0x555f975774d0 msgr2=0x555f975798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.577+0000 7f189e52f800 1 -- 172.21.15.133:0/1502350682 shutdown_connections 2024-02-15T22:56:27.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.577+0000 7f189e52f800 1 -- 172.21.15.133:0/1502350682 wait complete. 2024-02-15T22:56:27.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.589+0000 7f189e52f800 1 Processor -- start 2024-02-15T22:56:27.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.589+0000 7f189e52f800 1 -- start start 2024-02-15T22:56:27.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.589+0000 7f189e52f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f9766f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.589+0000 7f189e52f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f9747c980 con 0x555f9757b8b0 2024-02-15T22:56:27.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.589+0000 7f189a1b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f9766f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.589+0000 7f189a1b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f9766f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58254/0 (socket says 172.21.15.133:58254) 2024-02-15T22:56:27.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.589+0000 7f189a1b3640 1 -- 172.21.15.133:0/1216516610 learned_addr learned my addr 172.21.15.133:0/1216516610 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.589+0000 7f189a1b3640 1 -- 172.21.15.133:0/1216516610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890005de0 con 0x555f9757b8b0 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.590+0000 7f189a1b3640 1 --2- 172.21.15.133:0/1216516610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f9766f150 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f188c001e00 tx=0x7f188c00b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f60fd93b3ce77cf server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.590+0000 7f1788608640 1 -- 172.21.15.133:0/1216516610 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188c00d4b0 con 0x555f9757b8b0 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.590+0000 7f1788608640 1 -- 172.21.15.133:0/1216516610 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c00a040 con 0x555f9757b8b0 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.590+0000 7f1788608640 1 -- 172.21.15.133:0/1216516610 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188c00d7e0 con 0x555f9757b8b0 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189e52f800 1 -- 172.21.15.133:0/1216516610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 msgr2=0x555f9766f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189e52f800 1 --2- 172.21.15.133:0/1216516610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f9766f150 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f188c001e00 tx=0x7f188c00b650 comp rx=0 tx=0).stop 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189e52f800 1 -- 172.21.15.133:0/1216516610 shutdown_connections 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189e52f800 1 --2- 172.21.15.133:0/1216516610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f9766f150 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189e52f800 1 -- 172.21.15.133:0/1216516610 >> 172.21.15.133:0/1216516610 conn(0x555f975774d0 msgr2=0x555f9766aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189e52f800 1 -- 172.21.15.133:0/1216516610 shutdown_connections 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189e52f800 1 -- 172.21.15.133:0/1216516610 wait complete. 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189e52f800 1 Processor -- start 2024-02-15T22:56:27.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189e52f800 1 -- start start 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189e52f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f97676900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189e52f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f97478160 con 0x555f9757b8b0 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189a1b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f97676900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189a1b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f97676900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58270/0 (socket says 172.21.15.133:58270) 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.591+0000 7f189a1b3640 1 -- 172.21.15.133:0/3694916874 learned_addr learned my addr 172.21.15.133:0/3694916874 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.592+0000 7f189a1b3640 1 -- 172.21.15.133:0/3694916874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c001ab0 con 0x555f9757b8b0 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.592+0000 7f189a1b3640 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f97676900 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f188c001ed0 tx=0x7f188c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.592+0000 7f1786e05640 1 -- 172.21.15.133:0/3694916874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188c010650 con 0x555f9757b8b0 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.592+0000 7f1786e05640 1 -- 172.21.15.133:0/3694916874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c0107b0 con 0x555f9757b8b0 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.592+0000 7f1786e05640 1 -- 172.21.15.133:0/3694916874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188c010a90 con 0x555f9757b8b0 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.592+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f97676e40 con 0x555f9757b8b0 2024-02-15T22:56:27.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.592+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f97677320 con 0x555f9757b8b0 2024-02-15T22:56:27.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.593+0000 7f1786e05640 1 -- 172.21.15.133:0/3694916874 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f188c010d00 con 0x555f9757b8b0 2024-02-15T22:56:27.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.593+0000 7f1786e05640 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1780036790 0x7f1780038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.593+0000 7f1786e05640 1 -- 172.21.15.133:0/3694916874 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f188c04c170 con 0x555f9757b8b0 2024-02-15T22:56:27.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.593+0000 7f18999b2640 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1780036790 0x7f1780038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.593+0000 7f189e52f800 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555f9757d3f0 0x555f9767d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.593+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f9767dc30 con 0x555f9757d3f0 2024-02-15T22:56:27.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.593+0000 7f189a9b4640 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555f9757d3f0 0x555f9767d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.593+0000 7f18999b2640 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1780036790 0x7f1780038c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1890054000 tx=0x7f189004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.593+0000 7f189a9b4640 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555f9757d3f0 0x555f9767d660 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.594+0000 7f189a9b4640 1 -- 172.21.15.133:0/3694916874 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f189400a4a0 con 0x555f9757d3f0 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.594+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f9767ad10 con 0x555f9757d3f0 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.594+0000 7f189a9b4640 1 -- 172.21.15.133:0/3694916874 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f189400a4a0 con 0x555f9757d3f0 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.594+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f9767f990 con 0x555f9757d3f0 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.594+0000 7f189a9b4640 1 -- 172.21.15.133:0/3694916874 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f189400a4a0 con 0x555f9757d3f0 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.594+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f9767eca0 con 0x555f9757d3f0 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.595+0000 7f189a9b4640 1 -- 172.21.15.133:0/3694916874 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f189400a4a0 con 0x555f9757d3f0 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.595+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f9767f0b0 con 0x555f9757d3f0 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.595+0000 7f189a9b4640 1 -- 172.21.15.133:0/3694916874 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f189400a4a0 con 0x555f9757d3f0 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.595+0000 7f189e52f800 1 Processor -- start 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.595+0000 7f189e52f800 1 -- start start 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.595+0000 7f189e52f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9768e390 0x555f9768e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.595+0000 7f189e52f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f9741ae80 con 0x555f9768e390 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.596+0000 7f18999b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9768e390 0x555f9768e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.596+0000 7f18999b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9768e390 0x555f9768e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58278/0 (socket says 172.21.15.133:58278) 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.596+0000 7f18999b2640 1 -- 172.21.15.133:0/1709008342 learned_addr learned my addr 172.21.15.133:0/1709008342 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.596+0000 7f18999b2640 1 -- 172.21.15.133:0/1709008342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f9768ecf0 con 0x555f9768e390 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.596+0000 7f18999b2640 1 --2- 172.21.15.133:0/1709008342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9768e390 0x555f9768e7b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1890044830 tx=0x7f1890002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.596+0000 7f177ffff640 1 -- 172.21.15.133:0/1709008342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f189005db80 con 0x555f9768e390 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.596+0000 7f177ffff640 1 -- 172.21.15.133:0/1709008342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189005dd00 con 0x555f9768e390 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.596+0000 7f189e52f800 1 -- 172.21.15.133:0/1709008342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f9768eee0 con 0x555f9768e390 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.596+0000 7f177ffff640 1 -- 172.21.15.133:0/1709008342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1890069400 con 0x555f9768e390 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.596+0000 7f189e52f800 1 -- 172.21.15.133:0/1709008342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f9768fa30 con 0x555f9768e390 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.597+0000 7f177ffff640 1 -- 172.21.15.133:0/1709008342 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1890059040 con 0x555f9768e390 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.597+0000 7f177ffff640 1 --2- 172.21.15.133:0/1709008342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f17740367e0 0x7f1774038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.597+0000 7f177ffff640 1 -- 172.21.15.133:0/1709008342 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f189008f410 con 0x555f9768e390 2024-02-15T22:56:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.597+0000 7f189a9b4640 1 --2- 172.21.15.133:0/1709008342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f17740367e0 0x7f1774038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.597+0000 7f189e52f800 1 Processor -- start 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f189e52f800 1 -- start start 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f189a9b4640 1 --2- 172.21.15.133:0/1709008342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f17740367e0 0x7f1774038ca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x555f9767e6e0 tx=0x7f1894005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f189e52f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f9769b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f189e52f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f973f05d0 con 0x555f9769b550 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f18999b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f9769b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f18999b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f9769b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58280/0 (socket says 172.21.15.133:58280) 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f18999b2640 1 -- 172.21.15.133:0/1340230741 learned_addr learned my addr 172.21.15.133:0/1340230741 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f18999b2640 1 -- 172.21.15.133:0/1340230741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f9769bf40 con 0x555f9769b550 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f18999b2640 1 --2- 172.21.15.133:0/1340230741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f9769b970 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f189006e000 tx=0x7f1890068e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904bede790b29af9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f177dffb640 1 -- 172.21.15.133:0/1340230741 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1890069e20 con 0x555f9769b550 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f177dffb640 1 -- 172.21.15.133:0/1340230741 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1890072580 con 0x555f9769b550 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.598+0000 7f177dffb640 1 -- 172.21.15.133:0/1340230741 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18900064b0 con 0x555f9769b550 2024-02-15T22:56:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.599+0000 7f189e52f800 1 -- 172.21.15.133:0/1340230741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 msgr2=0x555f9769b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.599+0000 7f189e52f800 1 --2- 172.21.15.133:0/1340230741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f9769b970 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f189006e000 tx=0x7f1890068e80 comp rx=0 tx=0).stop 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.599+0000 7f189e52f800 1 -- 172.21.15.133:0/1340230741 shutdown_connections 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.599+0000 7f189e52f800 1 --2- 172.21.15.133:0/1340230741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f9769b970 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.599+0000 7f189e52f800 1 -- 172.21.15.133:0/1340230741 >> 172.21.15.133:0/1340230741 conn(0x555f976978b0 msgr2=0x555f97695910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.599+0000 7f189e52f800 1 -- 172.21.15.133:0/1340230741 shutdown_connections 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.599+0000 7f189e52f800 1 -- 172.21.15.133:0/1340230741 wait complete. 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.599+0000 7f189e52f800 1 Processor -- start 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.599+0000 7f189e52f800 1 -- start start 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.599+0000 7f189e52f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f976a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.599+0000 7f189e52f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f976a2aa0 con 0x555f9769b550 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.600+0000 7f18999b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f976a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.600+0000 7f18999b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f976a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58294/0 (socket says 172.21.15.133:58294) 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.600+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 learned_addr learned my addr 172.21.15.133:0/2867666333 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.600+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f9768fa30 con 0x555f9769b550 2024-02-15T22:56:27.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.600+0000 7f18999b2640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f976a2560 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f18900066e0 tx=0x7f189008d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.600+0000 7f176bfff640 1 -- 172.21.15.133:0/2867666333 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1890069e20 con 0x555f9769b550 2024-02-15T22:56:27.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.600+0000 7f176bfff640 1 -- 172.21.15.133:0/2867666333 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189008c340 con 0x555f9769b550 2024-02-15T22:56:27.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.600+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f976a2ca0 con 0x555f9769b550 2024-02-15T22:56:27.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.600+0000 7f176bfff640 1 -- 172.21.15.133:0/2867666333 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1890069580 con 0x555f9769b550 2024-02-15T22:56:27.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.600+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f976a2ca0 con 0x555f9769b550 2024-02-15T22:56:27.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.601+0000 7f176bfff640 1 -- 172.21.15.133:0/2867666333 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f18900696e0 con 0x555f9769b550 2024-02-15T22:56:27.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.601+0000 7f176bfff640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f17640367e0 0x7f1764038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.601+0000 7f176bfff640 1 -- 172.21.15.133:0/2867666333 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f18900910d0 con 0x555f9769b550 2024-02-15T22:56:27.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.601+0000 7f189a9b4640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f17640367e0 0x7f1764038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.601+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.601+0000 7f189e52f800 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555f976adef0 0x555f976b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.601+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b0b00 con 0x555f976adef0 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189a1b3640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555f976adef0 0x555f976b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189a9b4640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f17640367e0 0x7f1764038ca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f189400b010 tx=0x7f1894020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189a1b3640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555f976adef0 0x555f976b03b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f188c018040 con 0x555f976adef0 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189e52f800 20 realm 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b0ed0 con 0x555f976adef0 2024-02-15T22:56:27.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f188c018040 con 0x555f976adef0 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189e52f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b1750 con 0x555f976adef0 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f188c018040 con 0x555f976adef0 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.602+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b1ab0 con 0x555f976adef0 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.603+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f188c018040 con 0x555f976adef0 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.603+0000 7f189e52f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.603+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.603+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976adef0 2024-02-15T22:56:27.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.603+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f188c018040 con 0x555f976adef0 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.603+0000 7f189e52f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.603+0000 7f189e52f800 20 searching for the correct realm 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.603+0000 7f189e52f800 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x555f976b3e30 0x555f976b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.603+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b68a0 con 0x555f976b3e30 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.603+0000 7f18999b2640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x555f976b3e30 0x555f976b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.603+0000 7f18999b2640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x555f976b3e30 0x555f976b6220 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.604+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.604+0000 7f18999b2640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1890098c20 0x7f189007e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.604+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b68a0 con 0x7f1890098c20 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.604+0000 7f189a9b4640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1890098c20 0x7f189007e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.604+0000 7f189a9b4640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1890098c20 0x7f189007e800 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.604+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f189400a4a0 con 0x7f1890098c20 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.604+0000 7f189a9b4640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f18940141d0 0x7f1894015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.604+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b68a0 con 0x7f18940141d0 2024-02-15T22:56:27.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.605+0000 7f189a1b3640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f18940141d0 0x7f1894015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.605+0000 7f189a1b3640 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f18940141d0 0x7f1894015940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.605+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c018040 con 0x7f18940141d0 2024-02-15T22:56:27.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.605+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976adef0 2024-02-15T22:56:27.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.606+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c018040 con 0x555f976adef0 2024-02-15T22:56:27.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.606+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976adef0 2024-02-15T22:56:27.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.606+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c018040 con 0x555f976adef0 2024-02-15T22:56:27.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.606+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f18940141d0 2024-02-15T22:56:27.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.606+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c018040 con 0x7f18940141d0 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.606+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f18940141d0 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.606+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c018040 con 0x7f18940141d0 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.606+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f1890098c20 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.606+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f189400a4a0 con 0x7f1890098c20 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.606+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976b3e30 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.607+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.607+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976adef0 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.607+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c018040 con 0x555f976adef0 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.607+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f18940141d0 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.607+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.607+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976adef0 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.608+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.608+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f1890098c20 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.608+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.608+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976b3e30 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.608+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.608+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976b3e30 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.608+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.608+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f18940141d0 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.609+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.609+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976b3e30 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.609+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.609+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976b3e30 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.609+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.609+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976adef0 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.609+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.609+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976adef0 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.609+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.609+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f18940141d0 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.610+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.610+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976b3e30 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.610+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.610+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f1890098c20 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.610+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.610+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976adef0 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.610+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.610+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f18940141d0 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.611+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.611+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976b3e30 2024-02-15T22:56:27.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.611+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.611+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f18940141d0 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.611+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.611+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f1890098c20 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.611+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.611+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976b3e30 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f18940141d0 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x555f976adef0 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b13b0 con 0x7f1890098c20 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189e52f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189e52f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189e52f800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189e52f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189e52f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189e52f800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.612+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b27a0 con 0x555f976adef0 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b2b50 con 0x555f976adef0 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:27.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b2b50 con 0x555f976adef0 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 20 zone default found 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 4 Realm: () 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 20 zonegroup default 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b23f0 con 0x7f18940141d0 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.613+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b3420 con 0x555f976b3e30 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.614+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.614+0000 7f189e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.614+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.614+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b8670 con 0x555f976b3e30 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.614+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.614+0000 7f189e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.614+0000 7f189e52f800 20 started sync module instance, tier type = 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.614+0000 7f189e52f800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.614+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b7f50 con 0x7f1890098c20 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.615+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.615+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93869050657456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b8300 con 0x7f1890098c20 2024-02-15T22:56:27.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.615+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b93a0 con 0x555f976adef0 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.616+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93869050657456] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.616+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.616+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93869050661744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976b9550 con 0x555f976adef0 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.616+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976ba020 con 0x555f976b3e30 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.617+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.617+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93869050665728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976ba870 con 0x555f976b3e30 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.617+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976bb2f0 con 0x7f1890098c20 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.618+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93869050661744] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.618+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.618+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93869050670576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976bb6a0 con 0x7f1890098c20 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.618+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976bc0d0 con 0x555f976adef0 2024-02-15T22:56:27.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.618+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93869050665728] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.619+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.619+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93869050674128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976bc090 con 0x555f976adef0 2024-02-15T22:56:27.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.619+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976bcb00 con 0x7f18940141d0 2024-02-15T22:56:27.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.619+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93869050670576] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.620+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.620+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93869050676768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976bcb00 con 0x7f18940141d0 2024-02-15T22:56:27.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.620+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976bd500 con 0x7f18940141d0 2024-02-15T22:56:27.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.620+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93869050674128] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.621+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93869050676768] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.621+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.621+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93869050662864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976bd020 con 0x7f18940141d0 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.621+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976bd990 con 0x7f18940141d0 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.622+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93869050662864] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.622+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.622+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93869050667984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976bd990 con 0x7f18940141d0 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.622+0000 7f189e52f800 20 add_watcher() i=0 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.622+0000 7f189e52f800 20 add_watcher() i=1 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.622+0000 7f189e52f800 20 add_watcher() i=2 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.622+0000 7f189e52f800 20 add_watcher() i=3 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.622+0000 7f189e52f800 20 add_watcher() i=4 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.622+0000 7f189e52f800 20 add_watcher() i=5 2024-02-15T22:56:27.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.622+0000 7f189e52f800 20 add_watcher() i=6 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.623+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93869050667984] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.623+0000 7f189e52f800 20 add_watcher() i=7 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.623+0000 7f189e52f800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.623+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976bd970 con 0x555f976adef0 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.624+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.624+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93869050682752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976be640 con 0x555f976adef0 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.625+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93869050682752] v30'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.625+0000 7f1750fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.625+0000 7f189e52f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.625+0000 7f189e52f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.625+0000 7f189e52f800 5 note: GC not initialized 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.625+0000 7f16cb7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:27.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.625+0000 7f189e52f800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.625+0000 7f189e52f800 20 Filter name: none 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.625+0000 7f16c97fa640 20 reqs_thread_entry: start 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.625+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.625+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976f2a00 con 0x555f976adef0 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.626+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.626+0000 7f189e52f800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.626+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976f2a00 con 0x7f1890098c20 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.626+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.626+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.626+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976f1970 con 0x7f1890098c20 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:27.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:65 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976f3f10 con 0x555f976b3e30 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(65 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:66 4.26 4:64dd6fe8:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976f3960 con 0x7f18940141d0 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 4.1a 4:5969fa1d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976f8a30 con 0x7f1890098c20 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 4.3c 4:3d7776b5:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976fb360 con 0x555f976adef0 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 4.16 4:69b66c2d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976fdc90 con 0x555f976b3e30 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 4.c 4:32ea204e:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f977004b0 con 0x555f976adef0 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 4.2a 4:550e1cd1:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f97703210 con 0x555f976adef0 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 4.4 4:21b7c93c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f97706080 con 0x7f18940141d0 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 4.3a 4:5eac6251:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f97708ea0 con 0x555f976b3e30 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 4.18 4:1830de7d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f9770bbc0 con 0x7f1890098c20 2024-02-15T22:56:27.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(69 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(66 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.627+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(68 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 4.14 4:29b37fcc:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f9770bbc0 con 0x555f976b3e30 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(67 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:76 4.1d 4:b9a64d9c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f97703210 con 0x555f976b3e30 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(73 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(70 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(71 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(72 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(76 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(75 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f189e52f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.2 6:44d22c7c:::pubsub..bucket.myfoo%2fb92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f97700510 con 0x555f976b3e30 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(77 pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.628+0000 7f189e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.629+0000 7f1750fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.629+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93869050682752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976dcb90 con 0x555f976adef0 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.630+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93869050682752] v30'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.630+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93869050657456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976dcb90 con 0x7f1890098c20 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.631+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93869050657456] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.631+0000 7f189e52f800 20 remove_watcher() i=0 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.631+0000 7f189e52f800 2 removed watcher, disabling cache 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.631+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93869050661744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976dcb90 con 0x555f976adef0 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.633+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93869050661744] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.633+0000 7f189e52f800 20 remove_watcher() i=1 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.633+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93869050665728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976dcb90 con 0x555f976b3e30 2024-02-15T22:56:27.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.634+0000 7f18999b2640 1 -- 172.21.15.133:0/2867666333 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93869050665728] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18900a9040 con 0x555f976b3e30 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.634+0000 7f189e52f800 20 remove_watcher() i=2 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.634+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93869050670576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976dcb90 con 0x7f1890098c20 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.635+0000 7f189a9b4640 1 -- 172.21.15.133:0/2867666333 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93869050670576] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189403a040 con 0x7f1890098c20 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.635+0000 7f189e52f800 20 remove_watcher() i=3 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.635+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93869050674128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976dcb90 con 0x555f976adef0 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.636+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93869050674128] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x555f976adef0 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.636+0000 7f189e52f800 20 remove_watcher() i=4 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.636+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93869050676768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976dcb90 con 0x7f18940141d0 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.637+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93869050676768] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.637+0000 7f189e52f800 20 remove_watcher() i=5 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.637+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93869050662864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976dcb90 con 0x7f18940141d0 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.637+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93869050662864] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.637+0000 7f189e52f800 20 remove_watcher() i=6 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.637+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93869050667984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555f976dcb90 con 0x7f18940141d0 2024-02-15T22:56:27.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.638+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93869050667984] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188c03a040 con 0x7f18940141d0 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.638+0000 7f189e52f800 20 remove_watcher() i=7 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.638+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f18940141d0 msgr2=0x7f1894015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.638+0000 7f189e52f800 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f18940141d0 0x7f1894015940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.638+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555f976adef0 msgr2=0x555f976b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.638+0000 7f189e52f800 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555f976adef0 0x555f976b03b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1890098c20 msgr2=0x7f189007e800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1890098c20 0x7f189007e800 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x555f976b3e30 msgr2=0x555f976b6220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x555f976b3e30 0x555f976b6220 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f17640367e0 msgr2=0x7f1764038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f17640367e0 0x7f1764038ca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f189400b010 tx=0x7f1894020000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 msgr2=0x555f976a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189a1b3640 1 -- 172.21.15.133:0/2867666333 reap_dead start 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f976a2560 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f18900066e0 tx=0x7f189008d8c0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 shutdown_connections 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 --2- 172.21.15.133:0/2867666333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9769b550 0x555f976a2560 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 >> 172.21.15.133:0/2867666333 conn(0x555f976978b0 msgr2=0x555f97694f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 shutdown_connections 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/2867666333 wait complete. 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/1709008342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f17740367e0 msgr2=0x7f1774038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 --2- 172.21.15.133:0/1709008342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f17740367e0 0x7f1774038ca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x555f9767e6e0 tx=0x7f1894005840 comp rx=0 tx=0).stop 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/1709008342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9768e390 msgr2=0x555f9768e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 --2- 172.21.15.133:0/1709008342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9768e390 0x555f9768e7b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1890044830 tx=0x7f1890002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/1709008342 shutdown_connections 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 --2- 172.21.15.133:0/1709008342 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f17740367e0 0x7f1774038ca0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 --2- 172.21.15.133:0/1709008342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9768e390 0x555f9768e7b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/1709008342 >> 172.21.15.133:0/1709008342 conn(0x555f97682430 msgr2=0x555f97682830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/1709008342 shutdown_connections 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/1709008342 wait complete. 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.639+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555f9757d3f0 msgr2=0x555f9767d660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555f9757d3f0 0x555f9767d660 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1780036790 msgr2=0x7f1780038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1780036790 0x7f1780038c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1890054000 tx=0x7f189004e000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 msgr2=0x555f97676900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f97676900 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f188c001ed0 tx=0x7f188c000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 shutdown_connections 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555f9757d3f0 0x555f9767d660 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1780036790 0x7f1780038c50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 --2- 172.21.15.133:0/3694916874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f9757b8b0 0x555f97676900 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 >> 172.21.15.133:0/3694916874 conn(0x555f975774d0 msgr2=0x555f97669350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 shutdown_connections 2024-02-15T22:56:27.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.640+0000 7f189e52f800 1 -- 172.21.15.133:0/3694916874 wait complete. 2024-02-15T22:56:27.660 INFO:teuthology.orchestra.run.smithi133.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f2cd5859-7c57-45d7-89f3-01e23ceddfe0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","marker":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-15T22:56:26.874042Z","creation_time":"2024-02-15T22:56:26.869244Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]}] 2024-02-15T22:56:27.660 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f2cd5859-7c57-45d7-89f3-01e23ceddfe0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'marker': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-15T22:56:26.874042Z', 'creation_time': '2024-02-15T22:56:26.869244Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []}] 2024-02-15T22:56:27.666 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-15T22:56:27.666 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T22:56:27.666 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T22:56:27.666 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-15T22:56:27.743 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:27.743 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.741+0000 7fdb08d31800 1 Processor -- start 2024-02-15T22:56:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.741+0000 7fdb08d31800 1 -- start start 2024-02-15T22:56:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.741+0000 7fdb08d31800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561b74c69a80 0x561b74c6be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.742+0000 7fdb08d31800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561b74bb3bb0 con 0x561b74c6c3b0 2024-02-15T22:56:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.742+0000 7fdb08d31800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x561b74b6b450 con 0x561b74c69a80 2024-02-15T22:56:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.742+0000 7fdb04a67640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561b74c69a80 0x561b74c6be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.742+0000 7fdafc266640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x561b74c6c3b0 0x561b74c6e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45044/0 (socket says 172.21.15.133:45044) 2024-02-15T22:56:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.742+0000 7fdb04a67640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561b74c69a80 0x561b74c6be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58306/0 (socket says 172.21.15.133:58306) 2024-02-15T22:56:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.742+0000 7fdafc266640 1 -- 172.21.15.133:0/1546071933 learned_addr learned my addr 172.21.15.133:0/1546071933 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.742+0000 7fdb04a67640 1 -- 172.21.15.133:0/1546071933 >> v1:172.21.15.52:6789/0 conn(0x561b74c6c3b0 legacy=0x561b74c6e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.742+0000 7fdb04a67640 1 -- 172.21.15.133:0/1546071933 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b74c70ed0 con 0x561b74c69a80 2024-02-15T22:56:27.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.744+0000 7fdb04a67640 1 --2- 172.21.15.133:0/1546071933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74c6be70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400a470 tx=0x7fdaf401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5445b72988e28b89 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.744+0000 7fdafffff640 1 -- 172.21.15.133:0/1546071933 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaf4052570 con 0x561b74c69a80 2024-02-15T22:56:27.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.744+0000 7fdafffff640 1 -- 172.21.15.133:0/1546071933 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40526d0 con 0x561b74c69a80 2024-02-15T22:56:27.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.744+0000 7fdafffff640 1 -- 172.21.15.133:0/1546071933 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaf4052990 con 0x561b74c69a80 2024-02-15T22:56:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.745+0000 7fdb08d31800 1 -- 172.21.15.133:0/1546071933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 msgr2=0x561b74c6be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.745+0000 7fdb08d31800 1 --2- 172.21.15.133:0/1546071933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74c6be70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400a470 tx=0x7fdaf401cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.745+0000 7fdb08d31800 1 -- 172.21.15.133:0/1546071933 shutdown_connections 2024-02-15T22:56:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.745+0000 7fdb08d31800 1 --2- 172.21.15.133:0/1546071933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74c6be70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.745+0000 7fdb08d31800 1 -- 172.21.15.133:0/1546071933 >> 172.21.15.133:0/1546071933 conn(0x561b74c634d0 msgr2=0x561b74c658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.745+0000 7fdb08d31800 1 -- 172.21.15.133:0/1546071933 shutdown_connections 2024-02-15T22:56:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.745+0000 7fdb08d31800 1 -- 172.21.15.133:0/1546071933 wait complete. 2024-02-15T22:56:27.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.756+0000 7fdb08d31800 1 Processor -- start 2024-02-15T22:56:27.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.756+0000 7fdb08d31800 1 -- start start 2024-02-15T22:56:27.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.757+0000 7fdb08d31800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d58fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.757+0000 7fdb08d31800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b74b68980 con 0x561b74c69a80 2024-02-15T22:56:27.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.757+0000 7fdb04a67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d58fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.757+0000 7fdb04a67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d58fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58318/0 (socket says 172.21.15.133:58318) 2024-02-15T22:56:27.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.757+0000 7fdb04a67640 1 -- 172.21.15.133:0/452008654 learned_addr learned my addr 172.21.15.133:0/452008654 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.757+0000 7fdb04a67640 1 -- 172.21.15.133:0/452008654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf4005d20 con 0x561b74c69a80 2024-02-15T22:56:27.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.757+0000 7fdb04a67640 1 --2- 172.21.15.133:0/452008654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d58fd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4055040 tx=0x7fdaf404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3eae855f6ce94b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.757+0000 7fd9f2e0d640 1 -- 172.21.15.133:0/452008654 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaf400a180 con 0x561b74c69a80 2024-02-15T22:56:27.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.757+0000 7fd9f2e0d640 1 -- 172.21.15.133:0/452008654 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf400a2e0 con 0x561b74c69a80 2024-02-15T22:56:27.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.757+0000 7fd9f2e0d640 1 -- 172.21.15.133:0/452008654 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaf40529b0 con 0x561b74c69a80 2024-02-15T22:56:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.758+0000 7fdb08d31800 1 -- 172.21.15.133:0/452008654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 msgr2=0x561b74d58fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.758+0000 7fdb08d31800 1 --2- 172.21.15.133:0/452008654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d58fd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4055040 tx=0x7fdaf404c000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.758+0000 7fdb08d31800 1 -- 172.21.15.133:0/452008654 shutdown_connections 2024-02-15T22:56:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.758+0000 7fdb08d31800 1 --2- 172.21.15.133:0/452008654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d58fd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.758+0000 7fdb08d31800 1 -- 172.21.15.133:0/452008654 >> 172.21.15.133:0/452008654 conn(0x561b74c634d0 msgr2=0x561b74d548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.758+0000 7fdb08d31800 1 -- 172.21.15.133:0/452008654 shutdown_connections 2024-02-15T22:56:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.758+0000 7fdb08d31800 1 -- 172.21.15.133:0/452008654 wait complete. 2024-02-15T22:56:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.758+0000 7fdb08d31800 1 Processor -- start 2024-02-15T22:56:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.759+0000 7fdb08d31800 1 -- start start 2024-02-15T22:56:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.759+0000 7fdb08d31800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d60620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.759+0000 7fdb08d31800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b74b64160 con 0x561b74c69a80 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.759+0000 7fdb04a67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d60620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.759+0000 7fdb04a67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d60620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58326/0 (socket says 172.21.15.133:58326) 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.759+0000 7fdb04a67640 1 -- 172.21.15.133:0/229740737 learned_addr learned my addr 172.21.15.133:0/229740737 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.759+0000 7fdb04a67640 1 -- 172.21.15.133:0/229740737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b74c70ed0 con 0x561b74c69a80 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.759+0000 7fdb04a67640 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d60620 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400a470 tx=0x7fdaf4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.760+0000 7fd9f160a640 1 -- 172.21.15.133:0/229740737 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaf406a070 con 0x561b74c69a80 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.760+0000 7fd9f160a640 1 -- 172.21.15.133:0/229740737 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf405d420 con 0x561b74c69a80 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.760+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b74d60b60 con 0x561b74c69a80 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.760+0000 7fd9f160a640 1 -- 172.21.15.133:0/229740737 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaf405d5d0 con 0x561b74c69a80 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.760+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b74d61040 con 0x561b74c69a80 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.760+0000 7fd9f160a640 1 -- 172.21.15.133:0/229740737 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdaf405d730 con 0x561b74c69a80 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.761+0000 7fd9f160a640 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9ec0367e0 0x7fd9ec038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.761+0000 7fd9f160a640 1 -- 172.21.15.133:0/229740737 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fdaf408d8e0 con 0x561b74c69a80 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.761+0000 7fdafc266640 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9ec0367e0 0x7fd9ec038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.761+0000 7fdb08d31800 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561b74c6c3b0 0x561b74d672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.761+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d67900 con 0x561b74c6c3b0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.761+0000 7fdb05268640 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561b74c6c3b0 0x561b74d672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.761+0000 7fdafc266640 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9ec0367e0 0x7fd9ec038ca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdaec000f60 tx=0x7fdaec0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.761+0000 7fdb05268640 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561b74c6c3b0 0x561b74d672e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.761+0000 7fdb05268640 1 -- 172.21.15.133:0/229740737 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdb0000a4a0 con 0x561b74c6c3b0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.761+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d64a30 con 0x561b74c6c3b0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.762+0000 7fdb05268640 1 -- 172.21.15.133:0/229740737 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdb0000a4a0 con 0x561b74c6c3b0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.762+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d67dd0 con 0x561b74c6c3b0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.762+0000 7fdb05268640 1 -- 172.21.15.133:0/229740737 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fdb0000a4a0 con 0x561b74c6c3b0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.762+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d68ac0 con 0x561b74c6c3b0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.762+0000 7fdb05268640 1 -- 172.21.15.133:0/229740737 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdb0000a4a0 con 0x561b74c6c3b0 2024-02-15T22:56:27.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.762+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d68ed0 con 0x561b74c6c3b0 2024-02-15T22:56:27.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.762+0000 7fdb05268640 1 -- 172.21.15.133:0/229740737 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fdb0000a4a0 con 0x561b74c6c3b0 2024-02-15T22:56:27.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.763+0000 7fdb08d31800 1 Processor -- start 2024-02-15T22:56:27.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.763+0000 7fdb08d31800 1 -- start start 2024-02-15T22:56:27.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.763+0000 7fdb08d31800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69640 0x561b74c67ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.763+0000 7fdb08d31800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b74b06e80 con 0x561b74c69640 2024-02-15T22:56:27.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.763+0000 7fdafc266640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69640 0x561b74c67ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.763+0000 7fdafc266640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69640 0x561b74c67ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58330/0 (socket says 172.21.15.133:58330) 2024-02-15T22:56:27.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.763+0000 7fdafc266640 1 -- 172.21.15.133:0/3821103992 learned_addr learned my addr 172.21.15.133:0/3821103992 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.763+0000 7fdafc266640 1 -- 172.21.15.133:0/3821103992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b74c67ff0 con 0x561b74c69640 2024-02-15T22:56:27.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.764+0000 7fdafc266640 1 --2- 172.21.15.133:0/3821103992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69640 0x561b74c67ab0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdaec001ed0 tx=0x7fdaec00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.764+0000 7fd9ea7fc640 1 -- 172.21.15.133:0/3821103992 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaec020070 con 0x561b74c69640 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.764+0000 7fd9ea7fc640 1 -- 172.21.15.133:0/3821103992 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec01b550 con 0x561b74c69640 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.764+0000 7fdb08d31800 1 -- 172.21.15.133:0/3821103992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b74c68240 con 0x561b74c69640 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.764+0000 7fd9ea7fc640 1 -- 172.21.15.133:0/3821103992 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaec013040 con 0x561b74c69640 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.764+0000 7fdb08d31800 1 -- 172.21.15.133:0/3821103992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b74c68700 con 0x561b74c69640 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.764+0000 7fd9ea7fc640 1 -- 172.21.15.133:0/3821103992 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdaec01b7f0 con 0x561b74c69640 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.765+0000 7fd9ea7fc640 1 --2- 172.21.15.133:0/3821103992 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9dc0367e0 0x7fd9dc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.765+0000 7fd9ea7fc640 1 -- 172.21.15.133:0/3821103992 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fdaec04e230 con 0x561b74c69640 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.765+0000 7fdb05268640 1 --2- 172.21.15.133:0/3821103992 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9dc0367e0 0x7fd9dc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.765+0000 7fdb08d31800 1 Processor -- start 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.765+0000 7fdb05268640 1 --2- 172.21.15.133:0/3821103992 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9dc0367e0 0x7fd9dc038ca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x561b74d64950 tx=0x7fdb00005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.765+0000 7fdb08d31800 1 -- start start 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.765+0000 7fdb08d31800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d87940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.765+0000 7fdb08d31800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b74adc5d0 con 0x561b74d87520 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.765+0000 7fdafc266640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d87940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.765+0000 7fdafc266640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d87940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58338/0 (socket says 172.21.15.133:58338) 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.765+0000 7fdafc266640 1 -- 172.21.15.133:0/1184085137 learned_addr learned my addr 172.21.15.133:0/1184085137 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fdafc266640 1 -- 172.21.15.133:0/1184085137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b74d87f10 con 0x561b74d87520 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fdafc266640 1 --2- 172.21.15.133:0/1184085137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d87940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdaec04c750 tx=0x7fdaec019bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74555e6bd0004ecb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fd9dbfff640 1 -- 172.21.15.133:0/1184085137 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaec025930 con 0x561b74d87520 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fd9dbfff640 1 -- 172.21.15.133:0/1184085137 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec040e90 con 0x561b74d87520 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fd9dbfff640 1 -- 172.21.15.133:0/1184085137 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaec025410 con 0x561b74d87520 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fdb08d31800 1 -- 172.21.15.133:0/1184085137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 msgr2=0x561b74d87940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fdb08d31800 1 --2- 172.21.15.133:0/1184085137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d87940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdaec04c750 tx=0x7fdaec019bb0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fdb08d31800 1 -- 172.21.15.133:0/1184085137 shutdown_connections 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fdb08d31800 1 --2- 172.21.15.133:0/1184085137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d87940 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fdb08d31800 1 -- 172.21.15.133:0/1184085137 >> 172.21.15.133:0/1184085137 conn(0x561b74d83880 msgr2=0x561b74d818e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fdb08d31800 1 -- 172.21.15.133:0/1184085137 shutdown_connections 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.766+0000 7fdb08d31800 1 -- 172.21.15.133:0/1184085137 wait complete. 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.767+0000 7fdb08d31800 1 Processor -- start 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.767+0000 7fdb08d31800 1 -- start start 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.767+0000 7fdb08d31800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d8e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.767+0000 7fdb08d31800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b74d8ea70 con 0x561b74d87520 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.767+0000 7fdafc266640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d8e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.767+0000 7fdafc266640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d8e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58344/0 (socket says 172.21.15.133:58344) 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.767+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 learned_addr learned my addr 172.21.15.133:0/4161875746 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.767+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b74c68700 con 0x561b74d87520 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.767+0000 7fdafc266640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d8e530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdaec04ca70 tx=0x7fdaec04c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.768+0000 7fd9da7fc640 1 -- 172.21.15.133:0/4161875746 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaec025a70 con 0x561b74d87520 2024-02-15T22:56:27.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.768+0000 7fd9da7fc640 1 -- 172.21.15.133:0/4161875746 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec025410 con 0x561b74d87520 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.768+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b74d8ec70 con 0x561b74d87520 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.768+0000 7fd9da7fc640 1 -- 172.21.15.133:0/4161875746 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdaec01bc80 con 0x561b74d87520 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.768+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b74d8ec70 con 0x561b74d87520 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.769+0000 7fd9da7fc640 1 -- 172.21.15.133:0/4161875746 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdaec00cc60 con 0x561b74d87520 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.769+0000 7fd9da7fc640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9d00367e0 0x7fd9d0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.769+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.769+0000 7fd9da7fc640 1 -- 172.21.15.133:0/4161875746 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fdaec039b00 con 0x561b74d87520 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.769+0000 7fdb05268640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9d00367e0 0x7fd9d0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.769+0000 7fdb08d31800 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561b74d99f40 0x561b74d9c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.769+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d9cb00 con 0x561b74d99f40 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.769+0000 7fdb04a67640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561b74d99f40 0x561b74d9c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.769+0000 7fdb05268640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9d00367e0 0x7fd9d0038ca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000b010 tx=0x7fdb00020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.769+0000 7fdb04a67640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561b74d99f40 0x561b74d9c3b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdaf4059040 con 0x561b74d99f40 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 20 realm 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d9ce90 con 0x561b74d99f40 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdaf4059040 con 0x561b74d99f40 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d9d710 con 0x561b74d99f40 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdaf4059040 con 0x561b74d99f40 2024-02-15T22:56:27.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d9da70 con 0x561b74d99f40 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdaf4059040 con 0x561b74d99f40 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d9d370 con 0x561b74d99f40 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fdaf407e380 con 0x561b74d99f40 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.770+0000 7fdb08d31800 20 searching for the correct realm 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.771+0000 7fdb08d31800 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x561b74d9fdf0 0x561b74da21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.771+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d9fdf0 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.771+0000 7fdafc266640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x561b74d9fdf0 0x561b74da21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.771+0000 7fdafc266640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x561b74d9fdf0 0x561b74da21e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.771+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.771+0000 7fdafc266640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdaec038070 0x7fdaec02f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.771+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdaec038070 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.771+0000 7fdb05268640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdaec038070 0x7fdaec02f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.772+0000 7fdb05268640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdaec038070 0x7fdaec02f8a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.772+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb0000a4a0 con 0x7fdaec038070 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.772+0000 7fdb05268640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdb000141d0 0x7fdb00015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.772+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdb000141d0 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.772+0000 7fdb04a67640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdb000141d0 0x7fdb00015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.772+0000 7fdb04a67640 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdb000141d0 0x7fdb00015940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.773+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf407e380 con 0x7fdb000141d0 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.773+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d99f40 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.773+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf4086040 con 0x561b74d99f40 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.773+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d99f40 2024-02-15T22:56:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.773+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf4086040 con 0x561b74d99f40 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.773+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdb000141d0 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.773+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf4086040 con 0x7fdb000141d0 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.773+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdb000141d0 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.774+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf4086040 con 0x7fdb000141d0 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.774+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdaec038070 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.774+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb0000a4a0 con 0x7fdaec038070 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.774+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d9fdf0 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.774+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.774+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d99f40 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.774+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf4086040 con 0x561b74d99f40 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.774+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdb000141d0 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.775+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf4086040 con 0x7fdb000141d0 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.775+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d99f40 2024-02-15T22:56:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.775+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf4086040 con 0x561b74d99f40 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.775+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdaec038070 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.775+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.775+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d9fdf0 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.775+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.775+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d9fdf0 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.776+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.776+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdb000141d0 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.776+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf4086040 con 0x7fdb000141d0 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.776+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d9fdf0 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.776+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.776+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d9fdf0 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.776+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.776+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d99f40 2024-02-15T22:56:27.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.776+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf4086040 con 0x561b74d99f40 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.776+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d99f40 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.777+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fdaf4086040 con 0x561b74d99f40 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.777+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdb000141d0 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.777+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.777+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d9fdf0 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.777+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.777+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdaec038070 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.777+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.777+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d99f40 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.778+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.778+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdb000141d0 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.778+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.778+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d9fdf0 2024-02-15T22:56:27.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.778+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.778+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdb000141d0 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.778+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.778+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdaec038070 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.779+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.779+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d9fdf0 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.779+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.779+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdb000141d0 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.779+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.779+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x561b74d99f40 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.779+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.779+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da28b0 con 0x7fdaec038070 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:27.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d9e8c0 con 0x561b74d99f40 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d9e540 con 0x561b74d99f40 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74d9f250 con 0x561b74d99f40 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 zone default found 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 4 Realm: () 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 zonegroup default 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.780+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da2d40 con 0x7fdb000141d0 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.781+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.781+0000 7fdb08d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.781+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.781+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da4ad0 con 0x561b74d9fdf0 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.781+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.781+0000 7fdb08d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.781+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.781+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da4e30 con 0x561b74d9fdf0 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.782+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.782+0000 7fdb08d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.782+0000 7fdb08d31800 20 started sync module instance, tier type = 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.782+0000 7fdb08d31800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.782+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da43b0 con 0x7fdaec038070 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.782+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.782+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94675924565776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da4760 con 0x7fdaec038070 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.783+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da5b40 con 0x561b74d99f40 2024-02-15T22:56:27.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.783+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94675924565776] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.784+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.784+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94675924570896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da5d50 con 0x561b74d99f40 2024-02-15T22:56:27.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.784+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da6820 con 0x561b74d9fdf0 2024-02-15T22:56:27.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.785+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94675924570896] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.785+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.785+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94675924574976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da6bd0 con 0x561b74d9fdf0 2024-02-15T22:56:27.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.785+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da7580 con 0x7fdaec038070 2024-02-15T22:56:27.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.786+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94675924574976] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.786+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.786+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94675924572080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da7960 con 0x7fdaec038070 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.786+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da8360 con 0x561b74d99f40 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.787+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94675924572080] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.787+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.787+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94675924581984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da8320 con 0x561b74d99f40 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.787+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da8dc0 con 0x7fdb000141d0 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.788+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.788+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94675924584672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da8dc0 con 0x7fdb000141d0 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.788+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da9d00 con 0x7fdb000141d0 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.789+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94675924581984] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.789+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94675924584672] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.790+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.790+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94675924588512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da9170 con 0x7fdb000141d0 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.790+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74daa2d0 con 0x7fdb000141d0 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94675924590128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74daa6f0 con 0x7fdb000141d0 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb08d31800 20 add_watcher() i=0 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb08d31800 20 add_watcher() i=1 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb08d31800 20 add_watcher() i=2 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb08d31800 20 add_watcher() i=3 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb08d31800 20 add_watcher() i=4 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb08d31800 20 add_watcher() i=5 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94675924588512] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb08d31800 20 add_watcher() i=6 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94675924590128] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb08d31800 20 add_watcher() i=7 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb08d31800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.791+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da7190 con 0x561b74d99f40 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.792+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.792+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94675924591184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74daaf20 con 0x561b74d99f40 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.793+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94675924591184] v30'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.793+0000 7fd9bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.793+0000 7fdb08d31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.793+0000 7fdb08d31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.793+0000 7fdb08d31800 5 note: GC not initialized 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.793+0000 7fd9b9fe3640 20 reqs_thread_entry: start 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.793+0000 7fdb08d31800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.793+0000 7fdb08d31800 20 Filter name: none 2024-02-15T22:56:27.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.793+0000 7fd92b7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.793+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.793+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74ddf510 con 0x7fdaec038070 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb08d31800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:63 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74ddfdc0 con 0x561b74d9fdf0 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(63 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb08d31800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb08d31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74ddeb20 con 0x7fdaec038070 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb08d31800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:27.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.794+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:65 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74de18f0 con 0x561b74d9fdf0 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(65 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:66 4.26 4:64dd6fe8:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74de1370 con 0x7fdb000141d0 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 4.1a 4:5969fa1d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74de6500 con 0x7fdaec038070 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 4.3c 4:3d7776b5:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74de8ef0 con 0x561b74d99f40 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 4.16 4:69b66c2d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74deb710 con 0x561b74d9fdf0 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 4.c 4:32ea204e:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74dedf30 con 0x561b74d99f40 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 4.2a 4:550e1cd1:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74df0820 con 0x561b74d99f40 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 4.4 4:21b7c93c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74df3210 con 0x7fdb000141d0 2024-02-15T22:56:27.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 4.3a 4:5eac6251:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74df5c30 con 0x561b74d9fdf0 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(68 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 4.18 4:1830de7d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74df8630 con 0x7fdaec038070 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 4.14 4:29b37fcc:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74df8f30 con 0x561b74d9fdf0 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(67 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(70 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(69 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(71 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.796+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(66 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.796+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(72 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.795+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:76 4.1d 4:b9a64d9c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74df8f30 con 0x561b74d9fdf0 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.796+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.796+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(75 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.796+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(73 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.796+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(76 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.796+0000 7fdb08d31800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.796+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.2 6:44d22c7c:::pubsub..bucket.myfoo%2fb92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74df3190 con 0x561b74d9fdf0 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.796+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.796+0000 7fdb08d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.797+0000 7fd9bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.797+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94675924591184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74ddd830 con 0x561b74d99f40 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.798+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94675924591184] v30'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.798+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94675924565776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74daa250 con 0x7fdaec038070 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.799+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94675924565776] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.799+0000 7fdb08d31800 20 remove_watcher() i=0 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.799+0000 7fdb08d31800 2 removed watcher, disabling cache 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.799+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94675924570896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74daa250 con 0x561b74d99f40 2024-02-15T22:56:27.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.800+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94675924570896] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.800+0000 7fdb08d31800 20 remove_watcher() i=1 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.800+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94675924574976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da5310 con 0x561b74d9fdf0 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.801+0000 7fdafc266640 1 -- 172.21.15.133:0/4161875746 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94675924574976] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaec022070 con 0x561b74d9fdf0 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.801+0000 7fdb08d31800 20 remove_watcher() i=2 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.801+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94675924572080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74daa250 con 0x7fdaec038070 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.802+0000 7fdb05268640 1 -- 172.21.15.133:0/4161875746 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94675924572080] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdb0003a040 con 0x7fdaec038070 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.802+0000 7fdb08d31800 20 remove_watcher() i=3 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.802+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94675924581984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da5310 con 0x561b74d99f40 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.803+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94675924581984] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x561b74d99f40 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.803+0000 7fdb08d31800 20 remove_watcher() i=4 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.803+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94675924584672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74daa250 con 0x7fdb000141d0 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.804+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94675924584672] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.804+0000 7fdb08d31800 20 remove_watcher() i=5 2024-02-15T22:56:27.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.804+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94675924588512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da7e60 con 0x7fdb000141d0 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.805+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94675924588512] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.805+0000 7fdb08d31800 20 remove_watcher() i=6 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.805+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94675924590128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b74da5310 con 0x7fdb000141d0 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94675924590128] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdaf409d040 con 0x7fdb000141d0 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 20 remove_watcher() i=7 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdb000141d0 msgr2=0x7fdb00015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fdb000141d0 0x7fdb00015940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561b74d99f40 msgr2=0x561b74d9c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561b74d99f40 0x561b74d9c3b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdaec038070 msgr2=0x7fdaec02f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fdaec038070 0x7fdaec02f8a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x561b74d9fdf0 msgr2=0x561b74da21e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x561b74d9fdf0 0x561b74da21e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9d00367e0 msgr2=0x7fd9d0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9d00367e0 0x7fd9d0038ca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000b010 tx=0x7fdb00020000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 msgr2=0x561b74d8e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb04a67640 1 -- 172.21.15.133:0/4161875746 reap_dead start 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d8e530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdaec04ca70 tx=0x7fdaec04c6e0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 shutdown_connections 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 --2- 172.21.15.133:0/4161875746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74d87520 0x561b74d8e530 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 >> 172.21.15.133:0/4161875746 conn(0x561b74d83880 msgr2=0x561b74d80ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 shutdown_connections 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.806+0000 7fdb08d31800 1 -- 172.21.15.133:0/4161875746 wait complete. 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/3821103992 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9dc0367e0 msgr2=0x7fd9dc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 --2- 172.21.15.133:0/3821103992 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9dc0367e0 0x7fd9dc038ca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x561b74d64950 tx=0x7fdb00005840 comp rx=0 tx=0).stop 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/3821103992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69640 msgr2=0x561b74c67ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 --2- 172.21.15.133:0/3821103992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69640 0x561b74c67ab0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdaec001ed0 tx=0x7fdaec00d7a0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/3821103992 shutdown_connections 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 --2- 172.21.15.133:0/3821103992 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9dc0367e0 0x7fd9dc038ca0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 --2- 172.21.15.133:0/3821103992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69640 0x561b74c67ab0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/3821103992 >> 172.21.15.133:0/3821103992 conn(0x561b74d6c0e0 msgr2=0x561b74d6c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/3821103992 shutdown_connections 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/3821103992 wait complete. 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561b74c6c3b0 msgr2=0x561b74d672e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561b74c6c3b0 0x561b74d672e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9ec0367e0 msgr2=0x7fd9ec038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9ec0367e0 0x7fd9ec038ca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdaec000f60 tx=0x7fdaec0012b0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 msgr2=0x561b74d60620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d60620 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400a470 tx=0x7fdaf4002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 shutdown_connections 2024-02-15T22:56:27.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561b74c6c3b0 0x561b74d672e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd9ec0367e0 0x7fd9ec038ca0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 --2- 172.21.15.133:0/229740737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561b74c69a80 0x561b74d60620 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 >> 172.21.15.133:0/229740737 conn(0x561b74c634d0 msgr2=0x561b74d53150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 shutdown_connections 2024-02-15T22:56:27.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.807+0000 7fdb08d31800 1 -- 172.21.15.133:0/229740737 wait complete. 2024-02-15T22:56:27.828 INFO:teuthology.orchestra.run.smithi133.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f2cd5859-7c57-45d7-89f3-01e23ceddfe0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","marker":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-15T22:56:26.874042Z","creation_time":"2024-02-15T22:56:26.869244Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-15T22:56:27.828 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f2cd5859-7c57-45d7-89f3-01e23ceddfe0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'marker': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-15T22:56:26.874042Z', 'creation_time': '2024-02-15T22:56:26.869244Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-15T22:56:27.828 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-15T22:56:27.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-15T22:56:27.829 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-02-15T22:56:27.912 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:27.912 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.910+0000 7fa7c21d6800 1 Processor -- start 2024-02-15T22:56:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.910+0000 7fa7c21d6800 1 -- start start 2024-02-15T22:56:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.910+0000 7fa7c21d6800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557079d4f3d0 0x557079d57ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.910+0000 7fa7c21d6800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557079c99ba0 con 0x557079d4d890 2024-02-15T22:56:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.910+0000 7fa7c21d6800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x557079c51450 con 0x557079d4f3d0 2024-02-15T22:56:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.911+0000 7fa7bf4d4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557079d4f3d0 0x557079d57ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.911+0000 7fa7bfcd5640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x557079d4d890 0x557079d4dcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45058/0 (socket says 172.21.15.133:45058) 2024-02-15T22:56:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.911+0000 7fa7bf4d4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557079d4f3d0 0x557079d57ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58352/0 (socket says 172.21.15.133:58352) 2024-02-15T22:56:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.911+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/15459054 learned_addr learned my addr 172.21.15.133:0/15459054 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.911+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/15459054 >> v1:172.21.15.52:6789/0 conn(0x557079d4d890 legacy=0x557079d4dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.911+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/15459054 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557079cc21c0 con 0x557079d4f3d0 2024-02-15T22:56:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.911+0000 7fa7becd3640 1 -- 172.21.15.133:0/15459054 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343253627 0 0) 0x557079c99ba0 con 0x557079d4d890 2024-02-15T22:56:27.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.913+0000 7fa7bf4d4640 1 --2- 172.21.15.133:0/15459054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4f3d0 0x557079d57ed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400a470 tx=0x7fa7b401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71919eb1d84eb231 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.913+0000 7fa7becd3640 1 -- 172.21.15.133:0/15459054 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b404ad40 con 0x557079d4f3d0 2024-02-15T22:56:27.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.913+0000 7fa7becd3640 1 -- 172.21.15.133:0/15459054 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4052440 con 0x557079d4f3d0 2024-02-15T22:56:27.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.913+0000 7fa7becd3640 1 -- 172.21.15.133:0/15459054 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b404aea0 con 0x557079d4f3d0 2024-02-15T22:56:27.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.913+0000 7fa7c21d6800 1 -- 172.21.15.133:0/15459054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4f3d0 msgr2=0x557079d57ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.913+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/15459054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4f3d0 0x557079d57ed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400a470 tx=0x7fa7b401cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:27.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.914+0000 7fa7c21d6800 1 -- 172.21.15.133:0/15459054 shutdown_connections 2024-02-15T22:56:27.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.914+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/15459054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4f3d0 0x557079d57ed0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.914+0000 7fa7c21d6800 1 -- 172.21.15.133:0/15459054 >> 172.21.15.133:0/15459054 conn(0x557079d494f0 msgr2=0x557079d4b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.914+0000 7fa7c21d6800 1 -- 172.21.15.133:0/15459054 shutdown_connections 2024-02-15T22:56:27.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.914+0000 7fa7c21d6800 1 -- 172.21.15.133:0/15459054 wait complete. 2024-02-15T22:56:27.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.925+0000 7fa7c21d6800 1 Processor -- start 2024-02-15T22:56:27.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.925+0000 7fa7c21d6800 1 -- start start 2024-02-15T22:56:27.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.925+0000 7fa7c21d6800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e41170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.925+0000 7fa7c21d6800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557079c4e980 con 0x557079d4d890 2024-02-15T22:56:27.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.926+0000 7fa7bfcd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e41170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.926+0000 7fa7bfcd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e41170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58360/0 (socket says 172.21.15.133:58360) 2024-02-15T22:56:27.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.926+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3364272490 learned_addr learned my addr 172.21.15.133:0/3364272490 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.926+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3364272490 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b4005d20 con 0x557079d4d890 2024-02-15T22:56:27.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.926+0000 7fa7bfcd5640 1 --2- 172.21.15.133:0/3364272490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e41170 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b210 tx=0x7fa7b000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb88638ae091a5d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.926+0000 7fa6ade0b640 1 -- 172.21.15.133:0/3364272490 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b0014070 con 0x557079d4d890 2024-02-15T22:56:27.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.926+0000 7fa6ade0b640 1 -- 172.21.15.133:0/3364272490 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000d500 con 0x557079d4d890 2024-02-15T22:56:27.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.926+0000 7fa6ade0b640 1 -- 172.21.15.133:0/3364272490 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b000d800 con 0x557079d4d890 2024-02-15T22:56:27.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.927+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3364272490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 msgr2=0x557079e41170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.927+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3364272490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e41170 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b210 tx=0x7fa7b000b6d0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.927+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3364272490 shutdown_connections 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.927+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3364272490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e41170 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.927+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3364272490 >> 172.21.15.133:0/3364272490 conn(0x557079d494f0 msgr2=0x557079e3ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.927+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3364272490 shutdown_connections 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.927+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3364272490 wait complete. 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.927+0000 7fa7c21d6800 1 Processor -- start 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.927+0000 7fa7c21d6800 1 -- start start 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.927+0000 7fa7c21d6800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e48830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.927+0000 7fa7c21d6800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557079c4a160 con 0x557079d4d890 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.928+0000 7fa7bfcd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e48830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.928+0000 7fa7bfcd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e48830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58370/0 (socket says 172.21.15.133:58370) 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.928+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3203016400 learned_addr learned my addr 172.21.15.133:0/3203016400 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.928+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3203016400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0001b70 con 0x557079d4d890 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.928+0000 7fa7bfcd5640 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e48830 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b210 tx=0x7fa7b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.928+0000 7fa6a7fff640 1 -- 172.21.15.133:0/3203016400 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b000f950 con 0x557079d4d890 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.928+0000 7fa6a7fff640 1 -- 172.21.15.133:0/3203016400 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b0020070 con 0x557079d4d890 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.928+0000 7fa6a7fff640 1 -- 172.21.15.133:0/3203016400 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b000fc20 con 0x557079d4d890 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.928+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557079e48d70 con 0x557079d4d890 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.928+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557079e49250 con 0x557079d4d890 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.929+0000 7fa6a7fff640 1 -- 172.21.15.133:0/3203016400 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa7b000d040 con 0x557079d4d890 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.929+0000 7fa6a7fff640 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6a80367e0 0x7fa6a8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.929+0000 7fa6a7fff640 1 -- 172.21.15.133:0/3203016400 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fa7b000a040 con 0x557079d4d890 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.929+0000 7fa7bf4d4640 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6a80367e0 0x7fa6a8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.929+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557079d4f3d0 0x557079e4f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.929+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e4fb00 con 0x557079d4f3d0 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.929+0000 7fa7c04d6640 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557079d4f3d0 0x557079e4f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.930+0000 7fa7bf4d4640 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6a80367e0 0x7fa6a8038ca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4054000 tx=0x7fa7b404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.930+0000 7fa7c04d6640 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557079d4f3d0 0x557079e4f530 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.930+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3203016400 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7b800a4a0 con 0x557079d4f3d0 2024-02-15T22:56:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.930+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e4cc20 con 0x557079d4f3d0 2024-02-15T22:56:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.930+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3203016400 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa7b800a4a0 con 0x557079d4f3d0 2024-02-15T22:56:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.930+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e51830 con 0x557079d4f3d0 2024-02-15T22:56:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.931+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3203016400 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa7b800a4a0 con 0x557079d4f3d0 2024-02-15T22:56:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.931+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e50a30 con 0x557079d4f3d0 2024-02-15T22:56:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.931+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3203016400 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa7b800a4a0 con 0x557079d4f3d0 2024-02-15T22:56:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.931+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e50e40 con 0x557079d4f3d0 2024-02-15T22:56:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.931+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3203016400 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa7b800a4a0 con 0x557079d4f3d0 2024-02-15T22:56:27.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.931+0000 7fa7c21d6800 1 Processor -- start 2024-02-15T22:56:27.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.932+0000 7fa7c21d6800 1 -- start start 2024-02-15T22:56:27.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.932+0000 7fa7c21d6800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e602b0 0x557079e606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.932+0000 7fa7c21d6800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557079bece80 con 0x557079e602b0 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.932+0000 7fa7bf4d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e602b0 0x557079e606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.932+0000 7fa7bf4d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e602b0 0x557079e606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58386/0 (socket says 172.21.15.133:58386) 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.932+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/729072673 learned_addr learned my addr 172.21.15.133:0/729072673 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.932+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/729072673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557079e60c10 con 0x557079e602b0 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.932+0000 7fa7bf4d4640 1 --2- 172.21.15.133:0/729072673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e602b0 0x557079e606d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa7b404bfd0 tx=0x7fa7b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.932+0000 7fa6a57fa640 1 -- 172.21.15.133:0/729072673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b4067770 con 0x557079e602b0 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.932+0000 7fa6a57fa640 1 -- 172.21.15.133:0/729072673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b40678d0 con 0x557079e602b0 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.933+0000 7fa7c21d6800 1 -- 172.21.15.133:0/729072673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557079e60e00 con 0x557079e602b0 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.933+0000 7fa6a57fa640 1 -- 172.21.15.133:0/729072673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b4067b70 con 0x557079e602b0 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.933+0000 7fa7c21d6800 1 -- 172.21.15.133:0/729072673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557079e61950 con 0x557079e602b0 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.933+0000 7fa6a57fa640 1 -- 172.21.15.133:0/729072673 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa7b4065040 con 0x557079e602b0 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.933+0000 7fa6a57fa640 1 --2- 172.21.15.133:0/729072673 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6980367e0 0x7fa698038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.933+0000 7fa6a57fa640 1 -- 172.21.15.133:0/729072673 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fa7b4062040 con 0x557079e602b0 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.933+0000 7fa7c04d6640 1 --2- 172.21.15.133:0/729072673 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6980367e0 0x7fa698038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.934+0000 7fa7c21d6800 1 Processor -- start 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.934+0000 7fa7c21d6800 1 -- start start 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.934+0000 7fa7c04d6640 1 --2- 172.21.15.133:0/729072673 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6980367e0 0x7fa698038ca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x557079e50470 tx=0x7fa7b8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.934+0000 7fa7c21d6800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 0x557079e6d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.934+0000 7fa7c21d6800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557079bc25d0 con 0x557079e6d4a0 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.934+0000 7fa7bf4d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 0x557079e6d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.934+0000 7fa7bf4d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 0x557079e6d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58390/0 (socket says 172.21.15.133:58390) 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.934+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/1447619932 learned_addr learned my addr 172.21.15.133:0/1447619932 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.934+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/1447619932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557079e6de70 con 0x557079e6d4a0 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.934+0000 7fa7bf4d4640 1 --2- 172.21.15.133:0/1447619932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 0x557079e6d8a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa7b406fd10 tx=0x7fa7b405bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c042325272e5d766 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa69effd640 1 -- 172.21.15.133:0/1447619932 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b408c070 con 0x557079e6d4a0 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa69effd640 1 -- 172.21.15.133:0/1447619932 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b406f3a0 con 0x557079e6d4a0 2024-02-15T22:56:27.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa69effd640 1 -- 172.21.15.133:0/1447619932 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b4066c90 con 0x557079e6d4a0 2024-02-15T22:56:27.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa7c21d6800 1 -- 172.21.15.133:0/1447619932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 msgr2=0x557079e6d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/1447619932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 0x557079e6d8a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa7b406fd10 tx=0x7fa7b405bee0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa7c21d6800 1 -- 172.21.15.133:0/1447619932 shutdown_connections 2024-02-15T22:56:27.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/1447619932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 0x557079e6d8a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa7c21d6800 1 -- 172.21.15.133:0/1447619932 >> 172.21.15.133:0/1447619932 conn(0x557079e69770 msgr2=0x557079e677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa7c21d6800 1 -- 172.21.15.133:0/1447619932 shutdown_connections 2024-02-15T22:56:27.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa7c21d6800 1 -- 172.21.15.133:0/1447619932 wait complete. 2024-02-15T22:56:27.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa7c21d6800 1 Processor -- start 2024-02-15T22:56:27.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.935+0000 7fa7c21d6800 1 -- start start 2024-02-15T22:56:27.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa7c21d6800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 0x557079e74490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa7c21d6800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557079e749d0 con 0x557079e6d4a0 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa7bf4d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 0x557079e74490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa7bf4d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 0x557079e74490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58406/0 (socket says 172.21.15.133:58406) 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 learned_addr learned my addr 172.21.15.133:0/3963341791 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557079e61950 con 0x557079e6d4a0 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa7bf4d4640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 0x557079e74490 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa7b405cfd0 tx=0x7fa7b408ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa69d7fa640 1 -- 172.21.15.133:0/3963341791 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b406f510 con 0x557079e6d4a0 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa69d7fa640 1 -- 172.21.15.133:0/3963341791 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b408f960 con 0x557079e6d4a0 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557079e74bd0 con 0x557079e6d4a0 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa69d7fa640 1 -- 172.21.15.133:0/3963341791 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7b408fc20 con 0x557079e6d4a0 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.936+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557079e74bd0 con 0x557079e6d4a0 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.937+0000 7fa69d7fa640 1 -- 172.21.15.133:0/3963341791 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa7b408f070 con 0x557079e6d4a0 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.937+0000 7fa69d7fa640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6880367e0 0x7fa688038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.937+0000 7fa69d7fa640 1 -- 172.21.15.133:0/3963341791 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fa7b409e830 con 0x557079e6d4a0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.937+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.937+0000 7fa7c04d6640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6880367e0 0x7fa688038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.937+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557079e7fed0 0x557079e82370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.937+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e82ac0 con 0x557079e7fed0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7bfcd5640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557079e7fed0 0x557079e82370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7c04d6640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6880367e0 0x7fa688038ca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800b010 tx=0x7fa7b8020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7bfcd5640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557079e7fed0 0x557079e82370 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7b0016070 con 0x557079e7fed0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7c21d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7c21d6800 20 realm 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e82e90 con 0x557079e7fed0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7b0016070 con 0x557079e7fed0 2024-02-15T22:56:27.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7c21d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7c21d6800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e83710 con 0x557079e7fed0 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.938+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7b0016070 con 0x557079e7fed0 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7c21d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e83a70 con 0x557079e7fed0 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa7b0016070 con 0x557079e7fed0 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7c21d6800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e83370 con 0x557079e7fed0 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa7b0016070 con 0x557079e7fed0 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7c21d6800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:27.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7c21d6800 20 searching for the correct realm 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557079e85df0 0x557079e881e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e85df0 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7bf4d4640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557079e85df0 0x557079e881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.939+0000 7fa7bf4d4640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557079e85df0 0x557079e881e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.940+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.940+0000 7fa7bf4d4640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa7b408f410 0x7fa7b4009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.940+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b408f410 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.940+0000 7fa7c04d6640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa7b408f410 0x7fa7b4009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.940+0000 7fa7c04d6640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa7b408f410 0x7fa7b4009410 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.940+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b800a4a0 con 0x7fa7b408f410 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.940+0000 7fa7c04d6640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa7b80141d0 0x7fa7b8015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.940+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b80141d0 2024-02-15T22:56:27.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.941+0000 7fa7bfcd5640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa7b80141d0 0x7fa7b8015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.941+0000 7fa7bfcd5640 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa7b80141d0 0x7fa7b8015940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.941+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0016070 con 0x7fa7b80141d0 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.941+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e7fed0 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.942+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0016070 con 0x557079e7fed0 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.942+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e7fed0 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.942+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0016070 con 0x557079e7fed0 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.942+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b80141d0 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.942+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0016070 con 0x7fa7b80141d0 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.942+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b80141d0 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.942+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0016070 con 0x7fa7b80141d0 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.942+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b408f410 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.943+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b800a4a0 con 0x7fa7b408f410 2024-02-15T22:56:27.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.943+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e85df0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.943+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.943+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e7fed0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.943+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0016070 con 0x557079e7fed0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.943+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b80141d0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.943+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0016070 con 0x7fa7b80141d0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.943+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e7fed0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.944+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0016070 con 0x557079e7fed0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.944+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b408f410 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.944+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.944+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e85df0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.944+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.944+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e85df0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.944+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.944+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b80141d0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.945+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0016070 con 0x7fa7b80141d0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.945+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e85df0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.945+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.945+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e85df0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.945+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.945+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e7fed0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.945+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0016070 con 0x557079e7fed0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.945+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e7fed0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.946+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa7b0016070 con 0x557079e7fed0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.946+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b80141d0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.946+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.946+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e85df0 2024-02-15T22:56:27.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.946+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.946+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b408f410 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.946+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.946+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e7fed0 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.947+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.947+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b80141d0 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.947+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.947+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e85df0 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.947+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.947+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b80141d0 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.947+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.947+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b408f410 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.948+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.948+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e85df0 2024-02-15T22:56:27.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.948+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.948+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b80141d0 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.948+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.948+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x557079e7fed0 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e888b0 con 0x7fa7b408f410 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e84890 con 0x557079e7fed0 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e84510 con 0x557079e7fed0 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.949+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e85160 con 0x557079e7fed0 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 20 zone default found 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 4 Realm: () 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:27.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 20 zonegroup default 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e85160 con 0x7fa7b80141d0 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8a720 con 0x557079e85df0 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.950+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8aa80 con 0x557079e85df0 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.951+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.951+0000 7fa7c21d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:27.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.951+0000 7fa7c21d6800 20 started sync module instance, tier type = 2024-02-15T22:56:27.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.951+0000 7fa7c21d6800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:27.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.951+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8a000 con 0x7fa7b408f410 2024-02-15T22:56:27.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.952+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.952+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93941569985376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e89f80 con 0x7fa7b408f410 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.952+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8b720 con 0x557079e7fed0 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.953+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93941569985376] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.953+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.953+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93941569990112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8b6a0 con 0x557079e7fed0 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.953+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8c050 con 0x557079e85df0 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.954+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93941569990112] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.954+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.954+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93941569991168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8b620 con 0x557079e85df0 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.954+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8cee0 con 0x7fa7b408f410 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.956+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93941569991168] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.956+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.957+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93941569997376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8d300 con 0x7fa7b408f410 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.957+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8dc70 con 0x557079e7fed0 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.957+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93941569997376] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.958+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.958+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93941569998432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8dc70 con 0x557079e7fed0 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.958+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8e670 con 0x7fa7b80141d0 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.959+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93941569998432] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.959+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.959+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93941570003344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8dc70 con 0x7fa7b80141d0 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.959+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8f070 con 0x7fa7b80141d0 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.960+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93941570003344] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.960+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.960+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93941570005904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8f250 con 0x7fa7b80141d0 2024-02-15T22:56:27.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.960+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8fa50 con 0x7fa7b80141d0 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.961+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.961+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93941570008192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8fec0 con 0x7fa7b80141d0 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.961+0000 7fa7c21d6800 20 add_watcher() i=0 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.961+0000 7fa7c21d6800 20 add_watcher() i=1 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.961+0000 7fa7c21d6800 20 add_watcher() i=2 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.961+0000 7fa7c21d6800 20 add_watcher() i=3 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.961+0000 7fa7c21d6800 20 add_watcher() i=4 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.961+0000 7fa7c21d6800 20 add_watcher() i=5 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.961+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93941570005904] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.961+0000 7fa7c21d6800 20 add_watcher() i=6 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.962+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93941570008192] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.962+0000 7fa7c21d6800 20 add_watcher() i=7 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.962+0000 7fa7c21d6800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.962+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8d870 con 0x557079e7fed0 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.962+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.962+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93941570009440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8d870 con 0x557079e7fed0 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.963+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93941570009440] v30'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.963+0000 7fa675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.963+0000 7fa7c21d6800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.963+0000 7fa7c21d6800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.964+0000 7fa7c21d6800 5 note: GC not initialized 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.964+0000 7fa674fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.964+0000 7fa7c21d6800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.964+0000 7fa7c21d6800 20 Filter name: none 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.964+0000 7fa5ee7fc640 20 reqs_thread_entry: start 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.964+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.964+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ec4b10 con 0x557079e7fed0 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.964+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.964+0000 7fa7c21d6800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.964+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ec4b10 con 0x7fa7b408f410 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ec6020 con 0x557079e85df0 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:65 4.26 4:64dd6fe8:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ec5860 con 0x7fa7b80141d0 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 4.1a 4:5969fa1d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ecaa30 con 0x7fa7b408f410 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 4.3c 4:3d7776b5:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ecd380 con 0x557079e7fed0 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:68 4.16 4:69b66c2d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ecfba0 con 0x557079e85df0 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 4.c 4:32ea204e:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed2440 con 0x557079e7fed0 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 4.2a 4:550e1cd1:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed5180 con 0x557079e7fed0 2024-02-15T22:56:27.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 4.4 4:21b7c93c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7ee0 con 0x7fa7b80141d0 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:72 4.3a 4:5eac6251:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079edabb0 con 0x557079e85df0 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:73 4.18 4:1830de7d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079edd870 con 0x7fa7b408f410 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:74 4.14 4:29b37fcc:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ee0570 con 0x557079e85df0 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.965+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 4.1d 4:b9a64d9c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ee3210 con 0x557079e85df0 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(67 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(66 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(68 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(73 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(65 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(69 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(72 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(70 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(74 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(71 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(75 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.966+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x7fa7b408f410 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.967+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(76 foo.buckets [call] v30'15 uv15 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.967+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x7fa7b408f410 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.968+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(77 foo.buckets [call] v30'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.968+0000 7fa7c21d6800 20 rados->read ofs=0 len=0 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.968+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x557079e7fed0 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.968+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(78 foo [stat out=16b,read 0~358 out=358b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+374 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.969+0000 7fa7c21d6800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.969+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x7fa7b408f410 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.969+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.969+0000 7fa675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.970+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93941570009440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x557079e7fed0 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.970+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 93941570009440] v30'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.970+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93941569985376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x7fa7b408f410 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.971+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 93941569985376] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.971+0000 7fa7c21d6800 20 remove_watcher() i=0 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.971+0000 7fa7c21d6800 2 removed watcher, disabling cache 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.971+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93941569990112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x557079e7fed0 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.972+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 93941569990112] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.972+0000 7fa7c21d6800 20 remove_watcher() i=1 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.972+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93941569991168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x557079e85df0 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.973+0000 7fa7bf4d4640 1 -- 172.21.15.133:0/3963341791 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 93941569991168] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b4095020 con 0x557079e85df0 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.973+0000 7fa7c21d6800 20 remove_watcher() i=2 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.974+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93941569997376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x7fa7b408f410 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.974+0000 7fa7c04d6640 1 -- 172.21.15.133:0/3963341791 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 93941569997376] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b803a040 con 0x7fa7b408f410 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.974+0000 7fa7c21d6800 20 remove_watcher() i=3 2024-02-15T22:56:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.974+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93941569998432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x557079e7fed0 2024-02-15T22:56:27.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.976+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 93941569998432] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x557079e7fed0 2024-02-15T22:56:27.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.976+0000 7fa7c21d6800 20 remove_watcher() i=4 2024-02-15T22:56:27.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.976+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93941570003344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x7fa7b80141d0 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.977+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 93941570003344] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.977+0000 7fa7c21d6800 20 remove_watcher() i=5 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.977+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93941570005904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079ed7e60 con 0x7fa7b80141d0 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.977+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 93941570005904] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.977+0000 7fa7c21d6800 20 remove_watcher() i=6 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.977+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93941570008192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557079e8eb90 con 0x7fa7b80141d0 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.978+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 93941570008192] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7b0052040 con 0x7fa7b80141d0 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.978+0000 7fa7c21d6800 20 remove_watcher() i=7 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.978+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa7b80141d0 msgr2=0x7fa7b8015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.978+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa7b80141d0 0x7fa7b8015940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.978+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557079e7fed0 msgr2=0x557079e82370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.978+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557079e7fed0 0x557079e82370 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.978+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa7b408f410 msgr2=0x7fa7b4009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.978+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa7b408f410 0x7fa7b4009410 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.978+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557079e85df0 msgr2=0x557079e881e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.978+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x557079e85df0 0x557079e881e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6880367e0 msgr2=0x7fa688038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6880367e0 0x7fa688038ca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800b010 tx=0x7fa7b8020000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 msgr2=0x557079e74490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3963341791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e6d4a0 0x557079e74490 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa7b405cfd0 tx=0x7fa7b408ddc0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7bfcd5640 1 -- 172.21.15.133:0/3963341791 reap_dead start 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 shutdown_connections 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 >> 172.21.15.133:0/3963341791 conn(0x557079e69770 msgr2=0x557079e66dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 shutdown_connections 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3963341791 wait complete. 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/729072673 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6980367e0 msgr2=0x7fa698038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/729072673 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6980367e0 0x7fa698038ca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x557079e50470 tx=0x7fa7b8005840 comp rx=0 tx=0).stop 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/729072673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e602b0 msgr2=0x557079e606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/729072673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e602b0 0x557079e606d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa7b404bfd0 tx=0x7fa7b4002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/729072673 shutdown_connections 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/729072673 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6980367e0 0x7fa698038ca0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/729072673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079e602b0 0x557079e606d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/729072673 >> 172.21.15.133:0/729072673 conn(0x557079e54350 msgr2=0x557079e54750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/729072673 shutdown_connections 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/729072673 wait complete. 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557079d4f3d0 msgr2=0x557079e4f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557079d4f3d0 0x557079e4f530 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6a80367e0 msgr2=0x7fa6a8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6a80367e0 0x7fa6a8038ca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4054000 tx=0x7fa7b404e000 comp rx=0 tx=0).stop 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 msgr2=0x557079e48830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.979+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e48830 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b210 tx=0x7fa7b0000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.980+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 shutdown_connections 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.980+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557079d4f3d0 0x557079e4f530 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.980+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa6a80367e0 0x7fa6a8038ca0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.980+0000 7fa7c21d6800 1 --2- 172.21.15.133:0/3203016400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557079d4d890 0x557079e48830 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.980+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 >> 172.21.15.133:0/3203016400 conn(0x557079d494f0 msgr2=0x557079e3b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:27.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.980+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 shutdown_connections 2024-02-15T22:56:27.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:27.980+0000 7fa7c21d6800 1 -- 172.21.15.133:0/3203016400 wait complete. 2024-02-15T22:56:27.993 INFO:teuthology.orchestra.run.smithi133.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-02-15T22:56:27.968690Z","last_stats_update":"2024-02-15T22:56:27.967593Z"} 2024-02-15T22:56:27.994 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-02-15T22:56:27.968690Z', 'last_stats_update': '2024-02-15T22:56:27.967593Z'} 2024-02-15T22:56:27.999 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:27.999 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-15T22:56:27.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-15T22:56:27.999 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-02-15T22:56:28.043 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:28.043 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.041+0000 7f60f9016800 1 Processor -- start 2024-02-15T22:56:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.042+0000 7f60f9016800 1 -- start start 2024-02-15T22:56:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.042+0000 7f60f9016800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559d8253eaa0 0x559d82540e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.042+0000 7f60f9016800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559d82488ba0 con 0x559d825413d0 2024-02-15T22:56:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.042+0000 7f60f9016800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x559d82440450 con 0x559d8253eaa0 2024-02-15T22:56:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.042+0000 7f60f469d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559d8253eaa0 0x559d82540e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.042+0000 7f60f469d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559d8253eaa0 0x559d82540e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58422/0 (socket says 172.21.15.133:58422) 2024-02-15T22:56:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.042+0000 7f60f3e9c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x559d825413d0 0x559d825437c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45064/0 (socket says 172.21.15.133:45064) 2024-02-15T22:56:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.042+0000 7f60f469d640 1 -- 172.21.15.133:0/2562611107 learned_addr learned my addr 172.21.15.133:0/2562611107 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.042+0000 7f60f469d640 1 -- 172.21.15.133:0/2562611107 >> v1:172.21.15.52:6789/0 conn(0x559d825413d0 legacy=0x559d825437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.042+0000 7f60f369b640 1 -- 172.21.15.133:0/2562611107 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962276292 0 0) 0x559d82488ba0 con 0x559d825413d0 2024-02-15T22:56:28.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.042+0000 7f60f469d640 1 -- 172.21.15.133:0/2562611107 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d82545ef0 con 0x559d8253eaa0 2024-02-15T22:56:28.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.044+0000 7f60f469d640 1 --2- 172.21.15.133:0/2562611107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d82540e90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f60e400a520 tx=0x7f60e401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc30ab074dd2c7d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.044+0000 7f60f369b640 1 -- 172.21.15.133:0/2562611107 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e4052570 con 0x559d8253eaa0 2024-02-15T22:56:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.044+0000 7f60f369b640 1 -- 172.21.15.133:0/2562611107 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e40526d0 con 0x559d8253eaa0 2024-02-15T22:56:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.044+0000 7f60f369b640 1 -- 172.21.15.133:0/2562611107 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e4052990 con 0x559d8253eaa0 2024-02-15T22:56:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.045+0000 7f60f9016800 1 -- 172.21.15.133:0/2562611107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 msgr2=0x559d82540e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.045+0000 7f60f9016800 1 --2- 172.21.15.133:0/2562611107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d82540e90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f60e400a520 tx=0x7f60e401cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.045+0000 7f60f9016800 1 -- 172.21.15.133:0/2562611107 shutdown_connections 2024-02-15T22:56:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.045+0000 7f60f9016800 1 --2- 172.21.15.133:0/2562611107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d82540e90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.045+0000 7f60f9016800 1 -- 172.21.15.133:0/2562611107 >> 172.21.15.133:0/2562611107 conn(0x559d825384f0 msgr2=0x559d8253a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.045+0000 7f60f9016800 1 -- 172.21.15.133:0/2562611107 shutdown_connections 2024-02-15T22:56:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.045+0000 7f60f9016800 1 -- 172.21.15.133:0/2562611107 wait complete. 2024-02-15T22:56:28.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.056+0000 7f60f9016800 1 Processor -- start 2024-02-15T22:56:28.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.056+0000 7f60f9016800 1 -- start start 2024-02-15T22:56:28.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.057+0000 7f60f9016800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d8262def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.057+0000 7f60f9016800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8243d980 con 0x559d8253eaa0 2024-02-15T22:56:28.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.057+0000 7f60f469d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d8262def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.057+0000 7f60f469d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d8262def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58428/0 (socket says 172.21.15.133:58428) 2024-02-15T22:56:28.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.057+0000 7f60f469d640 1 -- 172.21.15.133:0/1833193464 learned_addr learned my addr 172.21.15.133:0/1833193464 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.057+0000 7f60f469d640 1 -- 172.21.15.133:0/1833193464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4005de0 con 0x559d8253eaa0 2024-02-15T22:56:28.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.057+0000 7f60f469d640 1 --2- 172.21.15.133:0/1833193464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d8262def0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f60e4055040 tx=0x7f60e404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2362a4a434c42b00 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.057+0000 7f5fe260c640 1 -- 172.21.15.133:0/1833193464 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e4052570 con 0x559d8253eaa0 2024-02-15T22:56:28.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.057+0000 7f5fe260c640 1 -- 172.21.15.133:0/1833193464 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e4052840 con 0x559d8253eaa0 2024-02-15T22:56:28.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.057+0000 7f5fe260c640 1 -- 172.21.15.133:0/1833193464 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e4052b20 con 0x559d8253eaa0 2024-02-15T22:56:28.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.058+0000 7f60f9016800 1 -- 172.21.15.133:0/1833193464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 msgr2=0x559d8262def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.058+0000 7f60f9016800 1 --2- 172.21.15.133:0/1833193464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d8262def0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f60e4055040 tx=0x7f60e404c000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.058+0000 7f60f9016800 1 -- 172.21.15.133:0/1833193464 shutdown_connections 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.058+0000 7f60f9016800 1 --2- 172.21.15.133:0/1833193464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d8262def0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.058+0000 7f60f9016800 1 -- 172.21.15.133:0/1833193464 >> 172.21.15.133:0/1833193464 conn(0x559d825384f0 msgr2=0x559d826296e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.058+0000 7f60f9016800 1 -- 172.21.15.133:0/1833193464 shutdown_connections 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.058+0000 7f60f9016800 1 -- 172.21.15.133:0/1833193464 wait complete. 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.058+0000 7f60f9016800 1 Processor -- start 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f60f9016800 1 -- start start 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f60f9016800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d82635330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f60f9016800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d82439160 con 0x559d8253eaa0 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f60f469d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d82635330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f60f469d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d82635330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58430/0 (socket says 172.21.15.133:58430) 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f60f469d640 1 -- 172.21.15.133:0/978169834 learned_addr learned my addr 172.21.15.133:0/978169834 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f60f469d640 1 -- 172.21.15.133:0/978169834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d82545ef0 con 0x559d8253eaa0 2024-02-15T22:56:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f60f469d640 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d82635330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f60e4000c00 tx=0x7f60e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f5fe0e09640 1 -- 172.21.15.133:0/978169834 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e405d480 con 0x559d8253eaa0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f5fe0e09640 1 -- 172.21.15.133:0/978169834 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e406e070 con 0x559d8253eaa0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559d82635870 con 0x559d8253eaa0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f5fe0e09640 1 -- 172.21.15.133:0/978169834 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e405d710 con 0x559d8253eaa0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.059+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d82635db0 con 0x559d8253eaa0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.060+0000 7f5fe0e09640 1 -- 172.21.15.133:0/978169834 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f60e4070030 con 0x559d8253eaa0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.060+0000 7f5fe0e09640 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fdc0367e0 0x7f5fdc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.060+0000 7f5fe0e09640 1 -- 172.21.15.133:0/978169834 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f60e408e390 con 0x559d8253eaa0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.060+0000 7f60f3e9c640 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fdc0367e0 0x7f5fdc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.060+0000 7f60f9016800 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559d825413d0 0x559d8263c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.060+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8263c6a0 con 0x559d825413d0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.061+0000 7f60f4e9e640 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559d825413d0 0x559d8263c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.061+0000 7f60f3e9c640 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fdc0367e0 0x7f5fdc038ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f60e8000c00 tx=0x7f60e80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.061+0000 7f60f4e9e640 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559d825413d0 0x559d8263c160 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.061+0000 7f60f4e9e640 1 -- 172.21.15.133:0/978169834 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f60ec00a4a0 con 0x559d825413d0 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.061+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82639700 con 0x559d825413d0 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.062+0000 7f60f4e9e640 1 -- 172.21.15.133:0/978169834 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f60ec00a4a0 con 0x559d825413d0 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.062+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8263cb60 con 0x559d825413d0 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.062+0000 7f60f4e9e640 1 -- 172.21.15.133:0/978169834 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f60ec00a4a0 con 0x559d825413d0 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.062+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8263d830 con 0x559d825413d0 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.062+0000 7f60f4e9e640 1 -- 172.21.15.133:0/978169834 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f60ec00a4a0 con 0x559d825413d0 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.062+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8263dc40 con 0x559d825413d0 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.062+0000 7f60f4e9e640 1 -- 172.21.15.133:0/978169834 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f60ec00a4a0 con 0x559d825413d0 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.063+0000 7f60f9016800 1 Processor -- start 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.063+0000 7f60f9016800 1 -- start start 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.063+0000 7f60f9016800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253e660 0x559d8253cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.063+0000 7f60f9016800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d823dbe80 con 0x559d8253e660 2024-02-15T22:56:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.063+0000 7f60f3e9c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253e660 0x559d8253cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.063+0000 7f60f3e9c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253e660 0x559d8253cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58434/0 (socket says 172.21.15.133:58434) 2024-02-15T22:56:28.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.063+0000 7f60f3e9c640 1 -- 172.21.15.133:0/149940585 learned_addr learned my addr 172.21.15.133:0/149940585 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.063+0000 7f60f3e9c640 1 -- 172.21.15.133:0/149940585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d8253d010 con 0x559d8253e660 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.064+0000 7f60f3e9c640 1 --2- 172.21.15.133:0/149940585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253e660 0x559d8253cad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f60e800e610 tx=0x7f60e800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.064+0000 7f5fd9ffb640 1 -- 172.21.15.133:0/149940585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e800bea0 con 0x559d8253e660 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.064+0000 7f5fd9ffb640 1 -- 172.21.15.133:0/149940585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e800d500 con 0x559d8253e660 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.064+0000 7f60f9016800 1 -- 172.21.15.133:0/149940585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559d8253d260 con 0x559d8253e660 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.064+0000 7f5fd9ffb640 1 -- 172.21.15.133:0/149940585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e800d7a0 con 0x559d8253e660 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.064+0000 7f60f9016800 1 -- 172.21.15.133:0/149940585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d8253d720 con 0x559d8253e660 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.064+0000 7f5fd9ffb640 1 -- 172.21.15.133:0/149940585 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f60e801a070 con 0x559d8253e660 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f5fd9ffb640 1 --2- 172.21.15.133:0/149940585 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fcc0367e0 0x7f5fcc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f5fd9ffb640 1 -- 172.21.15.133:0/149940585 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f60e8017050 con 0x559d8253e660 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f60f4e9e640 1 --2- 172.21.15.133:0/149940585 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fcc0367e0 0x7f5fcc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f60f9016800 1 Processor -- start 2024-02-15T22:56:28.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f60f9016800 1 -- start start 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f60f4e9e640 1 --2- 172.21.15.133:0/149940585 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fcc0367e0 0x7f5fcc038ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x559d8263d270 tx=0x7f60ec005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f60f9016800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 0x559d8265c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f60f9016800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d823b15d0 con 0x559d8265c2c0 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f60f3e9c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 0x559d8265c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f60f3e9c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 0x559d8265c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58438/0 (socket says 172.21.15.133:58438) 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f60f3e9c640 1 -- 172.21.15.133:0/1085348628 learned_addr learned my addr 172.21.15.133:0/1085348628 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.065+0000 7f60f3e9c640 1 -- 172.21.15.133:0/1085348628 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d8265cc90 con 0x559d8265c2c0 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f60f3e9c640 1 --2- 172.21.15.133:0/1085348628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 0x559d8265c6c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f60e804b9d0 tx=0x7f60e804bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458e06ee489b18bd server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f5fd37fe640 1 -- 172.21.15.133:0/1085348628 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e801a530 con 0x559d8265c2c0 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f5fd37fe640 1 -- 172.21.15.133:0/1085348628 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e804d0d0 con 0x559d8265c2c0 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f5fd37fe640 1 -- 172.21.15.133:0/1085348628 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e801ac40 con 0x559d8265c2c0 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f60f9016800 1 -- 172.21.15.133:0/1085348628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 msgr2=0x559d8265c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f60f9016800 1 --2- 172.21.15.133:0/1085348628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 0x559d8265c6c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f60e804b9d0 tx=0x7f60e804bc50 comp rx=0 tx=0).stop 2024-02-15T22:56:28.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f60f9016800 1 -- 172.21.15.133:0/1085348628 shutdown_connections 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f60f9016800 1 --2- 172.21.15.133:0/1085348628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 0x559d8265c6c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f60f9016800 1 -- 172.21.15.133:0/1085348628 >> 172.21.15.133:0/1085348628 conn(0x559d82658590 msgr2=0x559d826565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f60f9016800 1 -- 172.21.15.133:0/1085348628 shutdown_connections 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f60f9016800 1 -- 172.21.15.133:0/1085348628 wait complete. 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.066+0000 7f60f9016800 1 Processor -- start 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f60f9016800 1 -- start start 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f60f9016800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 0x559d826632c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f60f9016800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d82663800 con 0x559d8265c2c0 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f60f3e9c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 0x559d826632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f60f3e9c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 0x559d826632c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58444/0 (socket says 172.21.15.133:58444) 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 learned_addr learned my addr 172.21.15.133:0/2524158201 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d8253d720 con 0x559d8265c2c0 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f60f3e9c640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 0x559d826632c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f60e8048040 tx=0x7f60e804b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f5fd1ffb640 1 -- 172.21.15.133:0/2524158201 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e80242c0 con 0x559d8265c2c0 2024-02-15T22:56:28.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f5fd1ffb640 1 -- 172.21.15.133:0/2524158201 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e8024680 con 0x559d8265c2c0 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559d82663a00 con 0x559d8265c2c0 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f5fd1ffb640 1 -- 172.21.15.133:0/2524158201 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e801a7e0 con 0x559d8265c2c0 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.067+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d82663ec0 con 0x559d8265c2c0 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.068+0000 7f5fd1ffb640 1 -- 172.21.15.133:0/2524158201 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f60e800d040 con 0x559d8265c2c0 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.068+0000 7f5fd1ffb640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fc4036790 0x7f5fc4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.068+0000 7f5fd1ffb640 1 -- 172.21.15.133:0/2524158201 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f60e800a040 con 0x559d8265c2c0 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.068+0000 7f60f4e9e640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fc4036790 0x7f5fc4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.069+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.069+0000 7f60f9016800 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559d8266f0d0 0x559d82671590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.069+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82671ce0 con 0x559d8266f0d0 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.069+0000 7f60f4e9e640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fc4036790 0x7f5fc4038c50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00b010 tx=0x7f60ec020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.069+0000 7f60f469d640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559d8266f0d0 0x559d82671590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.069+0000 7f60f469d640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559d8266f0d0 0x559d82671590 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.069+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f60e4069870 con 0x559d8266f0d0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.069+0000 7f60f9016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.069+0000 7f60f9016800 20 realm 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.069+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.069+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826720b0 con 0x559d8266f0d0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f60e4069870 con 0x559d8266f0d0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82672930 con 0x559d8266f0d0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f60e4069870 con 0x559d8266f0d0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82672c90 con 0x559d8266f0d0 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82673490 con 0x559d8266f0d0 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 20 searching for the correct realm 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559d826753b0 0x559d82677850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.070+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d826753b0 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.071+0000 7f60f3e9c640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559d826753b0 0x559d82677850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.071+0000 7f60f3e9c640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559d826753b0 0x559d82677850 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.071+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.071+0000 7f60f3e9c640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f60e8027060 0x7f60e801b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.071+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60e8027060 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.071+0000 7f60f4e9e640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f60e8027060 0x7f60e801b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.072+0000 7f60f4e9e640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f60e8027060 0x7f60e801b6f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.072+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60ec00a4a0 con 0x7f60e8027060 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.072+0000 7f60f4e9e640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f60ec0141d0 0x7f60ec015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.072+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60ec0141d0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.072+0000 7f60f469d640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f60ec0141d0 0x7f60ec015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.073+0000 7f60f469d640 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f60ec0141d0 0x7f60ec015940 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.073+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.073+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d8266f0d0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.073+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.073+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d8266f0d0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.073+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.073+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60ec0141d0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.074+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.074+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60ec0141d0 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.074+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.074+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60e8027060 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.074+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60ec00a4a0 con 0x7f60e8027060 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.074+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d826753b0 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.074+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.074+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d8266f0d0 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.075+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.075+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60ec0141d0 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.075+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.075+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d8266f0d0 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.075+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.075+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60e8027060 2024-02-15T22:56:28.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.075+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.075+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d826753b0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.076+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.076+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d826753b0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.076+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.076+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60ec0141d0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.076+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.076+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d826753b0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.077+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.077+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d826753b0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.077+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.077+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d8266f0d0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.077+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.077+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d8266f0d0 2024-02-15T22:56:28.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.077+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.077+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60ec0141d0 2024-02-15T22:56:28.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.078+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.078+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d826753b0 2024-02-15T22:56:28.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.078+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.078+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60e8027060 2024-02-15T22:56:28.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.078+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.078+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d8266f0d0 2024-02-15T22:56:28.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.078+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.078+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60ec0141d0 2024-02-15T22:56:28.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.079+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.079+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d826753b0 2024-02-15T22:56:28.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.079+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.079+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60ec0141d0 2024-02-15T22:56:28.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.079+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.079+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60e8027060 2024-02-15T22:56:28.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.079+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.079+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d826753b0 2024-02-15T22:56:28.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60ec0141d0 2024-02-15T22:56:28.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x559d8266f0d0 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82677f20 con 0x7f60e8027060 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f9016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f9016800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f9016800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f9016800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f9016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f9016800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.080+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82674990 con 0x559d8266f0d0 2024-02-15T22:56:28.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826741e0 con 0x559d8266f0d0 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82673970 con 0x559d8266f0d0 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 20 zone default found 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 4 Realm: () 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 20 zonegroup default 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82678360 con 0x7f60ec0141d0 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.081+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f9016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267a1e0 con 0x559d826753b0 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f9016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267a540 con 0x559d826753b0 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f9016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f9016800 20 started sync module instance, tier type = 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f9016800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.082+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826797b0 con 0x7f60e8027060 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.083+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.083+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94134986052368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267a8a0 con 0x7f60e8027060 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.083+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267b250 con 0x559d8266f0d0 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.084+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94134986052368] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.084+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.084+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94134986054496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267b210 con 0x559d8266f0d0 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.084+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267bcd0 con 0x559d826753b0 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.085+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94134986054496] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.085+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.085+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94134986059120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267b190 con 0x559d826753b0 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.085+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267cb30 con 0x7f60e8027060 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.086+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94134986059120] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.086+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.086+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94134986065552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267cf50 con 0x7f60e8027060 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.086+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267d8c0 con 0x559d8266f0d0 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.088+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.088+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94134986069024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267d880 con 0x559d8266f0d0 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.088+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94134986065552] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.088+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267e840 con 0x7f60ec0141d0 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.089+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.089+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94134986072928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267e840 con 0x7f60ec0141d0 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.089+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267f240 con 0x7f60ec0141d0 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.089+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94134986069024] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.089+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94134986072928] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.090+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.090+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94134986066608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267ed60 con 0x7f60ec0141d0 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.090+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267f6d0 con 0x7f60ec0141d0 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94134986066608] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94134986071152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267f6d0 con 0x7f60ec0141d0 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f9016800 20 add_watcher() i=0 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f9016800 20 add_watcher() i=1 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f9016800 20 add_watcher() i=2 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f9016800 20 add_watcher() i=3 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f9016800 20 add_watcher() i=4 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f9016800 20 add_watcher() i=5 2024-02-15T22:56:28.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f9016800 20 add_watcher() i=6 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94134986071152] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f9016800 20 add_watcher() i=7 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f9016800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.091+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267f6d0 con 0x559d8266f0d0 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.092+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.092+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94134986078896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82680370 con 0x559d8266f0d0 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.093+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94134986078896] v30'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.093+0000 7f5faa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.093+0000 7f60f9016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.093+0000 7f60f9016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.093+0000 7f60f9016800 5 note: GC not initialized 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.093+0000 7f5fa97e2640 20 reqs_thread_entry: start 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.093+0000 7f60f9016800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.093+0000 7f60f9016800 20 Filter name: none 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f5f1affd640 20 reqs_thread_entry: start 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826b4c20 con 0x559d8266f0d0 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826b67c0 con 0x7f60e8027060 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 : miss 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.094+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.095+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826b8190 con 0x559d826753b0 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.095+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.095+0000 7f60f9016800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.095+0000 7f60f9016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.095+0000 7f60f9016800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.095+0000 7f60f9016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.095+0000 7f60f9016800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.095+0000 7f60f9016800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.095+0000 7f60f9016800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-15T22:56:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.095+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826bba10 con 0x7f60e8027060 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.096+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(65 foo.buckets [call] v30'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.096+0000 7f60f9016800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.096+0000 7f60f9016800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.096+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826babc0 con 0x7f60e8027060 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.097+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.097+0000 7f60f9016800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.097+0000 7f60f9016800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.097+0000 7f60f9016800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.097+0000 7f60f9016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.097+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826bb9a0 con 0x7f60e8027060 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.098+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.098+0000 7f60f9016800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.098+0000 7f60f9016800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.098+0000 7f60f9016800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T22:56:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.098+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94134986323072 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826bb9e0 con 0x7f60ec0141d0 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.098+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== watch-notify(notify (1) cookie 94134986066608 notify 128849018890 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x559d82635db0 con 0x7f60ec0141d0 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.098+0000 7f5fd37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94134986066608 notifier 4474 bl.length()=338 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.098+0000 7f5fd37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.098+0000 7f5fd37fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.098+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(68 notify.6 [notify cookie 94134986323072 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.098+0000 7f5fd37fe640 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5fb8003e90 con 0x7f60ec0141d0 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.099+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.099+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== watch-notify(notify_complete (2) cookie 94134986323072 notify 128849018890 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559d82635870 con 0x7f60ec0141d0 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.099+0000 7f5faa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.099+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94134986078896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826bb480 con 0x559d8266f0d0 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.100+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94134986078896] v30'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.100+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94134986052368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d826bb920 con 0x7f60e8027060 2024-02-15T22:56:28.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.101+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94134986052368] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.101+0000 7f60f9016800 20 remove_watcher() i=0 2024-02-15T22:56:28.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.101+0000 7f60f9016800 2 removed watcher, disabling cache 2024-02-15T22:56:28.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.101+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94134986054496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82679310 con 0x559d8266f0d0 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.103+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94134986054496] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.103+0000 7f60f9016800 20 remove_watcher() i=1 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.103+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94134986059120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d82679310 con 0x559d826753b0 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.104+0000 7f60f3e9c640 1 -- 172.21.15.133:0/2524158201 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94134986059120] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e8053040 con 0x559d826753b0 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.104+0000 7f60f9016800 20 remove_watcher() i=2 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.104+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94134986065552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267ad70 con 0x7f60e8027060 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.105+0000 7f60f4e9e640 1 -- 172.21.15.133:0/2524158201 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94134986065552] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60ec03a040 con 0x7f60e8027060 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.105+0000 7f60f9016800 20 remove_watcher() i=3 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.105+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94134986069024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267c690 con 0x559d8266f0d0 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.106+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94134986069024] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x559d8266f0d0 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.106+0000 7f60f9016800 20 remove_watcher() i=4 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.106+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94134986072928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267ad70 con 0x7f60ec0141d0 2024-02-15T22:56:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.107+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94134986072928] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.107+0000 7f60f9016800 20 remove_watcher() i=5 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.107+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94134986066608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267d420 con 0x7f60ec0141d0 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.108+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94134986066608] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.108+0000 7f60f9016800 20 remove_watcher() i=6 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.108+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94134986071152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559d8267ad70 con 0x7f60ec0141d0 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94134986071152] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e4084040 con 0x7f60ec0141d0 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 20 remove_watcher() i=7 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f60ec0141d0 msgr2=0x7f60ec015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f60ec0141d0 0x7f60ec015940 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559d8266f0d0 msgr2=0x559d82671590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559d8266f0d0 0x559d82671590 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f60e8027060 msgr2=0x7f60e801b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f60e8027060 0x7f60e801b6f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559d826753b0 msgr2=0x559d82677850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559d826753b0 0x559d82677850 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fc4036790 msgr2=0x7f5fc4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fc4036790 0x7f5fc4038c50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00b010 tx=0x7f60ec020000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 msgr2=0x559d826632c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 --2- 172.21.15.133:0/2524158201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8265c2c0 0x559d826632c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f60e8048040 tx=0x7f60e804b930 comp rx=0 tx=0).stop 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 reap_dead start 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f469d640 1 -- 172.21.15.133:0/2524158201 reap_dead start 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 shutdown_connections 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.109+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 >> 172.21.15.133:0/2524158201 conn(0x559d82658590 msgr2=0x559d82655bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 shutdown_connections 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/2524158201 wait complete. 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/149940585 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fcc0367e0 msgr2=0x7f5fcc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 --2- 172.21.15.133:0/149940585 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fcc0367e0 0x7f5fcc038ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x559d8263d270 tx=0x7f60ec005840 comp rx=0 tx=0).stop 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/149940585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253e660 msgr2=0x559d8253cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 --2- 172.21.15.133:0/149940585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253e660 0x559d8253cad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f60e800e610 tx=0x7f60e800ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/149940585 shutdown_connections 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 --2- 172.21.15.133:0/149940585 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fcc0367e0 0x7f5fcc038ca0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 --2- 172.21.15.133:0/149940585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253e660 0x559d8253cad0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/149940585 >> 172.21.15.133:0/149940585 conn(0x559d82640ea0 msgr2=0x559d826412a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/149940585 shutdown_connections 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/149940585 wait complete. 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559d825413d0 msgr2=0x559d8263c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559d825413d0 0x559d8263c160 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fdc0367e0 msgr2=0x7f5fdc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fdc0367e0 0x7f5fdc038ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f60e8000c00 tx=0x7f60e80013b0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 msgr2=0x559d82635330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d82635330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f60e4000c00 tx=0x7f60e4002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 shutdown_connections 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559d825413d0 0x559d8263c160 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5fdc0367e0 0x7f5fdc038ca0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 --2- 172.21.15.133:0/978169834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8253eaa0 0x559d82635330 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 >> 172.21.15.133:0/978169834 conn(0x559d825384f0 msgr2=0x559d8262f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 shutdown_connections 2024-02-15T22:56:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.110+0000 7f60f9016800 1 -- 172.21.15.133:0/978169834 wait complete. 2024-02-15T22:56:28.125 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-15T22:56:28.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-15T22:56:28.125 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-15T22:56:28.176 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:28.176 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:28.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.174+0000 7fd926f4b800 1 Processor -- start 2024-02-15T22:56:28.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.174+0000 7fd926f4b800 1 -- start start 2024-02-15T22:56:28.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.174+0000 7fd926f4b800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c3f4840600 0x55c3f48429f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.174+0000 7fd926f4b800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c3f4786bd0 con 0x55c3f483caf0 2024-02-15T22:56:28.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.174+0000 7fd926f4b800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c3f473e450 con 0x55c3f4840600 2024-02-15T22:56:28.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.175+0000 7fd91c250640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c3f4840600 0x55c3f48429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.175+0000 7fd924a51640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55c3f483caf0 0x55c3f483eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45080/0 (socket says 172.21.15.133:45080) 2024-02-15T22:56:28.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.175+0000 7fd924a51640 1 -- 172.21.15.133:0/661594318 learned_addr learned my addr 172.21.15.133:0/661594318 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:28.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.175+0000 7fd91c250640 1 -- 172.21.15.133:0/661594318 >> v1:172.21.15.52:6789/0 conn(0x55c3f483caf0 legacy=0x55c3f483eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.175+0000 7fd91ffff640 1 -- 172.21.15.133:0/661594318 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041115488 0 0) 0x55c3f4786bd0 con 0x55c3f483caf0 2024-02-15T22:56:28.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.175+0000 7fd91c250640 1 -- 172.21.15.133:0/661594318 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3f4843f40 con 0x55c3f4840600 2024-02-15T22:56:28.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.177+0000 7fd91c250640 1 --2- 172.21.15.133:0/661594318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f4840600 0x55c3f48429f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00a470 tx=0x7fd90c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb2de15e95ac89b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.177+0000 7fd91ffff640 1 -- 172.21.15.133:0/661594318 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd90c052570 con 0x55c3f4840600 2024-02-15T22:56:28.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.177+0000 7fd91ffff640 1 -- 172.21.15.133:0/661594318 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c0526d0 con 0x55c3f4840600 2024-02-15T22:56:28.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.177+0000 7fd91ffff640 1 -- 172.21.15.133:0/661594318 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd90c052990 con 0x55c3f4840600 2024-02-15T22:56:28.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.177+0000 7fd926f4b800 1 -- 172.21.15.133:0/661594318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f4840600 msgr2=0x55c3f48429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.177+0000 7fd926f4b800 1 --2- 172.21.15.133:0/661594318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f4840600 0x55c3f48429f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00a470 tx=0x7fd90c01cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:28.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.177+0000 7fd926f4b800 1 -- 172.21.15.133:0/661594318 shutdown_connections 2024-02-15T22:56:28.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.177+0000 7fd926f4b800 1 --2- 172.21.15.133:0/661594318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f4840600 0x55c3f48429f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.177+0000 7fd926f4b800 1 -- 172.21.15.133:0/661594318 >> 172.21.15.133:0/661594318 conn(0x55c3f4836520 msgr2=0x55c3f4838940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.177+0000 7fd926f4b800 1 -- 172.21.15.133:0/661594318 shutdown_connections 2024-02-15T22:56:28.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.177+0000 7fd926f4b800 1 -- 172.21.15.133:0/661594318 wait complete. 2024-02-15T22:56:28.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.189+0000 7fd926f4b800 1 Processor -- start 2024-02-15T22:56:28.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.189+0000 7fd926f4b800 1 -- start start 2024-02-15T22:56:28.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.189+0000 7fd926f4b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f492bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.189+0000 7fd926f4b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f473b980 con 0x55c3f483caf0 2024-02-15T22:56:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.189+0000 7fd924a51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f492bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.189+0000 7fd924a51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f492bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58472/0 (socket says 172.21.15.133:58472) 2024-02-15T22:56:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.189+0000 7fd924a51640 1 -- 172.21.15.133:0/260640235 learned_addr learned my addr 172.21.15.133:0/260640235 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.190+0000 7fd924a51640 1 -- 172.21.15.133:0/260640235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c005d20 con 0x55c3f483caf0 2024-02-15T22:56:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.190+0000 7fd924a51640 1 --2- 172.21.15.133:0/260640235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f492bf80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd91400b210 tx=0x7fd91400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0cf85f5edd336 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.190+0000 7fd812e0d640 1 -- 172.21.15.133:0/260640235 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd914014070 con 0x55c3f483caf0 2024-02-15T22:56:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.190+0000 7fd812e0d640 1 -- 172.21.15.133:0/260640235 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91400d500 con 0x55c3f483caf0 2024-02-15T22:56:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.190+0000 7fd812e0d640 1 -- 172.21.15.133:0/260640235 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd91400d800 con 0x55c3f483caf0 2024-02-15T22:56:28.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd926f4b800 1 -- 172.21.15.133:0/260640235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 msgr2=0x55c3f492bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd926f4b800 1 --2- 172.21.15.133:0/260640235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f492bf80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd91400b210 tx=0x7fd91400b6d0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd926f4b800 1 -- 172.21.15.133:0/260640235 shutdown_connections 2024-02-15T22:56:28.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd926f4b800 1 --2- 172.21.15.133:0/260640235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f492bf80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd926f4b800 1 -- 172.21.15.133:0/260640235 >> 172.21.15.133:0/260640235 conn(0x55c3f4836520 msgr2=0x55c3f49278a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd926f4b800 1 -- 172.21.15.133:0/260640235 shutdown_connections 2024-02-15T22:56:28.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd926f4b800 1 -- 172.21.15.133:0/260640235 wait complete. 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd926f4b800 1 Processor -- start 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd926f4b800 1 -- start start 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd926f4b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f4933630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd926f4b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f4737160 con 0x55c3f483caf0 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd924a51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f4933630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd924a51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f4933630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58476/0 (socket says 172.21.15.133:58476) 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.191+0000 7fd924a51640 1 -- 172.21.15.133:0/3011259413 learned_addr learned my addr 172.21.15.133:0/3011259413 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.192+0000 7fd924a51640 1 -- 172.21.15.133:0/3011259413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd914001b70 con 0x55c3f483caf0 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.192+0000 7fd924a51640 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f4933630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd91400b210 tx=0x7fd914000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.192+0000 7fd81160a640 1 -- 172.21.15.133:0/3011259413 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd91400f950 con 0x55c3f483caf0 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.192+0000 7fd81160a640 1 -- 172.21.15.133:0/3011259413 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd914020070 con 0x55c3f483caf0 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.192+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c3f4933b70 con 0x55c3f483caf0 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.192+0000 7fd81160a640 1 -- 172.21.15.133:0/3011259413 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd91400fc20 con 0x55c3f483caf0 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.192+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3f4934050 con 0x55c3f483caf0 2024-02-15T22:56:28.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.193+0000 7fd81160a640 1 -- 172.21.15.133:0/3011259413 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd91400d040 con 0x55c3f483caf0 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.193+0000 7fd81160a640 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd80c0367e0 0x7fd80c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.193+0000 7fd81160a640 1 -- 172.21.15.133:0/3011259413 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fd91400a040 con 0x55c3f483caf0 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.193+0000 7fd91c250640 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd80c0367e0 0x7fd80c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.193+0000 7fd926f4b800 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c3f4840600 0x55c3f493a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.193+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f493a900 con 0x55c3f4840600 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.193+0000 7fd925252640 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c3f4840600 0x55c3f493a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.194+0000 7fd91c250640 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd80c0367e0 0x7fd80c038ca0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd90c054000 tx=0x7fd90c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.194+0000 7fd925252640 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c3f4840600 0x55c3f493a330 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.194+0000 7fd925252640 1 -- 172.21.15.133:0/3011259413 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd92000a4a0 con 0x55c3f4840600 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.194+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4937a20 con 0x55c3f4840600 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.194+0000 7fd925252640 1 -- 172.21.15.133:0/3011259413 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd92000a4a0 con 0x55c3f4840600 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.194+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f493c630 con 0x55c3f4840600 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.195+0000 7fd925252640 1 -- 172.21.15.133:0/3011259413 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd92000a4a0 con 0x55c3f4840600 2024-02-15T22:56:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.195+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f493b830 con 0x55c3f4840600 2024-02-15T22:56:28.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.195+0000 7fd925252640 1 -- 172.21.15.133:0/3011259413 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd92000a4a0 con 0x55c3f4840600 2024-02-15T22:56:28.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.195+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f493bc40 con 0x55c3f4840600 2024-02-15T22:56:28.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.195+0000 7fd925252640 1 -- 172.21.15.133:0/3011259413 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd92000a4a0 con 0x55c3f4840600 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.195+0000 7fd926f4b800 1 Processor -- start 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.195+0000 7fd926f4b800 1 -- start start 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.195+0000 7fd926f4b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483c6b0 0x55c3f483ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.196+0000 7fd926f4b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f46d9e80 con 0x55c3f483c6b0 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.196+0000 7fd91c250640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483c6b0 0x55c3f483ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.196+0000 7fd91c250640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483c6b0 0x55c3f483ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58490/0 (socket says 172.21.15.133:58490) 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.196+0000 7fd91c250640 1 -- 172.21.15.133:0/3518892043 learned_addr learned my addr 172.21.15.133:0/3518892043 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.196+0000 7fd91c250640 1 -- 172.21.15.133:0/3518892043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3f483b060 con 0x55c3f483c6b0 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.196+0000 7fd91c250640 1 --2- 172.21.15.133:0/3518892043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483c6b0 0x55c3f483ab20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0447c0 tx=0x7fd90c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.196+0000 7fd80a7fc640 1 -- 172.21.15.133:0/3518892043 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd90c05d9b0 con 0x55c3f483c6b0 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.196+0000 7fd80a7fc640 1 -- 172.21.15.133:0/3518892043 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c05db10 con 0x55c3f483c6b0 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.197+0000 7fd926f4b800 1 -- 172.21.15.133:0/3518892043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c3f483b250 con 0x55c3f483c6b0 2024-02-15T22:56:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.197+0000 7fd80a7fc640 1 -- 172.21.15.133:0/3518892043 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd90c05ddd0 con 0x55c3f483c6b0 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.197+0000 7fd926f4b800 1 -- 172.21.15.133:0/3518892043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3f483b650 con 0x55c3f483c6b0 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.197+0000 7fd80a7fc640 1 -- 172.21.15.133:0/3518892043 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd90c066040 con 0x55c3f483c6b0 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.197+0000 7fd80a7fc640 1 --2- 172.21.15.133:0/3518892043 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7fc0367e0 0x7fd7fc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.197+0000 7fd80a7fc640 1 -- 172.21.15.133:0/3518892043 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fd90c063040 con 0x55c3f483c6b0 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.197+0000 7fd925252640 1 --2- 172.21.15.133:0/3518892043 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7fc0367e0 0x7fd7fc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.198+0000 7fd926f4b800 1 Processor -- start 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.198+0000 7fd926f4b800 1 -- start start 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.198+0000 7fd925252640 1 --2- 172.21.15.133:0/3518892043 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7fc0367e0 0x7fd7fc038ca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55c3f493b270 tx=0x7fd920005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.198+0000 7fd926f4b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f494b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.198+0000 7fd926f4b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f46af5d0 con 0x55c3f494ae20 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.198+0000 7fd91c250640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f494b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.198+0000 7fd91c250640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f494b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58502/0 (socket says 172.21.15.133:58502) 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.198+0000 7fd91c250640 1 -- 172.21.15.133:0/1307592429 learned_addr learned my addr 172.21.15.133:0/1307592429 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.198+0000 7fd91c250640 1 -- 172.21.15.133:0/1307592429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3f494b810 con 0x55c3f494ae20 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.198+0000 7fd91c250640 1 --2- 172.21.15.133:0/1307592429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f494b240 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd90c068ea0 tx=0x7fd90c0685a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3129f440ae1e51df server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd7fbfff640 1 -- 172.21.15.133:0/1307592429 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd90c067aa0 con 0x55c3f494ae20 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd7fbfff640 1 -- 172.21.15.133:0/1307592429 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c067c00 con 0x55c3f494ae20 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd7fbfff640 1 -- 172.21.15.133:0/1307592429 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd90c05c4d0 con 0x55c3f494ae20 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd926f4b800 1 -- 172.21.15.133:0/1307592429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 msgr2=0x55c3f494b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd926f4b800 1 --2- 172.21.15.133:0/1307592429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f494b240 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd90c068ea0 tx=0x7fd90c0685a0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd926f4b800 1 -- 172.21.15.133:0/1307592429 shutdown_connections 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd926f4b800 1 --2- 172.21.15.133:0/1307592429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f494b240 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd926f4b800 1 -- 172.21.15.133:0/1307592429 >> 172.21.15.133:0/1307592429 conn(0x55c3f4956770 msgr2=0x55c3f49547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd926f4b800 1 -- 172.21.15.133:0/1307592429 shutdown_connections 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd926f4b800 1 -- 172.21.15.133:0/1307592429 wait complete. 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd926f4b800 1 Processor -- start 2024-02-15T22:56:28.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.199+0000 7fd926f4b800 1 -- start start 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.200+0000 7fd926f4b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f4965800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.200+0000 7fd926f4b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f4965d40 con 0x55c3f494ae20 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.200+0000 7fd91c250640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f4965800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.200+0000 7fd91c250640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f4965800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58512/0 (socket says 172.21.15.133:58512) 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.200+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 learned_addr learned my addr 172.21.15.133:0/2368933170 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.200+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3f483b650 con 0x55c3f494ae20 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.200+0000 7fd91c250640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f4965800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd90c08a010 tx=0x7fd90c08de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.200+0000 7fd7fa7fc640 1 -- 172.21.15.133:0/2368933170 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd90c088070 con 0x55c3f494ae20 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.200+0000 7fd7fa7fc640 1 -- 172.21.15.133:0/2368933170 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c05c6a0 con 0x55c3f494ae20 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.201+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c3f4965f40 con 0x55c3f494ae20 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.201+0000 7fd7fa7fc640 1 -- 172.21.15.133:0/2368933170 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd90c08f730 con 0x55c3f494ae20 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.201+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3f49663a0 con 0x55c3f494ae20 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.201+0000 7fd7fa7fc640 1 -- 172.21.15.133:0/2368933170 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd90c08f040 con 0x55c3f494ae20 2024-02-15T22:56:28.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.201+0000 7fd7fa7fc640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7f00367e0 0x7fd7f0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.201+0000 7fd7fa7fc640 1 -- 172.21.15.133:0/2368933170 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fd90c09aaa0 con 0x55c3f494ae20 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.202+0000 7fd925252640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7f00367e0 0x7fd7f0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.202+0000 7fd925252640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7f00367e0 0x7fd7f0038ca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd92000b010 tx=0x7fd920020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.202+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.202+0000 7fd926f4b800 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c3f49713d0 0x55c3f4973890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.202+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4973fe0 con 0x55c3f49713d0 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.202+0000 7fd924a51640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c3f49713d0 0x55c3f4973890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.202+0000 7fd924a51640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c3f49713d0 0x55c3f4973890 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.202+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd914016070 con 0x55c3f49713d0 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.202+0000 7fd926f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.202+0000 7fd926f4b800 20 realm 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.202+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49743b0 con 0x55c3f49713d0 2024-02-15T22:56:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd914016070 con 0x55c3f49713d0 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4974c30 con 0x55c3f49713d0 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd914016070 con 0x55c3f49713d0 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4974f90 con 0x55c3f49713d0 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd914016070 con 0x55c3f49713d0 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4975790 con 0x55c3f49713d0 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd914016070 con 0x55c3f49713d0 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 20 searching for the correct realm 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c3f49776b0 0x55c3f4979b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.203+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49776b0 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.204+0000 7fd91c250640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c3f49776b0 0x55c3f4979b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.204+0000 7fd91c250640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c3f49776b0 0x55c3f4979b50 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.204+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.204+0000 7fd91c250640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd90c083040 0x7fd90c08f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.204+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd90c083040 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.204+0000 7fd925252640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd90c083040 0x7fd90c08f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.205+0000 7fd925252640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd90c083040 0x7fd90c08f9e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.205+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92000a4a0 con 0x7fd90c083040 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.205+0000 7fd925252640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd9200141d0 0x7fd920015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.205+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd9200141d0 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.205+0000 7fd924a51640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd9200141d0 0x7fd920015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.205+0000 7fd924a51640 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd9200141d0 0x7fd920015940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.206+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914016070 con 0x7fd9200141d0 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.206+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49713d0 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.206+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914016070 con 0x55c3f49713d0 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.206+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49713d0 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.206+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914016070 con 0x55c3f49713d0 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.206+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd9200141d0 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.206+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914016070 con 0x7fd9200141d0 2024-02-15T22:56:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.206+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd9200141d0 2024-02-15T22:56:28.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.206+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914016070 con 0x7fd9200141d0 2024-02-15T22:56:28.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.206+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd90c083040 2024-02-15T22:56:28.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.207+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92000a4a0 con 0x7fd90c083040 2024-02-15T22:56:28.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.207+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49776b0 2024-02-15T22:56:28.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.207+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.207+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49713d0 2024-02-15T22:56:28.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.207+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914016070 con 0x55c3f49713d0 2024-02-15T22:56:28.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.207+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd9200141d0 2024-02-15T22:56:28.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.208+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914016070 con 0x7fd9200141d0 2024-02-15T22:56:28.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.208+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49713d0 2024-02-15T22:56:28.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.208+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914016070 con 0x55c3f49713d0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.208+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd90c083040 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.208+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd92003a040 con 0x7fd90c083040 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.208+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49776b0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.208+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.208+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49776b0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.209+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.209+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd9200141d0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.209+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914016070 con 0x7fd9200141d0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.209+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49776b0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.209+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.209+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49776b0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.209+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.209+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49713d0 2024-02-15T22:56:28.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.210+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914016070 con 0x55c3f49713d0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.210+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49713d0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.210+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd914016070 con 0x55c3f49713d0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.210+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd9200141d0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.210+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.210+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49776b0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.210+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.210+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd90c083040 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.211+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92003a040 con 0x7fd90c083040 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.211+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49713d0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.211+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.211+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd9200141d0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.211+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.211+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49776b0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.211+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.211+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd9200141d0 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.212+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.212+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd90c083040 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.212+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92003a040 con 0x7fd90c083040 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.212+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49776b0 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.212+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.212+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd9200141d0 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.212+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.212+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x55c3f49713d0 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497a220 con 0x7fd90c083040 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92003a040 con 0x7fd90c083040 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:28.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:28.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:28.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:28.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:28.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4976c90 con 0x55c3f49713d0 2024-02-15T22:56:28.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49764e0 con 0x55c3f49713d0 2024-02-15T22:56:28.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.213+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4975c70 con 0x55c3f49713d0 2024-02-15T22:56:28.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 20 zone default found 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 4 Realm: () 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 20 zonegroup default 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49764e0 con 0x7fd9200141d0 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.214+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497c040 con 0x55c3f49776b0 2024-02-15T22:56:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.215+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.215+0000 7fd926f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.215+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.215+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497c3a0 con 0x55c3f49776b0 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.215+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.215+0000 7fd926f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.215+0000 7fd926f4b800 20 started sync module instance, tier type = 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.215+0000 7fd926f4b800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.215+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497b920 con 0x7fd90c083040 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.216+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003a040 con 0x7fd90c083040 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.216+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94300110566528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497b8a0 con 0x7fd90c083040 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.216+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497d090 con 0x55c3f49713d0 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.217+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94300110566528] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003a040 con 0x7fd90c083040 2024-02-15T22:56:28.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.217+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.217+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94300110571344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497d010 con 0x55c3f49713d0 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.217+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497d980 con 0x55c3f49776b0 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.218+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94300110571344] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.218+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.218+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94300110572400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497cf90 con 0x55c3f49776b0 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.218+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497e680 con 0x7fd90c083040 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.219+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94300110572400] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.219+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003a040 con 0x7fd90c083040 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.219+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94300110576864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497ea60 con 0x7fd90c083040 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.219+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497f440 con 0x55c3f49713d0 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.220+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.220+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94300110581600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497f440 con 0x55c3f49713d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.221+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4980400 con 0x7fd9200141d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.221+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94300110576864] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003a040 con 0x7fd90c083040 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.221+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.221+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94300110585568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49803c0 con 0x7fd9200141d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.221+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4980e00 con 0x7fd9200141d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.221+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94300110581600] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.222+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94300110585568] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.223+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.223+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94300110577920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497f820 con 0x7fd9200141d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.223+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49812a0 con 0x7fd9200141d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.223+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94300110577920] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94300110588192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49812a0 con 0x7fd9200141d0 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd926f4b800 20 add_watcher() i=0 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd926f4b800 20 add_watcher() i=1 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd926f4b800 20 add_watcher() i=2 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd926f4b800 20 add_watcher() i=3 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd926f4b800 20 add_watcher() i=4 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd926f4b800 20 add_watcher() i=5 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd926f4b800 20 add_watcher() i=6 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94300110588192] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd926f4b800 20 add_watcher() i=7 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.224+0000 7fd926f4b800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.225+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49812a0 con 0x55c3f49713d0 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.225+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.225+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94300110591584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4981f20 con 0x55c3f49713d0 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.226+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94300110591584] v30'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.226+0000 7fd7dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.226+0000 7fd926f4b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.226+0000 7fd926f4b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.226+0000 7fd926f4b800 5 note: GC not initialized 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.226+0000 7fd7d9fe3640 20 reqs_thread_entry: start 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.226+0000 7fd926f4b800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.226+0000 7fd926f4b800 20 Filter name: none 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd74b7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49b6860 con 0x7fd9200141d0 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49b4fa0 con 0x7fd9200141d0 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:56:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.227+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49b5820 con 0x7fd9200141d0 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.228+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~347] v30'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.228+0000 7fd926f4b800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.228+0000 7fd926f4b800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.228+0000 7fd926f4b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.228+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94300110803840 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49b57e0 con 0x7fd9200141d0 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.229+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== watch-notify(notify (1) cookie 94300110585568 notify 128849018891 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x55c3f4934050 con 0x7fd9200141d0 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.229+0000 7fd7fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94300110585568 notifier 4481 bl.length()=523 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.229+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(65 notify.5 [notify cookie 94300110803840 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.229+0000 7fd7fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.229+0000 7fd7fbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:56:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.229+0000 7fd7fbfff640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd7e8003e90 con 0x7fd9200141d0 2024-02-15T22:56:28.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.229+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.229+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== watch-notify(notify_complete (2) cookie 94300110803840 notify 128849018891 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c3f4933b70 con 0x7fd9200141d0 2024-02-15T22:56:28.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.229+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49b5780 con 0x7fd9200141d0 2024-02-15T22:56:28.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.230+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.230+0000 7fd926f4b800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T22:56:28.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.230+0000 7fd926f4b800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:56:28.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.230+0000 7fd926f4b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T22:56:28.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.230+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94300110803680 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f49b5700 con 0x55c3f49776b0 2024-02-15T22:56:28.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.231+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== watch-notify(notify (1) cookie 94300110572400 notify 128849018882 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55c3f4965f40 con 0x55c3f49776b0 2024-02-15T22:56:28.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.231+0000 7fd7fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94300110572400 notifier 4481 bl.length()=177 2024-02-15T22:56:28.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.231+0000 7fd7fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T22:56:28.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.231+0000 7fd7fbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:56:28.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.231+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(68 notify.2 [notify cookie 94300110803680 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.231+0000 7fd7fbfff640 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd7e8003e90 con 0x55c3f49776b0 2024-02-15T22:56:28.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.231+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.231+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== watch-notify(notify_complete (2) cookie 94300110803680 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c3f483b650 con 0x55c3f49776b0 2024-02-15T22:56:28.250 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:28.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.232+0000 7fd7dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.232+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94300110591584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4984260 con 0x55c3f49713d0 2024-02-15T22:56:28.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.233+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94300110591584] v30'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.233+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94300110566528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4981660 con 0x7fd90c083040 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.234+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94300110566528] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003a040 con 0x7fd90c083040 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.234+0000 7fd926f4b800 20 remove_watcher() i=0 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.234+0000 7fd926f4b800 2 removed watcher, disabling cache 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.234+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94300110571344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4981660 con 0x55c3f49713d0 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.235+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94300110571344] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.235+0000 7fd926f4b800 20 remove_watcher() i=1 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.235+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94300110572400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497c750 con 0x55c3f49776b0 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.236+0000 7fd91c250640 1 -- 172.21.15.133:0/2368933170 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94300110572400] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd90c080070 con 0x55c3f49776b0 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.236+0000 7fd926f4b800 20 remove_watcher() i=2 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.236+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94300110576864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4981660 con 0x7fd90c083040 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.237+0000 7fd925252640 1 -- 172.21.15.133:0/2368933170 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94300110576864] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003a040 con 0x7fd90c083040 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.237+0000 7fd926f4b800 20 remove_watcher() i=3 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.237+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94300110581600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497dce0 con 0x55c3f49713d0 2024-02-15T22:56:28.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.238+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94300110581600] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x55c3f49713d0 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.238+0000 7fd926f4b800 20 remove_watcher() i=4 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.238+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94300110585568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f4981660 con 0x7fd9200141d0 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.239+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94300110585568] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.239+0000 7fd926f4b800 20 remove_watcher() i=5 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.239+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94300110577920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497ef60 con 0x7fd9200141d0 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.240+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94300110577920] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.240+0000 7fd926f4b800 20 remove_watcher() i=6 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.240+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94300110588192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c3f497fee0 con 0x7fd9200141d0 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94300110588192] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd914052040 con 0x7fd9200141d0 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 20 remove_watcher() i=7 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd9200141d0 msgr2=0x7fd920015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd9200141d0 0x7fd920015940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c3f49713d0 msgr2=0x55c3f4973890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c3f49713d0 0x55c3f4973890 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd90c083040 msgr2=0x7fd90c08f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd90c083040 0x7fd90c08f9e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c3f49776b0 msgr2=0x55c3f4979b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c3f49776b0 0x55c3f4979b50 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7f00367e0 msgr2=0x7fd7f0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7f00367e0 0x7fd7f0038ca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd92000b010 tx=0x7fd920020000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 msgr2=0x55c3f4965800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd924a51640 1 -- 172.21.15.133:0/2368933170 reap_dead start 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f4965800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd90c08a010 tx=0x7fd90c08de40 comp rx=0 tx=0).stop 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 shutdown_connections 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 --2- 172.21.15.133:0/2368933170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f494ae20 0x55c3f4965800 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 >> 172.21.15.133:0/2368933170 conn(0x55c3f4956770 msgr2=0x55c3f4953dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 shutdown_connections 2024-02-15T22:56:28.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/2368933170 wait complete. 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/3518892043 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7fc0367e0 msgr2=0x7fd7fc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 --2- 172.21.15.133:0/3518892043 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7fc0367e0 0x7fd7fc038ca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55c3f493b270 tx=0x7fd920005840 comp rx=0 tx=0).stop 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/3518892043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483c6b0 msgr2=0x55c3f483ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 --2- 172.21.15.133:0/3518892043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483c6b0 0x55c3f483ab20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0447c0 tx=0x7fd90c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/3518892043 shutdown_connections 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 --2- 172.21.15.133:0/3518892043 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd7fc0367e0 0x7fd7fc038ca0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 --2- 172.21.15.133:0/3518892043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483c6b0 0x55c3f483ab20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.241+0000 7fd926f4b800 1 -- 172.21.15.133:0/3518892043 >> 172.21.15.133:0/3518892043 conn(0x55c3f493f150 msgr2=0x55c3f493f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 -- 172.21.15.133:0/3518892043 shutdown_connections 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 -- 172.21.15.133:0/3518892043 wait complete. 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c3f4840600 msgr2=0x55c3f493a330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c3f4840600 0x55c3f493a330 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd80c0367e0 msgr2=0x7fd80c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd80c0367e0 0x7fd80c038ca0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd90c054000 tx=0x7fd90c04e000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 msgr2=0x55c3f4933630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f4933630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd91400b210 tx=0x7fd914000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 shutdown_connections 2024-02-15T22:56:28.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c3f4840600 0x55c3f493a330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fd80c0367e0 0x7fd80c038ca0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 --2- 172.21.15.133:0/3011259413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3f483caf0 0x55c3f4933630 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 >> 172.21.15.133:0/3011259413 conn(0x55c3f4836520 msgr2=0x55c3f4926160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 shutdown_connections 2024-02-15T22:56:28.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.242+0000 7fd926f4b800 1 -- 172.21.15.133:0/3011259413 wait complete. 2024-02-15T22:56:28.261 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:28.266 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-15T22:56:28.270 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:28.270 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-02-15T22:56:28.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-02-15T22:56:28.271 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-02-15T22:56:28.312 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:28.312 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:28.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.310+0000 7fa120d40800 1 Processor -- start 2024-02-15T22:56:28.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.310+0000 7fa120d40800 1 -- start start 2024-02-15T22:56:28.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.310+0000 7fa120d40800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55caf0b0c890 0x55caf0b0ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.310+0000 7fa120d40800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55caf0a58bb0 con 0x55caf0b0d1f0 2024-02-15T22:56:28.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.310+0000 7fa120d40800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55caf0a10450 con 0x55caf0b0c890 2024-02-15T22:56:28.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.311+0000 7fa11ca44640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55caf0b0c890 0x55caf0b0ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.311+0000 7fa11ca44640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55caf0b0c890 0x55caf0b0ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58526/0 (socket says 172.21.15.133:58526) 2024-02-15T22:56:28.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.311+0000 7fa117fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55caf0b0d1f0 0x55caf0b0d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45084/0 (socket says 172.21.15.133:45084) 2024-02-15T22:56:28.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.311+0000 7fa11ca44640 1 -- 172.21.15.133:0/3317699795 learned_addr learned my addr 172.21.15.133:0/3317699795 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.311+0000 7fa11ca44640 1 -- 172.21.15.133:0/3317699795 >> v1:172.21.15.52:6789/0 conn(0x55caf0b0d1f0 legacy=0x55caf0b0d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.311+0000 7fa11ca44640 1 -- 172.21.15.133:0/3317699795 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55caf0a81310 con 0x55caf0b0c890 2024-02-15T22:56:28.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.313+0000 7fa11ca44640 1 --2- 172.21.15.133:0/3317699795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0b0ccb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa11000a520 tx=0x7fa11001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f52a28ef738d23 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.313+0000 7fa1177fe640 1 -- 172.21.15.133:0/3317699795 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa110052570 con 0x55caf0b0c890 2024-02-15T22:56:28.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.313+0000 7fa1177fe640 1 -- 172.21.15.133:0/3317699795 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1100526d0 con 0x55caf0b0c890 2024-02-15T22:56:28.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.313+0000 7fa1177fe640 1 -- 172.21.15.133:0/3317699795 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa110052990 con 0x55caf0b0c890 2024-02-15T22:56:28.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.313+0000 7fa120d40800 1 -- 172.21.15.133:0/3317699795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 msgr2=0x55caf0b0ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.313+0000 7fa120d40800 1 --2- 172.21.15.133:0/3317699795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0b0ccb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa11000a520 tx=0x7fa11001cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.313+0000 7fa120d40800 1 -- 172.21.15.133:0/3317699795 shutdown_connections 2024-02-15T22:56:28.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.313+0000 7fa120d40800 1 --2- 172.21.15.133:0/3317699795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0b0ccb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.313+0000 7fa120d40800 1 -- 172.21.15.133:0/3317699795 >> 172.21.15.133:0/3317699795 conn(0x55caf0b084d0 msgr2=0x55caf0b0a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.313+0000 7fa120d40800 1 -- 172.21.15.133:0/3317699795 shutdown_connections 2024-02-15T22:56:28.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.313+0000 7fa120d40800 1 -- 172.21.15.133:0/3317699795 wait complete. 2024-02-15T22:56:28.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.325+0000 7fa120d40800 1 Processor -- start 2024-02-15T22:56:28.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.325+0000 7fa120d40800 1 -- start start 2024-02-15T22:56:28.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.325+0000 7fa120d40800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c00210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.325+0000 7fa120d40800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf0a0d980 con 0x55caf0b0c890 2024-02-15T22:56:28.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.325+0000 7fa11ca44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c00210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.325+0000 7fa11ca44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c00210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58528/0 (socket says 172.21.15.133:58528) 2024-02-15T22:56:28.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.325+0000 7fa11ca44640 1 -- 172.21.15.133:0/2605522277 learned_addr learned my addr 172.21.15.133:0/2605522277 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.326+0000 7fa11ca44640 1 -- 172.21.15.133:0/2605522277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110005de0 con 0x55caf0b0c890 2024-02-15T22:56:28.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.326+0000 7fa11ca44640 1 --2- 172.21.15.133:0/2605522277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c00210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa110055040 tx=0x7fa11004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ab57a87f63e98d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.326+0000 7fa00ae05640 1 -- 172.21.15.133:0/2605522277 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa110052840 con 0x55caf0b0c890 2024-02-15T22:56:28.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.326+0000 7fa00ae05640 1 -- 172.21.15.133:0/2605522277 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1100529c0 con 0x55caf0b0c890 2024-02-15T22:56:28.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.326+0000 7fa00ae05640 1 -- 172.21.15.133:0/2605522277 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa110052ca0 con 0x55caf0b0c890 2024-02-15T22:56:28.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa120d40800 1 -- 172.21.15.133:0/2605522277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 msgr2=0x55caf0c00210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa120d40800 1 --2- 172.21.15.133:0/2605522277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c00210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa110055040 tx=0x7fa11004c000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa120d40800 1 -- 172.21.15.133:0/2605522277 shutdown_connections 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa120d40800 1 --2- 172.21.15.133:0/2605522277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c00210 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa120d40800 1 -- 172.21.15.133:0/2605522277 >> 172.21.15.133:0/2605522277 conn(0x55caf0b084d0 msgr2=0x55caf0bfbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa120d40800 1 -- 172.21.15.133:0/2605522277 shutdown_connections 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa120d40800 1 -- 172.21.15.133:0/2605522277 wait complete. 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa120d40800 1 Processor -- start 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa120d40800 1 -- start start 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa120d40800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c07840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa120d40800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf0a09160 con 0x55caf0b0c890 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa11ca44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c07840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa11ca44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c07840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58540/0 (socket says 172.21.15.133:58540) 2024-02-15T22:56:28.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.327+0000 7fa11ca44640 1 -- 172.21.15.133:0/665042101 learned_addr learned my addr 172.21.15.133:0/665042101 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.328+0000 7fa11ca44640 1 -- 172.21.15.133:0/665042101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55caf0a81310 con 0x55caf0b0c890 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.328+0000 7fa11ca44640 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c07840 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa11001ceb0 tx=0x7fa110002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.328+0000 7fa009602640 1 -- 172.21.15.133:0/665042101 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa11006c070 con 0x55caf0b0c890 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.328+0000 7fa009602640 1 -- 172.21.15.133:0/665042101 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11005d690 con 0x55caf0b0c890 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.328+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55caf0c07d80 con 0x55caf0b0c890 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.328+0000 7fa009602640 1 -- 172.21.15.133:0/665042101 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa11005d970 con 0x55caf0b0c890 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.328+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55caf0c082c0 con 0x55caf0b0c890 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.329+0000 7fa009602640 1 -- 172.21.15.133:0/665042101 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa110059040 con 0x55caf0b0c890 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.329+0000 7fa009602640 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa004036790 0x7fa004038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.329+0000 7fa009602640 1 -- 172.21.15.133:0/665042101 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fa11008d740 con 0x55caf0b0c890 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.329+0000 7fa117fff640 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa004036790 0x7fa004038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.329+0000 7fa120d40800 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55caf0b0d1f0 0x55caf0c0e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.329+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c0ebf0 con 0x55caf0b0d1f0 2024-02-15T22:56:28.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.329+0000 7fa11d245640 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55caf0b0d1f0 0x55caf0c0e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.329+0000 7fa117fff640 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa004036790 0x7fa004038c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa108000f60 tx=0x7fa108001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.330+0000 7fa11d245640 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55caf0b0d1f0 0x55caf0c0e670 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.330+0000 7fa11d245640 1 -- 172.21.15.133:0/665042101 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa11800a4a0 con 0x55caf0b0d1f0 2024-02-15T22:56:28.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.330+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c0bc30 con 0x55caf0b0d1f0 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.330+0000 7fa11d245640 1 -- 172.21.15.133:0/665042101 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa11800a4a0 con 0x55caf0b0d1f0 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.330+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c108f0 con 0x55caf0b0d1f0 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.330+0000 7fa11d245640 1 -- 172.21.15.133:0/665042101 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa11800a4a0 con 0x55caf0b0d1f0 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.330+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c0faf0 con 0x55caf0b0d1f0 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.331+0000 7fa11d245640 1 -- 172.21.15.133:0/665042101 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa11800a4a0 con 0x55caf0b0d1f0 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.331+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c0ff00 con 0x55caf0b0d1f0 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.331+0000 7fa11d245640 1 -- 172.21.15.133:0/665042101 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa11800a4a0 con 0x55caf0b0d1f0 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.331+0000 7fa120d40800 1 Processor -- start 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.331+0000 7fa120d40800 1 -- start start 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.331+0000 7fa120d40800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c1f300 0x55caf0c1f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.331+0000 7fa120d40800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf09abe80 con 0x55caf0c1f300 2024-02-15T22:56:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.332+0000 7fa117fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c1f300 0x55caf0c1f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.332+0000 7fa117fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c1f300 0x55caf0c1f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58552/0 (socket says 172.21.15.133:58552) 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.332+0000 7fa117fff640 1 -- 172.21.15.133:0/427175161 learned_addr learned my addr 172.21.15.133:0/427175161 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.332+0000 7fa117fff640 1 -- 172.21.15.133:0/427175161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55caf0c1fc60 con 0x55caf0c1f300 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.332+0000 7fa117fff640 1 --2- 172.21.15.133:0/427175161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c1f300 0x55caf0c1f720 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa108001ed0 tx=0x7fa10800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.332+0000 7fa0027fc640 1 -- 172.21.15.133:0/427175161 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10800bec0 con 0x55caf0c1f300 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.332+0000 7fa0027fc640 1 -- 172.21.15.133:0/427175161 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10800d520 con 0x55caf0c1f300 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.332+0000 7fa120d40800 1 -- 172.21.15.133:0/427175161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55caf0c206d0 con 0x55caf0c1f300 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.332+0000 7fa0027fc640 1 -- 172.21.15.133:0/427175161 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10800d7c0 con 0x55caf0c1f300 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.332+0000 7fa120d40800 1 -- 172.21.15.133:0/427175161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55caf0c20b90 con 0x55caf0c1f300 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.333+0000 7fa0027fc640 1 -- 172.21.15.133:0/427175161 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa10801a070 con 0x55caf0c1f300 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.333+0000 7fa0027fc640 1 --2- 172.21.15.133:0/427175161 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ff40367e0 0x7f9ff4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.333+0000 7fa0027fc640 1 -- 172.21.15.133:0/427175161 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fa108017050 con 0x55caf0c1f300 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.333+0000 7fa11d245640 1 --2- 172.21.15.133:0/427175161 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ff40367e0 0x7f9ff4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.334+0000 7fa120d40800 1 Processor -- start 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.334+0000 7fa11d245640 1 --2- 172.21.15.133:0/427175161 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ff40367e0 0x7f9ff4038ca0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55caf0c0f530 tx=0x7fa118005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.334+0000 7fa120d40800 1 -- start start 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.334+0000 7fa120d40800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c2c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.334+0000 7fa120d40800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf09815d0 con 0x55caf0c2c520 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.334+0000 7fa117fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c2c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.334+0000 7fa117fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c2c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58554/0 (socket says 172.21.15.133:58554) 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.334+0000 7fa117fff640 1 -- 172.21.15.133:0/726388508 learned_addr learned my addr 172.21.15.133:0/726388508 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.334+0000 7fa117fff640 1 -- 172.21.15.133:0/726388508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55caf0c2cf10 con 0x55caf0c2c520 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.335+0000 7fa117fff640 1 --2- 172.21.15.133:0/726388508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c2c940 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa108027030 tx=0x7fa108024560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce23267692db25b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.335+0000 7f9ff3fff640 1 -- 172.21.15.133:0/726388508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10804bae0 con 0x55caf0c2c520 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.335+0000 7f9ff3fff640 1 -- 172.21.15.133:0/726388508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10804bc40 con 0x55caf0c2c520 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.335+0000 7f9ff3fff640 1 -- 172.21.15.133:0/726388508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10804a210 con 0x55caf0c2c520 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.335+0000 7fa120d40800 1 -- 172.21.15.133:0/726388508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 msgr2=0x55caf0c2c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.335+0000 7fa120d40800 1 --2- 172.21.15.133:0/726388508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c2c940 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa108027030 tx=0x7fa108024560 comp rx=0 tx=0).stop 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.335+0000 7fa120d40800 1 -- 172.21.15.133:0/726388508 shutdown_connections 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.335+0000 7fa120d40800 1 --2- 172.21.15.133:0/726388508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c2c940 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.335+0000 7fa120d40800 1 -- 172.21.15.133:0/726388508 >> 172.21.15.133:0/726388508 conn(0x55caf0c28880 msgr2=0x55caf0c268e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.335+0000 7fa120d40800 1 -- 172.21.15.133:0/726388508 shutdown_connections 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.335+0000 7fa120d40800 1 -- 172.21.15.133:0/726388508 wait complete. 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7fa120d40800 1 Processor -- start 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7fa120d40800 1 -- start start 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7fa120d40800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c33520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7fa120d40800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf0c33a60 con 0x55caf0c2c520 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7fa117fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c33520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7fa117fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c33520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58558/0 (socket says 172.21.15.133:58558) 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 learned_addr learned my addr 172.21.15.133:0/3920578372 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55caf0c20b90 con 0x55caf0c2c520 2024-02-15T22:56:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7fa117fff640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c33520 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa108025750 tx=0x7fa10804b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7f9ff27fc640 1 -- 172.21.15.133:0/3920578372 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10804bae0 con 0x55caf0c2c520 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7f9ff27fc640 1 -- 172.21.15.133:0/3920578372 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10804a540 con 0x55caf0c2c520 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.336+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55caf0c33c60 con 0x55caf0c2c520 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.337+0000 7f9ff27fc640 1 -- 172.21.15.133:0/3920578372 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10801a320 con 0x55caf0c2c520 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.337+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55caf0c34120 con 0x55caf0c2c520 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.337+0000 7f9ff27fc640 1 -- 172.21.15.133:0/3920578372 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa10801a480 con 0x55caf0c2c520 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7f9ff27fc640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9fe80367e0 0x7f9fe8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7f9ff27fc640 1 -- 172.21.15.133:0/3920578372 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fa10804eb40 con 0x55caf0c2c520 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa11d245640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9fe80367e0 0x7f9fe8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa120d40800 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55caf0c3f100 0x55caf0c415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c41cf0 con 0x55caf0c3f100 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa11ca44640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55caf0c3f100 0x55caf0c415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa11d245640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9fe80367e0 0x7f9fe8038ca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa11800b010 tx=0x7fa118020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa11ca44640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55caf0c3f100 0x55caf0c415a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa11005dad0 con 0x55caf0c3f100 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa120d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa120d40800 20 realm 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.338+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c420c0 con 0x55caf0c3f100 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa11005dad0 con 0x55caf0c3f100 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c42940 con 0x55caf0c3f100 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa11005dad0 con 0x55caf0c3f100 2024-02-15T22:56:28.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c42ca0 con 0x55caf0c3f100 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa11005dad0 con 0x55caf0c3f100 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c425a0 con 0x55caf0c3f100 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa11005dad0 con 0x55caf0c3f100 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 20 searching for the correct realm 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55caf0c45020 0x55caf0c47410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.339+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c45020 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.340+0000 7fa117fff640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55caf0c45020 0x55caf0c47410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.340+0000 7fa117fff640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55caf0c45020 0x55caf0c47410 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.340+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.340+0000 7fa117fff640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa108027060 0x7fa108033850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.340+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa108027060 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.340+0000 7fa11d245640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa108027060 0x7fa108033850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.341+0000 7fa11d245640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa108027060 0x7fa108033850 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.341+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11800a4a0 con 0x7fa108027060 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.341+0000 7fa11d245640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa1180141d0 0x7fa118015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.341+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa1180141d0 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.341+0000 7fa11ca44640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa1180141d0 0x7fa118015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.341+0000 7fa11ca44640 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa1180141d0 0x7fa118015940 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.342+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11005dad0 con 0x7fa1180141d0 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.342+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c3f100 2024-02-15T22:56:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.342+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11005dad0 con 0x55caf0c3f100 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.342+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c3f100 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.342+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11005dad0 con 0x55caf0c3f100 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.342+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa1180141d0 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.342+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11005dad0 con 0x7fa1180141d0 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.342+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa1180141d0 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.343+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11005dad0 con 0x7fa1180141d0 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.343+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa108027060 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.343+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11800a4a0 con 0x7fa108027060 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.343+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c45020 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.343+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.343+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c3f100 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.343+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11005dad0 con 0x55caf0c3f100 2024-02-15T22:56:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.343+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa1180141d0 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.344+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11005dad0 con 0x7fa1180141d0 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.344+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c3f100 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.344+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11005dad0 con 0x55caf0c3f100 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.344+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa108027060 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.344+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa11803a040 con 0x7fa108027060 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.344+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c45020 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.344+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.344+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c45020 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.345+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.345+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa1180141d0 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.345+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11005dad0 con 0x7fa1180141d0 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.345+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c45020 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.345+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.345+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c45020 2024-02-15T22:56:28.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.345+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.345+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c3f100 2024-02-15T22:56:28.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.346+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11005dad0 con 0x55caf0c3f100 2024-02-15T22:56:28.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.346+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c3f100 2024-02-15T22:56:28.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.346+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa11005dad0 con 0x55caf0c3f100 2024-02-15T22:56:28.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.346+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa1180141d0 2024-02-15T22:56:28.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.346+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.346+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c45020 2024-02-15T22:56:28.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.346+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.346+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa108027060 2024-02-15T22:56:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.347+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11803a040 con 0x7fa108027060 2024-02-15T22:56:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.347+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c3f100 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.347+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.347+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa1180141d0 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.347+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.347+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c45020 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.347+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.347+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa1180141d0 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.348+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.348+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa108027060 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.348+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11803a040 con 0x7fa108027060 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.348+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c45020 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.348+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.348+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa1180141d0 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x55caf0c3f100 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47ac0 con 0x7fa108027060 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa11803a040 con 0x7fa108027060 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa120d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa120d40800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa120d40800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa120d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa120d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa120d40800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c43af0 con 0x55caf0c3f100 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa120d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.349+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c43770 con 0x55caf0c3f100 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c44480 con 0x55caf0c3f100 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 20 zone default found 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 4 Realm: () 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 20 zonegroup default 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c47f30 con 0x7fa1180141d0 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.350+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c49cc0 con 0x55caf0c45020 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.351+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.351+0000 7fa120d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.351+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.351+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4a020 con 0x55caf0c45020 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.351+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.351+0000 7fa120d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.351+0000 7fa120d40800 20 started sync module instance, tier type = 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.351+0000 7fa120d40800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.351+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c495a0 con 0x7fa108027060 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.352+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11803a040 con 0x7fa108027060 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.352+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94330111168768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c49520 con 0x7fa108027060 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.352+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4ad30 con 0x55caf0c3f100 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.353+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94330111168768] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11803a040 con 0x7fa108027060 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.353+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.353+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94330111173616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4acb0 con 0x55caf0c3f100 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.353+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4b6a0 con 0x55caf0c45020 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.354+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94330111173616] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.354+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.354+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94330111174672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4ac30 con 0x55caf0c45020 2024-02-15T22:56:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.355+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4c500 con 0x7fa108027060 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.355+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11803a040 con 0x7fa108027060 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.355+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94330111181376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4ccc0 con 0x7fa108027060 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.355+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4d790 con 0x55caf0c3f100 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.356+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94330111174672] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.356+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.357+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94330111181376] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11803a040 con 0x7fa108027060 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.357+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94330111185520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4d750 con 0x55caf0c3f100 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.357+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4c7a0 con 0x7fa1180141d0 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.357+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94330111185520] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.358+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.358+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94330111179344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4d750 con 0x7fa1180141d0 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.358+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4e790 con 0x7fa1180141d0 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.359+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.359+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94330111189744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4ebb0 con 0x7fa1180141d0 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.359+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4f5c0 con 0x7fa1180141d0 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.359+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94330111179344] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94330111188192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4f580 con 0x7fa1180141d0 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94330111189744] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa120d40800 20 add_watcher() i=0 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa120d40800 20 add_watcher() i=1 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa120d40800 20 add_watcher() i=2 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa120d40800 20 add_watcher() i=3 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa120d40800 20 add_watcher() i=4 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa120d40800 20 add_watcher() i=5 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa120d40800 20 add_watcher() i=6 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94330111188192] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa120d40800 20 add_watcher() i=7 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa120d40800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.360+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4f580 con 0x55caf0c3f100 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.361+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.361+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94330111193312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4fe90 con 0x55caf0c3f100 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.362+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94330111193312] v30'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.362+0000 7f9fd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.362+0000 7fa120d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.362+0000 7fa120d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.362+0000 7fa120d40800 5 note: GC not initialized 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.362+0000 7f9fd27e4640 20 reqs_thread_entry: start 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.362+0000 7fa120d40800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.362+0000 7fa120d40800 20 Filter name: none 2024-02-15T22:56:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.362+0000 7f9fcb7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.362+0000 7fa120d40800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.362+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c841c0 con 0x7fa108027060 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.363+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x7fa11803a040 con 0x7fa108027060 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.363+0000 7fa120d40800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.364+0000 7f9fd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.364+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94330111193312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c51f30 con 0x55caf0c3f100 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.365+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94330111193312] v30'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.365+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94330111168768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4f0e0 con 0x7fa108027060 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.366+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94330111168768] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11803a040 con 0x7fa108027060 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.366+0000 7fa120d40800 20 remove_watcher() i=0 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.366+0000 7fa120d40800 2 removed watcher, disabling cache 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.366+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94330111173616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c49100 con 0x55caf0c3f100 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.367+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94330111173616] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.367+0000 7fa120d40800 20 remove_watcher() i=1 2024-02-15T22:56:28.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.367+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94330111174672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c49100 con 0x55caf0c45020 2024-02-15T22:56:28.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.368+0000 7fa117fff640 1 -- 172.21.15.133:0/3920578372 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94330111174672] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10801bbb0 con 0x55caf0c45020 2024-02-15T22:56:28.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.368+0000 7fa120d40800 20 remove_watcher() i=2 2024-02-15T22:56:28.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.368+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94330111181376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4a890 con 0x7fa108027060 2024-02-15T22:56:28.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.369+0000 7fa11d245640 1 -- 172.21.15.133:0/3920578372 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94330111181376] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11803a040 con 0x7fa108027060 2024-02-15T22:56:28.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.369+0000 7fa120d40800 20 remove_watcher() i=3 2024-02-15T22:56:28.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.369+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94330111185520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4a890 con 0x55caf0c3f100 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.370+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94330111185520] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x55caf0c3f100 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.370+0000 7fa120d40800 20 remove_watcher() i=4 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.370+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94330111179344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4a890 con 0x7fa1180141d0 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.371+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94330111179344] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.371+0000 7fa120d40800 20 remove_watcher() i=5 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.371+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94330111189744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4a890 con 0x7fa1180141d0 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.372+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94330111189744] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.372+0000 7fa120d40800 20 remove_watcher() i=6 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.372+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94330111188192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55caf0c4a890 con 0x7fa1180141d0 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94330111188192] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa11009e040 con 0x7fa1180141d0 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 20 remove_watcher() i=7 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa1180141d0 msgr2=0x7fa118015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa1180141d0 0x7fa118015940 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55caf0c3f100 msgr2=0x55caf0c415a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55caf0c3f100 0x55caf0c415a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa108027060 msgr2=0x7fa108033850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa108027060 0x7fa108033850 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55caf0c45020 msgr2=0x55caf0c47410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55caf0c45020 0x55caf0c47410 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9fe80367e0 msgr2=0x7f9fe8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9fe80367e0 0x7f9fe8038ca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa11800b010 tx=0x7fa118020000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 msgr2=0x55caf0c33520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa11ca44640 1 -- 172.21.15.133:0/3920578372 reap_dead start 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c33520 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa108025750 tx=0x7fa10804b930 comp rx=0 tx=0).stop 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 shutdown_connections 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 --2- 172.21.15.133:0/3920578372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c2c520 0x55caf0c33520 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 >> 172.21.15.133:0/3920578372 conn(0x55caf0c28880 msgr2=0x55caf0c25ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 shutdown_connections 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/3920578372 wait complete. 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/427175161 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ff40367e0 msgr2=0x7f9ff4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 --2- 172.21.15.133:0/427175161 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ff40367e0 0x7f9ff4038ca0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55caf0c0f530 tx=0x7fa118005840 comp rx=0 tx=0).stop 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/427175161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c1f300 msgr2=0x55caf0c1f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 --2- 172.21.15.133:0/427175161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c1f300 0x55caf0c1f720 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa108001ed0 tx=0x7fa10800ea00 comp rx=0 tx=0).stop 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/427175161 shutdown_connections 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 --2- 172.21.15.133:0/427175161 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ff40367e0 0x7f9ff4038ca0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 --2- 172.21.15.133:0/427175161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0c1f300 0x55caf0c1f720 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.373+0000 7fa120d40800 1 -- 172.21.15.133:0/427175161 >> 172.21.15.133:0/427175161 conn(0x55caf0c133a0 msgr2=0x55caf0c137a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 -- 172.21.15.133:0/427175161 shutdown_connections 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 -- 172.21.15.133:0/427175161 wait complete. 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55caf0b0d1f0 msgr2=0x55caf0c0e670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55caf0b0d1f0 0x55caf0c0e670 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa004036790 msgr2=0x7fa004038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa004036790 0x7fa004038c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa108000f60 tx=0x7fa108001370 comp rx=0 tx=0).stop 2024-02-15T22:56:28.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 msgr2=0x55caf0c07840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c07840 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa11001ceb0 tx=0x7fa110002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 shutdown_connections 2024-02-15T22:56:28.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55caf0b0d1f0 0x55caf0c0e670 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa004036790 0x7fa004038c50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 --2- 172.21.15.133:0/665042101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55caf0b0c890 0x55caf0c07840 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 >> 172.21.15.133:0/665042101 conn(0x55caf0b084d0 msgr2=0x55caf0bfa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 shutdown_connections 2024-02-15T22:56:28.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.374+0000 7fa120d40800 1 -- 172.21.15.133:0/665042101 wait complete. 2024-02-15T22:56:28.388 INFO:teuthology.orchestra.run.smithi133.stdout:{"key":"bucket:myfoo","ver":{"tag":"_g8_AmLIL4aCade0vcIkZz2Z","ver":2},"mtime":"2024-02-15T22:56:28.098078Z","data":{"bucket":{"name":"myfoo","marker":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","bucket_id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-02-15T22:56:26.869244Z","linked":false,"has_bucket_info":false}} 2024-02-15T22:56:28.388 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_g8_AmLIL4aCade0vcIkZz2Z', 'ver': 2}, 'mtime': '2024-02-15T22:56:28.098078Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'bucket_id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-02-15T22:56:26.869244Z', 'linked': False, 'has_bucket_info': False}} 2024-02-15T22:56:28.388 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1'] 2024-02-15T22:56:28.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1'] 2024-02-15T22:56:28.389 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:28.474 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:28.475 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:28.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.473+0000 7fcbe3f20800 1 Processor -- start 2024-02-15T22:56:28.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.473+0000 7fcbe3f20800 1 -- start start 2024-02-15T22:56:28.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.473+0000 7fcbe3f20800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562a3058e320 0x562a30590710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.473+0000 7fcbe3f20800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562a304d5c50 con 0x562a30589e90 2024-02-15T22:56:28.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.473+0000 7fcbe3f20800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x562a3048d450 con 0x562a3058e320 2024-02-15T22:56:28.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.473+0000 7fcbd7483640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562a3058e320 0x562a30590710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.473+0000 7fcbdfc84640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x562a30589e90 0x562a3058a2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45098/0 (socket says 172.21.15.133:45098) 2024-02-15T22:56:28.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.473+0000 7fcbd7483640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562a3058e320 0x562a30590710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58570/0 (socket says 172.21.15.133:58570) 2024-02-15T22:56:28.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.473+0000 7fcbdfc84640 1 -- 172.21.15.133:0/1250018652 learned_addr learned my addr 172.21.15.133:0/1250018652 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:28.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.473+0000 7fcbd7483640 1 -- 172.21.15.133:0/1250018652 >> v1:172.21.15.52:6789/0 conn(0x562a30589e90 legacy=0x562a3058a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.473+0000 7fcbd7483640 1 -- 172.21.15.133:0/1250018652 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a30591d40 con 0x562a3058e320 2024-02-15T22:56:28.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.475+0000 7fcbd7483640 1 --2- 172.21.15.133:0/1250018652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a3058e320 0x562a30590710 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800a470 tx=0x7fcbc801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a96c1eb14d00e53 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.475+0000 7fcbdf483640 1 -- 172.21.15.133:0/1250018652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbc8052570 con 0x562a3058e320 2024-02-15T22:56:28.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.476+0000 7fcbdf483640 1 -- 172.21.15.133:0/1250018652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc80526d0 con 0x562a3058e320 2024-02-15T22:56:28.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.476+0000 7fcbdf483640 1 -- 172.21.15.133:0/1250018652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbc8052990 con 0x562a3058e320 2024-02-15T22:56:28.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.476+0000 7fcbe3f20800 1 -- 172.21.15.133:0/1250018652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a3058e320 msgr2=0x562a30590710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.476+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/1250018652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a3058e320 0x562a30590710 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800a470 tx=0x7fcbc801cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:28.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.476+0000 7fcbe3f20800 1 -- 172.21.15.133:0/1250018652 shutdown_connections 2024-02-15T22:56:28.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.476+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/1250018652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a3058e320 0x562a30590710 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.476+0000 7fcbe3f20800 1 -- 172.21.15.133:0/1250018652 >> 172.21.15.133:0/1250018652 conn(0x562a305854f0 msgr2=0x562a30587910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.476+0000 7fcbe3f20800 1 -- 172.21.15.133:0/1250018652 shutdown_connections 2024-02-15T22:56:28.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.476+0000 7fcbe3f20800 1 -- 172.21.15.133:0/1250018652 wait complete. 2024-02-15T22:56:28.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.488+0000 7fcbe3f20800 1 Processor -- start 2024-02-15T22:56:28.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.488+0000 7fcbe3f20800 1 -- start start 2024-02-15T22:56:28.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.488+0000 7fcbe3f20800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a30678ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.488+0000 7fcbe3f20800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a3048a980 con 0x562a30589e90 2024-02-15T22:56:28.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.488+0000 7fcbdfc84640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a30678ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.488+0000 7fcbdfc84640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a30678ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58582/0 (socket says 172.21.15.133:58582) 2024-02-15T22:56:28.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.488+0000 7fcbdfc84640 1 -- 172.21.15.133:0/733198225 learned_addr learned my addr 172.21.15.133:0/733198225 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.488+0000 7fcbdfc84640 1 -- 172.21.15.133:0/733198225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8005d20 con 0x562a30589e90 2024-02-15T22:56:28.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.488+0000 7fcbdfc84640 1 --2- 172.21.15.133:0/733198225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a30678ee0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0001c80 tx=0x7fcbd000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a58785b8342a85 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.489+0000 7fcacde0b640 1 -- 172.21.15.133:0/733198225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbd000e470 con 0x562a30589e90 2024-02-15T22:56:28.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.489+0000 7fcacde0b640 1 -- 172.21.15.133:0/733198225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd000e5d0 con 0x562a30589e90 2024-02-15T22:56:28.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.489+0000 7fcacde0b640 1 -- 172.21.15.133:0/733198225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbd000e8d0 con 0x562a30589e90 2024-02-15T22:56:28.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.489+0000 7fcbe3f20800 1 -- 172.21.15.133:0/733198225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 msgr2=0x562a30678ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.489+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/733198225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a30678ee0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0001c80 tx=0x7fcbd000b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.489+0000 7fcbe3f20800 1 -- 172.21.15.133:0/733198225 shutdown_connections 2024-02-15T22:56:28.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.489+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/733198225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a30678ee0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.489+0000 7fcbe3f20800 1 -- 172.21.15.133:0/733198225 >> 172.21.15.133:0/733198225 conn(0x562a305854f0 msgr2=0x562a30674800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.489+0000 7fcbe3f20800 1 -- 172.21.15.133:0/733198225 shutdown_connections 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.489+0000 7fcbe3f20800 1 -- 172.21.15.133:0/733198225 wait complete. 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.490+0000 7fcbe3f20800 1 Processor -- start 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.490+0000 7fcbe3f20800 1 -- start start 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.490+0000 7fcbe3f20800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a306849a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.490+0000 7fcbe3f20800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a30486160 con 0x562a30589e90 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.490+0000 7fcbdfc84640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a306849a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.490+0000 7fcbdfc84640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a306849a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58598/0 (socket says 172.21.15.133:58598) 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.490+0000 7fcbdfc84640 1 -- 172.21.15.133:0/501445104 learned_addr learned my addr 172.21.15.133:0/501445104 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.490+0000 7fcbdfc84640 1 -- 172.21.15.133:0/501445104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a304d5c50 con 0x562a30589e90 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.490+0000 7fcbdfc84640 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a306849a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0001c80 tx=0x7fcbd0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.491+0000 7fcac7fff640 1 -- 172.21.15.133:0/501445104 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbd001f070 con 0x562a30589e90 2024-02-15T22:56:28.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.491+0000 7fcac7fff640 1 -- 172.21.15.133:0/501445104 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd0018640 con 0x562a30589e90 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.491+0000 7fcac7fff640 1 -- 172.21.15.133:0/501445104 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbd00188e0 con 0x562a30589e90 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.491+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a30684ee0 con 0x562a30589e90 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.491+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a306853c0 con 0x562a30589e90 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.491+0000 7fcac7fff640 1 -- 172.21.15.133:0/501445104 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcbd0018b10 con 0x562a30589e90 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.491+0000 7fcac7fff640 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcac8036790 0x7fcac8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.492+0000 7fcac7fff640 1 -- 172.21.15.133:0/501445104 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fcbd004c0f0 con 0x562a30589e90 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.492+0000 7fcbd7483640 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcac8036790 0x7fcac8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.492+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562a3058e320 0x562a3068b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.492+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a3068bc70 con 0x562a3058e320 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.492+0000 7fcbe0485640 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562a3058e320 0x562a3068b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.492+0000 7fcbd7483640 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcac8036790 0x7fcac8038c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8054000 tx=0x7fcbc804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.492+0000 7fcbe0485640 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562a3058e320 0x562a3068b6a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.492+0000 7fcbe0485640 1 -- 172.21.15.133:0/501445104 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcbd800a4a0 con 0x562a3058e320 2024-02-15T22:56:28.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.492+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a30688db0 con 0x562a3058e320 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.493+0000 7fcbe0485640 1 -- 172.21.15.133:0/501445104 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcbd800a4a0 con 0x562a3058e320 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.493+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a3068d9d0 con 0x562a3058e320 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.493+0000 7fcbe0485640 1 -- 172.21.15.133:0/501445104 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fcbd800a4a0 con 0x562a3058e320 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.493+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a3068cce0 con 0x562a3058e320 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.493+0000 7fcbe0485640 1 -- 172.21.15.133:0/501445104 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcbd800a4a0 con 0x562a3058e320 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.493+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a3068d0f0 con 0x562a3058e320 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.494+0000 7fcbe0485640 1 -- 172.21.15.133:0/501445104 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fcbd800a4a0 con 0x562a3058e320 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.494+0000 7fcbe3f20800 1 Processor -- start 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.494+0000 7fcbe3f20800 1 -- start start 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.494+0000 7fcbe3f20800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a3069c430 0x562a3069c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.494+0000 7fcbe3f20800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a30428e80 con 0x562a3069c430 2024-02-15T22:56:28.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.494+0000 7fcbd7483640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a3069c430 0x562a3069c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.494+0000 7fcbd7483640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a3069c430 0x562a3069c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58608/0 (socket says 172.21.15.133:58608) 2024-02-15T22:56:28.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.494+0000 7fcbd7483640 1 -- 172.21.15.133:0/3849509263 learned_addr learned my addr 172.21.15.133:0/3849509263 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.495+0000 7fcbd7483640 1 -- 172.21.15.133:0/3849509263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a3069cd90 con 0x562a3069c430 2024-02-15T22:56:28.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.495+0000 7fcbd7483640 1 --2- 172.21.15.133:0/3849509263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a3069c430 0x562a3069c850 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80447c0 tx=0x7fcbc8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.495+0000 7fcac57fa640 1 -- 172.21.15.133:0/3849509263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbc8052e40 con 0x562a3069c430 2024-02-15T22:56:28.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.495+0000 7fcac57fa640 1 -- 172.21.15.133:0/3849509263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc805d890 con 0x562a3069c430 2024-02-15T22:56:28.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.495+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3849509263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a3069cf80 con 0x562a3069c430 2024-02-15T22:56:28.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.495+0000 7fcac57fa640 1 -- 172.21.15.133:0/3849509263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbc805db30 con 0x562a3069c430 2024-02-15T22:56:28.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.495+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3849509263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a3069db30 con 0x562a3069c430 2024-02-15T22:56:28.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.496+0000 7fcac57fa640 1 -- 172.21.15.133:0/3849509263 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcbc805dc90 con 0x562a3069c430 2024-02-15T22:56:28.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.496+0000 7fcac57fa640 1 --2- 172.21.15.133:0/3849509263 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcab80367e0 0x7fcab8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.496+0000 7fcac57fa640 1 -- 172.21.15.133:0/3849509263 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fcbc808f590 con 0x562a3069c430 2024-02-15T22:56:28.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.496+0000 7fcbe0485640 1 --2- 172.21.15.133:0/3849509263 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcab80367e0 0x7fcab8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.496+0000 7fcbe3f20800 1 Processor -- start 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.496+0000 7fcbe0485640 1 --2- 172.21.15.133:0/3849509263 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcab80367e0 0x7fcab8038ca0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x562a3068c720 tx=0x7fcbd8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.496+0000 7fcbe3f20800 1 -- start start 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.497+0000 7fcbe3f20800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 0x562a306a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.497+0000 7fcbe3f20800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a303fe5d0 con 0x562a306a95c0 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.497+0000 7fcbd7483640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 0x562a306a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.497+0000 7fcbd7483640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 0x562a306a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58612/0 (socket says 172.21.15.133:58612) 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.497+0000 7fcbd7483640 1 -- 172.21.15.133:0/2850589002 learned_addr learned my addr 172.21.15.133:0/2850589002 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.497+0000 7fcbd7483640 1 -- 172.21.15.133:0/2850589002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a306a9fb0 con 0x562a306a95c0 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.497+0000 7fcbd7483640 1 --2- 172.21.15.133:0/2850589002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 0x562a306a99e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcbc808db60 tx=0x7fcbc806df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45dfaee2a927c33e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.497+0000 7fcabeffd640 1 -- 172.21.15.133:0/2850589002 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbc808f200 con 0x562a306a95c0 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.497+0000 7fcabeffd640 1 -- 172.21.15.133:0/2850589002 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc808f360 con 0x562a306a95c0 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.497+0000 7fcabeffd640 1 -- 172.21.15.133:0/2850589002 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbc8009a50 con 0x562a306a95c0 2024-02-15T22:56:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.498+0000 7fcbe3f20800 1 -- 172.21.15.133:0/2850589002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 msgr2=0x562a306a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.498+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/2850589002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 0x562a306a99e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcbc808db60 tx=0x7fcbc806df50 comp rx=0 tx=0).stop 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.498+0000 7fcbe3f20800 1 -- 172.21.15.133:0/2850589002 shutdown_connections 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.498+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/2850589002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 0x562a306a99e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.498+0000 7fcbe3f20800 1 -- 172.21.15.133:0/2850589002 >> 172.21.15.133:0/2850589002 conn(0x562a306a5920 msgr2=0x562a306a3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.498+0000 7fcbe3f20800 1 -- 172.21.15.133:0/2850589002 shutdown_connections 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.498+0000 7fcbe3f20800 1 -- 172.21.15.133:0/2850589002 wait complete. 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.498+0000 7fcbe3f20800 1 Processor -- start 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.498+0000 7fcbe3f20800 1 -- start start 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.498+0000 7fcbe3f20800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 0x562a306b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.498+0000 7fcbe3f20800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a306b0af0 con 0x562a306a95c0 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.499+0000 7fcbd7483640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 0x562a306b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.499+0000 7fcbd7483640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 0x562a306b05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58618/0 (socket says 172.21.15.133:58618) 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.499+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 learned_addr learned my addr 172.21.15.133:0/3797172606 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.499+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a3069db30 con 0x562a306a95c0 2024-02-15T22:56:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.499+0000 7fcbd7483640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 0x562a306b05b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcbc807c040 tx=0x7fcbc808dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.499+0000 7fcabd7fa640 1 -- 172.21.15.133:0/3797172606 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbc808c1d0 con 0x562a306a95c0 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.499+0000 7fcabd7fa640 1 -- 172.21.15.133:0/3797172606 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc808c330 con 0x562a306a95c0 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.499+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a306b0cf0 con 0x562a306a95c0 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.499+0000 7fcabd7fa640 1 -- 172.21.15.133:0/3797172606 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbc808c5d0 con 0x562a306a95c0 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.499+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a306b1150 con 0x562a306a95c0 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.500+0000 7fcabd7fa640 1 -- 172.21.15.133:0/3797172606 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcbc808f870 con 0x562a306a95c0 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.500+0000 7fcabd7fa640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcaa80367e0 0x7fcaa8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.500+0000 7fcabd7fa640 1 -- 172.21.15.133:0/3797172606 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fcbc809d810 con 0x562a306a95c0 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.500+0000 7fcbe0485640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcaa80367e0 0x7fcaa8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562a306bc180 0x562a306be640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306bed90 con 0x562a306bc180 2024-02-15T22:56:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe0485640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcaa80367e0 0x7fcaa8038ca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800b010 tx=0x7fcbd8020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbdfc84640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562a306bc180 0x562a306be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbdfc84640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562a306bc180 0x562a306be640 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe3f20800 20 realm 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306bf160 con 0x562a306bc180 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe3f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.501+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306bf9e0 con 0x562a306bc180 2024-02-15T22:56:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbe3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306bfd40 con 0x562a306bc180 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbe3f20800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c0540 con 0x562a306bc180 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbe3f20800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbe3f20800 20 searching for the correct realm 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562a306c23d0 0x562a306c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306c23d0 2024-02-15T22:56:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbd7483640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562a306c23d0 0x562a306c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.502+0000 7fcbd7483640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562a306c23d0 0x562a306c4890 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.503+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.503+0000 7fcbd7483640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcbc806f070 0x7fcbc8088170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.503+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbc806f070 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.503+0000 7fcbe0485640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcbc806f070 0x7fcbc8088170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.503+0000 7fcbe0485640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcbc806f070 0x7fcbc8088170 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.503+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd800a4a0 con 0x7fcbc806f070 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.504+0000 7fcbe0485640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcbd80141d0 0x7fcbd8015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.504+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbd80141d0 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.504+0000 7fcbdfc84640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcbd80141d0 0x7fcbd8015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.504+0000 7fcbdfc84640 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcbd80141d0 0x7fcbd8015940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.504+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x7fcbd80141d0 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.504+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306bc180 2024-02-15T22:56:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.505+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.505+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306bc180 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.505+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.505+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbd80141d0 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.505+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x7fcbd80141d0 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.505+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbd80141d0 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.505+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x7fcbd80141d0 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.505+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbc806f070 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.505+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd800a4a0 con 0x7fcbc806f070 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.505+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306c23d0 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.506+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.506+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306bc180 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.506+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.506+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbd80141d0 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.506+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x7fcbd80141d0 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.506+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306bc180 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.506+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.506+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbc806f070 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.507+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.507+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306c23d0 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.507+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.507+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306c23d0 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.507+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.507+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbd80141d0 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.507+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x7fcbd80141d0 2024-02-15T22:56:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.507+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306c23d0 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.507+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.508+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306c23d0 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.508+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.508+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306bc180 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.508+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.508+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306bc180 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.508+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.508+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbd80141d0 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.508+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x7fcbd80141d0 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.508+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306c23d0 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.509+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.509+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbc806f070 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.509+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.509+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306bc180 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.509+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fcbd0014070 con 0x562a306bc180 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.509+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbd80141d0 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.509+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0014070 con 0x7fcbd80141d0 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.509+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306c23d0 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.510+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.510+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbd80141d0 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.510+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.510+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbc806f070 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.510+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.510+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306c23d0 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.510+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.510+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbd80141d0 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x562a306bc180 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c4f60 con 0x7fcbc806f070 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbe3f20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbe3f20800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbe3f20800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbe3f20800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbe3f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbe3f20800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c0e40 con 0x562a306bc180 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbe3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.511+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c1690 con 0x562a306bc180 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c53a0 con 0x562a306bc180 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 20 zone default found 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 4 Realm: () 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 20 zonegroup default 2024-02-15T22:56:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c53a0 con 0x7fcbd80141d0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.512+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c7220 con 0x562a306c23d0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.513+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.513+0000 7fcbe3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.513+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.513+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c7580 con 0x562a306c23d0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.513+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.513+0000 7fcbe3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.513+0000 7fcbe3f20800 20 started sync module instance, tier type = 2024-02-15T22:56:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.513+0000 7fcbe3f20800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.513+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c67f0 con 0x7fcbc806f070 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.514+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.514+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94739201027024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c67f0 con 0x7fcbc806f070 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.514+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c7f90 con 0x562a306bc180 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.515+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94739201027024] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.515+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.515+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94739201030784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c67f0 con 0x562a306bc180 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.515+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c8a00 con 0x562a306c23d0 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.516+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.516+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94739201033440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c9250 con 0x562a306c23d0 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.516+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c9cd0 con 0x7fcbc806f070 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.516+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94739201030784] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.517+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94739201033440] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.517+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.517+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94739201035696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c6350 con 0x7fcbc806f070 2024-02-15T22:56:28.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.517+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306ca690 con 0x562a306bc180 2024-02-15T22:56:28.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.518+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.518+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94739201040880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306caab0 con 0x562a306bc180 2024-02-15T22:56:28.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.518+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306cb510 con 0x7fcbd80141d0 2024-02-15T22:56:28.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.518+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94739201035696] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.519+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.519+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94739201038288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306cb510 con 0x7fcbd80141d0 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.519+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94739201040880] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.519+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306cbf00 con 0x7fcbd80141d0 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.520+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.520+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94739201042064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306cbf00 con 0x7fcbd80141d0 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.520+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306cc8d0 con 0x7fcbd80141d0 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.520+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94739201038288] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.521+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.521+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94739201049552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306cc890 con 0x7fcbd80141d0 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.521+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94739201042064] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.521+0000 7fcbe3f20800 20 add_watcher() i=0 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.521+0000 7fcbe3f20800 20 add_watcher() i=1 2024-02-15T22:56:28.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.521+0000 7fcbe3f20800 20 add_watcher() i=2 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.521+0000 7fcbe3f20800 20 add_watcher() i=3 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.521+0000 7fcbe3f20800 20 add_watcher() i=4 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.521+0000 7fcbe3f20800 20 add_watcher() i=5 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.521+0000 7fcbe3f20800 20 add_watcher() i=6 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.522+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94739201049552] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.522+0000 7fcbe3f20800 20 add_watcher() i=7 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.522+0000 7fcbe3f20800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.522+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306cf8c0 con 0x562a306bc180 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.522+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.522+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94739201044480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306ccda0 con 0x562a306bc180 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.523+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94739201044480] v30'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.523+0000 7fca95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.524+0000 7fcbe3f20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.524+0000 7fcbe3f20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.524+0000 7fcbe3f20800 5 note: GC not initialized 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.524+0000 7fca94fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.524+0000 7fcbe3f20800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.524+0000 7fcbe3f20800 20 Filter name: none 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.524+0000 7fca0e7fc640 20 reqs_thread_entry: start 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.524+0000 7fcbe3f20800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.524+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.524+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a307018a0 con 0x7fcbd80141d0 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(62 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a30703400 con 0x7fcbc806f070 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 : miss 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a30704ea0 con 0x562a306c23d0 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.525+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a30709740 con 0x7fcbc806f070 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.527+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.527+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a3070f780 con 0x562a306c23d0 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(66 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcbe3f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcbe3f20800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcbe3f20800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcbe3f20800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1, ofs0, ns] 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94739201283360 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a30709fd0 con 0x562a306bc180 2024-02-15T22:56:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== watch-notify(notify (1) cookie 94739201040880 notify 128849018892 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x562a306853c0 con 0x562a306bc180 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcabe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94739201040880 notifier 4495 bl.length()=725 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcabe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcabe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcabe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcabe7fc640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fcaa4003e90 con 0x562a306bc180 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(67 notify.4 [notify cookie 94739201283360 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.528+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.529+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== watch-notify(notify_complete (2) cookie 94739201283360 notify 128849018892 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562a30684ee0 con 0x562a306bc180 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.529+0000 7fcbe3f20800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_sources= new_sources= 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.529+0000 7fcbe3f20800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential sources added=[] removed=[] 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.529+0000 7fcbe3f20800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_dests= new_dests= 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.529+0000 7fcbe3f20800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential dests added=[] removed=[] 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.529+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a30705500 con 0x7fcbd80141d0 2024-02-15T22:56:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.530+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 fud.buckets [call] v30'1 uv1 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.530+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a30709b10 con 0x7fcbc806f070 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.531+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.531+0000 7fcbe3f20800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.531+0000 7fcbe3f20800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.531+0000 7fcbe3f20800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.531+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94739201283328 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a30709b10 con 0x7fcbd80141d0 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.531+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== watch-notify(notify (1) cookie 94739201042064 notify 128849018892 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x562a30684ee0 con 0x7fcbd80141d0 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.531+0000 7fcabeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94739201042064 notifier 4495 bl.length()=314 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.531+0000 7fcabeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.531+0000 7fcabeffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.531+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(71 notify.6 [notify cookie 94739201283328 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.531+0000 7fcabeffd640 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fca140033f0 con 0x7fcbd80141d0 2024-02-15T22:56:28.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.532+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.532+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== watch-notify(notify_complete (2) cookie 94739201283328 notify 128849018892 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcbd0028030 con 0x7fcbd80141d0 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.532+0000 7fca95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.532+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94739201044480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a30709b10 con 0x562a306bc180 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.533+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94739201044480] v30'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.533+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94739201027024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a30709b10 con 0x7fcbc806f070 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.534+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94739201027024] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.534+0000 7fcbe3f20800 20 remove_watcher() i=0 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.534+0000 7fcbe3f20800 2 removed watcher, disabling cache 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.534+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94739201030784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c1690 con 0x562a306bc180 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.535+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94739201030784] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.535+0000 7fcbe3f20800 20 remove_watcher() i=1 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.535+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94739201033440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a30709b10 con 0x562a306c23d0 2024-02-15T22:56:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.536+0000 7fcbd7483640 1 -- 172.21.15.133:0/3797172606 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94739201033440] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbc8059040 con 0x562a306c23d0 2024-02-15T22:56:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.537+0000 7fcbe3f20800 20 remove_watcher() i=2 2024-02-15T22:56:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.537+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94739201035696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c1690 con 0x7fcbc806f070 2024-02-15T22:56:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.537+0000 7fcbe0485640 1 -- 172.21.15.133:0/3797172606 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94739201035696] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd803a040 con 0x7fcbc806f070 2024-02-15T22:56:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.538+0000 7fcbe3f20800 20 remove_watcher() i=3 2024-02-15T22:56:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.538+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94739201040880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c1690 con 0x562a306bc180 2024-02-15T22:56:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.538+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94739201040880] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x562a306bc180 2024-02-15T22:56:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.538+0000 7fcbe3f20800 20 remove_watcher() i=4 2024-02-15T22:56:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.538+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94739201038288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c1690 con 0x7fcbd80141d0 2024-02-15T22:56:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.539+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94739201038288] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.540+0000 7fcbe3f20800 20 remove_watcher() i=5 2024-02-15T22:56:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.540+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94739201042064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c1690 con 0x7fcbd80141d0 2024-02-15T22:56:28.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.542+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94739201042064] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.542+0000 7fcbe3f20800 20 remove_watcher() i=6 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.542+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94739201049552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a306c1690 con 0x7fcbd80141d0 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.543+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94739201049552] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbd0052040 con 0x7fcbd80141d0 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.543+0000 7fcbe3f20800 20 remove_watcher() i=7 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcbd80141d0 msgr2=0x7fcbd8015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcbd80141d0 0x7fcbd8015940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562a306bc180 msgr2=0x562a306be640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562a306bc180 0x562a306be640 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcbc806f070 msgr2=0x7fcbc8088170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcbc806f070 0x7fcbc8088170 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562a306c23d0 msgr2=0x562a306c4890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562a306c23d0 0x562a306c4890 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcaa80367e0 msgr2=0x7fcaa8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcaa80367e0 0x7fcaa8038ca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800b010 tx=0x7fcbd8020000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 msgr2=0x562a306b05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3797172606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a306a95c0 0x562a306b05b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcbc807c040 tx=0x7fcbc808dac0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 reap_dead start 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbdfc84640 1 -- 172.21.15.133:0/3797172606 reap_dead start 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 shutdown_connections 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 >> 172.21.15.133:0/3797172606 conn(0x562a306a5920 msgr2=0x562a306a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 shutdown_connections 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3797172606 wait complete. 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3849509263 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcab80367e0 msgr2=0x7fcab8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3849509263 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcab80367e0 0x7fcab8038ca0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x562a3068c720 tx=0x7fcbd8005840 comp rx=0 tx=0).stop 2024-02-15T22:56:28.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3849509263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a3069c430 msgr2=0x562a3069c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3849509263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a3069c430 0x562a3069c850 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80447c0 tx=0x7fcbc8002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3849509263 shutdown_connections 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3849509263 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcab80367e0 0x7fcab8038ca0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/3849509263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a3069c430 0x562a3069c850 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3849509263 >> 172.21.15.133:0/3849509263 conn(0x562a306904d0 msgr2=0x562a306908d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3849509263 shutdown_connections 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/3849509263 wait complete. 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562a3058e320 msgr2=0x562a3068b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.544+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562a3058e320 0x562a3068b6a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.545+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcac8036790 msgr2=0x7fcac8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.545+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcac8036790 0x7fcac8038c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8054000 tx=0x7fcbc804e000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.545+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 msgr2=0x562a306849a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.545+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a306849a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0001c80 tx=0x7fcbd0000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.545+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 shutdown_connections 2024-02-15T22:56:28.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.545+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562a3058e320 0x562a3068b6a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.545+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcac8036790 0x7fcac8038c50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.545+0000 7fcbe3f20800 1 --2- 172.21.15.133:0/501445104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a30589e90 0x562a306849a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.545+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 >> 172.21.15.133:0/501445104 conn(0x562a305854f0 msgr2=0x562a30673060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.545+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 shutdown_connections 2024-02-15T22:56:28.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.545+0000 7fcbe3f20800 1 -- 172.21.15.133:0/501445104 wait complete. 2024-02-15T22:56:28.561 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-15T22:56:28.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-15T22:56:28.561 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.602+0000 7f742f14b800 1 Processor -- start 2024-02-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.602+0000 7f742f14b800 1 -- start start 2024-02-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.602+0000 7f742f14b800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c7fbf72590 0x55c7fbf74980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.602+0000 7f742f14b800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c7fbeb8bb0 con 0x55c7fbf6ea80 2024-02-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.602+0000 7f742f14b800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c7fbe70450 con 0x55c7fbf72590 2024-02-15T22:56:28.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.603+0000 7f7427fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c7fbf72590 0x55c7fbf74980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.603+0000 7f742cc51640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55c7fbf6ea80 0x55c7fbf70e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45112/0 (socket says 172.21.15.133:45112) 2024-02-15T22:56:28.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.603+0000 7f742cc51640 1 -- 172.21.15.133:0/1161576008 learned_addr learned my addr 172.21.15.133:0/1161576008 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:28.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.603+0000 7f7427fff640 1 -- 172.21.15.133:0/1161576008 >> v1:172.21.15.52:6789/0 conn(0x55c7fbf6ea80 legacy=0x55c7fbf70e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.603+0000 7f7427fff640 1 -- 172.21.15.133:0/1161576008 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7fbf75ed0 con 0x55c7fbf72590 2024-02-15T22:56:28.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.605+0000 7f7427fff640 1 --2- 172.21.15.133:0/1161576008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf72590 0x55c7fbf74980 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f741800a470 tx=0x7f741801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68ea05ce14d0c65 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.605+0000 7f74277fe640 1 -- 172.21.15.133:0/1161576008 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7418052570 con 0x55c7fbf72590 2024-02-15T22:56:28.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.605+0000 7f74277fe640 1 -- 172.21.15.133:0/1161576008 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74180526d0 con 0x55c7fbf72590 2024-02-15T22:56:28.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.605+0000 7f74277fe640 1 -- 172.21.15.133:0/1161576008 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7418052990 con 0x55c7fbf72590 2024-02-15T22:56:28.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.605+0000 7f742f14b800 1 -- 172.21.15.133:0/1161576008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf72590 msgr2=0x55c7fbf74980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.605+0000 7f742f14b800 1 --2- 172.21.15.133:0/1161576008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf72590 0x55c7fbf74980 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f741800a470 tx=0x7f741801cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:28.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.605+0000 7f742f14b800 1 -- 172.21.15.133:0/1161576008 shutdown_connections 2024-02-15T22:56:28.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.605+0000 7f742f14b800 1 --2- 172.21.15.133:0/1161576008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf72590 0x55c7fbf74980 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.605+0000 7f742f14b800 1 -- 172.21.15.133:0/1161576008 >> 172.21.15.133:0/1161576008 conn(0x55c7fbf684d0 msgr2=0x55c7fbf6a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.606+0000 7f742f14b800 1 -- 172.21.15.133:0/1161576008 shutdown_connections 2024-02-15T22:56:28.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.606+0000 7f742f14b800 1 -- 172.21.15.133:0/1161576008 wait complete. 2024-02-15T22:56:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.617+0000 7f742f14b800 1 Processor -- start 2024-02-15T22:56:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.617+0000 7f742f14b800 1 -- start start 2024-02-15T22:56:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.617+0000 7f742f14b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc05dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.617+0000 7f742f14b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fbe6d980 con 0x55c7fbf6ea80 2024-02-15T22:56:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.617+0000 7f742cc51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc05dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.617+0000 7f742cc51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc05dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58640/0 (socket says 172.21.15.133:58640) 2024-02-15T22:56:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.617+0000 7f742cc51640 1 -- 172.21.15.133:0/4200459349 learned_addr learned my addr 172.21.15.133:0/4200459349 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.618+0000 7f742cc51640 1 -- 172.21.15.133:0/4200459349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7418005d20 con 0x55c7fbf6ea80 2024-02-15T22:56:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.618+0000 7f742cc51640 1 --2- 172.21.15.133:0/4200459349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc05dff0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7420001c50 tx=0x7f742000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574168d83190782f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.618+0000 7f731ae05640 1 -- 172.21.15.133:0/4200459349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f742000e470 con 0x55c7fbf6ea80 2024-02-15T22:56:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.618+0000 7f731ae05640 1 -- 172.21.15.133:0/4200459349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742000e5d0 con 0x55c7fbf6ea80 2024-02-15T22:56:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.618+0000 7f731ae05640 1 -- 172.21.15.133:0/4200459349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f742000e8d0 con 0x55c7fbf6ea80 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742f14b800 1 -- 172.21.15.133:0/4200459349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 msgr2=0x55c7fc05dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742f14b800 1 --2- 172.21.15.133:0/4200459349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc05dff0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7420001c50 tx=0x7f742000b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742f14b800 1 -- 172.21.15.133:0/4200459349 shutdown_connections 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742f14b800 1 --2- 172.21.15.133:0/4200459349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc05dff0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742f14b800 1 -- 172.21.15.133:0/4200459349 >> 172.21.15.133:0/4200459349 conn(0x55c7fbf684d0 msgr2=0x55c7fc059910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742f14b800 1 -- 172.21.15.133:0/4200459349 shutdown_connections 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742f14b800 1 -- 172.21.15.133:0/4200459349 wait complete. 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742f14b800 1 Processor -- start 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742f14b800 1 -- start start 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742f14b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc0656b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742f14b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fbe69160 con 0x55c7fbf6ea80 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742cc51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc0656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.619+0000 7f742cc51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc0656b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58648/0 (socket says 172.21.15.133:58648) 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.620+0000 7f742cc51640 1 -- 172.21.15.133:0/1553579748 learned_addr learned my addr 172.21.15.133:0/1553579748 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.620+0000 7f742cc51640 1 -- 172.21.15.133:0/1553579748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7fbeb8bb0 con 0x55c7fbf6ea80 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.620+0000 7f742cc51640 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc0656b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7420000c00 tx=0x7f7420000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.620+0000 7f7319602640 1 -- 172.21.15.133:0/1553579748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f742001f070 con 0x55c7fbf6ea80 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.620+0000 7f7319602640 1 -- 172.21.15.133:0/1553579748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7420018770 con 0x55c7fbf6ea80 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.620+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c7fc065bf0 con 0x55c7fbf6ea80 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.620+0000 7f7319602640 1 -- 172.21.15.133:0/1553579748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7420018a30 con 0x55c7fbf6ea80 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.620+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7fc0660d0 con 0x55c7fbf6ea80 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.621+0000 7f7319602640 1 -- 172.21.15.133:0/1553579748 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7420018b90 con 0x55c7fbf6ea80 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.621+0000 7f7319602640 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73140367e0 0x7f7314038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.621+0000 7f7319602640 1 -- 172.21.15.133:0/1553579748 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f742004c160 con 0x55c7fbf6ea80 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.621+0000 7f7427fff640 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73140367e0 0x7f7314038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.621+0000 7f742f14b800 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c7fbf72590 0x55c7fc06c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.621+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc06c910 con 0x55c7fbf72590 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.621+0000 7f742d452640 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c7fbf72590 0x55c7fc06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.621+0000 7f7427fff640 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73140367e0 0x7f7314038ca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7418054000 tx=0x7f741804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.622+0000 7f742d452640 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c7fbf72590 0x55c7fc06c340 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.622+0000 7f742d452640 1 -- 172.21.15.133:0/1553579748 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f742800a4a0 con 0x55c7fbf72590 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.622+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc069a70 con 0x55c7fbf72590 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.622+0000 7f742d452640 1 -- 172.21.15.133:0/1553579748 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f742800a4a0 con 0x55c7fbf72590 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.622+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc06cde0 con 0x55c7fbf72590 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.622+0000 7f742d452640 1 -- 172.21.15.133:0/1553579748 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f742800a4a0 con 0x55c7fbf72590 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.622+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc06dad0 con 0x55c7fbf72590 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.623+0000 7f742d452640 1 -- 172.21.15.133:0/1553579748 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f742800a4a0 con 0x55c7fbf72590 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.623+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc06dee0 con 0x55c7fbf72590 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.623+0000 7f742d452640 1 -- 172.21.15.133:0/1553579748 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f742800a4a0 con 0x55c7fbf72590 2024-02-15T22:56:28.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.623+0000 7f742f14b800 1 Processor -- start 2024-02-15T22:56:28.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.623+0000 7f742f14b800 1 -- start start 2024-02-15T22:56:28.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.623+0000 7f742f14b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6e620 0x55c7fbf6ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.623+0000 7f742f14b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fbe0be80 con 0x55c7fbf6e620 2024-02-15T22:56:28.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.624+0000 7f7427fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6e620 0x55c7fbf6ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.624+0000 7f7427fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6e620 0x55c7fbf6ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58650/0 (socket says 172.21.15.133:58650) 2024-02-15T22:56:28.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.624+0000 7f7427fff640 1 -- 172.21.15.133:0/1094328890 learned_addr learned my addr 172.21.15.133:0/1094328890 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.624+0000 7f7427fff640 1 -- 172.21.15.133:0/1094328890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7fbf6cfd0 con 0x55c7fbf6e620 2024-02-15T22:56:28.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.624+0000 7f7427fff640 1 --2- 172.21.15.133:0/1094328890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6e620 0x55c7fbf6ca90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f74180447c0 tx=0x7f7418002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.625+0000 7f73127fc640 1 -- 172.21.15.133:0/1094328890 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7418052e40 con 0x55c7fbf6e620 2024-02-15T22:56:28.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.625+0000 7f742f14b800 1 -- 172.21.15.133:0/1094328890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c7fbf6d1c0 con 0x55c7fbf6e620 2024-02-15T22:56:28.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.625+0000 7f73127fc640 1 -- 172.21.15.133:0/1094328890 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741805d890 con 0x55c7fbf6e620 2024-02-15T22:56:28.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.625+0000 7f73127fc640 1 -- 172.21.15.133:0/1094328890 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f741805db30 con 0x55c7fbf6e620 2024-02-15T22:56:28.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.625+0000 7f742f14b800 1 -- 172.21.15.133:0/1094328890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7fbf6d680 con 0x55c7fbf6e620 2024-02-15T22:56:28.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.625+0000 7f73127fc640 1 -- 172.21.15.133:0/1094328890 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f741805dc90 con 0x55c7fbf6e620 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.625+0000 7f73127fc640 1 --2- 172.21.15.133:0/1094328890 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7304036790 0x7f7304038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.626+0000 7f73127fc640 1 -- 172.21.15.133:0/1094328890 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f741808fa00 con 0x55c7fbf6e620 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.626+0000 7f742d452640 1 --2- 172.21.15.133:0/1094328890 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7304036790 0x7f7304038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.626+0000 7f742f14b800 1 Processor -- start 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.626+0000 7f742f14b800 1 -- start start 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.626+0000 7f742d452640 1 --2- 172.21.15.133:0/1094328890 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7304036790 0x7f7304038c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55c7fc069990 tx=0x7f7428005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.626+0000 7f742f14b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc08c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.626+0000 7f742f14b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fbde15d0 con 0x55c7fc08c440 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.626+0000 7f7427fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc08c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.626+0000 7f7427fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc08c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58666/0 (socket says 172.21.15.133:58666) 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.626+0000 7f7427fff640 1 -- 172.21.15.133:0/2585837749 learned_addr learned my addr 172.21.15.133:0/2585837749 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.626+0000 7f7427fff640 1 -- 172.21.15.133:0/2585837749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7fc08ce30 con 0x55c7fc08c440 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f7427fff640 1 --2- 172.21.15.133:0/2585837749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc08c860 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f741805dfb0 tx=0x7f7418009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b336fdacf1bd445 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f7303fff640 1 -- 172.21.15.133:0/2585837749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7418078be0 con 0x55c7fc08c440 2024-02-15T22:56:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f7303fff640 1 -- 172.21.15.133:0/2585837749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7418078d40 con 0x55c7fc08c440 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f7303fff640 1 -- 172.21.15.133:0/2585837749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7418009410 con 0x55c7fc08c440 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f742f14b800 1 -- 172.21.15.133:0/2585837749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 msgr2=0x55c7fc08c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f742f14b800 1 --2- 172.21.15.133:0/2585837749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc08c860 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f741805dfb0 tx=0x7f7418009dd0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f742f14b800 1 -- 172.21.15.133:0/2585837749 shutdown_connections 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f742f14b800 1 --2- 172.21.15.133:0/2585837749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc08c860 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f742f14b800 1 -- 172.21.15.133:0/2585837749 >> 172.21.15.133:0/2585837749 conn(0x55c7fc0887a0 msgr2=0x55c7fc086800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f742f14b800 1 -- 172.21.15.133:0/2585837749 shutdown_connections 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f742f14b800 1 -- 172.21.15.133:0/2585837749 wait complete. 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.627+0000 7f742f14b800 1 Processor -- start 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f742f14b800 1 -- start start 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f742f14b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc093410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f742f14b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fc093950 con 0x55c7fc08c440 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f7427fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc093410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f7427fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc093410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58670/0 (socket says 172.21.15.133:58670) 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 learned_addr learned my addr 172.21.15.133:0/4125683827 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7fbf6d680 con 0x55c7fc08c440 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f7427fff640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc093410 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f741805d810 tx=0x7f741808df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f73027fc640 1 -- 172.21.15.133:0/4125683827 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7418066a50 con 0x55c7fc08c440 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f73027fc640 1 -- 172.21.15.133:0/4125683827 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7418066bb0 con 0x55c7fc08c440 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f73027fc640 1 -- 172.21.15.133:0/4125683827 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7418066e50 con 0x55c7fc08c440 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.628+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c7fc093b50 con 0x55c7fc08c440 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.629+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7fc093fb0 con 0x55c7fc08c440 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.629+0000 7f73027fc640 1 -- 172.21.15.133:0/4125683827 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7418005020 con 0x55c7fc08c440 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.629+0000 7f73027fc640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f72f8036790 0x7f72f8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.629+0000 7f73027fc640 1 -- 172.21.15.133:0/4125683827 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f7418099b10 con 0x55c7fc08c440 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.630+0000 7f742d452640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f72f8036790 0x7f72f8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.630+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.630+0000 7f742d452640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f72f8036790 0x7f72f8038c50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f742800b010 tx=0x7f7428020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.630+0000 7f742f14b800 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c7fc09f020 0x55c7fc0a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.630+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a1c30 con 0x55c7fc09f020 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.630+0000 7f742cc51640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c7fc09f020 0x55c7fc0a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.630+0000 7f742cc51640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c7fc09f020 0x55c7fc0a14e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 20 realm 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a2000 con 0x55c7fc09f020 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a2880 con 0x55c7fc09f020 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a2be0 con 0x55c7fc09f020 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a33e0 con 0x55c7fc09f020 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 20 searching for the correct realm 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c7fc0a5270 0x55c7fc0a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.631+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc0a5270 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.632+0000 7f7427fff640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c7fc0a5270 0x55c7fc0a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.632+0000 7f7427fff640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c7fc0a5270 0x55c7fc0a7730 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.632+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.632+0000 7f7427fff640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f741806f070 0x7f741807b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.632+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f741806f070 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.632+0000 7f742d452640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f741806f070 0x7f741807b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.633+0000 7f742d452640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f741806f070 0x7f741807b070 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.633+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f742800a4a0 con 0x7f741806f070 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.633+0000 7f742d452640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f74280141d0 0x7f7428015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.633+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f74280141d0 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.633+0000 7f742cc51640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f74280141d0 0x7f7428015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.634+0000 7f742cc51640 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f74280141d0 0x7f7428015940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.634+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x7f74280141d0 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.634+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc09f020 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.634+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.634+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc09f020 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.634+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.634+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f74280141d0 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.635+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x7f74280141d0 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.635+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f74280141d0 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.635+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x7f74280141d0 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.635+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f741806f070 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.635+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f742800a4a0 con 0x7f741806f070 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.635+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc0a5270 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.635+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.635+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc09f020 2024-02-15T22:56:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.635+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.636+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f74280141d0 2024-02-15T22:56:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.636+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x7f74280141d0 2024-02-15T22:56:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.636+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc09f020 2024-02-15T22:56:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.636+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.636+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f741806f070 2024-02-15T22:56:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.636+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.636+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc0a5270 2024-02-15T22:56:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.636+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.636+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc0a5270 2024-02-15T22:56:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.637+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.637+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f74280141d0 2024-02-15T22:56:28.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.637+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x7f74280141d0 2024-02-15T22:56:28.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.637+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc0a5270 2024-02-15T22:56:28.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.637+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.637+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc0a5270 2024-02-15T22:56:28.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.637+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.637+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc09f020 2024-02-15T22:56:28.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.638+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.638+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc09f020 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.638+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.638+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f74280141d0 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.638+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x7f74280141d0 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.638+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc0a5270 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.638+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.638+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f741806f070 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.639+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.639+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc09f020 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.639+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7420014070 con 0x55c7fc09f020 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.639+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f74280141d0 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.639+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420014070 con 0x7f74280141d0 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.639+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc0a5270 2024-02-15T22:56:28.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.640+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.640+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f74280141d0 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.640+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.640+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f741806f070 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.640+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.640+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc0a5270 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.640+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.640+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f74280141d0 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x55c7fc09f020 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a7e00 con 0x7f741806f070 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742f14b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742f14b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742f14b800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742f14b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742f14b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742f14b800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a3d40 con 0x55c7fc09f020 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.641+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a4590 con 0x55c7fc09f020 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a8240 con 0x55c7fc09f020 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 20 zone default found 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 4 Realm: () 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 20 zonegroup default 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.642+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a8240 con 0x7f74280141d0 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f742f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0aa0c0 con 0x55c7fc0a5270 2024-02-15T22:56:28.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f742f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0aa420 con 0x55c7fc0a5270 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f742f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f742f14b800 20 started sync module instance, tier type = 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f742f14b800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.643+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a9690 con 0x7f741806f070 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.644+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.644+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94317415406416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a9690 con 0x7f741806f070 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.644+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0aaf00 con 0x55c7fc09f020 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.645+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94317415406416] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.645+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.645+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94317415410208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a9690 con 0x55c7fc09f020 2024-02-15T22:56:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.645+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0ab9a0 con 0x55c7fc0a5270 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.646+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94317415410208] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.647+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.647+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94317415404016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a9610 con 0x55c7fc0a5270 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.647+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0ac800 con 0x7f741806f070 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.649+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94317415404016] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.649+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.649+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94317415416672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0acc20 con 0x7f741806f070 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.649+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0ad590 con 0x55c7fc09f020 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.650+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.650+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94317415420144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0ada10 con 0x55c7fc09f020 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.650+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0ae4d0 con 0x7f74280141d0 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.651+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.651+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94317415423888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0ae490 con 0x7f74280141d0 2024-02-15T22:56:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.651+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0af430 con 0x7f74280141d0 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.652+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94317415423888] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.652+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.652+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94317415427952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0af430 con 0x7f74280141d0 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.652+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0afe00 con 0x7f74280141d0 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.652+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94317415416672] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.653+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94317415420144] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.653+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.653+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94317415421200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0ac780 con 0x7f74280141d0 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.653+0000 7f742f14b800 20 add_watcher() i=0 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.653+0000 7f742f14b800 20 add_watcher() i=1 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.653+0000 7f742f14b800 20 add_watcher() i=2 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.653+0000 7f742f14b800 20 add_watcher() i=3 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.653+0000 7f742f14b800 20 add_watcher() i=4 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.653+0000 7f742f14b800 20 add_watcher() i=5 2024-02-15T22:56:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.653+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94317415427952] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.653+0000 7f742f14b800 20 add_watcher() i=6 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.654+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94317415421200] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.654+0000 7f742f14b800 20 add_watcher() i=7 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.654+0000 7f742f14b800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.654+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0ae6b0 con 0x55c7fc09f020 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.654+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.654+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94317415430400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0ae670 con 0x55c7fc09f020 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.655+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94317415430400] v30'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.655+0000 7f72e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.656+0000 7f742f14b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.656+0000 7f742f14b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.656+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0bb270 con 0x55c7fc09f020 2024-02-15T22:56:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.657+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.657+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0bb8e0 con 0x7f74280141d0 2024-02-15T22:56:28.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.658+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.658+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0bbd20 con 0x55c7fc0a5270 2024-02-15T22:56:28.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.659+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.659+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0bc710 con 0x55c7fc09f020 2024-02-15T22:56:28.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.660+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'113 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.660+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0bc6f0 con 0x7f741806f070 2024-02-15T22:56:28.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.661+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.661+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0bcc40 con 0x55c7fc0a5270 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.662+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'21 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.662+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0bd610 con 0x55c7fc09f020 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.663+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.663+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0bd610 con 0x7f74280141d0 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.664+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'21 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.664+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0bd610 con 0x7f741806f070 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.665+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.665+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0bdb40 con 0x55c7fc0a5270 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.666+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.666+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0be510 con 0x7f741806f070 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.667+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.667+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0b70b0 con 0x7f74280141d0 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.668+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.668+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0b76a0 con 0x7f741806f070 2024-02-15T22:56:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.669+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.669+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0b76a0 con 0x7f74280141d0 2024-02-15T22:56:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.670+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'27 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.670+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0b6ee0 con 0x55c7fc09f020 2024-02-15T22:56:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.671+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'114 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.671+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0b6ee0 con 0x55c7fc0a5270 2024-02-15T22:56:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.672+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.672+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x7f741806f070 2024-02-15T22:56:28.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.673+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'34 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.673+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x55c7fc0a5270 2024-02-15T22:56:28.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.674+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.674+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x55c7fc09f020 2024-02-15T22:56:28.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.675+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.675+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x55c7fc09f020 2024-02-15T22:56:28.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.676+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'115 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.676+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x55c7fc0a5270 2024-02-15T22:56:28.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.677+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.677+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x7f741806f070 2024-02-15T22:56:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.678+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.678+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x55c7fc0a5270 2024-02-15T22:56:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.679+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.679+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x55c7fc0a5270 2024-02-15T22:56:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.680+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.680+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x55c7fc0a5270 2024-02-15T22:56:28.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.681+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.681+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x55c7fc0a5270 2024-02-15T22:56:28.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.681+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.681+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x7f74280141d0 2024-02-15T22:56:28.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.682+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.683+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x55c7fc0a5270 2024-02-15T22:56:28.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.683+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.683+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x7f74280141d0 2024-02-15T22:56:28.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.684+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.684+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x55c7fc0a5270 2024-02-15T22:56:28.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.685+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'28 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.685+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x7f74280141d0 2024-02-15T22:56:28.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.686+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.686+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0beeb0 con 0x7f741806f070 2024-02-15T22:56:28.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.688+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.688+0000 7f72e1fe3640 20 reqs_thread_entry: start 2024-02-15T22:56:28.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.688+0000 7f742f14b800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:28.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.688+0000 7f742f14b800 20 Filter name: none 2024-02-15T22:56:28.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.688+0000 7f72537fe640 20 reqs_thread_entry: start 2024-02-15T22:56:28.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.688+0000 7f742f14b800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T22:56:28.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.688+0000 7f742f14b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.688+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0e87e0 con 0x7f74280141d0 2024-02-15T22:56:28.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.689+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.689+0000 7f742f14b800 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T22:56:28.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.689+0000 7f742f14b800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-15T22:56:28.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.689+0000 7f742f14b800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:56:28.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.689+0000 7f742f14b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:28.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.689+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0ead00 con 0x7f74280141d0 2024-02-15T22:56:28.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.689+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.693 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-15T22:56:28.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.690+0000 7f72e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.690+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94317415430400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0e8320 con 0x55c7fc09f020 2024-02-15T22:56:28.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.691+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94317415430400] v30'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.691+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94317415406416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0af900 con 0x7f741806f070 2024-02-15T22:56:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.691+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94317415406416] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.691+0000 7f742f14b800 20 remove_watcher() i=0 2024-02-15T22:56:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.692+0000 7f742f14b800 2 removed watcher, disabling cache 2024-02-15T22:56:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.692+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94317415410208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0af900 con 0x55c7fc09f020 2024-02-15T22:56:28.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.693+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94317415410208] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.693+0000 7f742f14b800 20 remove_watcher() i=1 2024-02-15T22:56:28.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.693+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94317415404016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0aaa20 con 0x55c7fc0a5270 2024-02-15T22:56:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.694+0000 7f7427fff640 1 -- 172.21.15.133:0/4125683827 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94317415404016] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f741807f020 con 0x55c7fc0a5270 2024-02-15T22:56:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.694+0000 7f742f14b800 20 remove_watcher() i=2 2024-02-15T22:56:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.694+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94317415416672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0af900 con 0x7f741806f070 2024-02-15T22:56:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.695+0000 7f742d452640 1 -- 172.21.15.133:0/4125683827 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94317415416672] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f742803a040 con 0x7f741806f070 2024-02-15T22:56:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.695+0000 7f742f14b800 20 remove_watcher() i=3 2024-02-15T22:56:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.695+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94317415420144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0a91f0 con 0x55c7fc09f020 2024-02-15T22:56:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.696+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94317415420144] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x55c7fc09f020 2024-02-15T22:56:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.696+0000 7f742f14b800 20 remove_watcher() i=4 2024-02-15T22:56:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.696+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94317415423888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0aaa20 con 0x7f74280141d0 2024-02-15T22:56:28.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.697+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94317415423888] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.697+0000 7f742f14b800 20 remove_watcher() i=5 2024-02-15T22:56:28.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.697+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94317415427952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0ac360 con 0x7f74280141d0 2024-02-15T22:56:28.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.698+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94317415427952] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.698+0000 7f742f14b800 20 remove_watcher() i=6 2024-02-15T22:56:28.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.698+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94317415421200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7fc0af900 con 0x7f74280141d0 2024-02-15T22:56:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.698+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94317415421200] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7420054040 con 0x7f74280141d0 2024-02-15T22:56:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.698+0000 7f742f14b800 20 remove_watcher() i=7 2024-02-15T22:56:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f74280141d0 msgr2=0x7f7428015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f74280141d0 0x7f7428015940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c7fc09f020 msgr2=0x55c7fc0a14e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c7fc09f020 0x55c7fc0a14e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f741806f070 msgr2=0x7f741807b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f741806f070 0x7f741807b070 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c7fc0a5270 msgr2=0x55c7fc0a7730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55c7fc0a5270 0x55c7fc0a7730 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f72f8036790 msgr2=0x7f72f8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f72f8036790 0x7f72f8038c50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f742800b010 tx=0x7f7428020000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 msgr2=0x55c7fc093410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742cc51640 1 -- 172.21.15.133:0/4125683827 reap_dead start 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc093410 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f741805d810 tx=0x7f741808df30 comp rx=0 tx=0).stop 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 shutdown_connections 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 --2- 172.21.15.133:0/4125683827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fc08c440 0x55c7fc093410 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 >> 172.21.15.133:0/4125683827 conn(0x55c7fc0887a0 msgr2=0x55c7fc085e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 shutdown_connections 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/4125683827 wait complete. 2024-02-15T22:56:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/1094328890 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7304036790 msgr2=0x7f7304038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 --2- 172.21.15.133:0/1094328890 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7304036790 0x7f7304038c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55c7fc069990 tx=0x7f7428005840 comp rx=0 tx=0).stop 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/1094328890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6e620 msgr2=0x55c7fbf6ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 --2- 172.21.15.133:0/1094328890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6e620 0x55c7fbf6ca90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f74180447c0 tx=0x7f7418002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/1094328890 shutdown_connections 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 --2- 172.21.15.133:0/1094328890 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7304036790 0x7f7304038c50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 --2- 172.21.15.133:0/1094328890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6e620 0x55c7fbf6ca90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/1094328890 >> 172.21.15.133:0/1094328890 conn(0x55c7fc071160 msgr2=0x55c7fc071560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/1094328890 shutdown_connections 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.699+0000 7f742f14b800 1 -- 172.21.15.133:0/1094328890 wait complete. 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c7fbf72590 msgr2=0x55c7fc06c340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c7fbf72590 0x55c7fc06c340 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73140367e0 msgr2=0x7f7314038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73140367e0 0x7f7314038ca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7418054000 tx=0x7f741804e000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 msgr2=0x55c7fc0656b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc0656b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7420000c00 tx=0x7f7420000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 shutdown_connections 2024-02-15T22:56:28.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55c7fbf72590 0x55c7fc06c340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73140367e0 0x7f7314038ca0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 --2- 172.21.15.133:0/1553579748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c7fbf6ea80 0x55c7fc0656b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 >> 172.21.15.133:0/1553579748 conn(0x55c7fbf684d0 msgr2=0x55c7fc0581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 shutdown_connections 2024-02-15T22:56:28.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.700+0000 7f742f14b800 1 -- 172.21.15.133:0/1553579748 wait complete. 2024-02-15T22:56:28.710 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-15T22:56:28.710 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-15T22:56:28.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-15T22:56:28.711 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-02-15T22:56:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.793+0000 7f78b813a800 1 Processor -- start 2024-02-15T22:56:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.793+0000 7f78b813a800 1 -- start start 2024-02-15T22:56:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.793+0000 7f78b813a800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x555d4d2825d0 0x555d4d2849c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.793+0000 7f78b813a800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555d4d1c8ba0 con 0x555d4d27eac0 2024-02-15T22:56:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.793+0000 7f78b813a800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x555d4d180450 con 0x555d4d2825d0 2024-02-15T22:56:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.794+0000 7f78b3604640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x555d4d2825d0 0x555d4d2849c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.794+0000 7f78b3e05640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x555d4d27eac0 0x555d4d280eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45120/0 (socket says 172.21.15.133:45120) 2024-02-15T22:56:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.794+0000 7f78b3e05640 1 -- 172.21.15.133:0/2221849421 learned_addr learned my addr 172.21.15.133:0/2221849421 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.794+0000 7f78b3604640 1 -- 172.21.15.133:0/2221849421 >> v1:172.21.15.52:6789/0 conn(0x555d4d27eac0 legacy=0x555d4d280eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.794+0000 7f78b3604640 1 -- 172.21.15.133:0/2221849421 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d4d285f10 con 0x555d4d2825d0 2024-02-15T22:56:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.796+0000 7f78b3604640 1 --2- 172.21.15.133:0/2221849421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d2825d0 0x555d4d2849c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f789c00a470 tx=0x7f789c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdeff1f0b02e1947 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.796+0000 7f78b2e03640 1 -- 172.21.15.133:0/2221849421 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f789c052570 con 0x555d4d2825d0 2024-02-15T22:56:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.796+0000 7f78b2e03640 1 -- 172.21.15.133:0/2221849421 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c0526d0 con 0x555d4d2825d0 2024-02-15T22:56:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.796+0000 7f78b2e03640 1 -- 172.21.15.133:0/2221849421 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f789c052990 con 0x555d4d2825d0 2024-02-15T22:56:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.796+0000 7f78b813a800 1 -- 172.21.15.133:0/2221849421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d2825d0 msgr2=0x555d4d2849c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.796+0000 7f78b813a800 1 --2- 172.21.15.133:0/2221849421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d2825d0 0x555d4d2849c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f789c00a470 tx=0x7f789c01cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.796+0000 7f78b813a800 1 -- 172.21.15.133:0/2221849421 shutdown_connections 2024-02-15T22:56:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.796+0000 7f78b813a800 1 --2- 172.21.15.133:0/2221849421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d2825d0 0x555d4d2849c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.796+0000 7f78b813a800 1 -- 172.21.15.133:0/2221849421 >> 172.21.15.133:0/2221849421 conn(0x555d4d2784f0 msgr2=0x555d4d27a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.796+0000 7f78b813a800 1 -- 172.21.15.133:0/2221849421 shutdown_connections 2024-02-15T22:56:28.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.796+0000 7f78b813a800 1 -- 172.21.15.133:0/2221849421 wait complete. 2024-02-15T22:56:28.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.808+0000 7f78b813a800 1 Processor -- start 2024-02-15T22:56:28.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.808+0000 7f78b813a800 1 -- start start 2024-02-15T22:56:28.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.808+0000 7f78b813a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d36dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.808+0000 7f78b813a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d4d17d980 con 0x555d4d27eac0 2024-02-15T22:56:28.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.808+0000 7f78b3e05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d36dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.809+0000 7f78b3e05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d36dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58682/0 (socket says 172.21.15.133:58682) 2024-02-15T22:56:28.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.809+0000 7f78b3e05640 1 -- 172.21.15.133:0/144954732 learned_addr learned my addr 172.21.15.133:0/144954732 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.809+0000 7f78b3e05640 1 -- 172.21.15.133:0/144954732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c005d20 con 0x555d4d27eac0 2024-02-15T22:56:28.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.809+0000 7f78b3e05640 1 --2- 172.21.15.133:0/144954732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d36dfd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f78ac001bc0 tx=0x7f78ac00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfe665d8fec1091 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.809+0000 7f77a1e0b640 1 -- 172.21.15.133:0/144954732 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78ac00e470 con 0x555d4d27eac0 2024-02-15T22:56:28.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.809+0000 7f77a1e0b640 1 -- 172.21.15.133:0/144954732 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac00e5f0 con 0x555d4d27eac0 2024-02-15T22:56:28.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.809+0000 7f77a1e0b640 1 -- 172.21.15.133:0/144954732 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78ac00e950 con 0x555d4d27eac0 2024-02-15T22:56:28.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.810+0000 7f78b813a800 1 -- 172.21.15.133:0/144954732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 msgr2=0x555d4d36dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.810+0000 7f78b813a800 1 --2- 172.21.15.133:0/144954732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d36dfd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f78ac001bc0 tx=0x7f78ac00b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.810+0000 7f78b813a800 1 -- 172.21.15.133:0/144954732 shutdown_connections 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.810+0000 7f78b813a800 1 --2- 172.21.15.133:0/144954732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d36dfd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.810+0000 7f78b813a800 1 -- 172.21.15.133:0/144954732 >> 172.21.15.133:0/144954732 conn(0x555d4d2784f0 msgr2=0x555d4d3698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.810+0000 7f78b813a800 1 -- 172.21.15.133:0/144954732 shutdown_connections 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.810+0000 7f78b813a800 1 -- 172.21.15.133:0/144954732 wait complete. 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.810+0000 7f78b813a800 1 Processor -- start 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.810+0000 7f78b813a800 1 -- start start 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.810+0000 7f78b813a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d3756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.810+0000 7f78b813a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d4d179160 con 0x555d4d27eac0 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.811+0000 7f78b3e05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d3756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.811+0000 7f78b3e05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d3756b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58688/0 (socket says 172.21.15.133:58688) 2024-02-15T22:56:28.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.811+0000 7f78b3e05640 1 -- 172.21.15.133:0/2817524634 learned_addr learned my addr 172.21.15.133:0/2817524634 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.811+0000 7f78b3e05640 1 -- 172.21.15.133:0/2817524634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d4d1c8ba0 con 0x555d4d27eac0 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.811+0000 7f78b3e05640 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d3756b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c010 tx=0x7f78ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.811+0000 7f779bfff640 1 -- 172.21.15.133:0/2817524634 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78ac01f070 con 0x555d4d27eac0 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.811+0000 7f779bfff640 1 -- 172.21.15.133:0/2817524634 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac0197c0 con 0x555d4d27eac0 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.811+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555d4d375bf0 con 0x555d4d27eac0 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.811+0000 7f779bfff640 1 -- 172.21.15.133:0/2817524634 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78ac019a60 con 0x555d4d27eac0 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.811+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d4d376070 con 0x555d4d27eac0 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.812+0000 7f779bfff640 1 -- 172.21.15.133:0/2817524634 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f78ac019bc0 con 0x555d4d27eac0 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.812+0000 7f779bfff640 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f779c0367e0 0x7f779c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.812+0000 7f779bfff640 1 -- 172.21.15.133:0/2817524634 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f78ac04c4f0 con 0x555d4d27eac0 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.812+0000 7f78b3604640 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f779c0367e0 0x7f779c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.812+0000 7f78b813a800 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555d4d2825d0 0x555d4d37c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.812+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d37c8f0 con 0x555d4d2825d0 2024-02-15T22:56:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.812+0000 7f78b4606640 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555d4d2825d0 0x555d4d37c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.813+0000 7f78b3604640 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f779c0367e0 0x7f779c038ca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f789c054000 tx=0x7f789c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.813+0000 7f78b4606640 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555d4d2825d0 0x555d4d37c320 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.813+0000 7f78b4606640 1 -- 172.21.15.133:0/2817524634 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f78a400a4a0 con 0x555d4d2825d0 2024-02-15T22:56:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.813+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d379a20 con 0x555d4d2825d0 2024-02-15T22:56:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.813+0000 7f78b4606640 1 -- 172.21.15.133:0/2817524634 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f78a400a4a0 con 0x555d4d2825d0 2024-02-15T22:56:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.813+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d37e620 con 0x555d4d2825d0 2024-02-15T22:56:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.814+0000 7f78b4606640 1 -- 172.21.15.133:0/2817524634 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f78a400a4a0 con 0x555d4d2825d0 2024-02-15T22:56:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.814+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d37d930 con 0x555d4d2825d0 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.814+0000 7f78b4606640 1 -- 172.21.15.133:0/2817524634 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f78a400a4a0 con 0x555d4d2825d0 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.814+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d37dd40 con 0x555d4d2825d0 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.814+0000 7f78b4606640 1 -- 172.21.15.133:0/2817524634 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f78a400a4a0 con 0x555d4d2825d0 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.814+0000 7f78b813a800 1 Processor -- start 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.814+0000 7f78b813a800 1 -- start start 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f78b813a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d38d060 0x555d4d38d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f78b813a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d4d11be80 con 0x555d4d38d060 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f78b3604640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d38d060 0x555d4d38d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f78b3604640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d38d060 0x555d4d38d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58700/0 (socket says 172.21.15.133:58700) 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f78b3604640 1 -- 172.21.15.133:0/1763450210 learned_addr learned my addr 172.21.15.133:0/1763450210 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f78b3604640 1 -- 172.21.15.133:0/1763450210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d4d38d9c0 con 0x555d4d38d060 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f78b3604640 1 --2- 172.21.15.133:0/1763450210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d38d060 0x555d4d38d480 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f789c055040 tx=0x7f789c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f77997fa640 1 -- 172.21.15.133:0/1763450210 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f789c05d730 con 0x555d4d38d060 2024-02-15T22:56:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f77997fa640 1 -- 172.21.15.133:0/1763450210 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c05d890 con 0x555d4d38d060 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f78b813a800 1 -- 172.21.15.133:0/1763450210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555d4d38dbb0 con 0x555d4d38d060 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f77997fa640 1 -- 172.21.15.133:0/1763450210 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f789c05db30 con 0x555d4d38d060 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.815+0000 7f78b813a800 1 -- 172.21.15.133:0/1763450210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d4d38e760 con 0x555d4d38d060 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.816+0000 7f77997fa640 1 -- 172.21.15.133:0/1763450210 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f789c066410 con 0x555d4d38d060 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.816+0000 7f77997fa640 1 --2- 172.21.15.133:0/1763450210 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f778c036790 0x7f778c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.816+0000 7f77997fa640 1 -- 172.21.15.133:0/1763450210 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f789c08f690 con 0x555d4d38d060 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.816+0000 7f78b4606640 1 --2- 172.21.15.133:0/1763450210 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f778c036790 0x7f778c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.817+0000 7f78b813a800 1 Processor -- start 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.817+0000 7f78b813a800 1 -- start start 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.817+0000 7f78b4606640 1 --2- 172.21.15.133:0/1763450210 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f778c036790 0x7f778c038c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x555d4d37d370 tx=0x7f78a4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.817+0000 7f78b813a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d39a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.817+0000 7f78b813a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d4d0f15d0 con 0x555d4d39a220 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.817+0000 7f78b3604640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d39a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.817+0000 7f78b3604640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d39a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58704/0 (socket says 172.21.15.133:58704) 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.817+0000 7f78b3604640 1 -- 172.21.15.133:0/1220451633 learned_addr learned my addr 172.21.15.133:0/1220451633 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.817+0000 7f78b3604640 1 -- 172.21.15.133:0/1220451633 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d4d39ac10 con 0x555d4d39a220 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.817+0000 7f78b3604640 1 --2- 172.21.15.133:0/1220451633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d39a640 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f789c08dc60 tx=0x7f789c0666c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9933b4f03e8bc7b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.817+0000 7f7792ffd640 1 -- 172.21.15.133:0/1220451633 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f789c065370 con 0x555d4d39a220 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f7792ffd640 1 -- 172.21.15.133:0/1220451633 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c0654d0 con 0x555d4d39a220 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f7792ffd640 1 -- 172.21.15.133:0/1220451633 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f789c0657f0 con 0x555d4d39a220 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f78b813a800 1 -- 172.21.15.133:0/1220451633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 msgr2=0x555d4d39a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f78b813a800 1 --2- 172.21.15.133:0/1220451633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d39a640 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f789c08dc60 tx=0x7f789c0666c0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f78b813a800 1 -- 172.21.15.133:0/1220451633 shutdown_connections 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f78b813a800 1 --2- 172.21.15.133:0/1220451633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d39a640 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f78b813a800 1 -- 172.21.15.133:0/1220451633 >> 172.21.15.133:0/1220451633 conn(0x555d4d396580 msgr2=0x555d4d3945e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f78b813a800 1 -- 172.21.15.133:0/1220451633 shutdown_connections 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f78b813a800 1 -- 172.21.15.133:0/1220451633 wait complete. 2024-02-15T22:56:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f78b813a800 1 Processor -- start 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f78b813a800 1 -- start start 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f78b813a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d3a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.818+0000 7f78b813a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d4d3a17c0 con 0x555d4d39a220 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.819+0000 7f78b3604640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d3a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.819+0000 7f78b3604640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d3a1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58714/0 (socket says 172.21.15.133:58714) 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.819+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 learned_addr learned my addr 172.21.15.133:0/3861057351 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.819+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d4d38e760 con 0x555d4d39a220 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.819+0000 7f78b3604640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d3a1280 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f789c05dd80 tx=0x7f789c08dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.819+0000 7f77917fa640 1 -- 172.21.15.133:0/3861057351 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f789c065370 con 0x555d4d39a220 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.819+0000 7f77917fa640 1 -- 172.21.15.133:0/3861057351 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c065640 con 0x555d4d39a220 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.819+0000 7f77917fa640 1 -- 172.21.15.133:0/3861057351 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f789c05fd30 con 0x555d4d39a220 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.819+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555d4d3a19c0 con 0x555d4d39a220 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.820+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d4d3a1e20 con 0x555d4d39a220 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.820+0000 7f77917fa640 1 -- 172.21.15.133:0/3861057351 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f789c08f9a0 con 0x555d4d39a220 2024-02-15T22:56:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.820+0000 7f77917fa640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f777c0367e0 0x7f777c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.820+0000 7f77917fa640 1 -- 172.21.15.133:0/3861057351 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f789c09aaf0 con 0x555d4d39a220 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.821+0000 7f78b4606640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f777c0367e0 0x7f777c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.821+0000 7f78b4606640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f777c0367e0 0x7f777c038ca0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f78a400b010 tx=0x7f78a4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.821+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.821+0000 7f78b813a800 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555d4d3ace10 0x555d4d3af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.821+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3afa20 con 0x555d4d3ace10 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.821+0000 7f78b3e05640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555d4d3ace10 0x555d4d3af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.821+0000 7f78b3e05640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555d4d3ace10 0x555d4d3af2d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 20 realm 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3afdf0 con 0x555d4d3ace10 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b0670 con 0x555d4d3ace10 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b09d0 con 0x555d4d3ace10 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b11d0 con 0x555d4d3ace10 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 20 searching for the correct realm 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x555d4d3b30f0 0x555d4d3b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.822+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3b30f0 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.823+0000 7f78b3604640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x555d4d3b30f0 0x555d4d3b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.823+0000 7f78b3604640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x555d4d3b30f0 0x555d4d3b5590 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.823+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.823+0000 7f78b3604640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f789c099060 0x7f789c093170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.823+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f789c099060 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.823+0000 7f78b4606640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f789c099060 0x7f789c093170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.824+0000 7f78b4606640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f789c099060 0x7f789c093170 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.824+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x7f789c099060 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.824+0000 7f78b4606640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f78a40141d0 0x7f78a4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.824+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f78a40141d0 2024-02-15T22:56:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.824+0000 7f78b3e05640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f78a40141d0 0x7f78a4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.825+0000 7f78b3e05640 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f78a40141d0 0x7f78a4015940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.825+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x7f78a40141d0 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.825+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3ace10 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.825+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.825+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3ace10 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.825+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.825+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f78a40141d0 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.826+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x7f78a40141d0 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.826+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f78a40141d0 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.826+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x7f78a40141d0 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.826+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f789c099060 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.826+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x7f789c099060 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.826+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3b30f0 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.826+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.826+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3ace10 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.827+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.827+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f78a40141d0 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.827+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x7f78a40141d0 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.827+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3ace10 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.827+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.827+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f789c099060 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.827+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.827+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3b30f0 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.828+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.828+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3b30f0 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.828+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.828+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f78a40141d0 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.828+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x7f78a40141d0 2024-02-15T22:56:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.828+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3b30f0 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.828+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.828+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3b30f0 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.828+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.828+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3ace10 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.829+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.829+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3ace10 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.829+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.829+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f78a40141d0 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.829+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x7f78a40141d0 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.829+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3b30f0 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.830+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.830+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f789c099060 2024-02-15T22:56:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.830+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.830+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3ace10 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.830+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f78ac00d590 con 0x555d4d3ace10 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.830+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f78a40141d0 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.830+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac00d590 con 0x7f78a40141d0 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.830+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3b30f0 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.831+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.831+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f78a40141d0 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.831+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.831+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f789c099060 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.831+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.831+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3b30f0 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.831+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.831+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f78a40141d0 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x555d4d3ace10 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b5c60 con 0x7f789c099060 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b813a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b813a800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b813a800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b813a800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b813a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b813a800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b26d0 con 0x555d4d3ace10 2024-02-15T22:56:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b813a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.832+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b1f20 con 0x555d4d3ace10 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b16b0 con 0x555d4d3ace10 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 20 zone default found 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 4 Realm: () 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 20 zonegroup default 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b1f20 con 0x7f78a40141d0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b7a80 con 0x555d4d3b30f0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.833+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.834+0000 7f78b813a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.834+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.834+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b7de0 con 0x555d4d3b30f0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.834+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.834+0000 7f78b813a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.834+0000 7f78b813a800 20 started sync module instance, tier type = 2024-02-15T22:56:28.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.834+0000 7f78b813a800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.834+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b1d30 con 0x7f789c099060 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.835+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.835+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93859216060096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b8140 con 0x7f789c099060 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.835+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b8980 con 0x555d4d3ace10 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.836+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93859216060096] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.836+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.836+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93859216061360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b85e0 con 0x555d4d3ace10 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.836+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b9440 con 0x555d4d3b30f0 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.837+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93859216061360] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.837+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.837+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93859216064832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b8560 con 0x555d4d3b30f0 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.838+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3ba1d0 con 0x7f789c099060 2024-02-15T22:56:28.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.838+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93859216064832] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.839+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.839+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93859216070688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3ba580 con 0x7f789c099060 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.839+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3bafe0 con 0x555d4d3ace10 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.839+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.839+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93859216075472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3bafe0 con 0x555d4d3ace10 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.839+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3bbf60 con 0x7f78a40141d0 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.840+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93859216070688] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.840+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93859216075472] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.840+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.840+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93859216079488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3bbf60 con 0x7f78a40141d0 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.840+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3bb470 con 0x7f78a40141d0 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.841+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93859216079488] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.842+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.842+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93859216077872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3bc310 con 0x7f78a40141d0 2024-02-15T22:56:28.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.842+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3bcdb0 con 0x7f78a40141d0 2024-02-15T22:56:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93859216077872] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93859216083088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3bcd70 con 0x7f78a40141d0 2024-02-15T22:56:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b813a800 20 add_watcher() i=0 2024-02-15T22:56:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b813a800 20 add_watcher() i=1 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b813a800 20 add_watcher() i=2 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b813a800 20 add_watcher() i=3 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b813a800 20 add_watcher() i=4 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b813a800 20 add_watcher() i=5 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b813a800 20 add_watcher() i=6 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93859216083088] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b813a800 20 add_watcher() i=7 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.843+0000 7f78b813a800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.844+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b9d30 con 0x555d4d3ace10 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.844+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.844+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93859216085264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3bdb50 con 0x555d4d3ace10 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.845+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93859216085264] v30'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.845+0000 7f7769fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.845+0000 7f78b813a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.845+0000 7f78b813a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.845+0000 7f78b813a800 5 note: GC not initialized 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.845+0000 7f7768fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.845+0000 7f78b813a800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.845+0000 7f78b813a800 20 Filter name: none 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.845+0000 7f76e27fc640 20 reqs_thread_entry: start 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.846+0000 7f78b813a800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.846+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.846+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3f2280 con 0x7f78a40141d0 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.846+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(62 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.846+0000 7f78b813a800 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.846+0000 7f78b813a800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.846+0000 7f78b813a800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.846+0000 7f78b813a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.846+0000 7f78b813a800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.846+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.846+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3f3de0 con 0x7f789c099060 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 : miss 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3f5830 con 0x555d4d3b30f0 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.847+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3f90e0 con 0x7f78a40141d0 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.848+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(65 fud.buckets [call] v30'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.848+0000 7f78b813a800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.848+0000 7f78b813a800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.848+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3f8090 con 0x7f789c099060 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.849+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.849+0000 7f78b813a800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.849+0000 7f78b813a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.849+0000 7f78b813a800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.849+0000 7f78b813a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.849+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3f8a30 con 0x7f789c099060 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f78b813a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f78b813a800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f78b813a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93859216328016 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3fa950 con 0x7f78a40141d0 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== watch-notify(notify (1) cookie 93859216077872 notify 128849018893 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x555d4d376070 con 0x7f78a40141d0 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f7792ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 93859216077872 notifier 4509 bl.length()=338 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f7792ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f7792ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(68 notify.6 [notify cookie 93859216328016 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f7792ffd640 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7778003e90 con 0x7f78a40141d0 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.850+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== watch-notify(notify_complete (2) cookie 93859216328016 notify 128849018893 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555d4d375bf0 con 0x7f78a40141d0 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.851+0000 7f7769fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.851+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93859216085264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3f8550 con 0x555d4d3ace10 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.852+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93859216085264] v30'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.852+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93859216060096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3f8a30 con 0x7f789c099060 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.853+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93859216060096] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.853+0000 7f78b813a800 20 remove_watcher() i=0 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.853+0000 7f78b813a800 2 removed watcher, disabling cache 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.853+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93859216061360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3f8a30 con 0x555d4d3ace10 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.854+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93859216061360] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.854+0000 7f78b813a800 20 remove_watcher() i=1 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.854+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93859216064832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3f8a30 con 0x555d4d3b30f0 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.855+0000 7f78b3604640 1 -- 172.21.15.133:0/3861057351 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93859216064832] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f789c080040 con 0x555d4d3b30f0 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.855+0000 7f78b813a800 20 remove_watcher() i=2 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.855+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93859216070688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b73b0 con 0x7f789c099060 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.856+0000 7f78b4606640 1 -- 172.21.15.133:0/3861057351 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93859216070688] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78a403a040 con 0x7f789c099060 2024-02-15T22:56:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.856+0000 7f78b813a800 20 remove_watcher() i=3 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.856+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93859216075472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b8140 con 0x555d4d3ace10 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.858+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93859216075472] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x555d4d3ace10 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.858+0000 7f78b813a800 20 remove_watcher() i=4 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.858+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93859216079488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b73b0 con 0x7f78a40141d0 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.859+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93859216079488] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.859+0000 7f78b813a800 20 remove_watcher() i=5 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.859+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93859216077872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3b8140 con 0x7f78a40141d0 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.859+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93859216077872] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.859+0000 7f78b813a800 20 remove_watcher() i=6 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.859+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93859216083088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555d4d3bba80 con 0x7f78a40141d0 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.860+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93859216083088] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78ac05c040 con 0x7f78a40141d0 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.860+0000 7f78b813a800 20 remove_watcher() i=7 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f78a40141d0 msgr2=0x7f78a4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f78a40141d0 0x7f78a4015940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555d4d3ace10 msgr2=0x555d4d3af2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555d4d3ace10 0x555d4d3af2d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f789c099060 msgr2=0x7f789c093170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f789c099060 0x7f789c093170 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x555d4d3b30f0 msgr2=0x555d4d3b5590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x555d4d3b30f0 0x555d4d3b5590 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f777c0367e0 msgr2=0x7f777c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f777c0367e0 0x7f777c038ca0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f78a400b010 tx=0x7f78a4020000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 msgr2=0x555d4d3a1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d3a1280 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f789c05dd80 tx=0x7f789c08dbc0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b3e05640 1 -- 172.21.15.133:0/3861057351 reap_dead start 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 shutdown_connections 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 --2- 172.21.15.133:0/3861057351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d39a220 0x555d4d3a1280 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 >> 172.21.15.133:0/3861057351 conn(0x555d4d396580 msgr2=0x555d4d393be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 shutdown_connections 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/3861057351 wait complete. 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/1763450210 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f778c036790 msgr2=0x7f778c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 --2- 172.21.15.133:0/1763450210 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f778c036790 0x7f778c038c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x555d4d37d370 tx=0x7f78a4005840 comp rx=0 tx=0).stop 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/1763450210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d38d060 msgr2=0x555d4d38d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 --2- 172.21.15.133:0/1763450210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d38d060 0x555d4d38d480 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f789c055040 tx=0x7f789c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/1763450210 shutdown_connections 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 --2- 172.21.15.133:0/1763450210 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f778c036790 0x7f778c038c50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 --2- 172.21.15.133:0/1763450210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d38d060 0x555d4d38d480 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/1763450210 >> 172.21.15.133:0/1763450210 conn(0x555d4d381100 msgr2=0x555d4d381500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/1763450210 shutdown_connections 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.861+0000 7f78b813a800 1 -- 172.21.15.133:0/1763450210 wait complete. 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555d4d2825d0 msgr2=0x555d4d37c320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555d4d2825d0 0x555d4d37c320 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f779c0367e0 msgr2=0x7f779c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f779c0367e0 0x7f779c038ca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f789c054000 tx=0x7f789c04e000 comp rx=0 tx=0).stop 2024-02-15T22:56:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 msgr2=0x555d4d3756b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d3756b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c010 tx=0x7f78ac000bc0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 shutdown_connections 2024-02-15T22:56:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x555d4d2825d0 0x555d4d37c320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f779c0367e0 0x7f779c038ca0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 --2- 172.21.15.133:0/2817524634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d4d27eac0 0x555d4d3756b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 >> 172.21.15.133:0/2817524634 conn(0x555d4d2784f0 msgr2=0x555d4d368150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 shutdown_connections 2024-02-15T22:56:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.862+0000 7f78b813a800 1 -- 172.21.15.133:0/2817524634 wait complete. 2024-02-15T22:56:28.877 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1'] 2024-02-15T22:56:28.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1'] 2024-02-15T22:56:28.877 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:28.924 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:28.924 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:28.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.922+0000 7fb086613800 1 Processor -- start 2024-02-15T22:56:28.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.922+0000 7fb086613800 1 -- start start 2024-02-15T22:56:28.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.922+0000 7fb086613800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55dd6b5eb5b0 0x55dd6b5ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.923+0000 7fb086613800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dd6b531c50 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.923+0000 7fb086613800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dd6b4e9450 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.923+0000 7fb081418640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55dd6b5eb5b0 0x55dd6b5ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.923+0000 7fb081c19640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55dd6b5e7aa0 0x55dd6b5e9e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45134/0 (socket says 172.21.15.133:45134) 2024-02-15T22:56:28.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.923+0000 7fb081418640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55dd6b5eb5b0 0x55dd6b5ed9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58716/0 (socket says 172.21.15.133:58716) 2024-02-15T22:56:28.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.923+0000 7fb081c19640 1 -- 172.21.15.133:0/474994125 learned_addr learned my addr 172.21.15.133:0/474994125 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:28.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.923+0000 7fb081418640 1 -- 172.21.15.133:0/474994125 >> v1:172.21.15.52:6789/0 conn(0x55dd6b5e7aa0 legacy=0x55dd6b5e9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.923+0000 7fb081418640 1 -- 172.21.15.133:0/474994125 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd6b5eeef0 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.923+0000 7fb080c17640 1 -- 172.21.15.133:0/474994125 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006990526 0 0) 0x55dd6b531c50 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.925+0000 7fb081418640 1 --2- 172.21.15.133:0/474994125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5eb5b0 0x55dd6b5ed9a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb07800a470 tx=0x7fb07801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9c6a064d78ad84 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.925+0000 7fb080c17640 1 -- 172.21.15.133:0/474994125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb078052570 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.925+0000 7fb080c17640 1 -- 172.21.15.133:0/474994125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0780526d0 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.925+0000 7fb080c17640 1 -- 172.21.15.133:0/474994125 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb078052990 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.926+0000 7fb086613800 1 -- 172.21.15.133:0/474994125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5eb5b0 msgr2=0x55dd6b5ed9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.926+0000 7fb086613800 1 --2- 172.21.15.133:0/474994125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5eb5b0 0x55dd6b5ed9a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb07800a470 tx=0x7fb07801cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.926+0000 7fb086613800 1 -- 172.21.15.133:0/474994125 shutdown_connections 2024-02-15T22:56:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.926+0000 7fb086613800 1 --2- 172.21.15.133:0/474994125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5eb5b0 0x55dd6b5ed9a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.926+0000 7fb086613800 1 -- 172.21.15.133:0/474994125 >> 172.21.15.133:0/474994125 conn(0x55dd6b5e14f0 msgr2=0x55dd6b5e3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.926+0000 7fb086613800 1 -- 172.21.15.133:0/474994125 shutdown_connections 2024-02-15T22:56:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.926+0000 7fb086613800 1 -- 172.21.15.133:0/474994125 wait complete. 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.937+0000 7fb086613800 1 Processor -- start 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.937+0000 7fb086613800 1 -- start start 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.937+0000 7fb086613800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b6d6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.937+0000 7fb086613800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6b4e6980 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.938+0000 7fb081c19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b6d6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.938+0000 7fb081c19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b6d6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58732/0 (socket says 172.21.15.133:58732) 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.938+0000 7fb081c19640 1 -- 172.21.15.133:0/751967700 learned_addr learned my addr 172.21.15.133:0/751967700 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.938+0000 7fb081c19640 1 -- 172.21.15.133:0/751967700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb078005d20 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.938+0000 7fb081c19640 1 --2- 172.21.15.133:0/751967700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b6d6e80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb07400b210 tx=0x7fb07400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6cea66076e95fe server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.938+0000 7faf6fe07640 1 -- 172.21.15.133:0/751967700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb074014070 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.938+0000 7faf6fe07640 1 -- 172.21.15.133:0/751967700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07400d500 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.938+0000 7faf6fe07640 1 -- 172.21.15.133:0/751967700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb07400d800 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.939+0000 7fb086613800 1 -- 172.21.15.133:0/751967700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 msgr2=0x55dd6b6d6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.939+0000 7fb086613800 1 --2- 172.21.15.133:0/751967700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b6d6e80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb07400b210 tx=0x7fb07400b6d0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.939+0000 7fb086613800 1 -- 172.21.15.133:0/751967700 shutdown_connections 2024-02-15T22:56:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.939+0000 7fb086613800 1 --2- 172.21.15.133:0/751967700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b6d6e80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.939+0000 7fb086613800 1 -- 172.21.15.133:0/751967700 >> 172.21.15.133:0/751967700 conn(0x55dd6b5e14f0 msgr2=0x55dd6b6d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.939+0000 7fb086613800 1 -- 172.21.15.133:0/751967700 shutdown_connections 2024-02-15T22:56:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.939+0000 7fb086613800 1 -- 172.21.15.133:0/751967700 wait complete. 2024-02-15T22:56:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.939+0000 7fb086613800 1 Processor -- start 2024-02-15T22:56:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.939+0000 7fb086613800 1 -- start start 2024-02-15T22:56:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7fb086613800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b5e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7fb086613800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6b4e2160 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7fb081c19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b5e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7fb081c19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b5e73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58748/0 (socket says 172.21.15.133:58748) 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7fb081c19640 1 -- 172.21.15.133:0/3613581188 learned_addr learned my addr 172.21.15.133:0/3613581188 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7fb081c19640 1 -- 172.21.15.133:0/3613581188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074001b70 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7fb081c19640 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b5e73c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb07400b210 tx=0x7fb074000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7faf6e604640 1 -- 172.21.15.133:0/3613581188 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb07400f950 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7faf6e604640 1 -- 172.21.15.133:0/3613581188 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb074020070 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dd6b5e7900 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7faf6e604640 1 -- 172.21.15.133:0/3613581188 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb07400fc20 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.940+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd6b5e5e00 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.941+0000 7faf6e604640 1 -- 172.21.15.133:0/3613581188 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb07400d040 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.942+0000 7faf6e604640 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf680367e0 0x7faf68038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.942+0000 7faf6e604640 1 -- 172.21.15.133:0/3613581188 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fb07400a040 con 0x55dd6b5e7aa0 2024-02-15T22:56:28.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.942+0000 7fb081418640 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf680367e0 0x7faf68038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.942+0000 7fb086613800 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55dd6b5eb5b0 0x55dd6b6e7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.942+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b6e7980 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.942+0000 7fb08241a640 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55dd6b5eb5b0 0x55dd6b6e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.942+0000 7fb081418640 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf680367e0 0x7faf68038ca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb078054000 tx=0x7fb07804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.942+0000 7fb08241a640 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55dd6b5eb5b0 0x55dd6b6e7440 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.942+0000 7fb08241a640 1 -- 172.21.15.133:0/3613581188 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb07c00a4a0 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.942+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b5e6130 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.943+0000 7fb08241a640 1 -- 172.21.15.133:0/3613581188 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb07c00a4a0 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.943+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b6e9680 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.943+0000 7fb08241a640 1 -- 172.21.15.133:0/3613581188 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb07c00a4a0 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.943+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b6e8880 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.943+0000 7fb08241a640 1 -- 172.21.15.133:0/3613581188 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb07c00a4a0 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.943+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b6e8c90 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.943+0000 7fb08241a640 1 -- 172.21.15.133:0/3613581188 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb07c00a4a0 con 0x55dd6b5eb5b0 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.944+0000 7fb086613800 1 Processor -- start 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.944+0000 7fb086613800 1 -- start start 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.944+0000 7fb086613800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b6f8060 0x55dd6b6f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.944+0000 7fb086613800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6b484e80 con 0x55dd6b6f8060 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.944+0000 7fb081418640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b6f8060 0x55dd6b6f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.944+0000 7fb081418640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b6f8060 0x55dd6b6f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58764/0 (socket says 172.21.15.133:58764) 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.944+0000 7fb081418640 1 -- 172.21.15.133:0/4221896679 learned_addr learned my addr 172.21.15.133:0/4221896679 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.945+0000 7fb081418640 1 -- 172.21.15.133:0/4221896679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd6b6f89c0 con 0x55dd6b6f8060 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.945+0000 7fb081418640 1 --2- 172.21.15.133:0/4221896679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b6f8060 0x55dd6b6f8480 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb078000c00 tx=0x7fb078002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.945+0000 7faf677fe640 1 -- 172.21.15.133:0/4221896679 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb07805d930 con 0x55dd6b6f8060 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.945+0000 7faf677fe640 1 -- 172.21.15.133:0/4221896679 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07805da90 con 0x55dd6b6f8060 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.945+0000 7faf677fe640 1 -- 172.21.15.133:0/4221896679 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb07805dd30 con 0x55dd6b6f8060 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.945+0000 7fb086613800 1 -- 172.21.15.133:0/4221896679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dd6b6f8bb0 con 0x55dd6b6f8060 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.945+0000 7fb086613800 1 -- 172.21.15.133:0/4221896679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd6b6f96a0 con 0x55dd6b6f8060 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.946+0000 7faf677fe640 1 -- 172.21.15.133:0/4221896679 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb078066040 con 0x55dd6b6f8060 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.946+0000 7faf677fe640 1 --2- 172.21.15.133:0/4221896679 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf5c0367e0 0x7faf5c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.946+0000 7faf677fe640 1 -- 172.21.15.133:0/4221896679 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fb078063040 con 0x55dd6b6f8060 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.946+0000 7fb08241a640 1 --2- 172.21.15.133:0/4221896679 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf5c0367e0 0x7faf5c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.946+0000 7fb086613800 1 Processor -- start 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.946+0000 7fb086613800 1 -- start start 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.946+0000 7fb08241a640 1 --2- 172.21.15.133:0/4221896679 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf5c0367e0 0x7faf5c038ca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55dd6b6e82c0 tx=0x7fb07c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.946+0000 7fb086613800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b705600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.946+0000 7fb086613800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6b45a5d0 con 0x55dd6b7051e0 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.946+0000 7fb081418640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b705600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.947+0000 7fb081418640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b705600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58780/0 (socket says 172.21.15.133:58780) 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.947+0000 7fb081418640 1 -- 172.21.15.133:0/687732976 learned_addr learned my addr 172.21.15.133:0/687732976 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.947+0000 7fb081418640 1 -- 172.21.15.133:0/687732976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd6b705bf0 con 0x55dd6b7051e0 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.947+0000 7fb081418640 1 --2- 172.21.15.133:0/687732976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b705600 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb078052460 tx=0x7fb07805cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423ab0ad2d60e38a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.947+0000 7faf657fa640 1 -- 172.21.15.133:0/687732976 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb078067390 con 0x55dd6b7051e0 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.947+0000 7faf657fa640 1 -- 172.21.15.133:0/687732976 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0780674f0 con 0x55dd6b7051e0 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.947+0000 7faf657fa640 1 -- 172.21.15.133:0/687732976 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb078071cc0 con 0x55dd6b7051e0 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.947+0000 7fb086613800 1 -- 172.21.15.133:0/687732976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 msgr2=0x55dd6b705600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.947+0000 7fb086613800 1 --2- 172.21.15.133:0/687732976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b705600 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb078052460 tx=0x7fb07805cf80 comp rx=0 tx=0).stop 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb086613800 1 -- 172.21.15.133:0/687732976 shutdown_connections 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb086613800 1 --2- 172.21.15.133:0/687732976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b705600 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb086613800 1 -- 172.21.15.133:0/687732976 >> 172.21.15.133:0/687732976 conn(0x55dd6b701520 msgr2=0x55dd6b6ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb086613800 1 -- 172.21.15.133:0/687732976 shutdown_connections 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb086613800 1 -- 172.21.15.133:0/687732976 wait complete. 2024-02-15T22:56:28.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb086613800 1 Processor -- start 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb086613800 1 -- start start 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb086613800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b70c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb086613800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6b70c740 con 0x55dd6b7051e0 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb081418640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b70c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb081418640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b70c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58782/0 (socket says 172.21.15.133:58782) 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.948+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 learned_addr learned my addr 172.21.15.133:0/2344536463 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.949+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd6b6f96a0 con 0x55dd6b7051e0 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.949+0000 7fb081418640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b70c200 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb078052460 tx=0x7fb07808df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.949+0000 7faf537fe640 1 -- 172.21.15.133:0/2344536463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb07808c070 con 0x55dd6b7051e0 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.949+0000 7faf537fe640 1 -- 172.21.15.133:0/2344536463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07808faf0 con 0x55dd6b7051e0 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.949+0000 7faf537fe640 1 -- 172.21.15.133:0/2344536463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb07808fdd0 con 0x55dd6b7051e0 2024-02-15T22:56:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.949+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dd6b70c940 con 0x55dd6b7051e0 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.949+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd6b70c940 con 0x55dd6b7051e0 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.950+0000 7faf537fe640 1 -- 172.21.15.133:0/2344536463 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb078009410 con 0x55dd6b7051e0 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.950+0000 7faf537fe640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf4c036790 0x7faf4c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.950+0000 7faf537fe640 1 -- 172.21.15.133:0/2344536463 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fb078099b00 con 0x55dd6b7051e0 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.950+0000 7fb08241a640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf4c036790 0x7faf4c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.950+0000 7fb08241a640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf4c036790 0x7faf4c038c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00b010 tx=0x7fb07c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.950+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.950+0000 7fb086613800 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55dd6b717c90 0x55dd6b71a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.950+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71a8a0 con 0x55dd6b717c90 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.950+0000 7fb081c19640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55dd6b717c90 0x55dd6b71a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb081c19640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55dd6b717c90 0x55dd6b71a150 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb074016070 con 0x55dd6b717c90 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb086613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb086613800 20 realm 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71ac70 con 0x55dd6b717c90 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb074016070 con 0x55dd6b717c90 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb086613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb086613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71b4f0 con 0x55dd6b717c90 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb074016070 con 0x55dd6b717c90 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb086613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.951+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71b850 con 0x55dd6b717c90 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.952+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb074016070 con 0x55dd6b717c90 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.952+0000 7fb086613800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.952+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.952+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71c050 con 0x55dd6b717c90 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.952+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb074016070 con 0x55dd6b717c90 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.952+0000 7fb086613800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.952+0000 7fb086613800 20 searching for the correct realm 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.952+0000 7fb086613800 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55dd6b71df70 0x55dd6b7203f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.952+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b71df70 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.952+0000 7fb081418640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55dd6b71df70 0x55dd6b7203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.952+0000 7fb081418640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55dd6b71df70 0x55dd6b7203f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.953+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb07806e020 con 0x55dd6b71df70 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.953+0000 7fb081418640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb078098070 0x7fb07808c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.953+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb078098070 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.953+0000 7fb08241a640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb078098070 0x7fb07808c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.953+0000 7fb08241a640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb078098070 0x7fb07808c630 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.953+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb07c00a4a0 con 0x7fb078098070 2024-02-15T22:56:28.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.953+0000 7fb08241a640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb07c0141d0 0x7fb07c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:28.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.953+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb07c0141d0 2024-02-15T22:56:28.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.954+0000 7fb081c19640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb07c0141d0 0x7fb07c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:28.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.954+0000 7fb081c19640 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb07c0141d0 0x7fb07c015940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:28.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.955+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074016070 con 0x7fb07c0141d0 2024-02-15T22:56:28.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.955+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b717c90 2024-02-15T22:56:28.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.955+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074016070 con 0x55dd6b717c90 2024-02-15T22:56:28.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.955+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b717c90 2024-02-15T22:56:28.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.955+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074016070 con 0x55dd6b717c90 2024-02-15T22:56:28.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.955+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb07c0141d0 2024-02-15T22:56:28.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.955+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074016070 con 0x7fb07c0141d0 2024-02-15T22:56:28.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.955+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb07c0141d0 2024-02-15T22:56:28.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.955+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074016070 con 0x7fb07c0141d0 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.956+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb078098070 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.956+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb07c00a4a0 con 0x7fb078098070 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.956+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b71df70 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.956+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb07806e020 con 0x55dd6b71df70 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.956+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b717c90 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.956+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074016070 con 0x55dd6b717c90 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.956+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb07c0141d0 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.957+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074016070 con 0x7fb07c0141d0 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.957+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b717c90 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.957+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074016070 con 0x55dd6b717c90 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.957+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb078098070 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.957+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.957+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b71df70 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.957+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.957+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b71df70 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.958+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.958+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb07c0141d0 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.958+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074016070 con 0x7fb07c0141d0 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.958+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b71df70 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.958+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.958+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b71df70 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.958+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.958+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b717c90 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.959+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074016070 con 0x55dd6b717c90 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.959+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b717c90 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.959+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb074016070 con 0x55dd6b717c90 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.959+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb07c0141d0 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.959+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.959+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b71df70 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.960+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.960+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb078098070 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.960+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.960+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b717c90 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.960+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.960+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb07c0141d0 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.960+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.960+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b71df70 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.961+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.961+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb07c0141d0 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.961+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.961+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb078098070 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.961+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.961+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b71df70 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.961+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.961+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb07c0141d0 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.962+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.962+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x55dd6b717c90 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.962+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.962+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b720ac0 con 0x7fb078098070 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.962+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.962+0000 7fb086613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:28.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71d550 con 0x55dd6b717c90 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71cda0 con 0x55dd6b717c90 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71c530 con 0x55dd6b717c90 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 zone default found 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 4 Realm: () 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:28.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 zonegroup default 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.963+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71cda0 con 0x7fb07c0141d0 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb086613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b7228e0 con 0x55dd6b71df70 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb086613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b722c40 con 0x55dd6b71df70 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb086613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:28.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb086613800 20 started sync module instance, tier type = 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb086613800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.964+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71cbb0 con 0x7fb078098070 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.965+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.965+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94409478774048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b722ff0 con 0x7fb078098070 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.965+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b7237f0 con 0x55dd6b717c90 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.966+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94409478774048] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.966+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.966+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94409478778864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b7238b0 con 0x55dd6b717c90 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.966+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b724220 con 0x55dd6b71df70 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.967+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94409478778864] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.967+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.967+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94409478779920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b723830 con 0x55dd6b71df70 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.967+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b725080 con 0x7fb078098070 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.968+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94409478779920] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.968+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.968+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94409478786016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b7254a0 con 0x7fb078098070 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.968+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b725e10 con 0x55dd6b717c90 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.969+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.969+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94409478789488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b725dd0 con 0x55dd6b717c90 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.969+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94409478786016] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.969+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b726d90 con 0x7fb07c0141d0 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.970+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94409478789488] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.970+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.970+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94409478787152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b726010 con 0x7fb07c0141d0 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.970+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b727230 con 0x7fb07c0141d0 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.971+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.971+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94409478794640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b727690 con 0x7fb07c0141d0 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.971+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b728130 con 0x7fb07c0141d0 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.972+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94409478787152] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.972+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94409478794640] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.972+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.972+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94409478798352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b7271b0 con 0x7fb07c0141d0 2024-02-15T22:56:28.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.972+0000 7fb086613800 20 add_watcher() i=0 2024-02-15T22:56:28.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.972+0000 7fb086613800 20 add_watcher() i=1 2024-02-15T22:56:28.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.972+0000 7fb086613800 20 add_watcher() i=2 2024-02-15T22:56:28.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.972+0000 7fb086613800 20 add_watcher() i=3 2024-02-15T22:56:28.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.972+0000 7fb086613800 20 add_watcher() i=4 2024-02-15T22:56:28.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.972+0000 7fb086613800 20 add_watcher() i=5 2024-02-15T22:56:28.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.972+0000 7fb086613800 20 add_watcher() i=6 2024-02-15T22:56:28.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.973+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94409478798352] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.973+0000 7fb086613800 20 add_watcher() i=7 2024-02-15T22:56:28.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.973+0000 7fb086613800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:28.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.973+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b72b150 con 0x55dd6b717c90 2024-02-15T22:56:28.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.974+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.974+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94409478793392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b728590 con 0x55dd6b717c90 2024-02-15T22:56:28.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94409478793392] v30'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7faf337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7fb086613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7fb086613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7fb086613800 5 note: GC not initialized 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7faf327fc640 20 reqs_thread_entry: start 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7fb086613800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7fb086613800 20 Filter name: none 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7faea3fff640 20 reqs_thread_entry: start 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7fb086613800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.975+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b75d220 con 0x55dd6b717c90 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b75edc0 con 0x7fb078098070 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 : miss 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 20 rados->read ofs=0 len=0 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.976+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b7607f0 con 0x55dd6b71df70 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.977+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.977+0000 7fb086613800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.977+0000 7fb086613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:28.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.977+0000 7fb086613800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.977+0000 7fb086613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.977+0000 7fb086613800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.977+0000 7fb086613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.977+0000 7fb086613800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.977+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b7650c0 con 0x7fb07c0141d0 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.978+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(65 fud.buckets [call] v30'3 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.978+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b76b060 con 0x55dd6b71df70 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(66 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'3 uv3 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7fb086613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7fb086613800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7fb086613800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7fb086613800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1, ofs0, ns] 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94409479032432 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b765950 con 0x55dd6b717c90 2024-02-15T22:56:28.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== watch-notify(notify (1) cookie 94409478789488 notify 128849018893 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55dd6b5e5e00 con 0x55dd6b717c90 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7faf657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94409478789488 notifier 4516 bl.length()=725 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7faf657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7faf657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(67 notify.4 [notify cookie 94409479032432 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7faf657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7faf657fa640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7faf44003e90 con 0x55dd6b717c90 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.979+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.980+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== watch-notify(notify_complete (2) cookie 94409479032432 notify 128849018893 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fb074001b70 con 0x55dd6b717c90 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.980+0000 7fb086613800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_sources= new_sources= 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.980+0000 7fb086613800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential sources added=[] removed=[] 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.980+0000 7fb086613800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_dests= new_dests= 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.980+0000 7fb086613800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential dests added=[] removed=[] 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.980+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b760f70 con 0x7fb078098070 2024-02-15T22:56:28.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.981+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(69 foo.buckets [call] v30'22 uv22 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.981+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b760f70 con 0x7fb078098070 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7fb086613800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7fb086613800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7fb086613800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94409479019888 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b760f70 con 0x7fb07c0141d0 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== watch-notify(notify (1) cookie 94409478794640 notify 128849018894 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7fb074001b70 con 0x7fb07c0141d0 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7faf657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94409478794640 notifier 4516 bl.length()=314 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7faf657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7faf657fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.6 [notify cookie 94409479019888 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7faf657fa640 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7faf440041f0 con 0x7fb07c0141d0 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.982+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.983+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== watch-notify(notify_complete (2) cookie 94409479019888 notify 128849018894 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fb078005d20 con 0x7fb07c0141d0 2024-02-15T22:56:28.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.983+0000 7faf337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.983+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94409478793392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b760f70 con 0x55dd6b717c90 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.984+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94409478793392] v30'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.984+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94409478774048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b760f70 con 0x7fb078098070 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.985+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94409478774048] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.985+0000 7fb086613800 20 remove_watcher() i=0 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.985+0000 7fb086613800 2 removed watcher, disabling cache 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.985+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94409478778864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71d550 con 0x55dd6b717c90 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.986+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94409478778864] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.986+0000 7fb086613800 20 remove_watcher() i=1 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.986+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94409478779920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b71d550 con 0x55dd6b71df70 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.987+0000 7fb081418640 1 -- 172.21.15.133:0/2344536463 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94409478779920] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb0780ab040 con 0x55dd6b71df70 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.987+0000 7fb086613800 20 remove_watcher() i=2 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.987+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94409478786016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b723490 con 0x7fb078098070 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.988+0000 7fb08241a640 1 -- 172.21.15.133:0/2344536463 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94409478786016] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb07c03a040 con 0x7fb078098070 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.988+0000 7fb086613800 20 remove_watcher() i=3 2024-02-15T22:56:28.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.988+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94409478789488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b723490 con 0x55dd6b717c90 2024-02-15T22:56:29.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.989+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94409478789488] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x55dd6b717c90 2024-02-15T22:56:29.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.989+0000 7fb086613800 20 remove_watcher() i=4 2024-02-15T22:56:29.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.989+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94409478787152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b723490 con 0x7fb07c0141d0 2024-02-15T22:56:29.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.990+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94409478787152] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:29.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.990+0000 7fb086613800 20 remove_watcher() i=5 2024-02-15T22:56:29.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.990+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94409478794640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b723490 con 0x7fb07c0141d0 2024-02-15T22:56:29.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.991+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94409478794640] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:29.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.991+0000 7fb086613800 20 remove_watcher() i=6 2024-02-15T22:56:29.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.991+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94409478798352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd6b723490 con 0x7fb07c0141d0 2024-02-15T22:56:29.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94409478798352] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb074054040 con 0x7fb07c0141d0 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 20 remove_watcher() i=7 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb07c0141d0 msgr2=0x7fb07c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb07c0141d0 0x7fb07c015940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55dd6b717c90 msgr2=0x55dd6b71a150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55dd6b717c90 0x55dd6b71a150 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb078098070 msgr2=0x7fb07808c630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb078098070 0x7fb07808c630 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55dd6b71df70 msgr2=0x55dd6b7203f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55dd6b71df70 0x55dd6b7203f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf4c036790 msgr2=0x7faf4c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf4c036790 0x7faf4c038c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00b010 tx=0x7fb07c020000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 msgr2=0x55dd6b70c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb081c19640 1 -- 172.21.15.133:0/2344536463 reap_dead start 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b70c200 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb078052460 tx=0x7fb07808df50 comp rx=0 tx=0).stop 2024-02-15T22:56:29.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 shutdown_connections 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 --2- 172.21.15.133:0/2344536463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b7051e0 0x55dd6b70c200 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 >> 172.21.15.133:0/2344536463 conn(0x55dd6b701520 msgr2=0x55dd6b6feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 shutdown_connections 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.992+0000 7fb086613800 1 -- 172.21.15.133:0/2344536463 wait complete. 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/4221896679 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf5c0367e0 msgr2=0x7faf5c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 --2- 172.21.15.133:0/4221896679 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf5c0367e0 0x7faf5c038ca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55dd6b6e82c0 tx=0x7fb07c005840 comp rx=0 tx=0).stop 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/4221896679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b6f8060 msgr2=0x55dd6b6f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 --2- 172.21.15.133:0/4221896679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b6f8060 0x55dd6b6f8480 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb078000c00 tx=0x7fb078002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/4221896679 shutdown_connections 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 --2- 172.21.15.133:0/4221896679 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf5c0367e0 0x7faf5c038ca0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 --2- 172.21.15.133:0/4221896679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b6f8060 0x55dd6b6f8480 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/4221896679 >> 172.21.15.133:0/4221896679 conn(0x55dd6b6ec100 msgr2=0x55dd6b6ec500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/4221896679 shutdown_connections 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/4221896679 wait complete. 2024-02-15T22:56:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55dd6b5eb5b0 msgr2=0x55dd6b6e7440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55dd6b5eb5b0 0x55dd6b6e7440 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf680367e0 msgr2=0x7faf68038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf680367e0 0x7faf68038ca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb078054000 tx=0x7fb07804e000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 msgr2=0x55dd6b5e73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b5e73c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb07400b210 tx=0x7fb074000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 shutdown_connections 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55dd6b5eb5b0 0x55dd6b6e7440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf680367e0 0x7faf68038ca0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 --2- 172.21.15.133:0/3613581188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd6b5e7aa0 0x55dd6b5e73c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 >> 172.21.15.133:0/3613581188 conn(0x55dd6b5e14f0 msgr2=0x55dd6b6d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 shutdown_connections 2024-02-15T22:56:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:28.993+0000 7fb086613800 1 -- 172.21.15.133:0/3613581188 wait complete. 2024-02-15T22:56:29.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-15T22:56:29.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-15T22:56:29.005 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-15T22:56:29.048 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:29.048 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:29.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.046+0000 7f5e44333800 1 Processor -- start 2024-02-15T22:56:29.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.046+0000 7f5e44333800 1 -- start start 2024-02-15T22:56:29.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.046+0000 7f5e44333800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5562ed69c020 0x5562ed69c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.046+0000 7f5e44333800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5562ed5e6bb0 con 0x5562ed69d280 2024-02-15T22:56:29.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.046+0000 7f5e44333800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5562ed59e450 con 0x5562ed69c020 2024-02-15T22:56:29.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.047+0000 7f5e3fffa640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5562ed69c020 0x5562ed69c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.047+0000 7f5e3fffa640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5562ed69c020 0x5562ed69c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58798/0 (socket says 172.21.15.133:58798) 2024-02-15T22:56:29.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.047+0000 7f5e3fffa640 1 -- 172.21.15.133:0/1760235544 learned_addr learned my addr 172.21.15.133:0/1760235544 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.047+0000 7f5e377f9640 1 --1- 172.21.15.133:0/1760235544 >> v1:172.21.15.52:6789/0 conn(0x5562ed69d280 0x5562ed69d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45144/0 (socket says 172.21.15.133:45144) 2024-02-15T22:56:29.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.047+0000 7f5e3fffa640 1 -- 172.21.15.133:0/1760235544 >> v1:172.21.15.52:6789/0 conn(0x5562ed69d280 legacy=0x5562ed69d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.047+0000 7f5e3fffa640 1 -- 172.21.15.133:0/1760235544 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562ed69cb10 con 0x5562ed69c020 2024-02-15T22:56:29.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.049+0000 7f5e3fffa640 1 --2- 172.21.15.133:0/1760235544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed69c440 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000a520 tx=0x7f5e3001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e3f179c676f74f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.049+0000 7f5e3f7f9640 1 -- 172.21.15.133:0/1760235544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e30052570 con 0x5562ed69c020 2024-02-15T22:56:29.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.049+0000 7f5e3f7f9640 1 -- 172.21.15.133:0/1760235544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e300526d0 con 0x5562ed69c020 2024-02-15T22:56:29.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.049+0000 7f5e3f7f9640 1 -- 172.21.15.133:0/1760235544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e30052990 con 0x5562ed69c020 2024-02-15T22:56:29.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.049+0000 7f5e44333800 1 -- 172.21.15.133:0/1760235544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 msgr2=0x5562ed69c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.049+0000 7f5e44333800 1 --2- 172.21.15.133:0/1760235544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed69c440 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000a520 tx=0x7f5e3001cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.049+0000 7f5e44333800 1 -- 172.21.15.133:0/1760235544 shutdown_connections 2024-02-15T22:56:29.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.049+0000 7f5e44333800 1 --2- 172.21.15.133:0/1760235544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed69c440 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.049+0000 7f5e44333800 1 -- 172.21.15.133:0/1760235544 >> 172.21.15.133:0/1760235544 conn(0x5562ed6975c0 msgr2=0x5562ed6999e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.049+0000 7f5e44333800 1 -- 172.21.15.133:0/1760235544 shutdown_connections 2024-02-15T22:56:29.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.049+0000 7f5e44333800 1 -- 172.21.15.133:0/1760235544 wait complete. 2024-02-15T22:56:29.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.061+0000 7f5e44333800 1 Processor -- start 2024-02-15T22:56:29.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.061+0000 7f5e44333800 1 -- start start 2024-02-15T22:56:29.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.061+0000 7f5e44333800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed78c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.061+0000 7f5e44333800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562ed59b980 con 0x5562ed69c020 2024-02-15T22:56:29.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.061+0000 7f5e3fffa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed78c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.062+0000 7f5e3fffa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed78c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58814/0 (socket says 172.21.15.133:58814) 2024-02-15T22:56:29.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.062+0000 7f5e3fffa640 1 -- 172.21.15.133:0/1304949072 learned_addr learned my addr 172.21.15.133:0/1304949072 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.062+0000 7f5e3fffa640 1 -- 172.21.15.133:0/1304949072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30005de0 con 0x5562ed69c020 2024-02-15T22:56:29.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.062+0000 7f5e3fffa640 1 --2- 172.21.15.133:0/1304949072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed78c3e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5e30055040 tx=0x7f5e3004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5b96b9fa9b7197 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.062+0000 7f5d2de0b640 1 -- 172.21.15.133:0/1304949072 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e30052840 con 0x5562ed69c020 2024-02-15T22:56:29.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.062+0000 7f5d2de0b640 1 -- 172.21.15.133:0/1304949072 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e300529c0 con 0x5562ed69c020 2024-02-15T22:56:29.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.062+0000 7f5d2de0b640 1 -- 172.21.15.133:0/1304949072 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e30052ca0 con 0x5562ed69c020 2024-02-15T22:56:29.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.063+0000 7f5e44333800 1 -- 172.21.15.133:0/1304949072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 msgr2=0x5562ed78c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.063+0000 7f5e44333800 1 --2- 172.21.15.133:0/1304949072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed78c3e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5e30055040 tx=0x7f5e3004c000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.063+0000 7f5e44333800 1 -- 172.21.15.133:0/1304949072 shutdown_connections 2024-02-15T22:56:29.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.063+0000 7f5e44333800 1 --2- 172.21.15.133:0/1304949072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed78c3e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.063+0000 7f5e44333800 1 -- 172.21.15.133:0/1304949072 >> 172.21.15.133:0/1304949072 conn(0x5562ed6975c0 msgr2=0x5562ed787d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.063+0000 7f5e44333800 1 -- 172.21.15.133:0/1304949072 shutdown_connections 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.063+0000 7f5e44333800 1 -- 172.21.15.133:0/1304949072 wait complete. 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.063+0000 7f5e44333800 1 Processor -- start 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.063+0000 7f5e44333800 1 -- start start 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.063+0000 7f5e44333800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed611050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.063+0000 7f5e44333800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562ed597160 con 0x5562ed69c020 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.064+0000 7f5e3fffa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed611050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.064+0000 7f5e3fffa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed611050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58820/0 (socket says 172.21.15.133:58820) 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.064+0000 7f5e3fffa640 1 -- 172.21.15.133:0/517681636 learned_addr learned my addr 172.21.15.133:0/517681636 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.064+0000 7f5e3fffa640 1 -- 172.21.15.133:0/517681636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3004e070 con 0x5562ed69c020 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.064+0000 7f5e3fffa640 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed611050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5e3001ceb0 tx=0x7f5e30002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.064+0000 7f5d27fff640 1 -- 172.21.15.133:0/517681636 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e3006c070 con 0x5562ed69c020 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.064+0000 7f5d27fff640 1 -- 172.21.15.133:0/517681636 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3005d480 con 0x5562ed69c020 2024-02-15T22:56:29.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.064+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5562ed60f740 con 0x5562ed69c020 2024-02-15T22:56:29.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.064+0000 7f5d27fff640 1 -- 172.21.15.133:0/517681636 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e3005d760 con 0x5562ed69c020 2024-02-15T22:56:29.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.064+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562ed60fc80 con 0x5562ed69c020 2024-02-15T22:56:29.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.065+0000 7f5d27fff640 1 -- 172.21.15.133:0/517681636 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5e30059040 con 0x5562ed69c020 2024-02-15T22:56:29.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.065+0000 7f5d27fff640 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d280367e0 0x7f5d28038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.065+0000 7f5d27fff640 1 -- 172.21.15.133:0/517681636 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f5e3008d260 con 0x5562ed69c020 2024-02-15T22:56:29.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.065+0000 7f5e377f9640 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d280367e0 0x7f5d28038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.065+0000 7f5e44333800 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5562ed69d280 0x5562ed79cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.065+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed610360 con 0x5562ed69d280 2024-02-15T22:56:29.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.066+0000 7f5e407fb640 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5562ed69d280 0x5562ed79cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.066+0000 7f5e377f9640 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d280367e0 0x7f5d28038ca0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e28000f60 tx=0x7f5e28001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.066+0000 7f5e407fb640 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5562ed69d280 0x5562ed79cd10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.066+0000 7f5e407fb640 1 -- 172.21.15.133:0/517681636 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5e3800a4a0 con 0x5562ed69d280 2024-02-15T22:56:29.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.066+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed79d250 con 0x5562ed69d280 2024-02-15T22:56:29.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.066+0000 7f5e407fb640 1 -- 172.21.15.133:0/517681636 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5e3800a4a0 con 0x5562ed69d280 2024-02-15T22:56:29.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.066+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed79eab0 con 0x5562ed69d280 2024-02-15T22:56:29.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.067+0000 7f5e407fb640 1 -- 172.21.15.133:0/517681636 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f5e3800a4a0 con 0x5562ed69d280 2024-02-15T22:56:29.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.067+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed79dcb0 con 0x5562ed69d280 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.067+0000 7f5e407fb640 1 -- 172.21.15.133:0/517681636 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5e3800a4a0 con 0x5562ed69d280 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.067+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed79e0c0 con 0x5562ed69d280 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.067+0000 7f5e407fb640 1 -- 172.21.15.133:0/517681636 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5e3800a4a0 con 0x5562ed69d280 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.068+0000 7f5e44333800 1 Processor -- start 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.068+0000 7f5e44333800 1 -- start start 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.068+0000 7f5e44333800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ad510 0x5562ed7ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.068+0000 7f5e44333800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562ed539e80 con 0x5562ed7ad510 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.068+0000 7f5e377f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ad510 0x5562ed7ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.068+0000 7f5e377f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ad510 0x5562ed7ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58822/0 (socket says 172.21.15.133:58822) 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.068+0000 7f5e377f9640 1 -- 172.21.15.133:0/1687401173 learned_addr learned my addr 172.21.15.133:0/1687401173 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.068+0000 7f5e377f9640 1 -- 172.21.15.133:0/1687401173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562ed7ade70 con 0x5562ed7ad510 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.068+0000 7f5e377f9640 1 --2- 172.21.15.133:0/1687401173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ad510 0x5562ed7ad930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5e28001ed0 tx=0x7f5e2800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.068+0000 7f5d257fa640 1 -- 172.21.15.133:0/1687401173 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e2800bec0 con 0x5562ed7ad510 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.069+0000 7f5d257fa640 1 -- 172.21.15.133:0/1687401173 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2800d520 con 0x5562ed7ad510 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.069+0000 7f5e44333800 1 -- 172.21.15.133:0/1687401173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5562ed7ae8e0 con 0x5562ed7ad510 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.069+0000 7f5d257fa640 1 -- 172.21.15.133:0/1687401173 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e2800d7c0 con 0x5562ed7ad510 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.069+0000 7f5e44333800 1 -- 172.21.15.133:0/1687401173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562ed7aeda0 con 0x5562ed7ad510 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.069+0000 7f5d257fa640 1 -- 172.21.15.133:0/1687401173 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5e2801a070 con 0x5562ed7ad510 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.069+0000 7f5d257fa640 1 --2- 172.21.15.133:0/1687401173 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d180367e0 0x7f5d18038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.069+0000 7f5d257fa640 1 -- 172.21.15.133:0/1687401173 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f5e28017050 con 0x5562ed7ad510 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.070+0000 7f5e407fb640 1 --2- 172.21.15.133:0/1687401173 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d180367e0 0x7f5d18038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.070+0000 7f5e44333800 1 Processor -- start 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.070+0000 7f5e44333800 1 -- start start 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.070+0000 7f5e407fb640 1 --2- 172.21.15.133:0/1687401173 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d180367e0 0x7f5d18038ca0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5562ed79d6f0 tx=0x7f5e38005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.070+0000 7f5e44333800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7bab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.070+0000 7f5e44333800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562ed50f5d0 con 0x5562ed7ba730 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.070+0000 7f5e377f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7bab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.070+0000 7f5e377f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7bab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58828/0 (socket says 172.21.15.133:58828) 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.070+0000 7f5e377f9640 1 -- 172.21.15.133:0/1567933732 learned_addr learned my addr 172.21.15.133:0/1567933732 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.070+0000 7f5e377f9640 1 -- 172.21.15.133:0/1567933732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562ed7bb120 con 0x5562ed7ba730 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.071+0000 7f5e377f9640 1 --2- 172.21.15.133:0/1567933732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7bab50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5e28027030 tx=0x7f5e28024560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f66afdc7fb4efd server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.071+0000 7f5d1effd640 1 -- 172.21.15.133:0/1567933732 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e2804d0d0 con 0x5562ed7ba730 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.071+0000 7f5d1effd640 1 -- 172.21.15.133:0/1567933732 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2804d230 con 0x5562ed7ba730 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.071+0000 7f5d1effd640 1 -- 172.21.15.133:0/1567933732 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e2804a340 con 0x5562ed7ba730 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.071+0000 7f5e44333800 1 -- 172.21.15.133:0/1567933732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 msgr2=0x5562ed7bab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.071+0000 7f5e44333800 1 --2- 172.21.15.133:0/1567933732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7bab50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5e28027030 tx=0x7f5e28024560 comp rx=0 tx=0).stop 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.071+0000 7f5e44333800 1 -- 172.21.15.133:0/1567933732 shutdown_connections 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.071+0000 7f5e44333800 1 --2- 172.21.15.133:0/1567933732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7bab50 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.071+0000 7f5e44333800 1 -- 172.21.15.133:0/1567933732 >> 172.21.15.133:0/1567933732 conn(0x5562ed7b6a90 msgr2=0x5562ed7b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.071+0000 7f5e44333800 1 -- 172.21.15.133:0/1567933732 shutdown_connections 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.071+0000 7f5e44333800 1 -- 172.21.15.133:0/1567933732 wait complete. 2024-02-15T22:56:29.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.072+0000 7f5e44333800 1 Processor -- start 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.072+0000 7f5e44333800 1 -- start start 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.072+0000 7f5e44333800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7c1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.072+0000 7f5e44333800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562ed7c1cb0 con 0x5562ed7ba730 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.072+0000 7f5e377f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.072+0000 7f5e377f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58830/0 (socket says 172.21.15.133:58830) 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.072+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 learned_addr learned my addr 172.21.15.133:0/3254125219 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.073+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562ed7aeda0 con 0x5562ed7ba730 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.073+0000 7f5e377f9640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7c1770 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5e28025750 tx=0x7f5e2804b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.073+0000 7f5d1d7fa640 1 -- 172.21.15.133:0/3254125219 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e2804d0d0 con 0x5562ed7ba730 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.073+0000 7f5d1d7fa640 1 -- 172.21.15.133:0/3254125219 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2801a320 con 0x5562ed7ba730 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.073+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5562ed7c1eb0 con 0x5562ed7ba730 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.073+0000 7f5d1d7fa640 1 -- 172.21.15.133:0/3254125219 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e2801a5e0 con 0x5562ed7ba730 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.073+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562ed7c2370 con 0x5562ed7ba730 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.074+0000 7f5d1d7fa640 1 -- 172.21.15.133:0/3254125219 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5e2801a740 con 0x5562ed7ba730 2024-02-15T22:56:29.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.074+0000 7f5d1d7fa640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d080367e0 0x7f5d08038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.074+0000 7f5d1d7fa640 1 -- 172.21.15.133:0/3254125219 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f5e28046bb0 con 0x5562ed7ba730 2024-02-15T22:56:29.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.074+0000 7f5e407fb640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d080367e0 0x7f5d08038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.074+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.074+0000 7f5e44333800 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5562ed7cd3b0 0x5562ed7cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.074+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7cffc0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.074+0000 7f5e407fb640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d080367e0 0x7f5d08038ca0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800b010 tx=0x7f5e38020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.074+0000 7f5e3fffa640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5562ed7cd3b0 0x5562ed7cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e3fffa640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5562ed7cd3b0 0x5562ed7cf870 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5e3005dc40 con 0x5562ed7cd3b0 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 20 realm 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d0390 con 0x5562ed7cd3b0 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5e3005dc40 con 0x5562ed7cd3b0 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:29.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d0c10 con 0x5562ed7cd3b0 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5e3005dc40 con 0x5562ed7cd3b0 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d0f70 con 0x5562ed7cd3b0 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5e3005dc40 con 0x5562ed7cd3b0 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.075+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d1770 con 0x5562ed7cd3b0 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.076+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f5e3005dc40 con 0x5562ed7cd3b0 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.076+0000 7f5e44333800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.076+0000 7f5e44333800 20 searching for the correct realm 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.076+0000 7f5e44333800 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5562ed7d3650 0x5562ed7d5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.076+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7d3650 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.076+0000 7f5e377f9640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5562ed7d3650 0x5562ed7d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.076+0000 7f5e377f9640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5562ed7d3650 0x5562ed7d5b10 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.077+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.077+0000 7f5e377f9640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5e28027060 0x7f5e28027660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.077+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e28027060 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.077+0000 7f5e407fb640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5e28027060 0x7f5e28027660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.077+0000 7f5e407fb640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5e28027060 0x7f5e28027660 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.077+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e3800a4a0 con 0x7f5e28027060 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.077+0000 7f5e407fb640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5e380141d0 0x7f5e38015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.077+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e380141d0 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.077+0000 7f5e3fffa640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5e380141d0 0x7f5e38015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.078+0000 7f5e3fffa640 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5e380141d0 0x7f5e38015940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.078+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e3005dc40 con 0x7f5e380141d0 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.078+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.078+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e3005dc40 con 0x5562ed7cd3b0 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.078+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.078+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e3005dc40 con 0x5562ed7cd3b0 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.079+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e380141d0 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.079+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e3005dc40 con 0x7f5e380141d0 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.079+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e380141d0 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.079+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e30095040 con 0x7f5e380141d0 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.079+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e28027060 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.079+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e3800a4a0 con 0x7f5e28027060 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.079+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7d3650 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.079+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.079+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.080+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e30095040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.080+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e380141d0 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.080+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e30095040 con 0x7f5e380141d0 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.080+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.080+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e30095040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.080+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e28027060 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.080+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.080+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7d3650 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.081+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.081+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7d3650 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.081+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.081+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e380141d0 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.081+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e30095040 con 0x7f5e380141d0 2024-02-15T22:56:29.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.081+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7d3650 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.082+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.082+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7d3650 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.082+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.082+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.082+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e30095040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.082+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.082+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5e30095040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.082+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e380141d0 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.082+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e30095040 con 0x7f5e380141d0 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.082+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7d3650 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.083+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.083+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e28027060 2024-02-15T22:56:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.083+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.083+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.083+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5e30095040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.083+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e380141d0 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.084+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e30095040 con 0x7f5e380141d0 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.084+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7d3650 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.084+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.084+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e380141d0 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.084+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e30095040 con 0x7f5e380141d0 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.084+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e28027060 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.084+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.084+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7d3650 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.085+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.085+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e380141d0 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.085+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.085+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.085+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.085+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d61e0 con 0x7f5e28027060 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d1f70 con 0x5562ed7cd3b0 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d2320 con 0x5562ed7cd3b0 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d2700 con 0x5562ed7cd3b0 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 zone default found 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 4 Realm: () 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 zonegroup default 2024-02-15T22:56:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.086+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d6620 con 0x7f5e380141d0 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e44333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d84a0 con 0x5562ed7d3650 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e44333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d8800 con 0x5562ed7d3650 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e44333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e44333800 20 started sync module instance, tier type = 2024-02-15T22:56:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e44333800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.087+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d7a70 con 0x7f5e28027060 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.088+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.088+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93883379580496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d7a70 con 0x7f5e28027060 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.088+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d91d0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.089+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93883379580496] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.089+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.089+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93883379584208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d7a70 con 0x5562ed7cd3b0 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.090+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d9c60 con 0x5562ed7d3650 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.090+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.090+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93883379586896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7da4b0 con 0x5562ed7d3650 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.090+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7daf50 con 0x7f5e28027060 2024-02-15T22:56:29.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.091+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93883379584208] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.091+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93883379586896] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.091+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.092+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93883379589136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d75d0 con 0x7f5e28027060 2024-02-15T22:56:29.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.092+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7db910 con 0x5562ed7cd3b0 2024-02-15T22:56:29.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.092+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.092+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93883379594352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7dbd30 con 0x5562ed7cd3b0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.092+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7dc790 con 0x7f5e380141d0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.093+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93883379589136] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.093+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93883379594352] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.093+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.093+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93883379591728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7db890 con 0x7f5e380141d0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.093+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7dcfe0 con 0x7f5e380141d0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.094+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93883379591728] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.095+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.095+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93883379597952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7dce10 con 0x7f5e380141d0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.095+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7dd610 con 0x7f5e380141d0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.095+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93883379601392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7dda50 con 0x7f5e380141d0 2024-02-15T22:56:29.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e44333800 20 add_watcher() i=0 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e44333800 20 add_watcher() i=1 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e44333800 20 add_watcher() i=2 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e44333800 20 add_watcher() i=3 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e44333800 20 add_watcher() i=4 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e44333800 20 add_watcher() i=5 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93883379597952] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e44333800 20 add_watcher() i=6 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93883379601392] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e44333800 20 add_watcher() i=7 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e44333800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.096+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7dca80 con 0x5562ed7cd3b0 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.097+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.097+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93883379602672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7de3c0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.098+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93883379602672] v30'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.098+0000 7f5cf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.098+0000 7f5e44333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.098+0000 7f5e44333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.098+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7e94a0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.099+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.099+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7e9b30 con 0x7f5e380141d0 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.100+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.100+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7e9f50 con 0x5562ed7d3650 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.101+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.101+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ea920 con 0x5562ed7cd3b0 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.102+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'122 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.102+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ea920 con 0x7f5e28027060 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.103+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.103+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7eae50 con 0x5562ed7d3650 2024-02-15T22:56:29.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.104+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'23 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.104+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7eb820 con 0x5562ed7cd3b0 2024-02-15T22:56:29.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.105+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.105+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7eb820 con 0x7f5e380141d0 2024-02-15T22:56:29.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.106+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'23 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.106+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7eb820 con 0x7f5e28027060 2024-02-15T22:56:29.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.107+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.107+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ebd50 con 0x5562ed7d3650 2024-02-15T22:56:29.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.108+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.108+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ebd50 con 0x7f5e28027060 2024-02-15T22:56:29.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.108+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.109+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec280 con 0x7f5e380141d0 2024-02-15T22:56:29.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.110+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.110+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x7f5e28027060 2024-02-15T22:56:29.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.111+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.111+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x7f5e380141d0 2024-02-15T22:56:29.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.112+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'29 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.112+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7cd3b0 2024-02-15T22:56:29.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.114+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'123 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.114+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7d3650 2024-02-15T22:56:29.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.115+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'29 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.115+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x7f5e28027060 2024-02-15T22:56:29.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.116+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'37 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.116+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7d3650 2024-02-15T22:56:29.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.117+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.117+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7cd3b0 2024-02-15T22:56:29.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.118+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.118+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7cd3b0 2024-02-15T22:56:29.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.119+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'124 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.119+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7d3650 2024-02-15T22:56:29.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.120+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.120+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x7f5e28027060 2024-02-15T22:56:29.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.121+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.121+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7d3650 2024-02-15T22:56:29.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.122+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.122+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7d3650 2024-02-15T22:56:29.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.123+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.123+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7d3650 2024-02-15T22:56:29.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.124+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.124+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7d3650 2024-02-15T22:56:29.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.125+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.125+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x7f5e380141d0 2024-02-15T22:56:29.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.126+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.126+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7d3650 2024-02-15T22:56:29.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.127+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.127+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x7f5e380141d0 2024-02-15T22:56:29.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.128+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.128+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x5562ed7d3650 2024-02-15T22:56:29.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.129+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'31 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.129+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x7f5e380141d0 2024-02-15T22:56:29.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.130+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.130+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7ec720 con 0x7f5e28027060 2024-02-15T22:56:29.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.131+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.131+0000 7f5cf4fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e44333800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e44333800 20 Filter name: none 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5c6e7fc640 20 reqs_thread_entry: start 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e44333800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e44333800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed8164b0 con 0x7f5e380141d0 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e44333800 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e44333800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e44333800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e44333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed8184d0 con 0x7f5e380141d0 2024-02-15T22:56:29.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.132+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.133+0000 7f5e44333800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-15T22:56:29.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.133+0000 7f5e44333800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T22:56:29.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.133+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 93883379839008 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed818c30 con 0x5562ed7d3650 2024-02-15T22:56:29.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.133+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== watch-notify(notify (1) cookie 93883379586896 notify 128849018883 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x5562ed7c1eb0 con 0x5562ed7d3650 2024-02-15T22:56:29.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.133+0000 7f5d1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 93883379586896 notifier 4523 bl.length()=170 2024-02-15T22:56:29.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.133+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 27 ==== osd_op_reply(96 notify.2 [notify cookie 93883379839008 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.133+0000 7f5d1effd640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d04003d50 con 0x5562ed7d3650 2024-02-15T22:56:29.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.133+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 28 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.133+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 29 ==== watch-notify(notify_complete (2) cookie 93883379839008 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5562ed7aeda0 con 0x5562ed7d3650 2024-02-15T22:56:29.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.133+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed818b90 con 0x7f5e380141d0 2024-02-15T22:56:29.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.134+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.134+0000 7f5e44333800 10 removing email index: 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.134+0000 7f5e44333800 10 removing user buckets index 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.134+0000 7f5e44333800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.134+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93883379844752 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed818b90 con 0x7f5e380141d0 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.135+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== watch-notify(notify (1) cookie 93883379597952 notify 128849018895 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x5562ed60fc80 con 0x7f5e380141d0 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.135+0000 7f5d1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 93883379597952 notifier 4523 bl.length()=160 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.135+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(99 notify.6 [notify cookie 93883379844752 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.135+0000 7f5d1e7fc640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c740032b0 con 0x7f5e380141d0 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.135+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.135+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 30 ==== watch-notify(notify_complete (2) cookie 93883379844752 notify 128849018895 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5562ed60f740 con 0x7f5e380141d0 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.135+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed818b90 con 0x7f5e380141d0 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.136+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 31 ==== osd_op_reply(101 fud.buckets [delete] v30'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.136+0000 7f5e44333800 10 removing user index: fud 2024-02-15T22:56:29.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.136+0000 7f5e44333800 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-15T22:56:29.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.136+0000 7f5e44333800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-15T22:56:29.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.136+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 93883379844752 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed818b90 con 0x7f5e380141d0 2024-02-15T22:56:29.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.136+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 32 ==== watch-notify(notify (1) cookie 93883379591728 notify 128849018896 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x5562ed60f740 con 0x7f5e380141d0 2024-02-15T22:56:29.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.136+0000 7f5d1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 93883379591728 notifier 4523 bl.length()=152 2024-02-15T22:56:29.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.136+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 33 ==== osd_op_reply(102 notify.5 [notify cookie 93883379844752 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.136+0000 7f5d1effd640 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d04003d50 con 0x7f5e380141d0 2024-02-15T22:56:29.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.136+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 34 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.137+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 35 ==== watch-notify(notify_complete (2) cookie 93883379844752 notify 128849018896 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5e3004e070 con 0x7f5e380141d0 2024-02-15T22:56:29.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.137+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed817020 con 0x7f5e380141d0 2024-02-15T22:56:29.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.138+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 36 ==== osd_op_reply(104 fud [call,call,delete] v30'4 uv4 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.138+0000 7f5cf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.138+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93883379602672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7dfee0 con 0x5562ed7cd3b0 2024-02-15T22:56:29.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.139+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93883379602672] v30'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.139+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93883379580496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed818690 con 0x7f5e28027060 2024-02-15T22:56:29.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.140+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93883379580496] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.141+0000 7f5e44333800 20 remove_watcher() i=0 2024-02-15T22:56:29.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.141+0000 7f5e44333800 2 removed watcher, disabling cache 2024-02-15T22:56:29.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.141+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93883379584208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d7e50 con 0x5562ed7cd3b0 2024-02-15T22:56:29.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.142+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93883379584208] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.142+0000 7f5e44333800 20 remove_watcher() i=1 2024-02-15T22:56:29.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.142+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93883379586896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d8cd0 con 0x5562ed7d3650 2024-02-15T22:56:29.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.143+0000 7f5e377f9640 1 -- 172.21.15.133:0/3254125219 <== osd.3 v2:172.21.15.133:6816/1065500544 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93883379586896] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e2804bdb0 con 0x5562ed7d3650 2024-02-15T22:56:29.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.143+0000 7f5e44333800 20 remove_watcher() i=2 2024-02-15T22:56:29.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.143+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93883379589136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d8cd0 con 0x7f5e28027060 2024-02-15T22:56:29.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.144+0000 7f5e407fb640 1 -- 172.21.15.133:0/3254125219 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93883379589136] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e3803a040 con 0x7f5e28027060 2024-02-15T22:56:29.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.144+0000 7f5e44333800 20 remove_watcher() i=3 2024-02-15T22:56:29.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.144+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93883379594352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7da010 con 0x5562ed7cd3b0 2024-02-15T22:56:29.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.145+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93883379594352] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x5562ed7cd3b0 2024-02-15T22:56:29.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.145+0000 7f5e44333800 20 remove_watcher() i=4 2024-02-15T22:56:29.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.145+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93883379591728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7d8cd0 con 0x7f5e380141d0 2024-02-15T22:56:29.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.146+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93883379591728] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.146+0000 7f5e44333800 20 remove_watcher() i=5 2024-02-15T22:56:29.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.146+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93883379597952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7db470 con 0x7f5e380141d0 2024-02-15T22:56:29.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.147+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93883379597952] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.147+0000 7f5e44333800 20 remove_watcher() i=6 2024-02-15T22:56:29.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.147+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93883379601392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5562ed7da010 con 0x7f5e380141d0 2024-02-15T22:56:29.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.147+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 <== osd.0 v2:172.21.15.52:6800/431200118 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93883379601392] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e300a1040 con 0x7f5e380141d0 2024-02-15T22:56:29.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.147+0000 7f5e44333800 20 remove_watcher() i=7 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5e380141d0 msgr2=0x7f5e38015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5e380141d0 0x7f5e38015940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5562ed7cd3b0 msgr2=0x5562ed7cf870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5562ed7cd3b0 0x5562ed7cf870 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5e28027060 msgr2=0x7f5e28027660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5e28027060 0x7f5e28027660 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5562ed7d3650 msgr2=0x5562ed7d5b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5562ed7d3650 0x5562ed7d5b10 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d080367e0 msgr2=0x7f5d08038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d080367e0 0x7f5d08038ca0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800b010 tx=0x7f5e38020000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 msgr2=0x5562ed7c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e3fffa640 1 -- 172.21.15.133:0/3254125219 reap_dead start 2024-02-15T22:56:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7c1770 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5e28025750 tx=0x7f5e2804b930 comp rx=0 tx=0).stop 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 shutdown_connections 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 --2- 172.21.15.133:0/3254125219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ba730 0x5562ed7c1770 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 >> 172.21.15.133:0/3254125219 conn(0x5562ed7b6a90 msgr2=0x5562ed7b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 shutdown_connections 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/3254125219 wait complete. 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/1687401173 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d180367e0 msgr2=0x7f5d18038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 --2- 172.21.15.133:0/1687401173 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d180367e0 0x7f5d18038ca0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5562ed79d6f0 tx=0x7f5e38005840 comp rx=0 tx=0).stop 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/1687401173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ad510 msgr2=0x5562ed7ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 --2- 172.21.15.133:0/1687401173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ad510 0x5562ed7ad930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5e28001ed0 tx=0x7f5e2800ea00 comp rx=0 tx=0).stop 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/1687401173 shutdown_connections 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 --2- 172.21.15.133:0/1687401173 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d180367e0 0x7f5d18038ca0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 --2- 172.21.15.133:0/1687401173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed7ad510 0x5562ed7ad930 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/1687401173 >> 172.21.15.133:0/1687401173 conn(0x5562ed7a15b0 msgr2=0x5562ed7a19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/1687401173 shutdown_connections 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.148+0000 7f5e44333800 1 -- 172.21.15.133:0/1687401173 wait complete. 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5562ed69d280 msgr2=0x5562ed79cd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5562ed69d280 0x5562ed79cd10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d280367e0 msgr2=0x7f5d28038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d280367e0 0x7f5d28038ca0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e28000f60 tx=0x7f5e28001370 comp rx=0 tx=0).stop 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 msgr2=0x5562ed611050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed611050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5e3001ceb0 tx=0x7f5e30002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 shutdown_connections 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5562ed69d280 0x5562ed79cd10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5d280367e0 0x7f5d28038ca0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 --2- 172.21.15.133:0/517681636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562ed69c020 0x5562ed611050 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 >> 172.21.15.133:0/517681636 conn(0x5562ed6975c0 msgr2=0x5562ed78add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 shutdown_connections 2024-02-15T22:56:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.149+0000 7f5e44333800 1 -- 172.21.15.133:0/517681636 wait complete. 2024-02-15T22:56:29.159 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-15T22:56:29.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-15T22:56:29.160 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-15T22:56:29.252 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:29.252 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:29.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.250+0000 7fabe7e11800 1 Processor -- start 2024-02-15T22:56:29.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.250+0000 7fabe7e11800 1 -- start start 2024-02-15T22:56:29.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.250+0000 7fabe7e11800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563f79c2de10 0x563f79c2e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.250+0000 7fabe7e11800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563f79b79b50 con 0x563f79c2f070 2024-02-15T22:56:29.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.250+0000 7fabe7e11800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x563f79b31450 con 0x563f79c2de10 2024-02-15T22:56:29.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.250+0000 7fabe3509640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563f79c2de10 0x563f79c2e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.251+0000 7fabe3509640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563f79c2de10 0x563f79c2e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58842/0 (socket says 172.21.15.133:58842) 2024-02-15T22:56:29.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.251+0000 7fabe3509640 1 -- 172.21.15.133:0/637113199 learned_addr learned my addr 172.21.15.133:0/637113199 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.251+0000 7fabe2d08640 1 --1- 172.21.15.133:0/637113199 >> v1:172.21.15.52:6789/0 conn(0x563f79c2f070 0x563f79c2f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45154/0 (socket says 172.21.15.133:45154) 2024-02-15T22:56:29.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.251+0000 7fabe3509640 1 -- 172.21.15.133:0/637113199 >> v1:172.21.15.52:6789/0 conn(0x563f79c2f070 legacy=0x563f79c2f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.251+0000 7fabe3509640 1 -- 172.21.15.133:0/637113199 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f79c2e900 con 0x563f79c2de10 2024-02-15T22:56:29.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.253+0000 7fabe3509640 1 --2- 172.21.15.133:0/637113199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79c2e230 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fabd400a6b0 tx=0x7fabd401eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fe5dfccda322a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.253+0000 7fabe2507640 1 -- 172.21.15.133:0/637113199 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd400a200 con 0x563f79c2de10 2024-02-15T22:56:29.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.253+0000 7fabe2507640 1 -- 172.21.15.133:0/637113199 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd400a360 con 0x563f79c2de10 2024-02-15T22:56:29.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.253+0000 7fabe2507640 1 -- 172.21.15.133:0/637113199 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd40086e0 con 0x563f79c2de10 2024-02-15T22:56:29.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.253+0000 7fabe7e11800 1 -- 172.21.15.133:0/637113199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 msgr2=0x563f79c2e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.254+0000 7fabe7e11800 1 --2- 172.21.15.133:0/637113199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79c2e230 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fabd400a6b0 tx=0x7fabd401eda0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.254+0000 7fabe7e11800 1 -- 172.21.15.133:0/637113199 shutdown_connections 2024-02-15T22:56:29.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.254+0000 7fabe7e11800 1 --2- 172.21.15.133:0/637113199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79c2e230 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.254+0000 7fabe7e11800 1 -- 172.21.15.133:0/637113199 >> 172.21.15.133:0/637113199 conn(0x563f79c29470 msgr2=0x563f79c2b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.254+0000 7fabe7e11800 1 -- 172.21.15.133:0/637113199 shutdown_connections 2024-02-15T22:56:29.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.254+0000 7fabe7e11800 1 -- 172.21.15.133:0/637113199 wait complete. 2024-02-15T22:56:29.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.265+0000 7fabe7e11800 1 Processor -- start 2024-02-15T22:56:29.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.265+0000 7fabe7e11800 1 -- start start 2024-02-15T22:56:29.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.265+0000 7fabe7e11800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d1d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.265+0000 7fabe7e11800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f79b2e980 con 0x563f79c2de10 2024-02-15T22:56:29.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.266+0000 7fabe3509640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d1d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.266+0000 7fabe3509640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d1d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58852/0 (socket says 172.21.15.133:58852) 2024-02-15T22:56:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.266+0000 7fabe3509640 1 -- 172.21.15.133:0/3208110110 learned_addr learned my addr 172.21.15.133:0/3208110110 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.266+0000 7fabe3509640 1 -- 172.21.15.133:0/3208110110 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd4005de0 con 0x563f79c2de10 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.266+0000 7fabe3509640 1 --2- 172.21.15.133:0/3208110110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d1d210 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fabd4056040 tx=0x7fabd404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fff3d8d5c4dff2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.266+0000 7faad160a640 1 -- 172.21.15.133:0/3208110110 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd400a200 con 0x563f79c2de10 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.266+0000 7faad160a640 1 -- 172.21.15.133:0/3208110110 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd4008590 con 0x563f79c2de10 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.266+0000 7faad160a640 1 -- 172.21.15.133:0/3208110110 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd4008870 con 0x563f79c2de10 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.267+0000 7fabe7e11800 1 -- 172.21.15.133:0/3208110110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 msgr2=0x563f79d1d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.267+0000 7fabe7e11800 1 --2- 172.21.15.133:0/3208110110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d1d210 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fabd4056040 tx=0x7fabd404e000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.267+0000 7fabe7e11800 1 -- 172.21.15.133:0/3208110110 shutdown_connections 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.267+0000 7fabe7e11800 1 --2- 172.21.15.133:0/3208110110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d1d210 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.267+0000 7fabe7e11800 1 -- 172.21.15.133:0/3208110110 >> 172.21.15.133:0/3208110110 conn(0x563f79c29470 msgr2=0x563f79d18b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.267+0000 7fabe7e11800 1 -- 172.21.15.133:0/3208110110 shutdown_connections 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.267+0000 7fabe7e11800 1 -- 172.21.15.133:0/3208110110 wait complete. 2024-02-15T22:56:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.267+0000 7fabe7e11800 1 Processor -- start 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.267+0000 7fabe7e11800 1 -- start start 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.267+0000 7fabe7e11800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d248a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.267+0000 7fabe7e11800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f79b2a160 con 0x563f79c2de10 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.268+0000 7fabe3509640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d248a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.268+0000 7fabe3509640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d248a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58866/0 (socket says 172.21.15.133:58866) 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.268+0000 7fabe3509640 1 -- 172.21.15.133:0/459579408 learned_addr learned my addr 172.21.15.133:0/459579408 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.268+0000 7fabe3509640 1 -- 172.21.15.133:0/459579408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd4050070 con 0x563f79c2de10 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.268+0000 7fabe3509640 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d248a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fabd401f610 tx=0x7fabd4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.268+0000 7faacfe07640 1 -- 172.21.15.133:0/459579408 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd4060470 con 0x563f79c2de10 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.268+0000 7faacfe07640 1 -- 172.21.15.133:0/459579408 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd40605d0 con 0x563f79c2de10 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.268+0000 7faacfe07640 1 -- 172.21.15.133:0/459579408 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd4060870 con 0x563f79c2de10 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.268+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563f79d24de0 con 0x563f79c2de10 2024-02-15T22:56:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.268+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f79d25320 con 0x563f79c2de10 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.269+0000 7faacfe07640 1 -- 172.21.15.133:0/459579408 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fabd4067040 con 0x563f79c2de10 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.269+0000 7faacfe07640 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faac80367e0 0x7faac8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.269+0000 7faacfe07640 1 -- 172.21.15.133:0/459579408 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fabd408f1a0 con 0x563f79c2de10 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.269+0000 7fabe2d08640 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faac80367e0 0x7faac8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.269+0000 7fabe7e11800 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563f79c2f070 0x563f79d2b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.269+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d2ba50 con 0x563f79c2f070 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.270+0000 7fabe3d0a640 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563f79c2f070 0x563f79d2b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.270+0000 7fabe2d08640 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faac80367e0 0x7faac8038ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fabd8000f60 tx=0x7fabd8001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.270+0000 7fabe3d0a640 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563f79c2f070 0x563f79d2b510 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.270+0000 7fabe3d0a640 1 -- 172.21.15.133:0/459579408 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fabdc00a4a0 con 0x563f79c2f070 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.270+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d28c20 con 0x563f79c2f070 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.270+0000 7fabe3d0a640 1 -- 172.21.15.133:0/459579408 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fabdc00a4a0 con 0x563f79c2f070 2024-02-15T22:56:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.270+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d2d780 con 0x563f79c2f070 2024-02-15T22:56:29.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.271+0000 7fabe3d0a640 1 -- 172.21.15.133:0/459579408 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fabdc00a4a0 con 0x563f79c2f070 2024-02-15T22:56:29.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.271+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d2ca90 con 0x563f79c2f070 2024-02-15T22:56:29.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.271+0000 7fabe3d0a640 1 -- 172.21.15.133:0/459579408 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fabdc00a4a0 con 0x563f79c2f070 2024-02-15T22:56:29.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.271+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d2cea0 con 0x563f79c2f070 2024-02-15T22:56:29.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.271+0000 7fabe3d0a640 1 -- 172.21.15.133:0/459579408 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fabdc00a4a0 con 0x563f79c2f070 2024-02-15T22:56:29.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.272+0000 7fabe7e11800 1 Processor -- start 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.272+0000 7fabe7e11800 1 -- start start 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.272+0000 7fabe7e11800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d40600 0x563f79d40a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.272+0000 7fabe7e11800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f79acce80 con 0x563f79d40600 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.272+0000 7fabe2d08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d40600 0x563f79d40a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.272+0000 7fabe2d08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d40600 0x563f79d40a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58878/0 (socket says 172.21.15.133:58878) 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.272+0000 7fabe2d08640 1 -- 172.21.15.133:0/1789226345 learned_addr learned my addr 172.21.15.133:0/1789226345 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.272+0000 7fabe2d08640 1 -- 172.21.15.133:0/1789226345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f79d40f60 con 0x563f79d40600 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.272+0000 7fabe2d08640 1 --2- 172.21.15.133:0/1789226345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d40600 0x563f79d40a20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fabd8001ed0 tx=0x7fabd800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.273+0000 7faacd602640 1 -- 172.21.15.133:0/1789226345 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd800bec0 con 0x563f79d40600 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.273+0000 7faacd602640 1 -- 172.21.15.133:0/1789226345 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd800d520 con 0x563f79d40600 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.273+0000 7fabe7e11800 1 -- 172.21.15.133:0/1789226345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563f79d419d0 con 0x563f79d40600 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.273+0000 7faacd602640 1 -- 172.21.15.133:0/1789226345 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd800d7c0 con 0x563f79d40600 2024-02-15T22:56:29.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.273+0000 7fabe7e11800 1 -- 172.21.15.133:0/1789226345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f79d41e90 con 0x563f79d40600 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.273+0000 7faacd602640 1 -- 172.21.15.133:0/1789226345 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fabd801a070 con 0x563f79d40600 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.273+0000 7faacd602640 1 --2- 172.21.15.133:0/1789226345 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faabc036850 0x7faabc038d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.274+0000 7faacd602640 1 -- 172.21.15.133:0/1789226345 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fabd8017050 con 0x563f79d40600 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.274+0000 7fabe3d0a640 1 --2- 172.21.15.133:0/1789226345 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faabc036850 0x7faabc038d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.274+0000 7fabe7e11800 1 Processor -- start 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.274+0000 7fabe7e11800 1 -- start start 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.274+0000 7fabe3d0a640 1 --2- 172.21.15.133:0/1789226345 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faabc036850 0x7faabc038d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x563f79d2c4d0 tx=0x7fabdc005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.274+0000 7fabe7e11800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d4dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.274+0000 7fabe7e11800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f79aa25d0 con 0x563f79d4d910 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.274+0000 7fabe2d08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d4dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.274+0000 7fabe2d08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d4dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58888/0 (socket says 172.21.15.133:58888) 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.274+0000 7fabe2d08640 1 -- 172.21.15.133:0/2968586984 learned_addr learned my addr 172.21.15.133:0/2968586984 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.274+0000 7fabe2d08640 1 -- 172.21.15.133:0/2968586984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f79d4e2c0 con 0x563f79d4d910 2024-02-15T22:56:29.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7fabe2d08640 1 --2- 172.21.15.133:0/2968586984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d4dcf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fabd8026fd0 tx=0x7fabd8024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d5bb84b8bf0596 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7faac6ffd640 1 -- 172.21.15.133:0/2968586984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd80263b0 con 0x563f79d4d910 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7faac6ffd640 1 -- 172.21.15.133:0/2968586984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8026510 con 0x563f79d4d910 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7faac6ffd640 1 -- 172.21.15.133:0/2968586984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd801a320 con 0x563f79d4d910 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7fabe7e11800 1 -- 172.21.15.133:0/2968586984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 msgr2=0x563f79d4dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7fabe7e11800 1 --2- 172.21.15.133:0/2968586984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d4dcf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fabd8026fd0 tx=0x7fabd8024eb0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7fabe7e11800 1 -- 172.21.15.133:0/2968586984 shutdown_connections 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7fabe7e11800 1 --2- 172.21.15.133:0/2968586984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d4dcf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7fabe7e11800 1 -- 172.21.15.133:0/2968586984 >> 172.21.15.133:0/2968586984 conn(0x563f79d49be0 msgr2=0x563f79d47c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7fabe7e11800 1 -- 172.21.15.133:0/2968586984 shutdown_connections 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7fabe7e11800 1 -- 172.21.15.133:0/2968586984 wait complete. 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.275+0000 7fabe7e11800 1 Processor -- start 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.276+0000 7fabe7e11800 1 -- start start 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.276+0000 7fabe7e11800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d54930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.276+0000 7fabe7e11800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f79d54e70 con 0x563f79d4d910 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.276+0000 7fabe2d08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d54930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.276+0000 7fabe2d08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d54930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58900/0 (socket says 172.21.15.133:58900) 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.276+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 learned_addr learned my addr 172.21.15.133:0/472585341 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.276+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f79d41e90 con 0x563f79d4d910 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.276+0000 7fabe2d08640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d54930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fabd804a940 tx=0x7fabd804b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.276+0000 7faac57fa640 1 -- 172.21.15.133:0/472585341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd8042070 con 0x563f79d4d910 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.276+0000 7faac57fa640 1 -- 172.21.15.133:0/472585341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8043040 con 0x563f79d4d910 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.276+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563f79d55070 con 0x563f79d4d910 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.277+0000 7faac57fa640 1 -- 172.21.15.133:0/472585341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd804d0d0 con 0x563f79d4d910 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.277+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f79d55070 con 0x563f79d4d910 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.277+0000 7faac57fa640 1 -- 172.21.15.133:0/472585341 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fabd804a250 con 0x563f79d4d910 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.277+0000 7faac57fa640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faaac0367e0 0x7faaac038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.277+0000 7faac57fa640 1 -- 172.21.15.133:0/472585341 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fabd804ec80 con 0x563f79d4d910 2024-02-15T22:56:29.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.277+0000 7fabe3d0a640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faaac0367e0 0x7faaac038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.278+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.278+0000 7fabe3d0a640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faaac0367e0 0x7faaac038ca0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00b010 tx=0x7fabdc020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.278+0000 7fabe7e11800 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563f79d60300 0x563f79d627c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.278+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d62f10 con 0x563f79d60300 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.278+0000 7fabe3509640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563f79d60300 0x563f79d627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.278+0000 7fabe3509640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563f79d60300 0x563f79d627c0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.278+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.278+0000 7fabe7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 20 realm 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d632e0 con 0x563f79d60300 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d63b60 con 0x563f79d60300 2024-02-15T22:56:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d63ec0 con 0x563f79d60300 2024-02-15T22:56:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d646c0 con 0x563f79d60300 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.279+0000 7fabe7e11800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.280+0000 7fabe7e11800 20 searching for the correct realm 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.280+0000 7fabe7e11800 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563f79d665e0 0x563f79d68a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.280+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d665e0 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.280+0000 7fabe2d08640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563f79d665e0 0x563f79d68a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.280+0000 7fabe2d08640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563f79d665e0 0x563f79d68a80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.280+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd8032070 con 0x563f79d665e0 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.280+0000 7fabe2d08640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fabd8035020 0x7fabd804d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.280+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabd8035020 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.280+0000 7fabe3d0a640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fabd8035020 0x7fabd804d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.281+0000 7fabe3d0a640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fabd8035020 0x7fabd804d5d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.281+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabdc00a4a0 con 0x7fabd8035020 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.281+0000 7fabe3d0a640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fabdc0141d0 0x7fabdc015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.281+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabdc0141d0 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.281+0000 7fabe3509640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fabdc0141d0 0x7fabdc015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.281+0000 7fabe3509640 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fabdc0141d0 0x7fabdc015940 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.282+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.282+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d60300 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.282+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.282+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d60300 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.282+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.282+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabdc0141d0 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.282+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.282+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabdc0141d0 2024-02-15T22:56:29.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.283+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.283+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabd8035020 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.283+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabdc00a4a0 con 0x7fabd8035020 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.283+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d665e0 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.283+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd8032070 con 0x563f79d665e0 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.283+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d60300 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.283+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.283+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabdc0141d0 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.284+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.284+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d60300 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.284+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.284+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabd8035020 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.284+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.284+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d665e0 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.284+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd8032070 con 0x563f79d665e0 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.284+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d665e0 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.284+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd8032070 con 0x563f79d665e0 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.285+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabdc0141d0 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.285+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.285+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d665e0 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.285+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd8032070 con 0x563f79d665e0 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.285+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d665e0 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.285+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd805a040 con 0x563f79d665e0 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.285+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d60300 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.285+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.285+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d60300 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.286+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.286+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabdc0141d0 2024-02-15T22:56:29.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.286+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.286+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d665e0 2024-02-15T22:56:29.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.286+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd805a040 con 0x563f79d665e0 2024-02-15T22:56:29.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.286+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabd8035020 2024-02-15T22:56:29.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.286+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.286+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d60300 2024-02-15T22:56:29.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.287+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.287+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabdc0141d0 2024-02-15T22:56:29.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.287+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.287+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d665e0 2024-02-15T22:56:29.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.287+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd805a040 con 0x563f79d665e0 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.287+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabdc0141d0 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.287+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.287+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x7fabd8035020 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.288+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.288+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69150 con 0x563f79d665e0 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.288+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd805a040 con 0x563f79d665e0 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.288+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fabd805f040 con 0x7fabdc0141d0 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.288+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.288+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fabd805f040 con 0x563f79d60300 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.288+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.288+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fabd805f040 con 0x7fabd8035020 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d65bc0 con 0x563f79d60300 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d65410 con 0x563f79d60300 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d64ba0 con 0x563f79d60300 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 zone default found 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 4 Realm: () 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 zonegroup default 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.289+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d69590 con 0x7fabdc0141d0 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.290+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.290+0000 7fabe7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.290+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.290+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6b410 con 0x563f79d665e0 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.290+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fabd805a040 con 0x563f79d665e0 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.290+0000 7fabe7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.290+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.290+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6b770 con 0x563f79d665e0 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.291+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fabd805a040 con 0x563f79d665e0 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.291+0000 7fabe7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.291+0000 7fabe7e11800 20 started sync module instance, tier type = 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.291+0000 7fabe7e11800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.291+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6a9e0 con 0x7fabd8035020 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.292+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.292+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94830627040656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6a9e0 con 0x7fabd8035020 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.292+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6c140 con 0x563f79d60300 2024-02-15T22:56:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.293+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94830627040656] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.293+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.293+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94830627044416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6a9e0 con 0x563f79d60300 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.293+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6cbc0 con 0x563f79d665e0 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.294+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94830627044416] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.294+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd805a040 con 0x563f79d665e0 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.294+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94830627038528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6a960 con 0x563f79d665e0 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.294+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6da20 con 0x7fabd8035020 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.295+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.295+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94830627038528] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd805a040 con 0x563f79d665e0 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.295+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94830627049328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6dca0 con 0x7fabd8035020 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.295+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6e770 con 0x563f79d60300 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.296+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.296+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94830627054160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6e770 con 0x563f79d60300 2024-02-15T22:56:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.296+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6f700 con 0x7fabdc0141d0 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.296+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94830627049328] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.297+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94830627054160] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.297+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.297+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94830627058144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6e950 con 0x7fabdc0141d0 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.297+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6ff50 con 0x7fabdc0141d0 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.298+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94830627058144] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.298+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.298+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94830627051360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6fb80 con 0x7fabdc0141d0 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.298+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d70570 con 0x7fabdc0141d0 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.299+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94830627051360] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.299+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.299+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94830627061840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d70750 con 0x7fabdc0141d0 2024-02-15T22:56:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.299+0000 7fabe7e11800 20 add_watcher() i=0 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.299+0000 7fabe7e11800 20 add_watcher() i=1 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.299+0000 7fabe7e11800 20 add_watcher() i=2 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.299+0000 7fabe7e11800 20 add_watcher() i=3 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.299+0000 7fabe7e11800 20 add_watcher() i=4 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.299+0000 7fabe7e11800 20 add_watcher() i=5 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.299+0000 7fabe7e11800 20 add_watcher() i=6 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.300+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94830627061840] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.300+0000 7fabe7e11800 20 add_watcher() i=7 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.300+0000 7fabe7e11800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.300+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d73b10 con 0x563f79d60300 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.300+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.300+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94830627063360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d70fd0 con 0x563f79d60300 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.301+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94830627063360] v30'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.301+0000 7faa99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.301+0000 7fabe7e11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.301+0000 7fabe7e11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.301+0000 7fabe7e11800 5 note: GC not initialized 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.301+0000 7faa98fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 20 Filter name: none 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7faa127fc640 20 reqs_thread_entry: start 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79da5c20 con 0x7fabdc0141d0 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-15T22:56:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79da42d0 con 0x7fabdc0141d0 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.302+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~386 in=386b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79da4b20 con 0x7fabdc0141d0 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~386] v30'5 uv5 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7fabe7e11800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7fabe7e11800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7fabe7e11800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-15T22:56:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94830627276416 in=589b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79da4b00 con 0x7fabd8035020 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== watch-notify(notify (1) cookie 94830627049328 notify 128849018892 ret 0) v3 ==== 619+0+0 (crc 0 0 0) 0x7fabdc026ce0 con 0x7fabd8035020 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7faac6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94830627049328 notifier 4530 bl.length()=577 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(65 notify.3 [notify cookie 94830627276416 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7faac6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7faac6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7faac6ffd640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7faaa8003e90 con 0x7fabd8035020 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.304+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.305+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== watch-notify(notify_complete (2) cookie 94830627276416 notify 128849018892 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fabdc030410 con 0x7fabd8035020 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.305+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79da4b20 con 0x7fabdc0141d0 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7fabe7e11800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7fabe7e11800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7fabe7e11800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94830627276336 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79da4a50 con 0x563f79d665e0 2024-02-15T22:56:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== watch-notify(notify (1) cookie 94830627038528 notify 128849018884 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x563f79d41e90 con 0x563f79d665e0 2024-02-15T22:56:29.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7faac6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94830627038528 notifier 4530 bl.length()=192 2024-02-15T22:56:29.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7faac6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T22:56:29.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7faac6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:56:29.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7faac6ffd640 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7faaa8003e90 con 0x563f79d665e0 2024-02-15T22:56:29.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(68 notify.2 [notify cookie 94830627276336 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fabd805a040 con 0x563f79d665e0 2024-02-15T22:56:29.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd805a040 con 0x563f79d665e0 2024-02-15T22:56:29.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.306+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== watch-notify(notify_complete (2) cookie 94830627276336 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fabd8052040 con 0x563f79d665e0 2024-02-15T22:56:29.322 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:29.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.307+0000 7faa99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.307+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94830627063360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d735e0 con 0x563f79d60300 2024-02-15T22:56:29.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.308+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94830627063360] v30'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.308+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94830627040656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d70640 con 0x7fabd8035020 2024-02-15T22:56:29.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.309+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94830627040656] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.309+0000 7fabe7e11800 20 remove_watcher() i=0 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.309+0000 7fabe7e11800 2 removed watcher, disabling cache 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.309+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94830627044416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d70640 con 0x563f79d60300 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.310+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94830627044416] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.310+0000 7fabe7e11800 20 remove_watcher() i=1 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.310+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94830627038528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d70640 con 0x563f79d665e0 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.311+0000 7fabe2d08640 1 -- 172.21.15.133:0/472585341 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94830627038528] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd805a040 con 0x563f79d665e0 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.311+0000 7fabe7e11800 20 remove_watcher() i=2 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.311+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94830627049328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6a540 con 0x7fabd8035020 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.312+0000 7fabe3d0a640 1 -- 172.21.15.133:0/472585341 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94830627049328] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabdc03a040 con 0x7fabd8035020 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.312+0000 7fabe7e11800 20 remove_watcher() i=3 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.312+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94830627054160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d70640 con 0x563f79d60300 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.313+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94830627054160] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x563f79d60300 2024-02-15T22:56:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.313+0000 7fabe7e11800 20 remove_watcher() i=4 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.313+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94830627058144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6a540 con 0x7fabdc0141d0 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.314+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94830627058144] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.314+0000 7fabe7e11800 20 remove_watcher() i=5 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.314+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94830627051360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d6e250 con 0x7fabdc0141d0 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.315+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94830627051360] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.315+0000 7fabe7e11800 20 remove_watcher() i=6 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.315+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94830627061840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563f79d70640 con 0x7fabdc0141d0 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94830627061840] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fabd4060ac0 con 0x7fabdc0141d0 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 20 remove_watcher() i=7 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fabdc0141d0 msgr2=0x7fabdc015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fabdc0141d0 0x7fabdc015940 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563f79d60300 msgr2=0x563f79d627c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563f79d60300 0x563f79d627c0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fabd8035020 msgr2=0x7fabd804d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fabd8035020 0x7fabd804d5d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563f79d665e0 msgr2=0x563f79d68a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563f79d665e0 0x563f79d68a80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faaac0367e0 msgr2=0x7faaac038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faaac0367e0 0x7faaac038ca0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00b010 tx=0x7fabdc020000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 msgr2=0x563f79d54930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe3509640 1 -- 172.21.15.133:0/472585341 reap_dead start 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d54930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fabd804a940 tx=0x7fabd804b9b0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 shutdown_connections 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.316+0000 7fabe7e11800 1 --2- 172.21.15.133:0/472585341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d4d910 0x563f79d54930 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 >> 172.21.15.133:0/472585341 conn(0x563f79d49be0 msgr2=0x563f79d47240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 shutdown_connections 2024-02-15T22:56:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/472585341 wait complete. 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/1789226345 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faabc036850 msgr2=0x7faabc038d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 --2- 172.21.15.133:0/1789226345 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faabc036850 0x7faabc038d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x563f79d2c4d0 tx=0x7fabdc005840 comp rx=0 tx=0).stop 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/1789226345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d40600 msgr2=0x563f79d40a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 --2- 172.21.15.133:0/1789226345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d40600 0x563f79d40a20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fabd8001ed0 tx=0x7fabd800ea00 comp rx=0 tx=0).stop 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/1789226345 shutdown_connections 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 --2- 172.21.15.133:0/1789226345 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faabc036850 0x7faabc038d10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 --2- 172.21.15.133:0/1789226345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79d40600 0x563f79d40a20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/1789226345 >> 172.21.15.133:0/1789226345 conn(0x563f79d30290 msgr2=0x563f79d30690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/1789226345 shutdown_connections 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/1789226345 wait complete. 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563f79c2f070 msgr2=0x563f79d2b510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563f79c2f070 0x563f79d2b510 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faac80367e0 msgr2=0x7faac8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faac80367e0 0x7faac8038ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fabd8000f60 tx=0x7fabd8001370 comp rx=0 tx=0).stop 2024-02-15T22:56:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 msgr2=0x563f79d248a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d248a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fabd401f610 tx=0x7fabd4002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 shutdown_connections 2024-02-15T22:56:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563f79c2f070 0x563f79d2b510 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faac80367e0 0x7faac8038ca0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 --2- 172.21.15.133:0/459579408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f79c2de10 0x563f79d248a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 >> 172.21.15.133:0/459579408 conn(0x563f79c29470 msgr2=0x563f79d17390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 shutdown_connections 2024-02-15T22:56:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.317+0000 7fabe7e11800 1 -- 172.21.15.133:0/459579408 wait complete. 2024-02-15T22:56:29.333 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:29.333 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-15T22:56:29.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-15T22:56:29.334 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-02-15T22:56:29.380 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:29.380 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:29.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.378+0000 7f4dd9616800 1 Processor -- start 2024-02-15T22:56:29.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.378+0000 7f4dd9616800 1 -- start start 2024-02-15T22:56:29.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.378+0000 7f4dd9616800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x558f4dbd4e90 0x558f4dbd52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.378+0000 7f4dd9616800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558f4db20c50 con 0x558f4dbd60f0 2024-02-15T22:56:29.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.378+0000 7f4dd9616800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x558f4dad8450 con 0x558f4dbd4e90 2024-02-15T22:56:29.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.378+0000 7f4dd4d61640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x558f4dbd4e90 0x558f4dbd52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.378+0000 7f4dcffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x558f4dbd60f0 0x558f4dbd6570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45162/0 (socket says 172.21.15.133:45162) 2024-02-15T22:56:29.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.378+0000 7f4dd4d61640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x558f4dbd4e90 0x558f4dbd52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58914/0 (socket says 172.21.15.133:58914) 2024-02-15T22:56:29.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.378+0000 7f4dcffff640 1 -- 172.21.15.133:0/1589567259 learned_addr learned my addr 172.21.15.133:0/1589567259 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:29.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.379+0000 7f4dd4d61640 1 -- 172.21.15.133:0/1589567259 >> v1:172.21.15.52:6789/0 conn(0x558f4dbd60f0 legacy=0x558f4dbd6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.379+0000 7f4dd4d61640 1 -- 172.21.15.133:0/1589567259 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f4dbd5980 con 0x558f4dbd4e90 2024-02-15T22:56:29.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.379+0000 7f4dcf7fe640 1 -- 172.21.15.133:0/1589567259 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725984639 0 0) 0x558f4db20c50 con 0x558f4dbd60f0 2024-02-15T22:56:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.380+0000 7f4dd4d61640 1 --2- 172.21.15.133:0/1589567259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd4e90 0x558f4dbd52b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800a470 tx=0x7f4dc801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b068b22c918957f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.381+0000 7f4dcf7fe640 1 -- 172.21.15.133:0/1589567259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc8052570 con 0x558f4dbd4e90 2024-02-15T22:56:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.381+0000 7f4dcf7fe640 1 -- 172.21.15.133:0/1589567259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc80526d0 con 0x558f4dbd4e90 2024-02-15T22:56:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.381+0000 7f4dcf7fe640 1 -- 172.21.15.133:0/1589567259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc8052990 con 0x558f4dbd4e90 2024-02-15T22:56:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.381+0000 7f4dd9616800 1 -- 172.21.15.133:0/1589567259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd4e90 msgr2=0x558f4dbd52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.381+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1589567259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd4e90 0x558f4dbd52b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800a470 tx=0x7f4dc801cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.381+0000 7f4dd9616800 1 -- 172.21.15.133:0/1589567259 shutdown_connections 2024-02-15T22:56:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.381+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1589567259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd4e90 0x558f4dbd52b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.381+0000 7f4dd9616800 1 -- 172.21.15.133:0/1589567259 >> 172.21.15.133:0/1589567259 conn(0x558f4dbd04f0 msgr2=0x558f4dbd2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.381+0000 7f4dd9616800 1 -- 172.21.15.133:0/1589567259 shutdown_connections 2024-02-15T22:56:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.381+0000 7f4dd9616800 1 -- 172.21.15.133:0/1589567259 wait complete. 2024-02-15T22:56:29.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.393+0000 7f4dd9616800 1 Processor -- start 2024-02-15T22:56:29.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.393+0000 7f4dd9616800 1 -- start start 2024-02-15T22:56:29.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.393+0000 7f4dd9616800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd4e90 0x558f4dcc5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.393+0000 7f4dd9616800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f4dad5980 con 0x558f4dbd4e90 2024-02-15T22:56:29.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.393+0000 7f4dd4d61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd4e90 0x558f4dcc5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.393+0000 7f4dd4d61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd4e90 0x558f4dcc5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58924/0 (socket says 172.21.15.133:58924) 2024-02-15T22:56:29.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.393+0000 7f4dd4d61640 1 -- 172.21.15.133:0/2810833453 learned_addr learned my addr 172.21.15.133:0/2810833453 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.393+0000 7f4dd4d61640 1 -- 172.21.15.133:0/2810833453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc8005d20 con 0x558f4dbd4e90 2024-02-15T22:56:29.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.393+0000 7f4dd4d61640 1 --2- 172.21.15.133:0/2810833453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd4e90 0x558f4dcc5070 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8055040 tx=0x7f4dc804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a234342199cd530 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.394+0000 7f4cc2e05640 1 -- 172.21.15.133:0/2810833453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc805f070 con 0x558f4dbd4e90 2024-02-15T22:56:29.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.394+0000 7f4cc2e05640 1 -- 172.21.15.133:0/2810833453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc800a170 con 0x558f4dbd4e90 2024-02-15T22:56:29.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.394+0000 7f4cc2e05640 1 -- 172.21.15.133:0/2810833453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc8052840 con 0x558f4dbd4e90 2024-02-15T22:56:29.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.394+0000 7f4dd9616800 1 -- 172.21.15.133:0/2810833453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd4e90 msgr2=0x558f4dcc5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.394+0000 7f4dd9616800 1 --2- 172.21.15.133:0/2810833453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd4e90 0x558f4dcc5070 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8055040 tx=0x7f4dc804c000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.394+0000 7f4dd9616800 1 -- 172.21.15.133:0/2810833453 shutdown_connections 2024-02-15T22:56:29.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.394+0000 7f4dd9616800 1 --2- 172.21.15.133:0/2810833453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd4e90 0x558f4dcc5070 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.394+0000 7f4dd9616800 1 -- 172.21.15.133:0/2810833453 >> 172.21.15.133:0/2810833453 conn(0x558f4dbd04f0 msgr2=0x558f4dcc0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.394+0000 7f4dd9616800 1 -- 172.21.15.133:0/2810833453 shutdown_connections 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.394+0000 7f4dd9616800 1 -- 172.21.15.133:0/2810833453 wait complete. 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.395+0000 7f4dd9616800 1 Processor -- start 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.395+0000 7f4dd9616800 1 -- start start 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.395+0000 7f4dd9616800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd60f0 0x558f4dccfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.395+0000 7f4dd9616800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f4dad1160 con 0x558f4dbd60f0 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.395+0000 7f4dd4d61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd60f0 0x558f4dccfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.395+0000 7f4dd4d61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd60f0 0x558f4dccfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58932/0 (socket says 172.21.15.133:58932) 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.395+0000 7f4dd4d61640 1 -- 172.21.15.133:0/1243359203 learned_addr learned my addr 172.21.15.133:0/1243359203 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.395+0000 7f4dd4d61640 1 -- 172.21.15.133:0/1243359203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc804e070 con 0x558f4dbd60f0 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.395+0000 7f4dd4d61640 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd60f0 0x558f4dccfa80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8000c00 tx=0x7f4dc8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.396+0000 7f4cc1602640 1 -- 172.21.15.133:0/1243359203 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc8052e30 con 0x558f4dbd60f0 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.396+0000 7f4cc1602640 1 -- 172.21.15.133:0/1243359203 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc806c460 con 0x558f4dbd60f0 2024-02-15T22:56:29.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.396+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558f4dccffc0 con 0x558f4dbd60f0 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.396+0000 7f4cc1602640 1 -- 172.21.15.133:0/1243359203 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc806c740 con 0x558f4dbd60f0 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.396+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f4dcd04a0 con 0x558f4dbd60f0 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.396+0000 7f4cc1602640 1 -- 172.21.15.133:0/1243359203 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4dc806a070 con 0x558f4dbd60f0 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.397+0000 7f4cc1602640 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cbc0367e0 0x7f4cbc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.397+0000 7f4cc1602640 1 -- 172.21.15.133:0/1243359203 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4dc808cd70 con 0x558f4dbd60f0 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.397+0000 7f4dcffff640 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cbc0367e0 0x7f4cbc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.397+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x558f4dcd4730 0x558f4dcd6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.397+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dcd7060 con 0x558f4dcd4730 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.397+0000 7f4dd5562640 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x558f4dcd4730 0x558f4dcd6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.397+0000 7f4dcffff640 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cbc0367e0 0x7f4cbc038ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0000c00 tx=0x7f4dc00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.397+0000 7f4dd5562640 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x558f4dcd4730 0x558f4dcd6b20 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.398+0000 7f4dd5562640 1 -- 172.21.15.133:0/1243359203 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4dd000a4a0 con 0x558f4dcd4730 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.398+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dcd7450 con 0x558f4dcd4730 2024-02-15T22:56:29.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.398+0000 7f4dd5562640 1 -- 172.21.15.133:0/1243359203 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4dd000a4a0 con 0x558f4dcd4730 2024-02-15T22:56:29.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.398+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dcd8d00 con 0x558f4dcd4730 2024-02-15T22:56:29.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.398+0000 7f4dd5562640 1 -- 172.21.15.133:0/1243359203 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4dd000a4a0 con 0x558f4dcd4730 2024-02-15T22:56:29.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.398+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dcd8010 con 0x558f4dcd4730 2024-02-15T22:56:29.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.398+0000 7f4dd5562640 1 -- 172.21.15.133:0/1243359203 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4dd000a4a0 con 0x558f4dcd4730 2024-02-15T22:56:29.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.398+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dcd8420 con 0x558f4dcd4730 2024-02-15T22:56:29.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.399+0000 7f4dd5562640 1 -- 172.21.15.133:0/1243359203 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4dd000a4a0 con 0x558f4dcd4730 2024-02-15T22:56:29.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.399+0000 7f4dd9616800 1 Processor -- start 2024-02-15T22:56:29.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.399+0000 7f4dd9616800 1 -- start start 2024-02-15T22:56:29.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.399+0000 7f4dd9616800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dce7770 0x558f4dce7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.399+0000 7f4dd9616800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f4da73e80 con 0x558f4dce7770 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.399+0000 7f4dcffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dce7770 0x558f4dce7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.399+0000 7f4dcffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dce7770 0x558f4dce7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58944/0 (socket says 172.21.15.133:58944) 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.399+0000 7f4dcffff640 1 -- 172.21.15.133:0/1647833825 learned_addr learned my addr 172.21.15.133:0/1647833825 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.400+0000 7f4dcffff640 1 -- 172.21.15.133:0/1647833825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f4dce80d0 con 0x558f4dce7770 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.400+0000 7f4dcffff640 1 --2- 172.21.15.133:0/1647833825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dce7770 0x558f4dce7b90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000e610 tx=0x7f4dc000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.400+0000 7f4cba7fc640 1 -- 172.21.15.133:0/1647833825 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc000bea0 con 0x558f4dce7770 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.400+0000 7f4cba7fc640 1 -- 172.21.15.133:0/1647833825 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc000d500 con 0x558f4dce7770 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.400+0000 7f4cba7fc640 1 -- 172.21.15.133:0/1647833825 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc000d7a0 con 0x558f4dce7770 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.400+0000 7f4dd9616800 1 -- 172.21.15.133:0/1647833825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558f4dce8b40 con 0x558f4dce7770 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.400+0000 7f4dd9616800 1 -- 172.21.15.133:0/1647833825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f4dce9000 con 0x558f4dce7770 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.401+0000 7f4cba7fc640 1 -- 172.21.15.133:0/1647833825 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4dc001a070 con 0x558f4dce7770 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.401+0000 7f4cba7fc640 1 --2- 172.21.15.133:0/1647833825 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cac0367e0 0x7f4cac038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.401+0000 7f4cba7fc640 1 -- 172.21.15.133:0/1647833825 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4dc0017050 con 0x558f4dce7770 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.401+0000 7f4dd5562640 1 --2- 172.21.15.133:0/1647833825 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cac0367e0 0x7f4cac038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.401+0000 7f4dd9616800 1 Processor -- start 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.401+0000 7f4dd5562640 1 --2- 172.21.15.133:0/1647833825 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cac0367e0 0x7f4cac038ca0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x558f4dcd7a50 tx=0x7f4dd0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.401+0000 7f4dd9616800 1 -- start start 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.401+0000 7f4dd9616800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcf4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.401+0000 7f4dd9616800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f4da495d0 con 0x558f4dcf4990 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.402+0000 7f4dcffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcf4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.402+0000 7f4dcffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcf4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58958/0 (socket says 172.21.15.133:58958) 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.402+0000 7f4dcffff640 1 -- 172.21.15.133:0/1041470278 learned_addr learned my addr 172.21.15.133:0/1041470278 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.402+0000 7f4dcffff640 1 -- 172.21.15.133:0/1041470278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f4dcf5380 con 0x558f4dcf4990 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.402+0000 7f4dcffff640 1 --2- 172.21.15.133:0/1041470278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcf4db0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4dc004b9d0 tx=0x7f4dc004bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a135d24724503a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.402+0000 7f4cabfff640 1 -- 172.21.15.133:0/1041470278 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc001a320 con 0x558f4dcf4990 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.402+0000 7f4cabfff640 1 -- 172.21.15.133:0/1041470278 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc001a480 con 0x558f4dcf4990 2024-02-15T22:56:29.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.402+0000 7f4cabfff640 1 -- 172.21.15.133:0/1041470278 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc001ac40 con 0x558f4dcf4990 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dd9616800 1 -- 172.21.15.133:0/1041470278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 msgr2=0x558f4dcf4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1041470278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcf4db0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4dc004b9d0 tx=0x7f4dc004bc50 comp rx=0 tx=0).stop 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dd9616800 1 -- 172.21.15.133:0/1041470278 shutdown_connections 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1041470278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcf4db0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dd9616800 1 -- 172.21.15.133:0/1041470278 >> 172.21.15.133:0/1041470278 conn(0x558f4dcf0cf0 msgr2=0x558f4dceed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dd9616800 1 -- 172.21.15.133:0/1041470278 shutdown_connections 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dd9616800 1 -- 172.21.15.133:0/1041470278 wait complete. 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dd9616800 1 Processor -- start 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dd9616800 1 -- start start 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dd9616800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcfb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dd9616800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f4dcfbf10 con 0x558f4dcf4990 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dcffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcfb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dcffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcfb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58966/0 (socket says 172.21.15.133:58966) 2024-02-15T22:56:29.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.403+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 learned_addr learned my addr 172.21.15.133:0/925799305 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.404+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f4dce9000 con 0x558f4dcf4990 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.404+0000 7f4dcffff640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcfb9d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0048040 tx=0x7f4dc004b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.404+0000 7f4caa7fc640 1 -- 172.21.15.133:0/925799305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc001a320 con 0x558f4dcf4990 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.404+0000 7f4caa7fc640 1 -- 172.21.15.133:0/925799305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc00242c0 con 0x558f4dcf4990 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.404+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558f4dcfc110 con 0x558f4dcf4990 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.404+0000 7f4caa7fc640 1 -- 172.21.15.133:0/925799305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc0024680 con 0x558f4dcf4990 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.404+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f4dcfc5d0 con 0x558f4dcf4990 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.405+0000 7f4caa7fc640 1 -- 172.21.15.133:0/925799305 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4dc000d040 con 0x558f4dcf4990 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.405+0000 7f4caa7fc640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ca00367e0 0x7f4ca0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.405+0000 7f4caa7fc640 1 -- 172.21.15.133:0/925799305 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4dc000a040 con 0x558f4dcf4990 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.405+0000 7f4dd5562640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ca00367e0 0x7f4ca0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.406+0000 7f4dd5562640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ca00367e0 0x7f4ca0038ca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000b010 tx=0x7f4dd0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.406+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.406+0000 7f4dd9616800 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x558f4dd077e0 0x558f4dd09ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.406+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd0a3f0 con 0x558f4dd077e0 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.406+0000 7f4dd4d61640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x558f4dd077e0 0x558f4dd09ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.406+0000 7f4dd4d61640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x558f4dd077e0 0x558f4dd09ca0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.406+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.406+0000 7f4dd9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.406+0000 7f4dd9616800 20 realm 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.406+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.406+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd0a7c0 con 0x558f4dd077e0 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd0b040 con 0x558f4dd077e0 2024-02-15T22:56:29.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd0b3a0 con 0x558f4dd077e0 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd0bba0 con 0x558f4dd077e0 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 20 searching for the correct realm 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x558f4dd0da60 0x558f4dd0ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd0da60 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.407+0000 7f4dcffff640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x558f4dd0da60 0x558f4dd0ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.408+0000 7f4dcffff640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x558f4dd0da60 0x558f4dd0ff00 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.408+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.408+0000 7f4dcffff640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4dc004ec20 0x7f4dc0027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.408+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dc004ec20 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.408+0000 7f4dd5562640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4dc004ec20 0x7f4dc0027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.409+0000 7f4dd5562640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4dc004ec20 0x7f4dc0027440 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.409+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dd000a4a0 con 0x7f4dc004ec20 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.409+0000 7f4dd5562640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4dd00141d0 0x7f4dd0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.409+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dd00141d0 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.409+0000 7f4dd4d61640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4dd00141d0 0x7f4dd0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.409+0000 7f4dd4d61640 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4dd00141d0 0x7f4dd0015940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.410+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x7f4dd00141d0 2024-02-15T22:56:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.410+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd077e0 2024-02-15T22:56:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.410+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.410+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd077e0 2024-02-15T22:56:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.410+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.410+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dd00141d0 2024-02-15T22:56:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.410+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x7f4dd00141d0 2024-02-15T22:56:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.410+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dd00141d0 2024-02-15T22:56:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.411+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x7f4dd00141d0 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.411+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dc004ec20 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.411+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dd000a4a0 con 0x7f4dc004ec20 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.411+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd0da60 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.411+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.411+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd077e0 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.411+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.411+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dd00141d0 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.412+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x7f4dd00141d0 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.412+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd077e0 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.412+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.412+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dc004ec20 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.412+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.412+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd0da60 2024-02-15T22:56:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.412+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.412+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd0da60 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.412+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.412+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dd00141d0 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.413+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x7f4dd00141d0 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.413+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd0da60 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.413+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.413+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd0da60 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.413+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.413+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd077e0 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.413+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.413+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd077e0 2024-02-15T22:56:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.414+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.414+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dd00141d0 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.414+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x7f4dd00141d0 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.414+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd0da60 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.414+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.414+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dc004ec20 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.414+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.414+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd077e0 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.415+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4dc8072020 con 0x558f4dd077e0 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.415+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dd00141d0 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.415+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc8072020 con 0x7f4dd00141d0 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.415+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd0da60 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.415+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.415+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dd00141d0 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.415+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.415+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dc004ec20 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.415+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.415+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd0da60 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dd00141d0 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x558f4dd077e0 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd105d0 con 0x7f4dc004ec20 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dd9616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dd9616800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dd9616800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dd9616800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dd9616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.416+0000 7f4dd9616800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd0d040 con 0x558f4dd077e0 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd0c020 con 0x558f4dd077e0 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd0c990 con 0x558f4dd077e0 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 20 zone default found 2024-02-15T22:56:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 4 Realm: () 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 20 zonegroup default 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.417+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd10a10 con 0x7f4dd00141d0 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dd9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd12890 con 0x558f4dd0da60 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dd9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd12bf0 con 0x558f4dd0da60 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dd9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dd9616800 20 started sync module instance, tier type = 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dd9616800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.418+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd11e60 con 0x7f4dc004ec20 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.419+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.419+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94073974235712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd11e60 con 0x7f4dc004ec20 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.419+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd135c0 con 0x558f4dd077e0 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.420+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94073974235712] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.420+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.420+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94073974239424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd11e60 con 0x558f4dd077e0 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.420+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd14050 con 0x558f4dd0da60 2024-02-15T22:56:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.421+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94073974239424] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.422+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.422+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94073974233536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd11de0 con 0x558f4dd0da60 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.422+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd14eb0 con 0x7f4dc004ec20 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.422+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.423+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94073974246384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd15670 con 0x7f4dc004ec20 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.423+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94073974233536] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.423+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd14440 con 0x558f4dd077e0 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.424+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.424+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94073974246384] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.424+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94073974250528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd15670 con 0x558f4dd077e0 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.424+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd15110 con 0x7f4dd00141d0 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.425+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.425+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94073974253184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd150d0 con 0x7f4dd00141d0 2024-02-15T22:56:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.425+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd17590 con 0x7f4dd00141d0 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.425+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94073974250528] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.425+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94073974253184] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.426+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.426+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94073974254240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd170b0 con 0x7f4dd00141d0 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.426+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd17510 con 0x7f4dd00141d0 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.427+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94073974254240] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.427+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.427+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94073974256848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd17970 con 0x7f4dd00141d0 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.427+0000 7f4dd9616800 20 add_watcher() i=0 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.427+0000 7f4dd9616800 20 add_watcher() i=1 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.427+0000 7f4dd9616800 20 add_watcher() i=2 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.427+0000 7f4dd9616800 20 add_watcher() i=3 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.427+0000 7f4dd9616800 20 add_watcher() i=4 2024-02-15T22:56:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.427+0000 7f4dd9616800 20 add_watcher() i=5 2024-02-15T22:56:29.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.427+0000 7f4dd9616800 20 add_watcher() i=6 2024-02-15T22:56:29.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.428+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94073974256848] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.428+0000 7f4dd9616800 20 add_watcher() i=7 2024-02-15T22:56:29.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.428+0000 7f4dd9616800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:29.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.428+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd1af50 con 0x558f4dd077e0 2024-02-15T22:56:29.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.428+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.428+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94073974251584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd18280 con 0x558f4dd077e0 2024-02-15T22:56:29.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.429+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94073974251584] v30'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.429+0000 7f4c8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.429+0000 7f4dd9616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.429+0000 7f4dd9616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.429+0000 7f4dd9616800 5 note: GC not initialized 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.429+0000 7f4c89fe3640 20 reqs_thread_entry: start 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 20 Filter name: none 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4bfb7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd4d050 con 0x7f4dd00141d0 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~386 out=386b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+509 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 20 rados_obj.operate() r=0 bl.length=386 2024-02-15T22:56:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.430+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd4eb90 con 0x7f4dc004ec20 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 : miss 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd50440 con 0x558f4dd0da60 2024-02-15T22:56:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.431+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd54da0 con 0x7f4dc004ec20 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.432+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(65 foo.buckets [call] v30'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.432+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:66 8.e 8:7055aed4:root::.bucket.meta.testx%3amyfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd58640 con 0x7f4dd00141d0 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.433+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [create,call,writefull 0~371,setxattr (203)] v30'5 uv5 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.433+0000 7f4dd9616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x7 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.433+0000 7f4dd9616800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.433+0000 7f4dd9616800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-15T22:56:29.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.433+0000 7f4dd9616800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1, ofs0, ns] 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.433+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94073974521680 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd56270 con 0x7f4dc004ec20 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== watch-notify(notify (1) cookie 94073974246384 notify 128849018893 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x7f4dd0026e40 con 0x7f4dc004ec20 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4cabfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94073974246384 notifier 4537 bl.length()=806 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4cabfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x7 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4cabfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4cabfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(67 notify.3 [notify cookie 94073974521680 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4cabfff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4c98003e90 con 0x7f4dc004ec20 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== watch-notify(notify_complete (2) cookie 94073974521680 notify 128849018893 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4dd0030410 con 0x7f4dc004ec20 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4dd9616800 20 handle_bi_update(): bucket=testx:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_sources= new_sources= 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4dd9616800 20 handle_bi_update(): bucket=testx:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential sources added=[] removed=[] 2024-02-15T22:56:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4dd9616800 20 handle_bi_update(): bucket=testx:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_dests= new_dests= 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4dd9616800 20 handle_bi_update(): bucket=testx:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential dests added=[] removed=[] 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.434+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd560d0 con 0x558f4dd077e0 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.435+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'1 uv1 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.435+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd560d0 con 0x558f4dd077e0 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.436+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.436+0000 7f4dd9616800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.436+0000 7f4dd9616800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.436+0000 7f4dd9616800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.436+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94073974512688 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd56050 con 0x558f4dd077e0 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.436+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 94073974250528 notify 128849018894 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x558f4dcd04a0 con 0x558f4dd077e0 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.436+0000 7f4cabfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94073974250528 notifier 4537 bl.length()=348 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.436+0000 7f4cabfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-15T22:56:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.436+0000 7f4cabfff640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.436+0000 7f4cabfff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4c98003e90 con 0x558f4dd077e0 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.436+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(71 notify.4 [notify cookie 94073974512688 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.437+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.437+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== watch-notify(notify_complete (2) cookie 94073974512688 notify 128849018894 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4dc807b070 con 0x558f4dd077e0 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.437+0000 7f4dd9616800 10 removing default.rgw.meta+root+myfoo from cache 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.437+0000 7f4dd9616800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.437+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94073974512688 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd56050 con 0x7f4dd00141d0 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.437+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== watch-notify(notify (1) cookie 94073974254240 notify 128849018897 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f4dc807b070 con 0x7f4dd00141d0 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.437+0000 7f4cab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94073974254240 notifier 4537 bl.length()=149 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.437+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(73 notify.6 [notify cookie 94073974512688 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.437+0000 7f4cab7fe640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4c080032b0 con 0x7f4dd00141d0 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.438+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(74 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.438+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== watch-notify(notify_complete (2) cookie 94073974512688 notify 128849018897 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558f4dccffc0 con 0x7f4dd00141d0 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.438+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:75 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd560d0 con 0x7f4dc004ec20 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.439+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(75 myfoo [call,delete] v30'25 uv25 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.439+0000 7f4dd9616800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 from cache 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.439+0000 7f4dd9616800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1, ofs0, ns] 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.439+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 7.d 7:b4812045:::notify.4:head [notify cookie 94073974491840 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd56770 con 0x558f4dd077e0 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.439+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== watch-notify(notify (1) cookie 94073974250528 notify 128849018895 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x558f4dccffc0 con 0x558f4dd077e0 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.439+0000 7f4cabfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94073974250528 notifier 4537 bl.length()=206 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.439+0000 7f4cabfff640 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4c98003e90 con 0x558f4dd077e0 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.439+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(76 notify.4 [notify cookie 94073974491840 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.439+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(77 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.439+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== watch-notify(notify_complete (2) cookie 94073974491840 notify 128849018895 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4dc804e070 con 0x558f4dd077e0 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.439+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:78 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd56770 con 0x558f4dd0da60 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.440+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(78 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call,delete] v30'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.441+0000 7f4c8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.441+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94073974251584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd36f10 con 0x558f4dd077e0 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.442+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94073974251584] v30'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.442+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94073974235712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd16040 con 0x7f4dc004ec20 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.443+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94073974235712] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.443+0000 7f4dd9616800 20 remove_watcher() i=0 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.443+0000 7f4dd9616800 2 removed watcher, disabling cache 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.443+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94073974239424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd16040 con 0x558f4dd077e0 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.444+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94073974239424] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.444+0000 7f4dd9616800 20 remove_watcher() i=1 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.444+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94073974233536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd16040 con 0x558f4dd0da60 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.445+0000 7f4dcffff640 1 -- 172.21.15.133:0/925799305 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94073974233536] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc0046d50 con 0x558f4dd0da60 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.445+0000 7f4dd9616800 20 remove_watcher() i=2 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.445+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94073974246384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd119c0 con 0x7f4dc004ec20 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.446+0000 7f4dd5562640 1 -- 172.21.15.133:0/925799305 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94073974246384] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dd003a040 con 0x7f4dc004ec20 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.446+0000 7f4dd9616800 20 remove_watcher() i=3 2024-02-15T22:56:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.446+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94073974250528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd119c0 con 0x558f4dd077e0 2024-02-15T22:56:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.446+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94073974250528] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x558f4dd077e0 2024-02-15T22:56:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.447+0000 7f4dd9616800 20 remove_watcher() i=4 2024-02-15T22:56:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.447+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94073974253184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd15c20 con 0x7f4dd00141d0 2024-02-15T22:56:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.447+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94073974253184] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.448+0000 7f4dd9616800 20 remove_watcher() i=5 2024-02-15T22:56:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.448+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94073974254240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd119c0 con 0x7f4dd00141d0 2024-02-15T22:56:29.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.448+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94073974254240] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.448+0000 7f4dd9616800 20 remove_watcher() i=6 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.448+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94073974256848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558f4dd15c20 con 0x7f4dd00141d0 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.449+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94073974256848] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc80a8040 con 0x7f4dd00141d0 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.449+0000 7f4dd9616800 20 remove_watcher() i=7 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.449+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4dd00141d0 msgr2=0x7f4dd0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4dd00141d0 0x7f4dd0015940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x558f4dd077e0 msgr2=0x558f4dd09ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x558f4dd077e0 0x558f4dd09ca0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4dc004ec20 msgr2=0x7f4dc0027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4dc004ec20 0x7f4dc0027440 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x558f4dd0da60 msgr2=0x558f4dd0ff00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x558f4dd0da60 0x558f4dd0ff00 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ca00367e0 msgr2=0x7f4ca0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ca00367e0 0x7f4ca0038ca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000b010 tx=0x7f4dd0020000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 msgr2=0x558f4dcfb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd4d61640 1 -- 172.21.15.133:0/925799305 reap_dead start 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcfb9d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0048040 tx=0x7f4dc004b930 comp rx=0 tx=0).stop 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 shutdown_connections 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/925799305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dcf4990 0x558f4dcfb9d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 >> 172.21.15.133:0/925799305 conn(0x558f4dcf0cf0 msgr2=0x558f4dcee350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 shutdown_connections 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/925799305 wait complete. 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/1647833825 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cac0367e0 msgr2=0x7f4cac038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1647833825 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cac0367e0 0x7f4cac038ca0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x558f4dcd7a50 tx=0x7f4dd0005840 comp rx=0 tx=0).stop 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/1647833825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dce7770 msgr2=0x558f4dce7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1647833825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dce7770 0x558f4dce7b90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000e610 tx=0x7f4dc000ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/1647833825 shutdown_connections 2024-02-15T22:56:29.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1647833825 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cac0367e0 0x7f4cac038ca0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1647833825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dce7770 0x558f4dce7b90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/1647833825 >> 172.21.15.133:0/1647833825 conn(0x558f4dcdb810 msgr2=0x558f4dcdbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/1647833825 shutdown_connections 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/1647833825 wait complete. 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x558f4dcd4730 msgr2=0x558f4dcd6b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.450+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x558f4dcd4730 0x558f4dcd6b20 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.451+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cbc0367e0 msgr2=0x7f4cbc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.451+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cbc0367e0 0x7f4cbc038ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0000c00 tx=0x7f4dc00013b0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.451+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd60f0 msgr2=0x558f4dccfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.451+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd60f0 0x558f4dccfa80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8000c00 tx=0x7f4dc8002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.451+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 shutdown_connections 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.451+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x558f4dcd4730 0x558f4dcd6b20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.451+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4cbc0367e0 0x7f4cbc038ca0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.451+0000 7f4dd9616800 1 --2- 172.21.15.133:0/1243359203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f4dbd60f0 0x558f4dccfa80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.451+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 >> 172.21.15.133:0/1243359203 conn(0x558f4dbd04f0 msgr2=0x558f4dcbf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.451+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 shutdown_connections 2024-02-15T22:56:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.451+0000 7f4dd9616800 1 -- 172.21.15.133:0/1243359203 wait complete. 2024-02-15T22:56:29.466 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-02-15T22:56:29.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-02-15T22:56:29.466 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-02-15T22:56:29.507 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:29.508 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.506+0000 7f213fb33800 1 Processor -- start 2024-02-15T22:56:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.506+0000 7f213fb33800 1 -- start start 2024-02-15T22:56:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.506+0000 7f213fb33800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x558101169890 0x558101169cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.506+0000 7f213fb33800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5581010b5bb0 con 0x55810116a1f0 2024-02-15T22:56:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.506+0000 7f213fb33800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55810106d450 con 0x558101169890 2024-02-15T22:56:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.506+0000 7f213b892640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x558101169890 0x558101169cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.506+0000 7f2133091640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55810116a1f0 0x55810116a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45168/0 (socket says 172.21.15.133:45168) 2024-02-15T22:56:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.506+0000 7f2133091640 1 -- 172.21.15.133:0/2964660319 learned_addr learned my addr 172.21.15.133:0/2964660319 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.507+0000 7f213b892640 1 -- 172.21.15.133:0/2964660319 >> v1:172.21.15.52:6789/0 conn(0x55810116a1f0 legacy=0x55810116a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.507+0000 7f213b892640 1 -- 172.21.15.133:0/2964660319 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581010de310 con 0x558101169890 2024-02-15T22:56:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.507+0000 7f213b091640 1 -- 172.21.15.133:0/2964660319 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350999861 0 0) 0x5581010b5bb0 con 0x55810116a1f0 2024-02-15T22:56:29.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.508+0000 7f213b892640 1 --2- 172.21.15.133:0/2964660319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x558101169cb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f212c00a470 tx=0x7f212c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9811e47d9d1aac4e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.508+0000 7f213b091640 1 -- 172.21.15.133:0/2964660319 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212c052570 con 0x558101169890 2024-02-15T22:56:29.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.509+0000 7f213b091640 1 -- 172.21.15.133:0/2964660319 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c0526d0 con 0x558101169890 2024-02-15T22:56:29.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.509+0000 7f213b091640 1 -- 172.21.15.133:0/2964660319 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212c052990 con 0x558101169890 2024-02-15T22:56:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.509+0000 7f213fb33800 1 -- 172.21.15.133:0/2964660319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 msgr2=0x558101169cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.509+0000 7f213fb33800 1 --2- 172.21.15.133:0/2964660319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x558101169cb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f212c00a470 tx=0x7f212c01cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.509+0000 7f213fb33800 1 -- 172.21.15.133:0/2964660319 shutdown_connections 2024-02-15T22:56:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.509+0000 7f213fb33800 1 --2- 172.21.15.133:0/2964660319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x558101169cb0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.509+0000 7f213fb33800 1 -- 172.21.15.133:0/2964660319 >> 172.21.15.133:0/2964660319 conn(0x5581011654d0 msgr2=0x5581011678f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.509+0000 7f213fb33800 1 -- 172.21.15.133:0/2964660319 shutdown_connections 2024-02-15T22:56:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.509+0000 7f213fb33800 1 -- 172.21.15.133:0/2964660319 wait complete. 2024-02-15T22:56:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.521+0000 7f213fb33800 1 Processor -- start 2024-02-15T22:56:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.521+0000 7f213fb33800 1 -- start start 2024-02-15T22:56:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.521+0000 7f213fb33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x55810125d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.521+0000 7f213fb33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810106a980 con 0x558101169890 2024-02-15T22:56:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.521+0000 7f213b892640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x55810125d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.521+0000 7f213b892640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x55810125d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58984/0 (socket says 172.21.15.133:58984) 2024-02-15T22:56:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.521+0000 7f213b892640 1 -- 172.21.15.133:0/483541262 learned_addr learned my addr 172.21.15.133:0/483541262 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.521+0000 7f213b892640 1 -- 172.21.15.133:0/483541262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c005d20 con 0x558101169890 2024-02-15T22:56:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.522+0000 7f213b892640 1 --2- 172.21.15.133:0/483541262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x55810125d090 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f212c055040 tx=0x7f212c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e26d84737fe1d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.522+0000 7f2029e0b640 1 -- 172.21.15.133:0/483541262 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212c00a180 con 0x558101169890 2024-02-15T22:56:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.522+0000 7f2029e0b640 1 -- 172.21.15.133:0/483541262 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c00a2e0 con 0x558101169890 2024-02-15T22:56:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.522+0000 7f2029e0b640 1 -- 172.21.15.133:0/483541262 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212c0529b0 con 0x558101169890 2024-02-15T22:56:29.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.522+0000 7f213fb33800 1 -- 172.21.15.133:0/483541262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 msgr2=0x55810125d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.522+0000 7f213fb33800 1 --2- 172.21.15.133:0/483541262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x55810125d090 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f212c055040 tx=0x7f212c04c000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.522+0000 7f213fb33800 1 -- 172.21.15.133:0/483541262 shutdown_connections 2024-02-15T22:56:29.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.522+0000 7f213fb33800 1 --2- 172.21.15.133:0/483541262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x55810125d090 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.523+0000 7f213fb33800 1 -- 172.21.15.133:0/483541262 >> 172.21.15.133:0/483541262 conn(0x5581011654d0 msgr2=0x5581012589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.523+0000 7f213fb33800 1 -- 172.21.15.133:0/483541262 shutdown_connections 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.523+0000 7f213fb33800 1 -- 172.21.15.133:0/483541262 wait complete. 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.523+0000 7f213fb33800 1 Processor -- start 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.523+0000 7f213fb33800 1 -- start start 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.523+0000 7f213fb33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x5581012646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.523+0000 7f213fb33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x558101066160 con 0x558101169890 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.523+0000 7f213b892640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x5581012646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.523+0000 7f213b892640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x5581012646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:58994/0 (socket says 172.21.15.133:58994) 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.523+0000 7f213b892640 1 -- 172.21.15.133:0/3438471919 learned_addr learned my addr 172.21.15.133:0/3438471919 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.523+0000 7f213b892640 1 -- 172.21.15.133:0/3438471919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581010de310 con 0x558101169890 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.524+0000 7f213b892640 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x5581012646e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f212c00a470 tx=0x7f212c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.524+0000 7f2023fff640 1 -- 172.21.15.133:0/3438471919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212c06a070 con 0x558101169890 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.524+0000 7f2023fff640 1 -- 172.21.15.133:0/3438471919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c05d420 con 0x558101169890 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.524+0000 7f2023fff640 1 -- 172.21.15.133:0/3438471919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212c05d5d0 con 0x558101169890 2024-02-15T22:56:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.524+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558101264c20 con 0x558101169890 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.524+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558101265100 con 0x558101169890 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.525+0000 7f2023fff640 1 -- 172.21.15.133:0/3438471919 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f212c05d730 con 0x558101169890 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.525+0000 7f2023fff640 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20240367e0 0x7f2024038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.525+0000 7f2023fff640 1 -- 172.21.15.133:0/3438471919 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f212c08d8e0 con 0x558101169890 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.525+0000 7f2133091640 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20240367e0 0x7f2024038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.525+0000 7f213fb33800 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55810116a1f0 0x55810126b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.525+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55810126b9c0 con 0x55810116a1f0 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.525+0000 7f213c093640 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55810116a1f0 0x55810126b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.525+0000 7f2133091640 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20240367e0 0x7f2024038ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2124000c00 tx=0x7f21240013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.525+0000 7f213c093640 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55810116a1f0 0x55810126b3c0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.526+0000 7f213c093640 1 -- 172.21.15.133:0/3438471919 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f213400a4a0 con 0x55810116a1f0 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.526+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558101268ac0 con 0x55810116a1f0 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.526+0000 7f213c093640 1 -- 172.21.15.133:0/3438471919 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f213400a4a0 con 0x55810116a1f0 2024-02-15T22:56:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.526+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55810126be70 con 0x55810116a1f0 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.526+0000 7f213c093640 1 -- 172.21.15.133:0/3438471919 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f213400a4a0 con 0x55810116a1f0 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.526+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55810126cb80 con 0x55810116a1f0 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.526+0000 7f213c093640 1 -- 172.21.15.133:0/3438471919 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f213400a4a0 con 0x55810116a1f0 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.526+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55810126cf90 con 0x55810116a1f0 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.527+0000 7f213c093640 1 -- 172.21.15.133:0/3438471919 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f213400a4a0 con 0x55810116a1f0 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.527+0000 7f213fb33800 1 Processor -- start 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.527+0000 7f213fb33800 1 -- start start 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.527+0000 7f213fb33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55810127c0c0 0x55810127c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.527+0000 7f213fb33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x558101008e80 con 0x55810127c0c0 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.528+0000 7f2133091640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55810127c0c0 0x55810127c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.528+0000 7f2133091640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55810127c0c0 0x55810127c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59006/0 (socket says 172.21.15.133:59006) 2024-02-15T22:56:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.528+0000 7f2133091640 1 -- 172.21.15.133:0/2024673776 learned_addr learned my addr 172.21.15.133:0/2024673776 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.528+0000 7f2133091640 1 -- 172.21.15.133:0/2024673776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55810127ca20 con 0x55810127c0c0 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.528+0000 7f2133091640 1 --2- 172.21.15.133:0/2024673776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55810127c0c0 0x55810127c4e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f212400e610 tx=0x7f212400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.528+0000 7f20217fa640 1 -- 172.21.15.133:0/2024673776 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212400bea0 con 0x55810127c0c0 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.528+0000 7f20217fa640 1 -- 172.21.15.133:0/2024673776 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212400d500 con 0x55810127c0c0 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.528+0000 7f213fb33800 1 -- 172.21.15.133:0/2024673776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55810127d490 con 0x55810127c0c0 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.528+0000 7f20217fa640 1 -- 172.21.15.133:0/2024673776 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212400d7a0 con 0x55810127c0c0 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.528+0000 7f213fb33800 1 -- 172.21.15.133:0/2024673776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55810127d950 con 0x55810127c0c0 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.529+0000 7f20217fa640 1 -- 172.21.15.133:0/2024673776 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f212401a070 con 0x55810127c0c0 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.529+0000 7f20217fa640 1 --2- 172.21.15.133:0/2024673776 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20140367e0 0x7f2014038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.529+0000 7f20217fa640 1 -- 172.21.15.133:0/2024673776 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f2124017050 con 0x55810127c0c0 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.529+0000 7f213c093640 1 --2- 172.21.15.133:0/2024673776 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20140367e0 0x7f2014038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.529+0000 7f213fb33800 1 Processor -- start 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.529+0000 7f213c093640 1 --2- 172.21.15.133:0/2024673776 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20140367e0 0x7f2014038ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55810126c5c0 tx=0x7f2134005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.529+0000 7f213fb33800 1 -- start start 2024-02-15T22:56:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.530+0000 7f213fb33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101289700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.530+0000 7f213fb33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x558100fde5d0 con 0x5581012892e0 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.530+0000 7f2133091640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101289700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.530+0000 7f2133091640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101289700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59010/0 (socket says 172.21.15.133:59010) 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.530+0000 7f2133091640 1 -- 172.21.15.133:0/1007570887 learned_addr learned my addr 172.21.15.133:0/1007570887 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.530+0000 7f2133091640 1 -- 172.21.15.133:0/1007570887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558101289cd0 con 0x5581012892e0 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.530+0000 7f2133091640 1 --2- 172.21.15.133:0/1007570887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101289700 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f212404b9d0 tx=0x7f2124026520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8652e02e3caeac9f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.530+0000 7f201affd640 1 -- 172.21.15.133:0/1007570887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212404d070 con 0x5581012892e0 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.530+0000 7f201affd640 1 -- 172.21.15.133:0/1007570887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212404d1d0 con 0x5581012892e0 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.530+0000 7f201affd640 1 -- 172.21.15.133:0/1007570887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212401a320 con 0x5581012892e0 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f213fb33800 1 -- 172.21.15.133:0/1007570887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 msgr2=0x558101289700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f213fb33800 1 --2- 172.21.15.133:0/1007570887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101289700 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f212404b9d0 tx=0x7f2124026520 comp rx=0 tx=0).stop 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f213fb33800 1 -- 172.21.15.133:0/1007570887 shutdown_connections 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f213fb33800 1 --2- 172.21.15.133:0/1007570887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101289700 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f213fb33800 1 -- 172.21.15.133:0/1007570887 >> 172.21.15.133:0/1007570887 conn(0x558101285640 msgr2=0x5581012836a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f213fb33800 1 -- 172.21.15.133:0/1007570887 shutdown_connections 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f213fb33800 1 -- 172.21.15.133:0/1007570887 wait complete. 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f213fb33800 1 Processor -- start 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f213fb33800 1 -- start start 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f213fb33800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101290310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f213fb33800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x558101290850 con 0x5581012892e0 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f2133091640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101290310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f2133091640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101290310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59018/0 (socket says 172.21.15.133:59018) 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.531+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 learned_addr learned my addr 172.21.15.133:0/3042411301 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.532+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55810127d950 con 0x5581012892e0 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.532+0000 7f2133091640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101290310 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2124024fd0 tx=0x7f212404b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.532+0000 7f20197fa640 1 -- 172.21.15.133:0/3042411301 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2124024680 con 0x5581012892e0 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.532+0000 7f20197fa640 1 -- 172.21.15.133:0/3042411301 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212404bae0 con 0x5581012892e0 2024-02-15T22:56:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.532+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558101290a50 con 0x5581012892e0 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.532+0000 7f20197fa640 1 -- 172.21.15.133:0/3042411301 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212404bda0 con 0x5581012892e0 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.532+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558101290e50 con 0x5581012892e0 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.533+0000 7f20197fa640 1 -- 172.21.15.133:0/3042411301 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f212400d040 con 0x5581012892e0 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.533+0000 7f20197fa640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20040367e0 0x7f2004038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.533+0000 7f20197fa640 1 -- 172.21.15.133:0/3042411301 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f212400a040 con 0x5581012892e0 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.533+0000 7f213c093640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20040367e0 0x7f2004038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.533+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.533+0000 7f213fb33800 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55810129c040 0x55810129e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.533+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55810129ec50 con 0x55810129c040 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.533+0000 7f213b892640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55810129c040 0x55810129e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.533+0000 7f213c093640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20040367e0 0x7f2004038ca0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f213400b010 tx=0x7f2134020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213b892640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55810129c040 0x55810129e500 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f212c059040 con 0x55810129c040 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 20 realm 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55810129efe0 con 0x55810129c040 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f212c059040 con 0x55810129c040 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55810129f860 con 0x55810129c040 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f212c059040 con 0x55810129c040 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55810129fbc0 con 0x55810129c040 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f212c059040 con 0x55810129c040 2024-02-15T22:56:29.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.534+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55810129f4c0 con 0x55810129c040 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.535+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f212c07e380 con 0x55810129c040 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.535+0000 7f213fb33800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.535+0000 7f213fb33800 20 searching for the correct realm 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.535+0000 7f213fb33800 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5581012a1f40 0x5581012a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.535+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x5581012a1f40 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.535+0000 7f2133091640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5581012a1f40 0x5581012a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.535+0000 7f2133091640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5581012a1f40 0x5581012a4330 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.536+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.536+0000 7f2133091640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f2124033020 0x7f2124028030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.536+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f2124033020 2024-02-15T22:56:29.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.536+0000 7f213c093640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f2124033020 0x7f2124028030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.536+0000 7f213c093640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f2124033020 0x7f2124028030 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.536+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f213400a4a0 con 0x7f2124033020 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.536+0000 7f213c093640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21340141d0 0x7f2134015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.536+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f21340141d0 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.536+0000 7f213b892640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21340141d0 0x7f2134015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.537+0000 7f213b892640 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21340141d0 0x7f2134015940 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.537+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c07e380 con 0x7f21340141d0 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.537+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x55810129c040 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.537+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c086040 con 0x55810129c040 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.537+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x55810129c040 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.538+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c086040 con 0x55810129c040 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.538+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f21340141d0 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.538+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c086040 con 0x7f21340141d0 2024-02-15T22:56:29.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.538+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f21340141d0 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.538+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c086040 con 0x7f21340141d0 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.538+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f2124033020 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.538+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f213400a4a0 con 0x7f2124033020 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.538+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x5581012a1f40 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.539+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.539+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x55810129c040 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.539+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c086040 con 0x55810129c040 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.539+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f21340141d0 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.539+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c086040 con 0x7f21340141d0 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.539+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x55810129c040 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.539+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c086040 con 0x55810129c040 2024-02-15T22:56:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.539+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f2124033020 2024-02-15T22:56:29.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.540+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f213403a040 con 0x7f2124033020 2024-02-15T22:56:29.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.540+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x5581012a1f40 2024-02-15T22:56:29.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.540+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.540+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x5581012a1f40 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.540+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.540+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f21340141d0 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.540+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c086040 con 0x7f21340141d0 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.540+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x5581012a1f40 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.541+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.541+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x5581012a1f40 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.541+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.541+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x55810129c040 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.541+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c086040 con 0x55810129c040 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.541+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x55810129c040 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.541+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f212c086040 con 0x55810129c040 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.541+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f21340141d0 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.542+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.542+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x5581012a1f40 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.542+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.542+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f2124033020 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.542+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f213403a040 con 0x7f2124033020 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.542+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x55810129c040 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.542+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.542+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f21340141d0 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.543+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.543+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x5581012a1f40 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.543+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.543+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f21340141d0 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.543+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.543+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f2124033020 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.543+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f213403a040 con 0x7f2124033020 2024-02-15T22:56:29.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.543+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x5581012a1f40 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f21340141d0 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x55810129c040 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4a00 con 0x7f2124033020 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f213403a040 con 0x7f2124033020 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213fb33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213fb33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213fb33800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213fb33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213fb33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213fb33800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:29.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.544+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a0a10 con 0x55810129c040 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a0690 con 0x55810129c040 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a13a0 con 0x55810129c040 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 20 zone default found 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 4 Realm: () 2024-02-15T22:56:29.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 20 zonegroup default 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.545+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a4e90 con 0x7f21340141d0 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f213fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a6c20 con 0x5581012a1f40 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f213fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a6f80 con 0x5581012a1f40 2024-02-15T22:56:29.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f213fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f213fb33800 20 started sync module instance, tier type = 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f213fb33800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.546+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a6500 con 0x7f2124033020 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.547+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f213403a040 con 0x7f2124033020 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.547+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94012558696544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a68b0 con 0x7f2124033020 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.547+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a7cb0 con 0x55810129c040 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.548+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94012558696544] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f213403a040 con 0x7f2124033020 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.548+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.548+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94012558701696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a7e00 con 0x55810129c040 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.548+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a88d0 con 0x5581012a1f40 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.549+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.549+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94012558701696] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.549+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94012558705584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a8c80 con 0x5581012a1f40 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.549+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a9650 con 0x7f2124033020 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.550+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94012558705584] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.550+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f213403a040 con 0x7f2124033020 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.550+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94012558709072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a9a30 con 0x7f2124033020 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.550+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012aa430 con 0x55810129c040 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.551+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.551+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94012558712624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012aa3f0 con 0x55810129c040 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.551+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012ab3b0 con 0x7f21340141d0 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.552+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94012558709072] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f213403a040 con 0x7f2124033020 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.552+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.552+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94012558716624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012ab3b0 con 0x7f21340141d0 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.552+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012abdb0 con 0x7f21340141d0 2024-02-15T22:56:29.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.552+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94012558712624] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.553+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.553+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94012558714800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012abd70 con 0x7f21340141d0 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.553+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94012558716624] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.553+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a78c0 con 0x7f21340141d0 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.554+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94012558714800] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.554+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.554+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94012558719184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012abcf0 con 0x7f21340141d0 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.554+0000 7f213fb33800 20 add_watcher() i=0 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.554+0000 7f213fb33800 20 add_watcher() i=1 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.554+0000 7f213fb33800 20 add_watcher() i=2 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.554+0000 7f213fb33800 20 add_watcher() i=3 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.554+0000 7f213fb33800 20 add_watcher() i=4 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.554+0000 7f213fb33800 20 add_watcher() i=5 2024-02-15T22:56:29.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.554+0000 7f213fb33800 20 add_watcher() i=6 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.555+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94012558719184] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.555+0000 7f213fb33800 20 add_watcher() i=7 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.555+0000 7f213fb33800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.555+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012af780 con 0x55810129c040 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.556+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.556+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94012558721600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012acb00 con 0x55810129c040 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.557+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94012558721600] v30'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.557+0000 7f1ff1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.557+0000 7f213fb33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.557+0000 7f213fb33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.557+0000 7f213fb33800 5 note: GC not initialized 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.557+0000 7f1ff0fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.557+0000 7f213fb33800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:29.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.557+0000 7f213fb33800 20 Filter name: none 2024-02-15T22:56:29.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.557+0000 7f1f6a7fc640 20 reqs_thread_entry: start 2024-02-15T22:56:29.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.557+0000 7f213fb33800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.557+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012e11d0 con 0x55810129c040 2024-02-15T22:56:29.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.558+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+332 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.558+0000 7f213fb33800 20 rados_obj.operate() r=0 bl.length=193 2024-02-15T22:56:29.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.558+0000 7f1ff1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.558+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94012558721600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012ae810 con 0x55810129c040 2024-02-15T22:56:29.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.559+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94012558721600] v30'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.559+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94012558696544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012ac240 con 0x7f2124033020 2024-02-15T22:56:29.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.560+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94012558696544] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f213403a040 con 0x7f2124033020 2024-02-15T22:56:29.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.560+0000 7f213fb33800 20 remove_watcher() i=0 2024-02-15T22:56:29.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.560+0000 7f213fb33800 2 removed watcher, disabling cache 2024-02-15T22:56:29.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.560+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94012558701696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012ac240 con 0x55810129c040 2024-02-15T22:56:29.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.561+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94012558701696] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.561+0000 7f213fb33800 20 remove_watcher() i=1 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.561+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94012558705584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012ac240 con 0x5581012a1f40 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.562+0000 7f2133091640 1 -- 172.21.15.133:0/3042411301 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94012558705584] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2124053040 con 0x5581012a1f40 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.562+0000 7f213fb33800 20 remove_watcher() i=2 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.562+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94012558709072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a83b0 con 0x7f2124033020 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.563+0000 7f213c093640 1 -- 172.21.15.133:0/3042411301 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94012558709072] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f213403a040 con 0x7f2124033020 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.563+0000 7f213fb33800 20 remove_watcher() i=3 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.563+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94012558712624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a9150 con 0x55810129c040 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.564+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94012558712624] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x55810129c040 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.564+0000 7f213fb33800 20 remove_watcher() i=4 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.564+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94012558716624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012a83b0 con 0x7f21340141d0 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.565+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94012558716624] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.565+0000 7f213fb33800 20 remove_watcher() i=5 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.565+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94012558714800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012aaed0 con 0x7f21340141d0 2024-02-15T22:56:29.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.566+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94012558714800] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.566+0000 7f213fb33800 20 remove_watcher() i=6 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.566+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94012558719184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5581012aaed0 con 0x7f21340141d0 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.567+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94012558719184] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f212c09d040 con 0x7f21340141d0 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.567+0000 7f213fb33800 20 remove_watcher() i=7 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.567+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21340141d0 msgr2=0x7f2134015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.567+0000 7f213fb33800 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21340141d0 0x7f2134015940 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.567+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55810129c040 msgr2=0x55810129e500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.567+0000 7f213fb33800 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55810129c040 0x55810129e500 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.567+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f2124033020 msgr2=0x7f2124028030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.567+0000 7f213fb33800 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f2124033020 0x7f2124028030 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.567+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5581012a1f40 msgr2=0x5581012a4330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.567+0000 7f213fb33800 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5581012a1f40 0x5581012a4330 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.567+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20040367e0 msgr2=0x7f2004038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20040367e0 0x7f2004038ca0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f213400b010 tx=0x7f2134020000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 msgr2=0x558101290310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213b892640 1 -- 172.21.15.133:0/3042411301 reap_dead start 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101290310 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2124024fd0 tx=0x7f212404b930 comp rx=0 tx=0).stop 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 shutdown_connections 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/3042411301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5581012892e0 0x558101290310 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 >> 172.21.15.133:0/3042411301 conn(0x558101285640 msgr2=0x558101282ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 shutdown_connections 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/3042411301 wait complete. 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/2024673776 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20140367e0 msgr2=0x7f2014038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/2024673776 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20140367e0 0x7f2014038ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55810126c5c0 tx=0x7f2134005840 comp rx=0 tx=0).stop 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/2024673776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55810127c0c0 msgr2=0x55810127c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/2024673776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55810127c0c0 0x55810127c4e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f212400e610 tx=0x7f212400ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/2024673776 shutdown_connections 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/2024673776 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20140367e0 0x7f2014038ca0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/2024673776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55810127c0c0 0x55810127c4e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/2024673776 >> 172.21.15.133:0/2024673776 conn(0x558101270160 msgr2=0x558101270560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/2024673776 shutdown_connections 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/2024673776 wait complete. 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55810116a1f0 msgr2=0x55810126b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55810116a1f0 0x55810126b3c0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20240367e0 msgr2=0x7f2024038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20240367e0 0x7f2024038ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2124000c00 tx=0x7f21240013b0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 msgr2=0x5581012646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x5581012646e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f212c00a470 tx=0x7f212c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 shutdown_connections 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55810116a1f0 0x55810126b3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20240367e0 0x7f2024038ca0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 --2- 172.21.15.133:0/3438471919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558101169890 0x5581012646e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.568+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 >> 172.21.15.133:0/3438471919 conn(0x5581011654d0 msgr2=0x558101257250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.569+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 shutdown_connections 2024-02-15T22:56:29.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.569+0000 7f213fb33800 1 -- 172.21.15.133:0/3438471919 wait complete. 2024-02-15T22:56:29.581 INFO:teuthology.orchestra.run.smithi133.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"NBglLrmLVO2l7y6nt1Qfc2x8","ver":2},"mtime":"2024-02-15T22:56:29.436577Z","data":{"bucket":{"name":"myfoo","marker":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","bucket_id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-02-15T22:56:26.869244Z","linked":true,"has_bucket_info":false}} 2024-02-15T22:56:29.582 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'NBglLrmLVO2l7y6nt1Qfc2x8', 'ver': 2}, 'mtime': '2024-02-15T22:56:29.436577Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'bucket_id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-02-15T22:56:26.869244Z', 'linked': True, 'has_bucket_info': False}} 2024-02-15T22:56:29.582 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-15T22:56:29.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-15T22:56:29.582 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-02-15T22:56:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.665+0000 7f311722e800 1 Processor -- start 2024-02-15T22:56:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.665+0000 7f311722e800 1 -- start start 2024-02-15T22:56:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.665+0000 7f311722e800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563899e908f0 0x563899e90d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.665+0000 7f311722e800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563899ddcba0 con 0x563899e91250 2024-02-15T22:56:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.665+0000 7f311722e800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x563899d94450 con 0x563899e908f0 2024-02-15T22:56:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.665+0000 7f3112533640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563899e908f0 0x563899e90d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.665+0000 7f3111d32640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x563899e91250 0x563899e91700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45180/0 (socket says 172.21.15.133:45180) 2024-02-15T22:56:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.665+0000 7f3111d32640 1 -- 172.21.15.133:0/280985818 learned_addr learned my addr 172.21.15.133:0/280985818 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.666+0000 7f3111531640 1 -- 172.21.15.133:0/280985818 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181132383 0 0) 0x563899ddcba0 con 0x563899e91250 2024-02-15T22:56:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.666+0000 7f3111531640 1 -- 172.21.15.133:0/280985818 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30fc001e10 con 0x563899e91250 2024-02-15T22:56:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.666+0000 7f3112533640 1 -- 172.21.15.133:0/280985818 >> v1:172.21.15.52:6789/0 conn(0x563899e91250 legacy=0x563899e91700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.666+0000 7f3112533640 1 -- 172.21.15.133:0/280985818 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563899e052f0 con 0x563899e908f0 2024-02-15T22:56:29.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.668+0000 7f3112533640 1 --2- 172.21.15.133:0/280985818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899e90d10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f310400a470 tx=0x7f310401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f231c620fac9f31b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.668+0000 7f3111531640 1 -- 172.21.15.133:0/280985818 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f310404ad60 con 0x563899e908f0 2024-02-15T22:56:29.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.668+0000 7f3111531640 1 -- 172.21.15.133:0/280985818 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3104052440 con 0x563899e908f0 2024-02-15T22:56:29.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.668+0000 7f3111531640 1 -- 172.21.15.133:0/280985818 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3104052700 con 0x563899e908f0 2024-02-15T22:56:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.668+0000 7f311722e800 1 -- 172.21.15.133:0/280985818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 msgr2=0x563899e90d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.668+0000 7f311722e800 1 --2- 172.21.15.133:0/280985818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899e90d10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f310400a470 tx=0x7f310401cc80 comp rx=0 tx=0).stop 2024-02-15T22:56:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.668+0000 7f311722e800 1 -- 172.21.15.133:0/280985818 shutdown_connections 2024-02-15T22:56:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.668+0000 7f311722e800 1 --2- 172.21.15.133:0/280985818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899e90d10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.668+0000 7f311722e800 1 -- 172.21.15.133:0/280985818 >> 172.21.15.133:0/280985818 conn(0x563899e8c4f0 msgr2=0x563899e8e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.668+0000 7f311722e800 1 -- 172.21.15.133:0/280985818 shutdown_connections 2024-02-15T22:56:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.668+0000 7f311722e800 1 -- 172.21.15.133:0/280985818 wait complete. 2024-02-15T22:56:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.680+0000 7f311722e800 1 Processor -- start 2024-02-15T22:56:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.680+0000 7f311722e800 1 -- start start 2024-02-15T22:56:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.680+0000 7f311722e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f84040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.680+0000 7f311722e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563899d91980 con 0x563899e908f0 2024-02-15T22:56:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.681+0000 7f3112533640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f84040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.681+0000 7f3112533640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f84040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59036/0 (socket says 172.21.15.133:59036) 2024-02-15T22:56:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.681+0000 7f3112533640 1 -- 172.21.15.133:0/18238653 learned_addr learned my addr 172.21.15.133:0/18238653 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.681+0000 7f3112533640 1 -- 172.21.15.133:0/18238653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3104005d20 con 0x563899e908f0 2024-02-15T22:56:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.681+0000 7f3112533640 1 --2- 172.21.15.133:0/18238653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f84040 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3104055040 tx=0x7f310404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213545c9dc1cee1b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.681+0000 7f3000608640 1 -- 172.21.15.133:0/18238653 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f310400a040 con 0x563899e908f0 2024-02-15T22:56:29.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.681+0000 7f3000608640 1 -- 172.21.15.133:0/18238653 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310400a1a0 con 0x563899e908f0 2024-02-15T22:56:29.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.681+0000 7f3000608640 1 -- 172.21.15.133:0/18238653 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31040525b0 con 0x563899e908f0 2024-02-15T22:56:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.682+0000 7f311722e800 1 -- 172.21.15.133:0/18238653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 msgr2=0x563899f84040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.682+0000 7f311722e800 1 --2- 172.21.15.133:0/18238653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f84040 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3104055040 tx=0x7f310404c000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.682+0000 7f311722e800 1 -- 172.21.15.133:0/18238653 shutdown_connections 2024-02-15T22:56:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.682+0000 7f311722e800 1 --2- 172.21.15.133:0/18238653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f84040 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.682+0000 7f311722e800 1 -- 172.21.15.133:0/18238653 >> 172.21.15.133:0/18238653 conn(0x563899e8c4f0 msgr2=0x563899f7f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.682+0000 7f311722e800 1 -- 172.21.15.133:0/18238653 shutdown_connections 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.682+0000 7f311722e800 1 -- 172.21.15.133:0/18238653 wait complete. 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.682+0000 7f311722e800 1 Processor -- start 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.682+0000 7f311722e800 1 -- start start 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f311722e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f8b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f311722e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563899d8d160 con 0x563899e908f0 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f3112533640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f8b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f3112533640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f8b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59040/0 (socket says 172.21.15.133:59040) 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f3112533640 1 -- 172.21.15.133:0/1643378537 learned_addr learned my addr 172.21.15.133:0/1643378537 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f3112533640 1 -- 172.21.15.133:0/1643378537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563899e052f0 con 0x563899e908f0 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f3112533640 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f8b670 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3104055040 tx=0x7f3104002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f2ffee05640 1 -- 172.21.15.133:0/1643378537 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f310406b070 con 0x563899e908f0 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f2ffee05640 1 -- 172.21.15.133:0/1643378537 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3104052c60 con 0x563899e908f0 2024-02-15T22:56:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563899f8bbb0 con 0x563899e908f0 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f2ffee05640 1 -- 172.21.15.133:0/1643378537 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f310406f410 con 0x563899e908f0 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.683+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563899f8c0f0 con 0x563899e908f0 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.684+0000 7f2ffee05640 1 -- 172.21.15.133:0/1643378537 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3104059050 con 0x563899e908f0 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.684+0000 7f2ffee05640 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2ff8036790 0x7f2ff8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.684+0000 7f2ffee05640 1 -- 172.21.15.133:0/1643378537 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f310408ce80 con 0x563899e908f0 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.684+0000 7f3111d32640 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2ff8036790 0x7f2ff8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.684+0000 7f311722e800 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563899e91250 0x563899f924a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.684+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899f929e0 con 0x563899e91250 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.685+0000 7f3112d34640 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563899e91250 0x563899f924a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.685+0000 7f3111d32640 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2ff8036790 0x7f2ff8038c50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3108000f60 tx=0x7f31080010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.685+0000 7f3112d34640 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563899e91250 0x563899f924a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.685+0000 7f3112d34640 1 -- 172.21.15.133:0/1643378537 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f310c00a4a0 con 0x563899e91250 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.685+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899f8fa60 con 0x563899e91250 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.685+0000 7f3112d34640 1 -- 172.21.15.133:0/1643378537 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f310c00a4a0 con 0x563899e91250 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.685+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899f94710 con 0x563899e91250 2024-02-15T22:56:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.686+0000 7f3112d34640 1 -- 172.21.15.133:0/1643378537 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f310c00a4a0 con 0x563899e91250 2024-02-15T22:56:29.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.686+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899f93910 con 0x563899e91250 2024-02-15T22:56:29.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.686+0000 7f3112d34640 1 -- 172.21.15.133:0/1643378537 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f310c00a4a0 con 0x563899e91250 2024-02-15T22:56:29.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.686+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899f93d20 con 0x563899e91250 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.686+0000 7f3112d34640 1 -- 172.21.15.133:0/1643378537 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f310c00a4a0 con 0x563899e91250 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f311722e800 1 Processor -- start 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f311722e800 1 -- start start 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f311722e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fa3120 0x563899fa3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f311722e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563899d2fe80 con 0x563899fa3120 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f3111d32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fa3120 0x563899fa3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f3111d32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fa3120 0x563899fa3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59056/0 (socket says 172.21.15.133:59056) 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f3111d32640 1 -- 172.21.15.133:0/392306645 learned_addr learned my addr 172.21.15.133:0/392306645 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f3111d32640 1 -- 172.21.15.133:0/392306645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563899fa3a80 con 0x563899fa3120 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f3111d32640 1 --2- 172.21.15.133:0/392306645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fa3120 0x563899fa3540 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f310800bec0 tx=0x7f310800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f2ff7fff640 1 -- 172.21.15.133:0/392306645 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3108020070 con 0x563899fa3120 2024-02-15T22:56:29.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f2ff7fff640 1 -- 172.21.15.133:0/392306645 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310801b550 con 0x563899fa3120 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.687+0000 7f311722e800 1 -- 172.21.15.133:0/392306645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563899fa44f0 con 0x563899fa3120 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.688+0000 7f2ff7fff640 1 -- 172.21.15.133:0/392306645 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3108013040 con 0x563899fa3120 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.688+0000 7f311722e800 1 -- 172.21.15.133:0/392306645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563899fa49b0 con 0x563899fa3120 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.688+0000 7f2ff7fff640 1 -- 172.21.15.133:0/392306645 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f310801b830 con 0x563899fa3120 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.688+0000 7f2ff7fff640 1 --2- 172.21.15.133:0/392306645 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2fec0367e0 0x7f2fec038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.688+0000 7f2ff7fff640 1 -- 172.21.15.133:0/392306645 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f310804e130 con 0x563899fa3120 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.689+0000 7f3112d34640 1 --2- 172.21.15.133:0/392306645 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2fec0367e0 0x7f2fec038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.689+0000 7f311722e800 1 Processor -- start 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.689+0000 7f311722e800 1 -- start start 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.689+0000 7f3112d34640 1 --2- 172.21.15.133:0/392306645 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2fec0367e0 0x7f2fec038ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x563899f93350 tx=0x7f310c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.689+0000 7f311722e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 0x563899fb0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.689+0000 7f311722e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563899d055d0 con 0x563899fb03e0 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.689+0000 7f3111d32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 0x563899fb0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.689+0000 7f3111d32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 0x563899fb0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59062/0 (socket says 172.21.15.133:59062) 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.689+0000 7f3111d32640 1 -- 172.21.15.133:0/4167917104 learned_addr learned my addr 172.21.15.133:0/4167917104 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.689+0000 7f3111d32640 1 -- 172.21.15.133:0/4167917104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563899fb0dd0 con 0x563899fb03e0 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.689+0000 7f3111d32640 1 --2- 172.21.15.133:0/4167917104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 0x563899fb0800 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f310800c010 tx=0x7f3108025930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4408b3f71e9cb6c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f2ff5ffb640 1 -- 172.21.15.133:0/4167917104 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3108025410 con 0x563899fb03e0 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f2ff5ffb640 1 -- 172.21.15.133:0/4167917104 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108025570 con 0x563899fb03e0 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f2ff5ffb640 1 -- 172.21.15.133:0/4167917104 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3108019320 con 0x563899fb03e0 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f311722e800 1 -- 172.21.15.133:0/4167917104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 msgr2=0x563899fb0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f311722e800 1 --2- 172.21.15.133:0/4167917104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 0x563899fb0800 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f310800c010 tx=0x7f3108025930 comp rx=0 tx=0).stop 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f311722e800 1 -- 172.21.15.133:0/4167917104 shutdown_connections 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f311722e800 1 --2- 172.21.15.133:0/4167917104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 0x563899fb0800 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f311722e800 1 -- 172.21.15.133:0/4167917104 >> 172.21.15.133:0/4167917104 conn(0x563899fac700 msgr2=0x563899faa760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f311722e800 1 -- 172.21.15.133:0/4167917104 shutdown_connections 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f311722e800 1 -- 172.21.15.133:0/4167917104 wait complete. 2024-02-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f311722e800 1 Processor -- start 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.690+0000 7f311722e800 1 -- start start 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.691+0000 7f311722e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 0x563899fb73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.691+0000 7f311722e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563899fb7930 con 0x563899fb03e0 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.691+0000 7f3111d32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 0x563899fb73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.691+0000 7f3111d32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 0x563899fb73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59068/0 (socket says 172.21.15.133:59068) 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.691+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 learned_addr learned my addr 172.21.15.133:0/2063458108 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.691+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563899fa49b0 con 0x563899fb03e0 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.691+0000 7f3111d32640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 0x563899fb73f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f310804b5f0 tx=0x7f310804c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.692+0000 7f2fe3fff640 1 -- 172.21.15.133:0/2063458108 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3108025410 con 0x563899fb03e0 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.692+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563899fb7b30 con 0x563899fb03e0 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.692+0000 7f2fe3fff640 1 -- 172.21.15.133:0/2063458108 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310800ce70 con 0x563899fb03e0 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.692+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563899fb7ff0 con 0x563899fb03e0 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.692+0000 7f2fe3fff640 1 -- 172.21.15.133:0/2063458108 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f310803be00 con 0x563899fb03e0 2024-02-15T22:56:29.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.692+0000 7f2fe3fff640 1 -- 172.21.15.133:0/2063458108 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f310803b410 con 0x563899fb03e0 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.693+0000 7f2fe3fff640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2fdc036790 0x7f2fdc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.693+0000 7f2fe3fff640 1 -- 172.21.15.133:0/2063458108 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f3108054810 con 0x563899fb03e0 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.693+0000 7f3112d34640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2fdc036790 0x7f2fdc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.693+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.693+0000 7f311722e800 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563899fc2fc0 0x563899fc5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.693+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fc5bd0 con 0x563899fc2fc0 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.693+0000 7f3112d34640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2fdc036790 0x7f2fdc038c50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f310c00b010 tx=0x7f310c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.693+0000 7f3112533640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563899fc2fc0 0x563899fc5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f3112533640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563899fc2fc0 0x563899fc5480 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 20 realm 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fc5fa0 con 0x563899fc2fc0 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fc6820 con 0x563899fc2fc0 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fc6b80 con 0x563899fc2fc0 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.694+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fc7380 con 0x563899fc2fc0 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.695+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.695+0000 7f311722e800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.695+0000 7f311722e800 20 searching for the correct realm 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.695+0000 7f311722e800 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563899fc9210 0x563899fcb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.695+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc9210 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.695+0000 7f3111d32640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563899fc9210 0x563899fcb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.695+0000 7f3111d32640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563899fc9210 0x563899fcb6d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.696+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.696+0000 7f3111d32640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f310803b030 0x7f3108052100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.696+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310803b030 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.696+0000 7f3112d34640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f310803b030 0x7f3108052100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.696+0000 7f3112d34640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f310803b030 0x7f3108052100 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.696+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310c00a4a0 con 0x7f310803b030 2024-02-15T22:56:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.696+0000 7f3112d34640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f310c0141d0 0x7f310c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.696+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310c0141d0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.697+0000 7f3112533640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f310c0141d0 0x7f310c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.697+0000 7f3112533640 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f310c0141d0 0x7f310c015940 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.697+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x7f310c0141d0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.697+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc2fc0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.697+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.697+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc2fc0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.698+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.698+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310c0141d0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.698+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x7f310c0141d0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.698+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310c0141d0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.698+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x7f310c0141d0 2024-02-15T22:56:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.698+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310803b030 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.698+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310c00a4a0 con 0x7f310803b030 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.698+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc9210 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.699+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.699+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc2fc0 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.699+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.699+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310c0141d0 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.699+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x7f310c0141d0 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.699+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc2fc0 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.699+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.699+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310803b030 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.700+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.700+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc9210 2024-02-15T22:56:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.700+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.700+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc9210 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.700+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.700+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310c0141d0 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.701+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x7f310c0141d0 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.701+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc9210 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.701+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.701+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc9210 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.701+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.701+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc2fc0 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.701+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.701+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc2fc0 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.702+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.702+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310c0141d0 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.702+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x7f310c0141d0 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.702+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc9210 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.702+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.702+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310803b030 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.702+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.702+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc2fc0 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.702+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f310405c930 con 0x563899fc2fc0 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.702+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310c0141d0 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.703+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x7f310c0141d0 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.703+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc9210 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.703+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.703+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310c0141d0 2024-02-15T22:56:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.703+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310405c930 con 0x7f310c0141d0 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.703+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310803b030 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.704+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.704+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc9210 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.704+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.704+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310c0141d0 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.704+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.704+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x563899fc2fc0 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcbda0 con 0x7f310803b030 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fc7cb0 con 0x563899fc2fc0 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fc8500 con 0x563899fc2fc0 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.705+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcc1e0 con 0x563899fc2fc0 2024-02-15T22:56:29.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 20 zone default found 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 4 Realm: () 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 20 zonegroup default 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcc1e0 con 0x7f310c0141d0 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fce060 con 0x563899fc9210 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.706+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fce3c0 con 0x563899fc9210 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.707+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.707+0000 7f311722e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.707+0000 7f311722e800 20 started sync module instance, tier type = 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.707+0000 7f311722e800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.707+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcd630 con 0x7f310803b030 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.708+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.708+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94801101642480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fce720 con 0x7f310803b030 2024-02-15T22:56:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.708+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcef20 con 0x563899fc2fc0 2024-02-15T22:56:29.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.709+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94801101642480] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.709+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.709+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94801101645600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcefe0 con 0x563899fc2fc0 2024-02-15T22:56:29.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.709+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcf950 con 0x563899fc9210 2024-02-15T22:56:29.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.710+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94801101645600] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.710+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.710+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94801101646656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcef60 con 0x563899fc9210 2024-02-15T22:56:29.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.710+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd0760 con 0x7f310803b030 2024-02-15T22:56:29.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.711+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94801101646656] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.711+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.711+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94801101652672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd0b80 con 0x7f310803b030 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.711+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd14f0 con 0x563899fc2fc0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.712+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.712+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94801101652672] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.712+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94801101653728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd14f0 con 0x563899fc2fc0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.712+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd1ef0 con 0x7f310c0141d0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.713+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.713+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94801101653728] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.713+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94801101658608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd1eb0 con 0x7f310c0141d0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.713+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd1070 con 0x7f310c0141d0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.714+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94801101658608] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.715+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.715+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94801101656176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd2990 con 0x7f310c0141d0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.715+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd3300 con 0x7f310c0141d0 2024-02-15T22:56:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.716+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94801101656176] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.716+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.716+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94801101660832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd3300 con 0x7f310c0141d0 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.716+0000 7f311722e800 20 add_watcher() i=0 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.716+0000 7f311722e800 20 add_watcher() i=1 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.716+0000 7f311722e800 20 add_watcher() i=2 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.716+0000 7f311722e800 20 add_watcher() i=3 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.716+0000 7f311722e800 20 add_watcher() i=4 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.716+0000 7f311722e800 20 add_watcher() i=5 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.716+0000 7f311722e800 20 add_watcher() i=6 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.717+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94801101660832] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.717+0000 7f311722e800 20 add_watcher() i=7 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.717+0000 7f311722e800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.717+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd67e0 con 0x563899fc2fc0 2024-02-15T22:56:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.717+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.717+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94801101677008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd3470 con 0x563899fc2fc0 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.718+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94801101677008] v30'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.718+0000 7f2fc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.718+0000 7f311722e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.718+0000 7f311722e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.718+0000 7f311722e800 5 note: GC not initialized 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.718+0000 7f2f437fe640 20 reqs_thread_entry: start 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 20 Filter name: none 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f2f417fa640 20 reqs_thread_entry: start 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a008870 con 0x563899fc2fc0 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a00a3d0 con 0x563899fc2fc0 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+241 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 20 rados_obj.operate() r=0 bl.length=193 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-02-15T22:56:29.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 : miss 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.719+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:64 8.e 8:7055aed4:root::.bucket.meta.testx%3amyfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a00bdf0 con 0x7f310c0141d0 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.720+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv5 ondisk = 0) v8 ==== 338+0+733 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.720+0000 7f311722e800 20 rados_obj.operate() r=0 bl.length=371 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.720+0000 7f311722e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.720+0000 7f311722e800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.720+0000 7f311722e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.720+0000 7f311722e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.720+0000 7f311722e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.720+0000 7f311722e800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.720+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a010330 con 0x563899fc2fc0 2024-02-15T22:56:29.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.721+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.721+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a013bf0 con 0x563899fc9210 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.722+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [create,call,writefull 0~352,setxattr (123)] v30'5 uv5 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.722+0000 7f311722e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x7 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.722+0000 7f311722e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.722+0000 7f311722e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.722+0000 7f311722e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1, ofs0, ns] 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.722+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94801101920672 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a013670 con 0x563899fc2fc0 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== watch-notify(notify (1) cookie 94801101653728 notify 128849018896 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x563899f8c0f0 con 0x563899fc2fc0 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f2ff5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94801101653728 notifier 4551 bl.length()=701 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f2ff5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x7 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f2ff5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f2ff5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:29.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f2ff5ffb640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2fd8003e90 con 0x563899fc2fc0 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(67 notify.4 [notify cookie 94801101920672 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== watch-notify(notify_complete (2) cookie 94801101920672 notify 128849018896 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563899f8bbb0 con 0x563899fc2fc0 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f311722e800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_sources= new_sources= 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f311722e800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential sources added=[] removed=[] 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f311722e800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_dests= new_dests= 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f311722e800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential dests added=[] removed=[] 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.723+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a013530 con 0x7f310803b030 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.724+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(69 foo.buckets [call] v30'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.724+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a013530 con 0x7f310803b030 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.726+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.726+0000 7f311722e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.726+0000 7f311722e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:29.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.726+0000 7f311722e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.726+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94801101926544 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a0134b0 con 0x7f310c0141d0 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== watch-notify(notify (1) cookie 94801101656176 notify 128849018898 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x563899f8bbb0 con 0x7f310c0141d0 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f2ff57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94801101656176 notifier 4551 bl.length()=314 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f2ff57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f2ff57fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.6 [notify cookie 94801101926544 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f2ff57fa640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2f480033f0 con 0x7f310c0141d0 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== watch-notify(notify_complete (2) cookie 94801101926544 notify 128849018898 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563899e052f0 con 0x7f310c0141d0 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f311722e800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f311722e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:73 7.d 7:b4812045:::notify.4:head [notify cookie 94801101926480 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a013470 con 0x563899fc2fc0 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== watch-notify(notify (1) cookie 94801101653728 notify 128849018897 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x563899e052f0 con 0x563899fc2fc0 2024-02-15T22:56:29.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f2ff57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94801101653728 notifier 4551 bl.length()=155 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f2ff57fa640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2f480033f0 con 0x563899fc2fc0 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.727+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(73 notify.4 [notify cookie 94801101926480 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.728+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(74 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.728+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== watch-notify(notify_complete (2) cookie 94801101926480 notify 128849018897 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3104005d20 con 0x563899fc2fc0 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.728+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a0134f0 con 0x563899fc2fc0 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.729+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(75 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.729+0000 7f311722e800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 from cache 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.729+0000 7f311722e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1, ofs0, ns] 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.729+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [notify cookie 94801101898864 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a0134f0 con 0x7f310803b030 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.729+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== watch-notify(notify (1) cookie 94801101652672 notify 128849018894 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x7f310c026a90 con 0x7f310803b030 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.729+0000 7f2ff5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94801101652672 notifier 4551 bl.length()=212 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.729+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(76 notify.3 [notify cookie 94801101898864 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.729+0000 7f2ff5ffb640 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2fd8003e90 con 0x7f310803b030 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.729+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(77 notify.3 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.729+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== watch-notify(notify_complete (2) cookie 94801101898864 notify 128849018894 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f310c026cf0 con 0x7f310803b030 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.729+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 8.e 8:7055aed4:root::.bucket.meta.testx%3amyfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a013050 con 0x7f310c0141d0 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.730+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(78 .bucket.meta.testx:myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call,delete] v30'6 uv6 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.731+0000 7f2fc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.731+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94801101677008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56389a013050 con 0x563899fc2fc0 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.732+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94801101677008] v30'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.732+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94801101642480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd6160 con 0x7f310803b030 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.733+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94801101642480] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.733+0000 7f311722e800 20 remove_watcher() i=0 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.733+0000 7f311722e800 2 removed watcher, disabling cache 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.733+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94801101645600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcdaf0 con 0x563899fc2fc0 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.734+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 36 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94801101645600] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.734+0000 7f311722e800 20 remove_watcher() i=1 2024-02-15T22:56:29.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.734+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94801101646656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fcdaf0 con 0x563899fc9210 2024-02-15T22:56:29.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.735+0000 7f3111d32640 1 -- 172.21.15.133:0/2063458108 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94801101646656] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3108022070 con 0x563899fc9210 2024-02-15T22:56:29.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.735+0000 7f311722e800 20 remove_watcher() i=2 2024-02-15T22:56:29.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.735+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94801101652672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd6160 con 0x7f310803b030 2024-02-15T22:56:29.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.736+0000 7f3112d34640 1 -- 172.21.15.133:0/2063458108 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94801101652672] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310c03a040 con 0x7f310803b030 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.736+0000 7f311722e800 20 remove_watcher() i=3 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.736+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94801101653728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd02c0 con 0x563899fc2fc0 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.737+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.1 v2:172.21.15.133:6808/2671624067 37 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94801101653728] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x563899fc2fc0 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.737+0000 7f311722e800 20 remove_watcher() i=4 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.737+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94801101658608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd6160 con 0x7f310c0141d0 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.738+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94801101658608] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.738+0000 7f311722e800 20 remove_watcher() i=5 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.738+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94801101656176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd19f0 con 0x7f310c0141d0 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.739+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94801101656176] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.739+0000 7f311722e800 20 remove_watcher() i=6 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.739+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94801101660832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563899fd1070 con 0x7f310c0141d0 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94801101660832] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f310409e040 con 0x7f310c0141d0 2024-02-15T22:56:29.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 20 remove_watcher() i=7 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f310c0141d0 msgr2=0x7f310c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f310c0141d0 0x7f310c015940 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563899fc2fc0 msgr2=0x563899fc5480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563899fc2fc0 0x563899fc5480 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f310803b030 msgr2=0x7f3108052100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f310803b030 0x7f3108052100 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563899fc9210 msgr2=0x563899fcb6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563899fc9210 0x563899fcb6d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2fdc036790 msgr2=0x7f2fdc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2fdc036790 0x7f2fdc038c50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f310c00b010 tx=0x7f310c020000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 msgr2=0x563899fb73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 --2- 172.21.15.133:0/2063458108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fb03e0 0x563899fb73f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f310804b5f0 tx=0x7f310804c660 comp rx=0 tx=0).stop 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 reap_dead start 2024-02-15T22:56:29.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f3112533640 1 -- 172.21.15.133:0/2063458108 reap_dead start 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 shutdown_connections 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 >> 172.21.15.133:0/2063458108 conn(0x563899fac700 msgr2=0x563899fa9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 shutdown_connections 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.740+0000 7f311722e800 1 -- 172.21.15.133:0/2063458108 wait complete. 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/392306645 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2fec0367e0 msgr2=0x7f2fec038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 --2- 172.21.15.133:0/392306645 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2fec0367e0 0x7f2fec038ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x563899f93350 tx=0x7f310c005840 comp rx=0 tx=0).stop 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/392306645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fa3120 msgr2=0x563899fa3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 --2- 172.21.15.133:0/392306645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fa3120 0x563899fa3540 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f310800bec0 tx=0x7f310800d7a0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/392306645 shutdown_connections 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 --2- 172.21.15.133:0/392306645 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2fec0367e0 0x7f2fec038ca0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 --2- 172.21.15.133:0/392306645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899fa3120 0x563899fa3540 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/392306645 >> 172.21.15.133:0/392306645 conn(0x563899f971c0 msgr2=0x563899f975c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/392306645 shutdown_connections 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/392306645 wait complete. 2024-02-15T22:56:29.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563899e91250 msgr2=0x563899f924a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563899e91250 0x563899f924a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2ff8036790 msgr2=0x7f2ff8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2ff8036790 0x7f2ff8038c50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3108000f60 tx=0x7f31080010a0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 msgr2=0x563899f8b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f8b670 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3104055040 tx=0x7f3104002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 shutdown_connections 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563899e91250 0x563899f924a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2ff8036790 0x7f2ff8038c50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 --2- 172.21.15.133:0/1643378537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563899e908f0 0x563899f8b670 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 >> 172.21.15.133:0/1643378537 conn(0x563899e8c4f0 msgr2=0x563899f7e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 shutdown_connections 2024-02-15T22:56:29.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.741+0000 7f311722e800 1 -- 172.21.15.133:0/1643378537 wait complete. 2024-02-15T22:56:29.757 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-15T22:56:29.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-15T22:56:29.757 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-02-15T22:56:29.801 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:29.801 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.799+0000 7fa012a44800 1 Processor -- start 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.799+0000 7fa012a44800 1 -- start start 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.800+0000 7fa012a44800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5605f45ed410 0x5605f45f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.800+0000 7fa012a44800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5605f4537ba0 con 0x5605f45eb8d0 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.800+0000 7fa012a44800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5605f44ef450 con 0x5605f45ed410 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.800+0000 7fa00fd42640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5605f45ed410 0x5605f45f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.800+0000 7fa010543640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5605f45eb8d0 0x5605f45ebcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45182/0 (socket says 172.21.15.133:45182) 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.800+0000 7fa00fd42640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5605f45ed410 0x5605f45f5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59080/0 (socket says 172.21.15.133:59080) 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.800+0000 7fa010543640 1 -- 172.21.15.133:0/1390362518 learned_addr learned my addr 172.21.15.133:0/1390362518 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.800+0000 7fa00fd42640 1 -- 172.21.15.133:0/1390362518 >> v1:172.21.15.52:6789/0 conn(0x5605f45eb8d0 legacy=0x5605f45ebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.800+0000 7fa00f541640 1 -- 172.21.15.133:0/1390362518 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053129883 0 0) 0x5605f4537ba0 con 0x5605f45eb8d0 2024-02-15T22:56:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.800+0000 7fa00fd42640 1 -- 172.21.15.133:0/1390362518 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605f4560180 con 0x5605f45ed410 2024-02-15T22:56:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.802+0000 7fa00fd42640 1 --2- 172.21.15.133:0/1390362518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45ed410 0x5605f45f5f10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa00400a470 tx=0x7fa00401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1acfe6b624b5ed server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.802+0000 7fa00f541640 1 -- 172.21.15.133:0/1390362518 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa00404ad40 con 0x5605f45ed410 2024-02-15T22:56:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.802+0000 7fa00f541640 1 -- 172.21.15.133:0/1390362518 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa004052440 con 0x5605f45ed410 2024-02-15T22:56:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.802+0000 7fa00f541640 1 -- 172.21.15.133:0/1390362518 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa00404aea0 con 0x5605f45ed410 2024-02-15T22:56:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.803+0000 7fa012a44800 1 -- 172.21.15.133:0/1390362518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45ed410 msgr2=0x5605f45f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.803+0000 7fa012a44800 1 --2- 172.21.15.133:0/1390362518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45ed410 0x5605f45f5f10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa00400a470 tx=0x7fa00401cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.803+0000 7fa012a44800 1 -- 172.21.15.133:0/1390362518 shutdown_connections 2024-02-15T22:56:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.803+0000 7fa012a44800 1 --2- 172.21.15.133:0/1390362518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45ed410 0x5605f45f5f10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.803+0000 7fa012a44800 1 -- 172.21.15.133:0/1390362518 >> 172.21.15.133:0/1390362518 conn(0x5605f45e74f0 msgr2=0x5605f45e9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.803+0000 7fa012a44800 1 -- 172.21.15.133:0/1390362518 shutdown_connections 2024-02-15T22:56:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.803+0000 7fa012a44800 1 -- 172.21.15.133:0/1390362518 wait complete. 2024-02-15T22:56:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.814+0000 7fa012a44800 1 Processor -- start 2024-02-15T22:56:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.814+0000 7fa012a44800 1 -- start start 2024-02-15T22:56:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.814+0000 7fa012a44800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46df170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.814+0000 7fa012a44800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605f44ec980 con 0x5605f45eb8d0 2024-02-15T22:56:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.815+0000 7fa010543640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46df170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.815+0000 7fa010543640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46df170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59094/0 (socket says 172.21.15.133:59094) 2024-02-15T22:56:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.815+0000 7fa010543640 1 -- 172.21.15.133:0/149527454 learned_addr learned my addr 172.21.15.133:0/149527454 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.815+0000 7fa010543640 1 -- 172.21.15.133:0/149527454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa004005d20 con 0x5605f45eb8d0 2024-02-15T22:56:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.815+0000 7fa010543640 1 --2- 172.21.15.133:0/149527454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46df170 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa00000b210 tx=0x7fa00000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71521951c4eb33d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.815+0000 7f9efe60c640 1 -- 172.21.15.133:0/149527454 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa000014070 con 0x5605f45eb8d0 2024-02-15T22:56:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.815+0000 7f9efe60c640 1 -- 172.21.15.133:0/149527454 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00000d500 con 0x5605f45eb8d0 2024-02-15T22:56:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.815+0000 7f9efe60c640 1 -- 172.21.15.133:0/149527454 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa00000d800 con 0x5605f45eb8d0 2024-02-15T22:56:29.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.816+0000 7fa012a44800 1 -- 172.21.15.133:0/149527454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 msgr2=0x5605f46df170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.816+0000 7fa012a44800 1 --2- 172.21.15.133:0/149527454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46df170 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa00000b210 tx=0x7fa00000b6d0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.816+0000 7fa012a44800 1 -- 172.21.15.133:0/149527454 shutdown_connections 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.816+0000 7fa012a44800 1 --2- 172.21.15.133:0/149527454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46df170 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.816+0000 7fa012a44800 1 -- 172.21.15.133:0/149527454 >> 172.21.15.133:0/149527454 conn(0x5605f45e74f0 msgr2=0x5605f46daa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.816+0000 7fa012a44800 1 -- 172.21.15.133:0/149527454 shutdown_connections 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.816+0000 7fa012a44800 1 -- 172.21.15.133:0/149527454 wait complete. 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.816+0000 7fa012a44800 1 Processor -- start 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.816+0000 7fa012a44800 1 -- start start 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.816+0000 7fa012a44800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46e6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.816+0000 7fa012a44800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605f44e8160 con 0x5605f45eb8d0 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.817+0000 7fa010543640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46e6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.817+0000 7fa010543640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46e6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59106/0 (socket says 172.21.15.133:59106) 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.817+0000 7fa010543640 1 -- 172.21.15.133:0/502089889 learned_addr learned my addr 172.21.15.133:0/502089889 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.817+0000 7fa010543640 1 -- 172.21.15.133:0/502089889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa000001b70 con 0x5605f45eb8d0 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.817+0000 7fa010543640 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46e6830 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa00000b210 tx=0x7fa000000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.817+0000 7f9efce09640 1 -- 172.21.15.133:0/502089889 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa00000f950 con 0x5605f45eb8d0 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.817+0000 7f9efce09640 1 -- 172.21.15.133:0/502089889 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa000020070 con 0x5605f45eb8d0 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.817+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605f46e6d70 con 0x5605f45eb8d0 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.817+0000 7f9efce09640 1 -- 172.21.15.133:0/502089889 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa00000fc20 con 0x5605f45eb8d0 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.817+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605f46e7250 con 0x5605f45eb8d0 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.818+0000 7f9efce09640 1 -- 172.21.15.133:0/502089889 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa00000d040 con 0x5605f45eb8d0 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.818+0000 7f9efce09640 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ef80367e0 0x7f9ef8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.818+0000 7f9efce09640 1 -- 172.21.15.133:0/502089889 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fa00000a040 con 0x5605f45eb8d0 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.818+0000 7fa00fd42640 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ef80367e0 0x7f9ef8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.818+0000 7fa012a44800 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5605f45ed410 0x5605f46ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.818+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f46edb00 con 0x5605f45ed410 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.818+0000 7fa010d44640 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5605f45ed410 0x5605f46ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.819+0000 7fa00fd42640 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ef80367e0 0x7f9ef8038ca0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa004054000 tx=0x7fa00404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.819+0000 7fa010d44640 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5605f45ed410 0x5605f46ed530 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.819+0000 7fa010d44640 1 -- 172.21.15.133:0/502089889 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa00800a4a0 con 0x5605f45ed410 2024-02-15T22:56:29.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.819+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f46eac20 con 0x5605f45ed410 2024-02-15T22:56:29.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.819+0000 7fa010d44640 1 -- 172.21.15.133:0/502089889 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa00800a4a0 con 0x5605f45ed410 2024-02-15T22:56:29.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.819+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f46ef830 con 0x5605f45ed410 2024-02-15T22:56:29.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.819+0000 7fa010d44640 1 -- 172.21.15.133:0/502089889 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa00800a4a0 con 0x5605f45ed410 2024-02-15T22:56:29.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.819+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f46eea30 con 0x5605f45ed410 2024-02-15T22:56:29.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.820+0000 7fa010d44640 1 -- 172.21.15.133:0/502089889 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa00800a4a0 con 0x5605f45ed410 2024-02-15T22:56:29.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.820+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f46eee40 con 0x5605f45ed410 2024-02-15T22:56:29.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.820+0000 7fa010d44640 1 -- 172.21.15.133:0/502089889 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa00800a4a0 con 0x5605f45ed410 2024-02-15T22:56:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.820+0000 7fa012a44800 1 Processor -- start 2024-02-15T22:56:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.820+0000 7fa012a44800 1 -- start start 2024-02-15T22:56:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.820+0000 7fa012a44800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f46fe2b0 0x5605f46fe6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.821+0000 7fa012a44800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605f448ae80 con 0x5605f46fe2b0 2024-02-15T22:56:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.821+0000 7fa00fd42640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f46fe2b0 0x5605f46fe6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.821+0000 7fa00fd42640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f46fe2b0 0x5605f46fe6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59116/0 (socket says 172.21.15.133:59116) 2024-02-15T22:56:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.821+0000 7fa00fd42640 1 -- 172.21.15.133:0/1750374273 learned_addr learned my addr 172.21.15.133:0/1750374273 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.821+0000 7fa00fd42640 1 -- 172.21.15.133:0/1750374273 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605f46fec10 con 0x5605f46fe2b0 2024-02-15T22:56:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.821+0000 7fa00fd42640 1 --2- 172.21.15.133:0/1750374273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f46fe2b0 0x5605f46fe6d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa00404bfd0 tx=0x7fa004002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.821+0000 7f9ef5ffb640 1 -- 172.21.15.133:0/1750374273 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa004067770 con 0x5605f46fe2b0 2024-02-15T22:56:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.821+0000 7f9ef5ffb640 1 -- 172.21.15.133:0/1750374273 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0040678d0 con 0x5605f46fe2b0 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.821+0000 7fa012a44800 1 -- 172.21.15.133:0/1750374273 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605f46fee00 con 0x5605f46fe2b0 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.821+0000 7f9ef5ffb640 1 -- 172.21.15.133:0/1750374273 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa004067b70 con 0x5605f46fe2b0 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.821+0000 7fa012a44800 1 -- 172.21.15.133:0/1750374273 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605f46ff950 con 0x5605f46fe2b0 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.822+0000 7f9ef5ffb640 1 -- 172.21.15.133:0/1750374273 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa004065040 con 0x5605f46fe2b0 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.822+0000 7f9ef5ffb640 1 --2- 172.21.15.133:0/1750374273 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ee8036830 0x7f9ee8038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.822+0000 7f9ef5ffb640 1 -- 172.21.15.133:0/1750374273 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fa004062040 con 0x5605f46fe2b0 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.822+0000 7fa010d44640 1 --2- 172.21.15.133:0/1750374273 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ee8036830 0x7f9ee8038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.823+0000 7fa012a44800 1 Processor -- start 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.823+0000 7fa010d44640 1 --2- 172.21.15.133:0/1750374273 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ee8036830 0x7f9ee8038cf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5605f46ee470 tx=0x7fa008005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.823+0000 7fa012a44800 1 -- start start 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.823+0000 7fa012a44800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 0x5605f470b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.823+0000 7fa012a44800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605f44605d0 con 0x5605f470b410 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.823+0000 7fa00fd42640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 0x5605f470b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.823+0000 7fa00fd42640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 0x5605f470b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59132/0 (socket says 172.21.15.133:59132) 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.823+0000 7fa00fd42640 1 -- 172.21.15.133:0/526661958 learned_addr learned my addr 172.21.15.133:0/526661958 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.823+0000 7fa00fd42640 1 -- 172.21.15.133:0/526661958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605f470be00 con 0x5605f470b410 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.823+0000 7fa00fd42640 1 --2- 172.21.15.133:0/526661958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 0x5605f470b830 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa0040059a0 tx=0x7fa00406ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f5e4acfb1a5d1f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7f9eef7fe640 1 -- 172.21.15.133:0/526661958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa00408c070 con 0x5605f470b410 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7f9eef7fe640 1 -- 172.21.15.133:0/526661958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00406f3a0 con 0x5605f470b410 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7f9eef7fe640 1 -- 172.21.15.133:0/526661958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa00406f550 con 0x5605f470b410 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7fa012a44800 1 -- 172.21.15.133:0/526661958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 msgr2=0x5605f470b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7fa012a44800 1 --2- 172.21.15.133:0/526661958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 0x5605f470b830 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa0040059a0 tx=0x7fa00406ff30 comp rx=0 tx=0).stop 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7fa012a44800 1 -- 172.21.15.133:0/526661958 shutdown_connections 2024-02-15T22:56:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7fa012a44800 1 --2- 172.21.15.133:0/526661958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 0x5605f470b830 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7fa012a44800 1 -- 172.21.15.133:0/526661958 >> 172.21.15.133:0/526661958 conn(0x5605f4707770 msgr2=0x5605f47057d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7fa012a44800 1 -- 172.21.15.133:0/526661958 shutdown_connections 2024-02-15T22:56:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7fa012a44800 1 -- 172.21.15.133:0/526661958 wait complete. 2024-02-15T22:56:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7fa012a44800 1 Processor -- start 2024-02-15T22:56:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.824+0000 7fa012a44800 1 -- start start 2024-02-15T22:56:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7fa012a44800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 0x5605f4712420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7fa012a44800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605f4712960 con 0x5605f470b410 2024-02-15T22:56:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7fa00fd42640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 0x5605f4712420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7fa00fd42640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 0x5605f4712420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59142/0 (socket says 172.21.15.133:59142) 2024-02-15T22:56:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 learned_addr learned my addr 172.21.15.133:0/466305622 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605f46ff950 con 0x5605f470b410 2024-02-15T22:56:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7fa00fd42640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 0x5605f4712420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa00407d040 tx=0x7fa00408ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7f9eedffb640 1 -- 172.21.15.133:0/466305622 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa00408fa20 con 0x5605f470b410 2024-02-15T22:56:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7f9eedffb640 1 -- 172.21.15.133:0/466305622 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00408fb80 con 0x5605f470b410 2024-02-15T22:56:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7f9eedffb640 1 -- 172.21.15.133:0/466305622 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa00408fe60 con 0x5605f470b410 2024-02-15T22:56:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605f4712b60 con 0x5605f470b410 2024-02-15T22:56:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.825+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605f4712b60 con 0x5605f470b410 2024-02-15T22:56:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.826+0000 7f9eedffb640 1 -- 172.21.15.133:0/466305622 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa004081050 con 0x5605f470b410 2024-02-15T22:56:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.826+0000 7f9eedffb640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ee0036790 0x7f9ee0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.826+0000 7f9eedffb640 1 -- 172.21.15.133:0/466305622 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fa00409e810 con 0x5605f470b410 2024-02-15T22:56:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.826+0000 7fa010d44640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ee0036790 0x7f9ee0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.827+0000 7fa010d44640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ee0036790 0x7f9ee0038c50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa00800b010 tx=0x7fa008020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.827+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.827+0000 7fa012a44800 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5605f471dd20 0x5605f47201e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.827+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4720930 con 0x5605f471dd20 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.827+0000 7fa010543640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5605f471dd20 0x5605f47201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.827+0000 7fa010543640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5605f471dd20 0x5605f47201e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.827+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa000016070 con 0x5605f471dd20 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.827+0000 7fa012a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.827+0000 7fa012a44800 20 realm 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.827+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.827+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4720d00 con 0x5605f471dd20 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa000016070 con 0x5605f471dd20 2024-02-15T22:56:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4721580 con 0x5605f471dd20 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa000016070 con 0x5605f471dd20 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f47218e0 con 0x5605f471dd20 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa000016070 con 0x5605f471dd20 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f47220e0 con 0x5605f471dd20 2024-02-15T22:56:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa000016070 con 0x5605f471dd20 2024-02-15T22:56:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 20 searching for the correct realm 2024-02-15T22:56:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5605f4724000 0x5605f47264a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.828+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f4724000 2024-02-15T22:56:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.829+0000 7fa00fd42640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5605f4724000 0x5605f47264a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.829+0000 7fa00fd42640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5605f4724000 0x5605f47264a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.829+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.829+0000 7fa00fd42640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa004092c00 0x7fa00409ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.829+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa004092c00 2024-02-15T22:56:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.829+0000 7fa010d44640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa004092c00 0x7fa00409ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.830+0000 7fa010d44640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa004092c00 0x7fa00409ea20 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.830+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa00800a4a0 con 0x7fa004092c00 2024-02-15T22:56:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.830+0000 7fa010d44640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa0080141d0 0x7fa008015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.830+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa0080141d0 2024-02-15T22:56:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.830+0000 7fa010543640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa0080141d0 0x7fa008015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.831+0000 7fa010543640 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa0080141d0 0x7fa008015940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.831+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000016070 con 0x7fa0080141d0 2024-02-15T22:56:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.831+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f471dd20 2024-02-15T22:56:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.831+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000016070 con 0x5605f471dd20 2024-02-15T22:56:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.831+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f471dd20 2024-02-15T22:56:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.831+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000016070 con 0x5605f471dd20 2024-02-15T22:56:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.831+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa0080141d0 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.832+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000016070 con 0x7fa0080141d0 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.832+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa0080141d0 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.832+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000016070 con 0x7fa0080141d0 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.832+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa004092c00 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.832+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa00800a4a0 con 0x7fa004092c00 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.832+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f4724000 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.832+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.832+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f471dd20 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.833+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000016070 con 0x5605f471dd20 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.833+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa0080141d0 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.833+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000016070 con 0x7fa0080141d0 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.833+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f471dd20 2024-02-15T22:56:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.833+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000016070 con 0x5605f471dd20 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.833+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa004092c00 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.833+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.833+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f4724000 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.833+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.833+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f4724000 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.834+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.834+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa0080141d0 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.834+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000016070 con 0x7fa0080141d0 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.834+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f4724000 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.834+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.834+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f4724000 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.834+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.834+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f471dd20 2024-02-15T22:56:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.834+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000016070 con 0x5605f471dd20 2024-02-15T22:56:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.834+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f471dd20 2024-02-15T22:56:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.835+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa000016070 con 0x5605f471dd20 2024-02-15T22:56:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.835+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa0080141d0 2024-02-15T22:56:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.835+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.835+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f4724000 2024-02-15T22:56:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.835+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.835+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa004092c00 2024-02-15T22:56:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.835+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.835+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f471dd20 2024-02-15T22:56:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.836+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.836+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa0080141d0 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.836+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.836+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f4724000 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.836+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.836+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa0080141d0 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.836+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.836+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa004092c00 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.837+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.837+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f4724000 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.837+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.837+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa0080141d0 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.837+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.837+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x5605f471dd20 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4726b70 con 0x7fa004092c00 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f47235e0 con 0x5605f471dd20 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4722e30 con 0x5605f471dd20 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.838+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f47225c0 con 0x5605f471dd20 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 20 zone default found 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 4 Realm: () 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 20 zonegroup default 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4722e30 con 0x7fa0080141d0 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4728990 con 0x5605f4724000 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4728cf0 con 0x5605f4724000 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.839+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.840+0000 7fa012a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.840+0000 7fa012a44800 20 started sync module instance, tier type = 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.840+0000 7fa012a44800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.840+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4728270 con 0x7fa004092c00 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.841+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.841+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94583575969232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4728620 con 0x7fa004092c00 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.841+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f47299e0 con 0x5605f471dd20 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.842+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94583575969232] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.842+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.842+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94583575974320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4729b10 con 0x5605f471dd20 2024-02-15T22:56:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.842+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472a5c0 con 0x5605f4724000 2024-02-15T22:56:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.843+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94583575974320] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.843+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.843+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94583575978176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472a9a0 con 0x5605f4724000 2024-02-15T22:56:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.843+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472b370 con 0x7fa004092c00 2024-02-15T22:56:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.844+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94583575978176] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.844+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.844+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94583575981680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472b720 con 0x7fa004092c00 2024-02-15T22:56:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.844+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472c150 con 0x5605f471dd20 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.845+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.845+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94583575985232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472c150 con 0x5605f471dd20 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.845+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472d0c0 con 0x7fa0080141d0 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.845+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94583575981680] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.846+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94583575985232] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.846+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.846+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94583575989184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472c330 con 0x7fa0080141d0 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.846+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472d940 con 0x7fa0080141d0 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.847+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94583575989184] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.847+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.847+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94583575975376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472d0c0 con 0x7fa0080141d0 2024-02-15T22:56:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.847+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472df50 con 0x7fa0080141d0 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.848+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94583575975376] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.848+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.848+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94583575991376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472df50 con 0x7fa0080141d0 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.848+0000 7fa012a44800 20 add_watcher() i=0 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.848+0000 7fa012a44800 20 add_watcher() i=1 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.848+0000 7fa012a44800 20 add_watcher() i=2 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.848+0000 7fa012a44800 20 add_watcher() i=3 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.848+0000 7fa012a44800 20 add_watcher() i=4 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.848+0000 7fa012a44800 20 add_watcher() i=5 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.848+0000 7fa012a44800 20 add_watcher() i=6 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.849+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94583575991376] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.849+0000 7fa012a44800 20 add_watcher() i=7 2024-02-15T22:56:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.849+0000 7fa012a44800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.849+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472df40 con 0x5605f471dd20 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.849+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.849+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94583575995200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472eca0 con 0x5605f471dd20 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.850+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94583575995200] v30'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.850+0000 7f9ec67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.851+0000 7fa012a44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.851+0000 7fa012a44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.851+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f47312d0 con 0x5605f471dd20 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.851+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.851+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473a770 con 0x7fa0080141d0 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.852+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.852+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473abb0 con 0x5605f4724000 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.853+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.853+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473b580 con 0x5605f471dd20 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.854+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'135 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.854+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4739d80 con 0x7fa004092c00 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.855+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.855+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4739d80 con 0x5605f4724000 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.856+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.856+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473c800 con 0x5605f471dd20 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.857+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.857+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473c800 con 0x7fa0080141d0 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.858+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.858+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473c800 con 0x7fa004092c00 2024-02-15T22:56:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.859+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.859+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473cdd0 con 0x5605f4724000 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.860+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.860+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473d5d0 con 0x7fa004092c00 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.861+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.861+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4738e10 con 0x7fa0080141d0 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.862+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.862+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4738e10 con 0x7fa004092c00 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.863+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.863+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4738e10 con 0x7fa0080141d0 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.864+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'31 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.864+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4738fe0 con 0x5605f471dd20 2024-02-15T22:56:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.865+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'136 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.865+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4738fe0 con 0x5605f4724000 2024-02-15T22:56:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.866+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.866+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4738fe0 con 0x7fa004092c00 2024-02-15T22:56:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.867+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'40 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.867+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4738fe0 con 0x5605f4724000 2024-02-15T22:56:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.868+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.868+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4738fe0 con 0x5605f471dd20 2024-02-15T22:56:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.869+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.869+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x5605f471dd20 2024-02-15T22:56:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.870+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'137 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.870+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x5605f4724000 2024-02-15T22:56:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.871+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.871+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x7fa004092c00 2024-02-15T22:56:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.872+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.872+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x5605f4724000 2024-02-15T22:56:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.873+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.873+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x5605f4724000 2024-02-15T22:56:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.874+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.874+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x5605f4724000 2024-02-15T22:56:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.875+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.875+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x5605f4724000 2024-02-15T22:56:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.876+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.876+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x7fa0080141d0 2024-02-15T22:56:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.877+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.877+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x5605f4724000 2024-02-15T22:56:29.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.878+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.878+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x7fa0080141d0 2024-02-15T22:56:29.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.879+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.879+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x5605f4724000 2024-02-15T22:56:29.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.880+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'34 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.880+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x7fa0080141d0 2024-02-15T22:56:29.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.881+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.881+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473e140 con 0x7fa004092c00 2024-02-15T22:56:29.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.882+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.882+0000 7f9ec57e2640 20 reqs_thread_entry: start 2024-02-15T22:56:29.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.882+0000 7fa012a44800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:29.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 20 Filter name: none 2024-02-15T22:56:29.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7f9e36ffd640 20 reqs_thread_entry: start 2024-02-15T22:56:29.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-15T22:56:29.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 20 rados->read ofs=0 len=0 2024-02-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4767ae0 con 0x7fa0080141d0 2024-02-15T22:56:29.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~386 out=386b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+509 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 20 rados_obj.operate() r=0 bl.length=386 2024-02-15T22:56:29.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-15T22:56:29.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-15T22:56:29.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:29.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4769fe0 con 0x5605f471dd20 2024-02-15T22:56:29.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-15T22:56:29.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.883+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94583576229200 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f476a480 con 0x5605f4724000 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.884+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== watch-notify(notify (1) cookie 94583575978176 notify 128849018885 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x5605f46ff950 con 0x5605f4724000 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.884+0000 7f9eef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94583575978176 notifier 4558 bl.length()=170 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.884+0000 7f9eef7fe640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9ed4003d50 con 0x5605f4724000 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.884+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 27 ==== osd_op_reply(96 notify.2 [notify cookie 94583576229200 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.884+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 28 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.884+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 29 ==== watch-notify(notify_complete (2) cookie 94583576229200 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5605f470be00 con 0x5605f4724000 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.884+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4767550 con 0x7fa0080141d0 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.885+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.885+0000 7fa012a44800 10 removing email index: 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.885+0000 7fa012a44800 10 removing user buckets index 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.885+0000 7fa012a44800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-02-15T22:56:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.885+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [notify cookie 94583576229200 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f476a480 con 0x5605f471dd20 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.885+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== watch-notify(notify (1) cookie 94583575985232 notify 128849018898 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x5605f46e7250 con 0x5605f471dd20 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.885+0000 7f9eeeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94583575985232 notifier 4558 bl.length()=175 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.885+0000 7f9eeeffd640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9e440032b0 con 0x5605f471dd20 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.885+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(99 notify.4 [notify cookie 94583576229200 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.886+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(100 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.886+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== watch-notify(notify_complete (2) cookie 94583576229200 notify 128849018898 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5605f46e6d70 con 0x5605f471dd20 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.886+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:101 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4767fc0 con 0x5605f471dd20 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(101 testx$tenanteduser.buckets [delete] v30'3 uv3 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7fa012a44800 10 removing user index: testx$tenanteduser 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7fa012a44800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7fa012a44800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [notify cookie 94583576229248 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f4769530 con 0x7fa004092c00 2024-02-15T22:56:29.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== watch-notify(notify (1) cookie 94583575981680 notify 128849018895 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x7fa008026bd0 con 0x7fa004092c00 2024-02-15T22:56:29.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7f9eef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94583575981680 notifier 4558 bl.length()=167 2024-02-15T22:56:29.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7f9eef7fe640 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9ed4003d50 con 0x7fa004092c00 2024-02-15T22:56:29.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(102 notify.3 [notify cookie 94583576229248 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(103 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 21 ==== watch-notify(notify_complete (2) cookie 94583576229248 notify 128849018895 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa008026e30 con 0x7fa004092c00 2024-02-15T22:56:29.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.887+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:104 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f476a480 con 0x7fa0080141d0 2024-02-15T22:56:29.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.889+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(104 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.889+0000 7f9ec67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:29.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.889+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94583575995200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f473b580 con 0x5605f471dd20 2024-02-15T22:56:29.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.890+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94583575995200] v30'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.890+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94583575969232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472e340 con 0x7fa004092c00 2024-02-15T22:56:29.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.891+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94583575969232] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.891+0000 7fa012a44800 20 remove_watcher() i=0 2024-02-15T22:56:29.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.891+0000 7fa012a44800 2 removed watcher, disabling cache 2024-02-15T22:56:29.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.891+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94583575974320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472e340 con 0x5605f471dd20 2024-02-15T22:56:29.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.892+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 36 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94583575974320] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.892+0000 7fa012a44800 20 remove_watcher() i=1 2024-02-15T22:56:29.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.892+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94583575978176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f47291b0 con 0x5605f4724000 2024-02-15T22:56:29.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.893+0000 7fa00fd42640 1 -- 172.21.15.133:0/466305622 <== osd.3 v2:172.21.15.133:6816/1065500544 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94583575978176] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa004095020 con 0x5605f4724000 2024-02-15T22:56:29.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.893+0000 7fa012a44800 20 remove_watcher() i=2 2024-02-15T22:56:29.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.893+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94583575981680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472e340 con 0x7fa004092c00 2024-02-15T22:56:29.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.894+0000 7fa010d44640 1 -- 172.21.15.133:0/466305622 <== osd.2 v2:172.21.15.133:6800/2073628168 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94583575981680] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa00803a040 con 0x7fa004092c00 2024-02-15T22:56:29.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.894+0000 7fa012a44800 20 remove_watcher() i=3 2024-02-15T22:56:29.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.894+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94583575985232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f47291b0 con 0x5605f471dd20 2024-02-15T22:56:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.895+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.1 v2:172.21.15.133:6808/2671624067 37 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94583575985232] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x5605f471dd20 2024-02-15T22:56:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.895+0000 7fa012a44800 20 remove_watcher() i=4 2024-02-15T22:56:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.895+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94583575989184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472e340 con 0x7fa0080141d0 2024-02-15T22:56:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.897+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94583575989184] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.897+0000 7fa012a44800 20 remove_watcher() i=5 2024-02-15T22:56:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.897+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94583575975376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472bc50 con 0x7fa0080141d0 2024-02-15T22:56:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.898+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94583575975376] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.898+0000 7fa012a44800 20 remove_watcher() i=6 2024-02-15T22:56:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.898+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94583575991376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5605f472e340 con 0x7fa0080141d0 2024-02-15T22:56:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.898+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94583575991376] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa000052040 con 0x7fa0080141d0 2024-02-15T22:56:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.898+0000 7fa012a44800 20 remove_watcher() i=7 2024-02-15T22:56:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa0080141d0 msgr2=0x7fa008015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa0080141d0 0x7fa008015940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5605f471dd20 msgr2=0x5605f47201e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5605f471dd20 0x5605f47201e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa004092c00 msgr2=0x7fa00409ea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa004092c00 0x7fa00409ea20 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5605f4724000 msgr2=0x5605f47264a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5605f4724000 0x5605f47264a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ee0036790 msgr2=0x7f9ee0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ee0036790 0x7f9ee0038c50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa00800b010 tx=0x7fa008020000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 msgr2=0x5605f4712420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 --2- 172.21.15.133:0/466305622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f470b410 0x5605f4712420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa00407d040 tx=0x7fa00408ddc0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 reap_dead start 2024-02-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa010543640 1 -- 172.21.15.133:0/466305622 reap_dead start 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 shutdown_connections 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 >> 172.21.15.133:0/466305622 conn(0x5605f4707770 msgr2=0x5605f4704dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 shutdown_connections 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/466305622 wait complete. 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/1750374273 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ee8036830 msgr2=0x7f9ee8038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 --2- 172.21.15.133:0/1750374273 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ee8036830 0x7f9ee8038cf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5605f46ee470 tx=0x7fa008005840 comp rx=0 tx=0).stop 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/1750374273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f46fe2b0 msgr2=0x5605f46fe6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 --2- 172.21.15.133:0/1750374273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f46fe2b0 0x5605f46fe6d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa00404bfd0 tx=0x7fa004002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/1750374273 shutdown_connections 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 --2- 172.21.15.133:0/1750374273 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ee8036830 0x7f9ee8038cf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 --2- 172.21.15.133:0/1750374273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f46fe2b0 0x5605f46fe6d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/1750374273 >> 172.21.15.133:0/1750374273 conn(0x5605f46f2350 msgr2=0x5605f46f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/1750374273 shutdown_connections 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.899+0000 7fa012a44800 1 -- 172.21.15.133:0/1750374273 wait complete. 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5605f45ed410 msgr2=0x5605f46ed530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5605f45ed410 0x5605f46ed530 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ef80367e0 msgr2=0x7f9ef8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ef80367e0 0x7f9ef8038ca0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa004054000 tx=0x7fa00404e000 comp rx=0 tx=0).stop 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 msgr2=0x5605f46e6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46e6830 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa00000b210 tx=0x7fa000000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 shutdown_connections 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5605f45ed410 0x5605f46ed530 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f9ef80367e0 0x7f9ef8038ca0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 --2- 172.21.15.133:0/502089889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605f45eb8d0 0x5605f46e6830 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 >> 172.21.15.133:0/502089889 conn(0x5605f45e74f0 msgr2=0x5605f46d9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 shutdown_connections 2024-02-15T22:56:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:29.900+0000 7fa012a44800 1 -- 172.21.15.133:0/502089889 wait complete. 2024-02-15T22:56:29.916 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-15T22:56:29.921 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-02-15T22:56:29.964 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:29.965 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-15T22:56:29.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-15T22:56:29.965 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-02-15T22:56:30.010 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:30.010 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.008+0000 7fec435af800 1 Processor -- start 2024-02-15T22:56:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.008+0000 7fec435af800 1 -- start start 2024-02-15T22:56:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.008+0000 7fec435af800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b0cb4248f0 0x55b0cb424d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.008+0000 7fec435af800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b0cb370ba0 con 0x55b0cb425250 2024-02-15T22:56:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.008+0000 7fec435af800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b0cb328450 con 0x55b0cb4248f0 2024-02-15T22:56:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.008+0000 7fec410ae640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b0cb4248f0 0x55b0cb424d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.008+0000 7fec408ad640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55b0cb425250 0x55b0cb425700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45186/0 (socket says 172.21.15.133:45186) 2024-02-15T22:56:30.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.008+0000 7fec410ae640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b0cb4248f0 0x55b0cb424d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59154/0 (socket says 172.21.15.133:59154) 2024-02-15T22:56:30.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.008+0000 7fec410ae640 1 -- 172.21.15.133:0/357376250 learned_addr learned my addr 172.21.15.133:0/357376250 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.009+0000 7fec410ae640 1 -- 172.21.15.133:0/357376250 >> v1:172.21.15.52:6789/0 conn(0x55b0cb425250 legacy=0x55b0cb425700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.009+0000 7fec410ae640 1 -- 172.21.15.133:0/357376250 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0cb399bc0 con 0x55b0cb4248f0 2024-02-15T22:56:30.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.009+0000 7fec33fff640 1 -- 172.21.15.133:0/357376250 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165526278 0 0) 0x55b0cb370ba0 con 0x55b0cb425250 2024-02-15T22:56:30.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.010+0000 7fec410ae640 1 --2- 172.21.15.133:0/357376250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb424d10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fec3400a520 tx=0x7fec3401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157fdb602437e174 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.011+0000 7fec33fff640 1 -- 172.21.15.133:0/357376250 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec34052570 con 0x55b0cb4248f0 2024-02-15T22:56:30.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.011+0000 7fec33fff640 1 -- 172.21.15.133:0/357376250 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec340526d0 con 0x55b0cb4248f0 2024-02-15T22:56:30.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.011+0000 7fec33fff640 1 -- 172.21.15.133:0/357376250 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec34052990 con 0x55b0cb4248f0 2024-02-15T22:56:30.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.011+0000 7fec435af800 1 -- 172.21.15.133:0/357376250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 msgr2=0x55b0cb424d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.011+0000 7fec435af800 1 --2- 172.21.15.133:0/357376250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb424d10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fec3400a520 tx=0x7fec3401cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.011+0000 7fec435af800 1 -- 172.21.15.133:0/357376250 shutdown_connections 2024-02-15T22:56:30.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.011+0000 7fec435af800 1 --2- 172.21.15.133:0/357376250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb424d10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.011+0000 7fec435af800 1 -- 172.21.15.133:0/357376250 >> 172.21.15.133:0/357376250 conn(0x55b0cb420470 msgr2=0x55b0cb422890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.011+0000 7fec435af800 1 -- 172.21.15.133:0/357376250 shutdown_connections 2024-02-15T22:56:30.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.011+0000 7fec435af800 1 -- 172.21.15.133:0/357376250 wait complete. 2024-02-15T22:56:30.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.023+0000 7fec435af800 1 Processor -- start 2024-02-15T22:56:30.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.023+0000 7fec435af800 1 -- start start 2024-02-15T22:56:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.023+0000 7fec435af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb517fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.023+0000 7fec435af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0cb325980 con 0x55b0cb4248f0 2024-02-15T22:56:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.023+0000 7fec410ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb517fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.023+0000 7fec410ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb517fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59168/0 (socket says 172.21.15.133:59168) 2024-02-15T22:56:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.023+0000 7fec410ae640 1 -- 172.21.15.133:0/2365557106 learned_addr learned my addr 172.21.15.133:0/2365557106 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.023+0000 7fec410ae640 1 -- 172.21.15.133:0/2365557106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34005de0 con 0x55b0cb4248f0 2024-02-15T22:56:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.024+0000 7fec410ae640 1 --2- 172.21.15.133:0/2365557106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb517fe0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fec34055040 tx=0x7fec3404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7cee0b75ef0b6c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.024+0000 7feb2f606640 1 -- 172.21.15.133:0/2365557106 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec34052570 con 0x55b0cb4248f0 2024-02-15T22:56:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.024+0000 7feb2f606640 1 -- 172.21.15.133:0/2365557106 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec34052840 con 0x55b0cb4248f0 2024-02-15T22:56:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.024+0000 7feb2f606640 1 -- 172.21.15.133:0/2365557106 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec34052b20 con 0x55b0cb4248f0 2024-02-15T22:56:30.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.024+0000 7fec435af800 1 -- 172.21.15.133:0/2365557106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 msgr2=0x55b0cb517fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.024+0000 7fec435af800 1 --2- 172.21.15.133:0/2365557106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb517fe0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fec34055040 tx=0x7fec3404c000 comp rx=0 tx=0).stop 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec435af800 1 -- 172.21.15.133:0/2365557106 shutdown_connections 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec435af800 1 --2- 172.21.15.133:0/2365557106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb517fe0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec435af800 1 -- 172.21.15.133:0/2365557106 >> 172.21.15.133:0/2365557106 conn(0x55b0cb420470 msgr2=0x55b0cb513900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec435af800 1 -- 172.21.15.133:0/2365557106 shutdown_connections 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec435af800 1 -- 172.21.15.133:0/2365557106 wait complete. 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec435af800 1 Processor -- start 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec435af800 1 -- start start 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec435af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb51f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec435af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0cb321160 con 0x55b0cb4248f0 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec410ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb51f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec410ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb51f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59172/0 (socket says 172.21.15.133:59172) 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec410ae640 1 -- 172.21.15.133:0/4258598385 learned_addr learned my addr 172.21.15.133:0/4258598385 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.025+0000 7fec410ae640 1 -- 172.21.15.133:0/4258598385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0cb399bc0 con 0x55b0cb4248f0 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.026+0000 7fec410ae640 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb51f550 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fec34000c00 tx=0x7fec34002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.026+0000 7feb2de03640 1 -- 172.21.15.133:0/4258598385 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec3405d480 con 0x55b0cb4248f0 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.026+0000 7feb2de03640 1 -- 172.21.15.133:0/4258598385 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3406e070 con 0x55b0cb4248f0 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.026+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b0cb51fa90 con 0x55b0cb4248f0 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.026+0000 7feb2de03640 1 -- 172.21.15.133:0/4258598385 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec3405d710 con 0x55b0cb4248f0 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.026+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0cb51ffd0 con 0x55b0cb4248f0 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.027+0000 7feb2de03640 1 -- 172.21.15.133:0/4258598385 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fec34070030 con 0x55b0cb4248f0 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.027+0000 7feb2de03640 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb280367e0 0x7feb28038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.027+0000 7feb2de03640 1 -- 172.21.15.133:0/4258598385 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fec3408e390 con 0x55b0cb4248f0 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.027+0000 7fec408ad640 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb280367e0 0x7feb28038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.027+0000 7fec435af800 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b0cb425250 0x55b0cb526380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.027+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb526900 con 0x55b0cb425250 2024-02-15T22:56:30.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.027+0000 7fec418af640 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b0cb425250 0x55b0cb526380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.028+0000 7fec408ad640 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb280367e0 0x7feb28038ca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec38000c00 tx=0x7fec380013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.028+0000 7fec418af640 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b0cb425250 0x55b0cb526380 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.028+0000 7fec418af640 1 -- 172.21.15.133:0/4258598385 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec3c00a4a0 con 0x55b0cb425250 2024-02-15T22:56:30.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.028+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb523920 con 0x55b0cb425250 2024-02-15T22:56:30.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.028+0000 7fec418af640 1 -- 172.21.15.133:0/4258598385 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fec3c00a4a0 con 0x55b0cb425250 2024-02-15T22:56:30.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.028+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb528650 con 0x55b0cb425250 2024-02-15T22:56:30.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.028+0000 7fec418af640 1 -- 172.21.15.133:0/4258598385 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fec3c00a4a0 con 0x55b0cb425250 2024-02-15T22:56:30.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.028+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb527850 con 0x55b0cb425250 2024-02-15T22:56:30.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.029+0000 7fec418af640 1 -- 172.21.15.133:0/4258598385 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fec3c00a4a0 con 0x55b0cb425250 2024-02-15T22:56:30.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.029+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb527c60 con 0x55b0cb425250 2024-02-15T22:56:30.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.029+0000 7fec418af640 1 -- 172.21.15.133:0/4258598385 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fec3c00a4a0 con 0x55b0cb425250 2024-02-15T22:56:30.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.029+0000 7fec435af800 1 Processor -- start 2024-02-15T22:56:30.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.029+0000 7fec435af800 1 -- start start 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.029+0000 7fec435af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb537030 0x55b0cb537450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.029+0000 7fec435af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0cb2c3e80 con 0x55b0cb537030 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.030+0000 7fec408ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb537030 0x55b0cb537450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.030+0000 7fec408ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb537030 0x55b0cb537450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59176/0 (socket says 172.21.15.133:59176) 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.030+0000 7fec408ad640 1 -- 172.21.15.133:0/1042634691 learned_addr learned my addr 172.21.15.133:0/1042634691 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.030+0000 7fec408ad640 1 -- 172.21.15.133:0/1042634691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0cb537990 con 0x55b0cb537030 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.030+0000 7fec408ad640 1 --2- 172.21.15.133:0/1042634691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb537030 0x55b0cb537450 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fec3800e610 tx=0x7fec3800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.030+0000 7feb26ffd640 1 -- 172.21.15.133:0/1042634691 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec3800bea0 con 0x55b0cb537030 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.030+0000 7feb26ffd640 1 -- 172.21.15.133:0/1042634691 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3800d500 con 0x55b0cb537030 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.030+0000 7fec435af800 1 -- 172.21.15.133:0/1042634691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b0cb538400 con 0x55b0cb537030 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.030+0000 7feb26ffd640 1 -- 172.21.15.133:0/1042634691 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec3800d7a0 con 0x55b0cb537030 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.031+0000 7fec435af800 1 -- 172.21.15.133:0/1042634691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0cb5388c0 con 0x55b0cb537030 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.031+0000 7feb26ffd640 1 -- 172.21.15.133:0/1042634691 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fec3801a070 con 0x55b0cb537030 2024-02-15T22:56:30.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.031+0000 7feb26ffd640 1 --2- 172.21.15.133:0/1042634691 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb180367e0 0x7feb18038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.031+0000 7feb26ffd640 1 -- 172.21.15.133:0/1042634691 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fec38017050 con 0x55b0cb537030 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.031+0000 7fec418af640 1 --2- 172.21.15.133:0/1042634691 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb180367e0 0x7feb18038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7fec435af800 1 Processor -- start 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7fec435af800 1 -- start start 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7fec418af640 1 --2- 172.21.15.133:0/1042634691 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb180367e0 0x7feb18038ca0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55b0cb5272f0 tx=0x7fec3c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7fec435af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb5446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7fec435af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0cb2995d0 con 0x55b0cb5442e0 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7fec408ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb5446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7fec408ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb5446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59186/0 (socket says 172.21.15.133:59186) 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7fec408ad640 1 -- 172.21.15.133:0/4014008981 learned_addr learned my addr 172.21.15.133:0/4014008981 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7fec408ad640 1 -- 172.21.15.133:0/4014008981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0cb544cb0 con 0x55b0cb5442e0 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7fec408ad640 1 --2- 172.21.15.133:0/4014008981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb5446e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fec3804b9d0 tx=0x7fec3804bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae7946727e2ee34 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7feb24ff9640 1 -- 172.21.15.133:0/4014008981 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec3801a320 con 0x55b0cb5442e0 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7feb24ff9640 1 -- 172.21.15.133:0/4014008981 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3801a480 con 0x55b0cb5442e0 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.032+0000 7feb24ff9640 1 -- 172.21.15.133:0/4014008981 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec3801ac40 con 0x55b0cb5442e0 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.033+0000 7fec435af800 1 -- 172.21.15.133:0/4014008981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 msgr2=0x55b0cb5446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.033+0000 7fec435af800 1 --2- 172.21.15.133:0/4014008981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb5446e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fec3804b9d0 tx=0x7fec3804bc50 comp rx=0 tx=0).stop 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.033+0000 7fec435af800 1 -- 172.21.15.133:0/4014008981 shutdown_connections 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.033+0000 7fec435af800 1 --2- 172.21.15.133:0/4014008981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb5446e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.033+0000 7fec435af800 1 -- 172.21.15.133:0/4014008981 >> 172.21.15.133:0/4014008981 conn(0x55b0cb5405b0 msgr2=0x55b0cb53e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.033+0000 7fec435af800 1 -- 172.21.15.133:0/4014008981 shutdown_connections 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.033+0000 7fec435af800 1 -- 172.21.15.133:0/4014008981 wait complete. 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.033+0000 7fec435af800 1 Processor -- start 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.033+0000 7fec435af800 1 -- start start 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.033+0000 7fec435af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb54b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.033+0000 7fec435af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0cb54b820 con 0x55b0cb5442e0 2024-02-15T22:56:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.034+0000 7fec408ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb54b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.034+0000 7fec408ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb54b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59190/0 (socket says 172.21.15.133:59190) 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.034+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 learned_addr learned my addr 172.21.15.133:0/1339895590 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.034+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0cb5388c0 con 0x55b0cb5442e0 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.034+0000 7fec408ad640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb54b2e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fec38048040 tx=0x7fec3804b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.034+0000 7feb16ffd640 1 -- 172.21.15.133:0/1339895590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec3801a320 con 0x55b0cb5442e0 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.034+0000 7feb16ffd640 1 -- 172.21.15.133:0/1339895590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec380242c0 con 0x55b0cb5442e0 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.034+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b0cb54ba20 con 0x55b0cb5442e0 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.035+0000 7feb16ffd640 1 -- 172.21.15.133:0/1339895590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec38024680 con 0x55b0cb5442e0 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.035+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0cb54bee0 con 0x55b0cb5442e0 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.035+0000 7feb16ffd640 1 -- 172.21.15.133:0/1339895590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fec3800d040 con 0x55b0cb5442e0 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.035+0000 7feb16ffd640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb0c0367e0 0x7feb0c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.035+0000 7feb16ffd640 1 -- 172.21.15.133:0/1339895590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fec3800a040 con 0x55b0cb5442e0 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.036+0000 7fec418af640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb0c0367e0 0x7feb0c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.036+0000 7fec418af640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb0c0367e0 0x7feb0c038ca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fec3c011010 tx=0x7fec3c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.036+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.036+0000 7fec435af800 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b0cb5570f0 0x55b0cb5595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.036+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb559d00 con 0x55b0cb5570f0 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.036+0000 7fec410ae640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b0cb5570f0 0x55b0cb5595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.036+0000 7fec410ae640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b0cb5570f0 0x55b0cb5595b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.036+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec34069870 con 0x55b0cb5570f0 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 20 realm 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55a0d0 con 0x55b0cb5570f0 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec34069870 con 0x55b0cb5570f0 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55a950 con 0x55b0cb5570f0 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec34069870 con 0x55b0cb5570f0 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55acb0 con 0x55b0cb5570f0 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55b4b0 con 0x55b0cb5570f0 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 20 searching for the correct realm 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55b0cb55d340 0x55b0cb55f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.037+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb55d340 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.038+0000 7fec408ad640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55b0cb55d340 0x55b0cb55f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.038+0000 7fec408ad640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55b0cb55d340 0x55b0cb55f800 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.038+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec38053040 con 0x55b0cb55d340 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.038+0000 7fec408ad640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fec38027060 0x7fec380290e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.038+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec38027060 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.038+0000 7fec418af640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fec38027060 0x7fec380290e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.039+0000 7fec418af640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fec38027060 0x7fec380290e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.039+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec3c00a4a0 con 0x7fec38027060 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.039+0000 7fec418af640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fec3c0141d0 0x7fec3c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.039+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec3c0141d0 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.039+0000 7fec410ae640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fec3c0141d0 0x7fec3c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.040+0000 7fec410ae640 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fec3c0141d0 0x7fec3c015940 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.040+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.040+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb5570f0 2024-02-15T22:56:30.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.040+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.040+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb5570f0 2024-02-15T22:56:30.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.040+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.040+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec3c0141d0 2024-02-15T22:56:30.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.041+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.041+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec3c0141d0 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.041+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.041+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec38027060 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.041+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec3c00a4a0 con 0x7fec38027060 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.041+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb55d340 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.041+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec38053040 con 0x55b0cb55d340 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.041+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb5570f0 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.042+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.042+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec3c0141d0 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.042+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.042+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb5570f0 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.042+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.042+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec38027060 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.042+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.042+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb55d340 2024-02-15T22:56:30.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.043+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec38053040 con 0x55b0cb55d340 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.043+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb55d340 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.043+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec38053040 con 0x55b0cb55d340 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.043+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec3c0141d0 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.043+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.043+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb55d340 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.043+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec38053040 con 0x55b0cb55d340 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.043+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb55d340 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.043+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec38053040 con 0x55b0cb55d340 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.043+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb5570f0 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.044+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.044+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb5570f0 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.044+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.044+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec3c0141d0 2024-02-15T22:56:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.044+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.044+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb55d340 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.044+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec38053040 con 0x55b0cb55d340 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.044+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec38027060 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.045+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.045+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb5570f0 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.045+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.045+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec3c0141d0 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.045+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.045+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb55d340 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.046+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec38053040 con 0x55b0cb55d340 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.046+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec3c0141d0 2024-02-15T22:56:30.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.046+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.046+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec38027060 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.046+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.046+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb55d340 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.046+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec38053040 con 0x55b0cb55d340 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.046+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec3c0141d0 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.046+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.046+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x55b0cb5570f0 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55fed0 con 0x7fec38027060 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:30.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55bdb0 con 0x55b0cb5570f0 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb55c600 con 0x55b0cb5570f0 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.047+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb560310 con 0x55b0cb5570f0 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 20 zone default found 2024-02-15T22:56:30.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 4 Realm: () 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 20 zonegroup default 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb560310 con 0x7fec3c0141d0 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb562190 con 0x55b0cb55d340 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.048+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5624f0 con 0x55b0cb55d340 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.049+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.049+0000 7fec435af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.049+0000 7fec435af800 20 started sync module instance, tier type = 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.049+0000 7fec435af800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.049+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb561760 con 0x7fec38027060 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.050+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.050+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94217814023248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb561760 con 0x7fec38027060 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.050+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb562f90 con 0x55b0cb5570f0 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.051+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94217814023248] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.051+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.051+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94217814026864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb561760 con 0x55b0cb5570f0 2024-02-15T22:56:30.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.051+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb563a60 con 0x55b0cb55d340 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.052+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94217814026864] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.052+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.052+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94217814020800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5616e0 con 0x55b0cb55d340 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.052+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5648f0 con 0x7fec38027060 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.053+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94217814020800] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.053+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.053+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94217814033488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb564d10 con 0x7fec38027060 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.053+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb565680 con 0x55b0cb5570f0 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.054+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.054+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94217814036960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb565660 con 0x55b0cb5570f0 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.054+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb566600 con 0x7fec3c0141d0 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.054+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94217814033488] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.055+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94217814036960] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.055+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.055+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94217814034544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb566120 con 0x7fec3c0141d0 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.055+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb566e80 con 0x7fec3c0141d0 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.056+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94217814034544] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.056+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.056+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94217814039008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb566b70 con 0x7fec3c0141d0 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.056+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5674e0 con 0x7fec3c0141d0 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.057+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.057+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94217814044736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb567900 con 0x7fec3c0141d0 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.057+0000 7fec435af800 20 add_watcher() i=0 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.057+0000 7fec435af800 20 add_watcher() i=1 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.057+0000 7fec435af800 20 add_watcher() i=2 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.057+0000 7fec435af800 20 add_watcher() i=3 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.057+0000 7fec435af800 20 add_watcher() i=4 2024-02-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.057+0000 7fec435af800 20 add_watcher() i=5 2024-02-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.057+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94217814039008] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.057+0000 7fec435af800 20 add_watcher() i=6 2024-02-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.058+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94217814044736] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.058+0000 7fec435af800 20 add_watcher() i=7 2024-02-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.058+0000 7fec435af800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.058+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb566790 con 0x55b0cb5570f0 2024-02-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.058+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.059+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94217814045792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb568270 con 0x55b0cb5570f0 2024-02-15T22:56:30.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.060+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94217814045792] v30'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.060+0000 7feaf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:30.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.060+0000 7fec435af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:30.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.060+0000 7fec435af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:30.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.060+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb573320 con 0x55b0cb5570f0 2024-02-15T22:56:30.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.061+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.061+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb573930 con 0x7fec3c0141d0 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.063+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.063+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb573e60 con 0x55b0cb55d340 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.063+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.064+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb574830 con 0x55b0cb5570f0 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.064+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'140 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.064+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb56f290 con 0x7fec38027060 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.065+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'41 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.065+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb56f290 con 0x55b0cb55d340 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.066+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.066+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb575a10 con 0x55b0cb5570f0 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.068+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.068+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb571380 con 0x7fec3c0141d0 2024-02-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.069+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'27 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.069+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb571990 con 0x7fec38027060 2024-02-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.069+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.069+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb571990 con 0x55b0cb55d340 2024-02-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.070+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.070+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576a20 con 0x7fec38027060 2024-02-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.071+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.071+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576bf0 con 0x7fec3c0141d0 2024-02-15T22:56:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.073+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.073+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576bf0 con 0x7fec38027060 2024-02-15T22:56:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.074+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.074+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576e50 con 0x7fec3c0141d0 2024-02-15T22:56:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.075+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.075+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576e50 con 0x55b0cb5570f0 2024-02-15T22:56:30.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.076+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'141 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.076+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576e50 con 0x55b0cb55d340 2024-02-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.077+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.077+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576e50 con 0x7fec38027060 2024-02-15T22:56:30.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.078+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.078+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x55b0cb55d340 2024-02-15T22:56:30.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.078+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.078+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x55b0cb5570f0 2024-02-15T22:56:30.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.080+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.080+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x55b0cb5570f0 2024-02-15T22:56:30.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.080+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'142 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.080+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x55b0cb55d340 2024-02-15T22:56:30.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.082+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.082+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x7fec38027060 2024-02-15T22:56:30.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.083+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.083+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x55b0cb55d340 2024-02-15T22:56:30.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.084+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.084+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x55b0cb55d340 2024-02-15T22:56:30.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.084+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.084+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x55b0cb55d340 2024-02-15T22:56:30.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.085+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.085+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x55b0cb55d340 2024-02-15T22:56:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.086+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.086+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x7fec3c0141d0 2024-02-15T22:56:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.087+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.087+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x55b0cb55d340 2024-02-15T22:56:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.088+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.088+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x7fec3c0141d0 2024-02-15T22:56:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.089+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.089+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x55b0cb55d340 2024-02-15T22:56:30.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.090+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'37 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.090+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x7fec3c0141d0 2024-02-15T22:56:30.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.091+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.091+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb576ee0 con 0x7fec38027060 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.092+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.092+0000 7feaf67e4640 20 reqs_thread_entry: start 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.092+0000 7fec435af800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.092+0000 7fec435af800 20 Filter name: none 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.092+0000 7fea67fff640 20 reqs_thread_entry: start 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5707f0 con 0x7fec38027060 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T22:56:30.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 : miss 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:95 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a2520 con 0x55b0cb55d340 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(95 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 20 get_obj_state: octx=0x7fec3c029040 obj=myfoo:four state=0x55b0cb5a3248 s->prefetch_data=0 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.093+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 3.25 3:a4de337f:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a4300 con 0x55b0cb5570f0 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.094+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(96 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+865 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.094+0000 7fec435af800 10 manifest: total_size = 4 2024-02-15T22:56:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.094+0000 7fec435af800 20 get_obj_state: setting s->obj_tag to b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5703738236000018294 2024-02-15T22:56:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.094+0000 7fec435af800 20 get_obj_state: octx=0x7fec3c029040 obj=myfoo:four state=0x55b0cb5a3248 s->prefetch_data=0 2024-02-15T22:56:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.094+0000 7fec435af800 20 prepare_atomic_modification: state is not atomic. state=0x55b0cb5a3248 2024-02-15T22:56:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.094+0000 7fec435af800 20 bucket index object: :.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6 2024-02-15T22:56:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.094+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:97 4.4 4:21b7c93c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a8d10 con 0x7fec3c0141d0 2024-02-15T22:56:30.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.095+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(97 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6 [stat,call,call] v30'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.095+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:98 3.25 3:a4de337f:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a8d10 con 0x55b0cb5570f0 2024-02-15T22:56:30.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.096+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(98 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1_four [call] v30'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.096+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:99 4.4 4:21b7c93c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a92b0 con 0x7fec3c0141d0 2024-02-15T22:56:30.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.097+0000 7feaf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.097+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94217814045792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a9290 con 0x55b0cb5570f0 2024-02-15T22:56:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.097+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(99 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6 [stat,call,call] v30'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.097+0000 7feb24ff9640 20 handle_completion(): completion ok for obj=four 2024-02-15T22:56:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.098+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94217814045792] v30'143 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.098+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94217814023248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a9270 con 0x7fec38027060 2024-02-15T22:56:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.099+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94217814023248] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.099+0000 7fec435af800 20 remove_watcher() i=0 2024-02-15T22:56:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.099+0000 7fec435af800 2 removed watcher, disabling cache 2024-02-15T22:56:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.099+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94217814026864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a9270 con 0x55b0cb5570f0 2024-02-15T22:56:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.100+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94217814026864] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.100+0000 7fec435af800 20 remove_watcher() i=1 2024-02-15T22:56:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.100+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94217814020800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a9270 con 0x55b0cb55d340 2024-02-15T22:56:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.101+0000 7fec408ad640 1 -- 172.21.15.133:0/1339895590 <== osd.3 v2:172.21.15.133:6816/1065500544 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94217814020800] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec38060040 con 0x55b0cb55d340 2024-02-15T22:56:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.101+0000 7fec435af800 20 remove_watcher() i=2 2024-02-15T22:56:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.101+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94217814033488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a9270 con 0x7fec38027060 2024-02-15T22:56:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.102+0000 7fec418af640 1 -- 172.21.15.133:0/1339895590 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94217814033488] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec38027060 2024-02-15T22:56:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.102+0000 7fec435af800 20 remove_watcher() i=3 2024-02-15T22:56:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.102+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94217814036960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a9270 con 0x55b0cb5570f0 2024-02-15T22:56:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.103+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94217814036960] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x55b0cb5570f0 2024-02-15T22:56:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.103+0000 7fec435af800 20 remove_watcher() i=4 2024-02-15T22:56:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.103+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94217814034544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a9270 con 0x7fec3c0141d0 2024-02-15T22:56:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.104+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94217814034544] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.104+0000 7fec435af800 20 remove_watcher() i=5 2024-02-15T22:56:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.104+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94217814039008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a9270 con 0x7fec3c0141d0 2024-02-15T22:56:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.105+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94217814039008] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.105+0000 7fec435af800 20 remove_watcher() i=6 2024-02-15T22:56:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.105+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94217814044736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0cb5a9270 con 0x7fec3c0141d0 2024-02-15T22:56:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94217814044736] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec34084040 con 0x7fec3c0141d0 2024-02-15T22:56:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 20 remove_watcher() i=7 2024-02-15T22:56:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fec3c0141d0 msgr2=0x7fec3c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fec3c0141d0 0x7fec3c015940 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b0cb5570f0 msgr2=0x55b0cb5595b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b0cb5570f0 0x55b0cb5595b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fec38027060 msgr2=0x7fec380290e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fec38027060 0x7fec380290e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55b0cb55d340 msgr2=0x55b0cb55f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55b0cb55d340 0x55b0cb55f800 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb0c0367e0 msgr2=0x7feb0c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb0c0367e0 0x7feb0c038ca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fec3c011010 tx=0x7fec3c020000 comp rx=0 tx=0).stop 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec410ae640 1 -- 172.21.15.133:0/1339895590 reap_dead start 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 msgr2=0x55b0cb54b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.106+0000 7fec435af800 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb54b2e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fec38048040 tx=0x7fec3804b930 comp rx=0 tx=0).stop 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 shutdown_connections 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 --2- 172.21.15.133:0/1339895590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb5442e0 0x55b0cb54b2e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 >> 172.21.15.133:0/1339895590 conn(0x55b0cb5405b0 msgr2=0x55b0cb53dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 shutdown_connections 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/1339895590 wait complete. 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/1042634691 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb180367e0 msgr2=0x7feb18038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 --2- 172.21.15.133:0/1042634691 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb180367e0 0x7feb18038ca0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55b0cb5272f0 tx=0x7fec3c005840 comp rx=0 tx=0).stop 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/1042634691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb537030 msgr2=0x55b0cb537450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 --2- 172.21.15.133:0/1042634691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb537030 0x55b0cb537450 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fec3800e610 tx=0x7fec3800ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/1042634691 shutdown_connections 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 --2- 172.21.15.133:0/1042634691 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb180367e0 0x7feb18038ca0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 --2- 172.21.15.133:0/1042634691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb537030 0x55b0cb537450 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/1042634691 >> 172.21.15.133:0/1042634691 conn(0x55b0cb52b0d0 msgr2=0x55b0cb52b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/1042634691 shutdown_connections 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/1042634691 wait complete. 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b0cb425250 msgr2=0x55b0cb526380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b0cb425250 0x55b0cb526380 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb280367e0 msgr2=0x7feb28038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb280367e0 0x7feb28038ca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec38000c00 tx=0x7fec380013b0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 msgr2=0x55b0cb51f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb51f550 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fec34000c00 tx=0x7fec34002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 shutdown_connections 2024-02-15T22:56:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b0cb425250 0x55b0cb526380 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb280367e0 0x7feb28038ca0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 --2- 172.21.15.133:0/4258598385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b0cb4248f0 0x55b0cb51f550 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 >> 172.21.15.133:0/4258598385 conn(0x55b0cb420470 msgr2=0x55b0cb5169d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.107+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 shutdown_connections 2024-02-15T22:56:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.108+0000 7fec435af800 1 -- 172.21.15.133:0/4258598385 wait complete. 2024-02-15T22:56:30.118 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T22:56:30.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-15T22:56:30.118 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-15T22:56:30.160 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:30.161 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:30.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.159+0000 7fb869213800 1 Processor -- start 2024-02-15T22:56:30.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.159+0000 7fb869213800 1 -- start start 2024-02-15T22:56:30.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.159+0000 7fb869213800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55857b7ce5b0 0x55857b7d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.159+0000 7fb869213800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55857b714bb0 con 0x55857b7caaa0 2024-02-15T22:56:30.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.159+0000 7fb869213800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55857b6cc450 con 0x55857b7ce5b0 2024-02-15T22:56:30.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.159+0000 7fb85ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55857b7ce5b0 0x55857b7d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.159+0000 7fb864819640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55857b7caaa0 0x55857b7cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45196/0 (socket says 172.21.15.133:45196) 2024-02-15T22:56:30.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.159+0000 7fb864819640 1 -- 172.21.15.133:0/714172512 learned_addr learned my addr 172.21.15.133:0/714172512 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:30.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.159+0000 7fb85ffff640 1 -- 172.21.15.133:0/714172512 >> v1:172.21.15.52:6789/0 conn(0x55857b7caaa0 legacy=0x55857b7cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.159+0000 7fb85f7fe640 1 -- 172.21.15.133:0/714172512 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696989112 0 0) 0x55857b714bb0 con 0x55857b7caaa0 2024-02-15T22:56:30.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.159+0000 7fb85ffff640 1 -- 172.21.15.133:0/714172512 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55857b7d1ef0 con 0x55857b7ce5b0 2024-02-15T22:56:30.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.161+0000 7fb85ffff640 1 --2- 172.21.15.133:0/714172512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7ce5b0 0x55857b7d09a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb85000a470 tx=0x7fb85001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b740fb53396729cd server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.161+0000 7fb85f7fe640 1 -- 172.21.15.133:0/714172512 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb850052570 con 0x55857b7ce5b0 2024-02-15T22:56:30.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.161+0000 7fb85f7fe640 1 -- 172.21.15.133:0/714172512 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8500526d0 con 0x55857b7ce5b0 2024-02-15T22:56:30.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.161+0000 7fb85f7fe640 1 -- 172.21.15.133:0/714172512 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb850052990 con 0x55857b7ce5b0 2024-02-15T22:56:30.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.162+0000 7fb869213800 1 -- 172.21.15.133:0/714172512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7ce5b0 msgr2=0x55857b7d09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.162+0000 7fb869213800 1 --2- 172.21.15.133:0/714172512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7ce5b0 0x55857b7d09a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb85000a470 tx=0x7fb85001cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:30.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.162+0000 7fb869213800 1 -- 172.21.15.133:0/714172512 shutdown_connections 2024-02-15T22:56:30.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.162+0000 7fb869213800 1 --2- 172.21.15.133:0/714172512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7ce5b0 0x55857b7d09a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.162+0000 7fb869213800 1 -- 172.21.15.133:0/714172512 >> 172.21.15.133:0/714172512 conn(0x55857b7c44d0 msgr2=0x55857b7c68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.162+0000 7fb869213800 1 -- 172.21.15.133:0/714172512 shutdown_connections 2024-02-15T22:56:30.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.162+0000 7fb869213800 1 -- 172.21.15.133:0/714172512 wait complete. 2024-02-15T22:56:30.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.173+0000 7fb869213800 1 Processor -- start 2024-02-15T22:56:30.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.174+0000 7fb869213800 1 -- start start 2024-02-15T22:56:30.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.174+0000 7fb869213800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8b9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.174+0000 7fb869213800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55857b6c9980 con 0x55857b7caaa0 2024-02-15T22:56:30.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.174+0000 7fb864819640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8b9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.174+0000 7fb864819640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8b9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59212/0 (socket says 172.21.15.133:59212) 2024-02-15T22:56:30.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.174+0000 7fb864819640 1 -- 172.21.15.133:0/1023368332 learned_addr learned my addr 172.21.15.133:0/1023368332 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.174+0000 7fb864819640 1 -- 172.21.15.133:0/1023368332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb850005d20 con 0x55857b7caaa0 2024-02-15T22:56:30.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.175+0000 7fb864819640 1 --2- 172.21.15.133:0/1023368332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8b9e70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb85800b210 tx=0x7fb85800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927321133f36ebe7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.175+0000 7fb752e05640 1 -- 172.21.15.133:0/1023368332 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb858014070 con 0x55857b7caaa0 2024-02-15T22:56:30.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.175+0000 7fb752e05640 1 -- 172.21.15.133:0/1023368332 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800d500 con 0x55857b7caaa0 2024-02-15T22:56:30.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.175+0000 7fb752e05640 1 -- 172.21.15.133:0/1023368332 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85800d800 con 0x55857b7caaa0 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.175+0000 7fb869213800 1 -- 172.21.15.133:0/1023368332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 msgr2=0x55857b8b9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.175+0000 7fb869213800 1 --2- 172.21.15.133:0/1023368332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8b9e70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb85800b210 tx=0x7fb85800b6d0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.175+0000 7fb869213800 1 -- 172.21.15.133:0/1023368332 shutdown_connections 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.175+0000 7fb869213800 1 --2- 172.21.15.133:0/1023368332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8b9e70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.175+0000 7fb869213800 1 -- 172.21.15.133:0/1023368332 >> 172.21.15.133:0/1023368332 conn(0x55857b7c44d0 msgr2=0x55857b8b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.175+0000 7fb869213800 1 -- 172.21.15.133:0/1023368332 shutdown_connections 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.175+0000 7fb869213800 1 -- 172.21.15.133:0/1023368332 wait complete. 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.176+0000 7fb869213800 1 Processor -- start 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.176+0000 7fb869213800 1 -- start start 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.176+0000 7fb869213800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.176+0000 7fb869213800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55857b6c5160 con 0x55857b7caaa0 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.176+0000 7fb864819640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.176+0000 7fb864819640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8c1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59222/0 (socket says 172.21.15.133:59222) 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.176+0000 7fb864819640 1 -- 172.21.15.133:0/2009650595 learned_addr learned my addr 172.21.15.133:0/2009650595 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.177+0000 7fb864819640 1 -- 172.21.15.133:0/2009650595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858001b70 con 0x55857b7caaa0 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.177+0000 7fb864819640 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8c1530 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb85800b210 tx=0x7fb858000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.177+0000 7fb751602640 1 -- 172.21.15.133:0/2009650595 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85800f950 con 0x55857b7caaa0 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.177+0000 7fb751602640 1 -- 172.21.15.133:0/2009650595 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858020070 con 0x55857b7caaa0 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.177+0000 7fb751602640 1 -- 172.21.15.133:0/2009650595 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85800fc20 con 0x55857b7caaa0 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.177+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55857b8c1a70 con 0x55857b7caaa0 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.177+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55857b8c1f50 con 0x55857b7caaa0 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.178+0000 7fb751602640 1 -- 172.21.15.133:0/2009650595 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb85800d040 con 0x55857b7caaa0 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.178+0000 7fb751602640 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb74c0367e0 0x7fb74c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.178+0000 7fb751602640 1 -- 172.21.15.133:0/2009650595 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fb85800a040 con 0x55857b7caaa0 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.178+0000 7fb85ffff640 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb74c0367e0 0x7fb74c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.178+0000 7fb869213800 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55857b7ce5b0 0x55857b8c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.178+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8c87e0 con 0x55857b7ce5b0 2024-02-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.178+0000 7fb86501a640 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55857b7ce5b0 0x55857b8c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.178+0000 7fb85ffff640 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb74c0367e0 0x7fb74c038ca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb850054000 tx=0x7fb85004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.178+0000 7fb86501a640 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55857b7ce5b0 0x55857b8c8210 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.179+0000 7fb86501a640 1 -- 172.21.15.133:0/2009650595 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x55857b7ce5b0 2024-02-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.179+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8c5940 con 0x55857b7ce5b0 2024-02-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.179+0000 7fb86501a640 1 -- 172.21.15.133:0/2009650595 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb86000a4a0 con 0x55857b7ce5b0 2024-02-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.179+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8ca540 con 0x55857b7ce5b0 2024-02-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.179+0000 7fb86501a640 1 -- 172.21.15.133:0/2009650595 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb86000a4a0 con 0x55857b7ce5b0 2024-02-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.179+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8c9850 con 0x55857b7ce5b0 2024-02-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.180+0000 7fb86501a640 1 -- 172.21.15.133:0/2009650595 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb86000a4a0 con 0x55857b7ce5b0 2024-02-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.180+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8c9c60 con 0x55857b7ce5b0 2024-02-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.180+0000 7fb86501a640 1 -- 172.21.15.133:0/2009650595 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb86000a4a0 con 0x55857b7ce5b0 2024-02-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.180+0000 7fb869213800 1 Processor -- start 2024-02-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.180+0000 7fb869213800 1 -- start start 2024-02-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.180+0000 7fb869213800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8d8fb0 0x55857b8d93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.180+0000 7fb869213800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55857b667e80 con 0x55857b8d8fb0 2024-02-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.181+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8d8fb0 0x55857b8d93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.181+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8d8fb0 0x55857b8d93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59224/0 (socket says 172.21.15.133:59224) 2024-02-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.181+0000 7fb85ffff640 1 -- 172.21.15.133:0/3770853998 learned_addr learned my addr 172.21.15.133:0/3770853998 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.181+0000 7fb85ffff640 1 -- 172.21.15.133:0/3770853998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55857b8d9910 con 0x55857b8d8fb0 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.181+0000 7fb85ffff640 1 --2- 172.21.15.133:0/3770853998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8d8fb0 0x55857b8d93d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb8500447c0 tx=0x7fb850002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.181+0000 7fb74a7fc640 1 -- 172.21.15.133:0/3770853998 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85005d9b0 con 0x55857b8d8fb0 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.181+0000 7fb74a7fc640 1 -- 172.21.15.133:0/3770853998 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85005db10 con 0x55857b8d8fb0 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.181+0000 7fb869213800 1 -- 172.21.15.133:0/3770853998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55857b8d9b00 con 0x55857b8d8fb0 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.181+0000 7fb74a7fc640 1 -- 172.21.15.133:0/3770853998 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85005ddd0 con 0x55857b8d8fb0 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.181+0000 7fb869213800 1 -- 172.21.15.133:0/3770853998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55857b8da5f0 con 0x55857b8d8fb0 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.182+0000 7fb74a7fc640 1 -- 172.21.15.133:0/3770853998 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb850066040 con 0x55857b8d8fb0 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.182+0000 7fb74a7fc640 1 --2- 172.21.15.133:0/3770853998 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb73c036830 0x7fb73c038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.182+0000 7fb74a7fc640 1 -- 172.21.15.133:0/3770853998 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fb850063040 con 0x55857b8d8fb0 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.182+0000 7fb86501a640 1 --2- 172.21.15.133:0/3770853998 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb73c036830 0x7fb73c038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.182+0000 7fb869213800 1 Processor -- start 2024-02-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb869213800 1 -- start start 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb86501a640 1 --2- 172.21.15.133:0/3770853998 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb73c036830 0x7fb73c038cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55857b8c9290 tx=0x7fb860005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb869213800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8e6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb869213800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55857b63d5d0 con 0x55857b8e6110 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8e6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59226/0 (socket says 172.21.15.133:59226) 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb85ffff640 1 -- 172.21.15.133:0/41949006 learned_addr learned my addr 172.21.15.133:0/41949006 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb85ffff640 1 -- 172.21.15.133:0/41949006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55857b8e6b00 con 0x55857b8e6110 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb85ffff640 1 --2- 172.21.15.133:0/41949006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8e6530 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb8500059a0 tx=0x7fb85005c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b462ac26a2a9369 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb73bfff640 1 -- 172.21.15.133:0/41949006 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85007e070 con 0x55857b8e6110 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb73bfff640 1 -- 172.21.15.133:0/41949006 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8500687b0 con 0x55857b8e6110 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.183+0000 7fb73bfff640 1 -- 172.21.15.133:0/41949006 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb850067aa0 con 0x55857b8e6110 2024-02-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.184+0000 7fb869213800 1 -- 172.21.15.133:0/41949006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 msgr2=0x55857b8e6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.184+0000 7fb869213800 1 --2- 172.21.15.133:0/41949006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8e6530 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb8500059a0 tx=0x7fb85005c950 comp rx=0 tx=0).stop 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.184+0000 7fb869213800 1 -- 172.21.15.133:0/41949006 shutdown_connections 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.184+0000 7fb869213800 1 --2- 172.21.15.133:0/41949006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8e6530 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.184+0000 7fb869213800 1 -- 172.21.15.133:0/41949006 >> 172.21.15.133:0/41949006 conn(0x55857b8e2470 msgr2=0x55857b8e04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.184+0000 7fb869213800 1 -- 172.21.15.133:0/41949006 shutdown_connections 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.184+0000 7fb869213800 1 -- 172.21.15.133:0/41949006 wait complete. 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.184+0000 7fb869213800 1 Processor -- start 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.184+0000 7fb869213800 1 -- start start 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.184+0000 7fb869213800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.184+0000 7fb869213800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55857b8ed690 con 0x55857b8e6110 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.185+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.185+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8ed150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59236/0 (socket says 172.21.15.133:59236) 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.185+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 learned_addr learned my addr 172.21.15.133:0/3566453769 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.185+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55857b8da5f0 con 0x55857b8e6110 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.185+0000 7fb85ffff640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8ed150 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb850070780 tx=0x7fb85008de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.185+0000 7fb73a7fc640 1 -- 172.21.15.133:0/3566453769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85007e040 con 0x55857b8e6110 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.185+0000 7fb73a7fc640 1 -- 172.21.15.133:0/3566453769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb850006e60 con 0x55857b8e6110 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.185+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55857b8ed890 con 0x55857b8e6110 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.185+0000 7fb73a7fc640 1 -- 172.21.15.133:0/3566453769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85005c6c0 con 0x55857b8e6110 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.185+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55857b8edcf0 con 0x55857b8e6110 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.186+0000 7fb73a7fc640 1 -- 172.21.15.133:0/3566453769 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb850081040 con 0x55857b8e6110 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.186+0000 7fb73a7fc640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb7300367e0 0x7fb730038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.186+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.186+0000 7fb73a7fc640 1 -- 172.21.15.133:0/3566453769 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fb850099b30 con 0x55857b8e6110 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.186+0000 7fb86501a640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb7300367e0 0x7fb730038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb869213800 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55857b8f8d10 0x55857b8fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8fb900 con 0x55857b8f8d10 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb864819640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55857b8f8d10 0x55857b8fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb86501a640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb7300367e0 0x7fb730038ca0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb86000b010 tx=0x7fb860020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb864819640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55857b8f8d10 0x55857b8fb1b0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb858016070 con 0x55857b8f8d10 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb869213800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb869213800 20 realm 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8fbcd0 con 0x55857b8f8d10 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb858016070 con 0x55857b8f8d10 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb869213800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb869213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.187+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8fc520 con 0x55857b8f8d10 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb858016070 con 0x55857b8f8d10 2024-02-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb869213800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8fc880 con 0x55857b8f8d10 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb858016070 con 0x55857b8f8d10 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb869213800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8fc1c0 con 0x55857b8f8d10 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb858016070 con 0x55857b8f8d10 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb869213800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb869213800 20 searching for the correct realm 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb869213800 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55857b8fec40 0x55857b901030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8fec40 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb85ffff640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55857b8fec40 0x55857b901030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.188+0000 7fb85ffff640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55857b8fec40 0x55857b901030 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.189+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.189+0000 7fb85ffff640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb850098060 0x7fb85008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.189+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb850098060 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.189+0000 7fb86501a640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb850098060 0x7fb85008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.189+0000 7fb86501a640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb850098060 0x7fb85008f090 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.190+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb850098060 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.190+0000 7fb86501a640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb8600141d0 0x7fb860015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.190+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb8600141d0 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.190+0000 7fb864819640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb8600141d0 0x7fb860015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.190+0000 7fb864819640 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb8600141d0 0x7fb860015940 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.190+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858016070 con 0x7fb8600141d0 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.190+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8f8d10 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.191+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858016070 con 0x55857b8f8d10 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.191+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8f8d10 2024-02-15T22:56:30.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.191+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858016070 con 0x55857b8f8d10 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.191+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb8600141d0 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.191+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858016070 con 0x7fb8600141d0 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.191+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb8600141d0 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.191+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858016070 con 0x7fb8600141d0 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.191+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb850098060 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.192+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb850098060 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.192+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8fec40 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.192+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.192+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8f8d10 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.192+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858016070 con 0x55857b8f8d10 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.192+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb8600141d0 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.192+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858016070 con 0x7fb8600141d0 2024-02-15T22:56:30.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.192+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8f8d10 2024-02-15T22:56:30.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.193+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858016070 con 0x55857b8f8d10 2024-02-15T22:56:30.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.193+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb850098060 2024-02-15T22:56:30.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.193+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.193+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8fec40 2024-02-15T22:56:30.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.193+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.193+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8fec40 2024-02-15T22:56:30.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.193+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.193+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb8600141d0 2024-02-15T22:56:30.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.194+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858016070 con 0x7fb8600141d0 2024-02-15T22:56:30.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.194+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8fec40 2024-02-15T22:56:30.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.194+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.194+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8fec40 2024-02-15T22:56:30.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.194+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.194+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8f8d10 2024-02-15T22:56:30.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.194+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858016070 con 0x55857b8f8d10 2024-02-15T22:56:30.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.194+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8f8d10 2024-02-15T22:56:30.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.195+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb858016070 con 0x55857b8f8d10 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.195+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb8600141d0 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.195+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.195+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8fec40 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.195+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.195+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb850098060 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.195+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.195+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8f8d10 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.195+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.195+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb8600141d0 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.196+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.196+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8fec40 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.196+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.196+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb8600141d0 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.196+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.196+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb850098060 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.196+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.196+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8fec40 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.197+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.197+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb8600141d0 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.197+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.197+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x55857b8f8d10 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9016b0 con 0x7fb850098060 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:30.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8fd6f0 con 0x55857b8f8d10 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8fd370 con 0x55857b8f8d10 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8fdfc0 con 0x55857b8f8d10 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 zone default found 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 4 Realm: () 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 zonegroup default 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.198+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b8fdfc0 con 0x7fb8600141d0 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb869213800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9034d0 con 0x55857b8fec40 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb869213800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b903830 con 0x55857b8fec40 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb869213800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb869213800 20 started sync module instance, tier type = 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb869213800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.199+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b902db0 con 0x7fb850098060 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.200+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.200+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94031792056592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b903160 con 0x7fb850098060 2024-02-15T22:56:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.200+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b904560 con 0x55857b8f8d10 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.201+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94031792056592] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.202+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.202+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94031792061744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b904770 con 0x55857b8f8d10 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.202+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b905240 con 0x55857b8fec40 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.203+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94031792061744] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.203+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.203+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94031792065824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9055f0 con 0x55857b8fec40 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.203+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b905ff0 con 0x7fb850098060 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.204+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94031792065824] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.204+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.204+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94031792069360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9063a0 con 0x7fb850098060 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.204+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b906dd0 con 0x55857b8f8d10 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.205+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.205+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94031792072912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b906dd0 con 0x55857b8f8d10 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.205+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94031792069360] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.205+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b907d60 con 0x7fb8600141d0 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.206+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94031792072912] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.206+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.206+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94031792063008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b907880 con 0x7fb8600141d0 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.206+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b908330 con 0x7fb8600141d0 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.207+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94031792063008] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.207+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.207+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94031792074672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b908330 con 0x7fb8600141d0 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.207+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b908ca0 con 0x7fb8600141d0 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.208+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94031792074672] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.208+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.208+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94031792078752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b908ca0 con 0x7fb8600141d0 2024-02-15T22:56:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.208+0000 7fb869213800 20 add_watcher() i=0 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.208+0000 7fb869213800 20 add_watcher() i=1 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.208+0000 7fb869213800 20 add_watcher() i=2 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.208+0000 7fb869213800 20 add_watcher() i=3 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.208+0000 7fb869213800 20 add_watcher() i=4 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.208+0000 7fb869213800 20 add_watcher() i=5 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.208+0000 7fb869213800 20 add_watcher() i=6 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.209+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94031792078752] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.209+0000 7fb869213800 20 add_watcher() i=7 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.209+0000 7fb869213800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.209+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b908c80 con 0x55857b8f8d10 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.209+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.209+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94031792082992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9098f0 con 0x55857b8f8d10 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.210+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94031792082992] v30'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb71afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb869213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb869213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb869213800 5 note: GC not initialized 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb719fe3640 20 reqs_thread_entry: start 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb869213800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb869213800 20 Filter name: none 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb68b7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b93e0b0 con 0x7fb850098060 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb869213800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.211+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:63 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b93e930 con 0x55857b8fec40 2024-02-15T22:56:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.212+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(63 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.212+0000 7fb869213800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.212+0000 7fb869213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.212+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.212+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b93d9b0 con 0x7fb850098060 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.212+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.212+0000 7fb869213800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.212+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.212+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:65 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b940440 con 0x55857b8fec40 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(65 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:66 4.26 4:64dd6fe8:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b93fed0 con 0x7fb8600141d0 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 4.1a 4:5969fa1d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b944f80 con 0x7fb850098060 2024-02-15T22:56:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 4.3c 4:3d7776b5:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9478f0 con 0x55857b8f8d10 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 4.16 4:69b66c2d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9478f0 con 0x55857b8fec40 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 4.c 4:32ea204e:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b944f80 con 0x55857b8f8d10 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 4.2a 4:550e1cd1:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b94f790 con 0x55857b8f8d10 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 4.4 4:21b7c93c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9521d0 con 0x7fb8600141d0 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 4.3a 4:5eac6251:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b954b70 con 0x55857b8fec40 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 4.18 4:1830de7d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b9574d0 con 0x7fb850098060 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 4.14 4:29b37fcc:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b959fc0 con 0x55857b8fec40 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:76 4.1d 4:b9a64d9c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b95ca00 con 0x55857b8fec40 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(66 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(72 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(68 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(67 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(69 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(70 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(71 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.5 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(73 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.213+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(75 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.214+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(76 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.214+0000 7fb869213800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.214+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.2 6:44d22c7c:::pubsub..bucket.myfoo%2fb92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b95ca00 con 0x55857b8fec40 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.214+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.214+0000 7fb869213800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.215+0000 7fb71afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.215+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94031792082992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b95ca00 con 0x55857b8f8d10 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.216+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94031792082992] v30'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.216+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94031792056592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b95ca00 con 0x7fb850098060 2024-02-15T22:56:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.216+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94031792056592] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.217+0000 7fb869213800 20 remove_watcher() i=0 2024-02-15T22:56:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.217+0000 7fb869213800 2 removed watcher, disabling cache 2024-02-15T22:56:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.217+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94031792061744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b95ca00 con 0x55857b8f8d10 2024-02-15T22:56:30.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.218+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94031792061744] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.218+0000 7fb869213800 20 remove_watcher() i=1 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.218+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94031792065824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b95ca00 con 0x55857b8fec40 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.219+0000 7fb85ffff640 1 -- 172.21.15.133:0/3566453769 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94031792065824] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb85006e070 con 0x55857b8fec40 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.219+0000 7fb869213800 20 remove_watcher() i=2 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.219+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94031792069360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b95ca00 con 0x7fb850098060 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.220+0000 7fb86501a640 1 -- 172.21.15.133:0/3566453769 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94031792069360] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86003a040 con 0x7fb850098060 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.220+0000 7fb869213800 20 remove_watcher() i=3 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.220+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94031792072912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b95ca00 con 0x55857b8f8d10 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.221+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94031792072912] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x55857b8f8d10 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.221+0000 7fb869213800 20 remove_watcher() i=4 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.221+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94031792063008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b95ca00 con 0x7fb8600141d0 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.222+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94031792063008] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.222+0000 7fb869213800 20 remove_watcher() i=5 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.222+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94031792074672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b95ca00 con 0x7fb8600141d0 2024-02-15T22:56:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.223+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94031792074672] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.223+0000 7fb869213800 20 remove_watcher() i=6 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.223+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94031792078752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55857b95ca00 con 0x7fb8600141d0 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94031792078752] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb858052040 con 0x7fb8600141d0 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 20 remove_watcher() i=7 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb8600141d0 msgr2=0x7fb860015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb8600141d0 0x7fb860015940 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55857b8f8d10 msgr2=0x55857b8fb1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55857b8f8d10 0x55857b8fb1b0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb850098060 msgr2=0x7fb85008f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb850098060 0x7fb85008f090 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55857b8fec40 msgr2=0x55857b901030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55857b8fec40 0x55857b901030 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb7300367e0 msgr2=0x7fb730038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb7300367e0 0x7fb730038ca0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb86000b010 tx=0x7fb860020000 comp rx=0 tx=0).stop 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 msgr2=0x55857b8ed150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb864819640 1 -- 172.21.15.133:0/3566453769 reap_dead start 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8ed150 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb850070780 tx=0x7fb85008de40 comp rx=0 tx=0).stop 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 shutdown_connections 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 --2- 172.21.15.133:0/3566453769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8e6110 0x55857b8ed150 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 >> 172.21.15.133:0/3566453769 conn(0x55857b8e2470 msgr2=0x55857b8dfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 shutdown_connections 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.224+0000 7fb869213800 1 -- 172.21.15.133:0/3566453769 wait complete. 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/3770853998 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb73c036830 msgr2=0x7fb73c038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 --2- 172.21.15.133:0/3770853998 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb73c036830 0x7fb73c038cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55857b8c9290 tx=0x7fb860005840 comp rx=0 tx=0).stop 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/3770853998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8d8fb0 msgr2=0x55857b8d93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 --2- 172.21.15.133:0/3770853998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8d8fb0 0x55857b8d93d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb8500447c0 tx=0x7fb850002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/3770853998 shutdown_connections 2024-02-15T22:56:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 --2- 172.21.15.133:0/3770853998 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb73c036830 0x7fb73c038cf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 --2- 172.21.15.133:0/3770853998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b8d8fb0 0x55857b8d93d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/3770853998 >> 172.21.15.133:0/3770853998 conn(0x55857b8cd050 msgr2=0x55857b8cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/3770853998 shutdown_connections 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/3770853998 wait complete. 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55857b7ce5b0 msgr2=0x55857b8c8210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55857b7ce5b0 0x55857b8c8210 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb74c0367e0 msgr2=0x7fb74c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb74c0367e0 0x7fb74c038ca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb850054000 tx=0x7fb85004e000 comp rx=0 tx=0).stop 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 msgr2=0x55857b8c1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8c1530 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb85800b210 tx=0x7fb858000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 shutdown_connections 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55857b7ce5b0 0x55857b8c8210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb74c0367e0 0x7fb74c038ca0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 --2- 172.21.15.133:0/2009650595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55857b7caaa0 0x55857b8c1530 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 >> 172.21.15.133:0/2009650595 conn(0x55857b7c44d0 msgr2=0x55857b8b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 shutdown_connections 2024-02-15T22:56:30.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.225+0000 7fb869213800 1 -- 172.21.15.133:0/2009650595 wait complete. 2024-02-15T22:56:30.241 INFO:teuthology.orchestra.run.smithi133.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f2cd5859-7c57-45d7-89f3-01e23ceddfe0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","marker":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-15T22:56:29.722670Z","creation_time":"2024-02-15T22:56:26.869244Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-15T22:56:30.242 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f2cd5859-7c57-45d7-89f3-01e23ceddfe0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'marker': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-15T22:56:29.722670Z', 'creation_time': '2024-02-15T22:56:26.869244Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-15T22:56:30.242 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-02-15T22:56:30.242 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-02-15T22:56:30.242 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-02-15T22:56:30.323 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:30.323 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:30.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.321+0000 7fbdf8a30800 1 Processor -- start 2024-02-15T22:56:30.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.321+0000 7fbdf8a30800 1 -- start start 2024-02-15T22:56:30.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.321+0000 7fbdf8a30800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556cbb908110 0x556cbb997b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.321+0000 7fbdf8a30800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556cbb8dfba0 con 0x556cbb9980a0 2024-02-15T22:56:30.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.321+0000 7fbdf8a30800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x556cbb897450 con 0x556cbb908110 2024-02-15T22:56:30.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.322+0000 7fbdf3d33640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556cbb908110 0x556cbb997b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.322+0000 7fbdeb532640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x556cbb9980a0 0x556cbb99a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45212/0 (socket says 172.21.15.133:45212) 2024-02-15T22:56:30.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.322+0000 7fbdeb532640 1 -- 172.21.15.133:0/3488240069 learned_addr learned my addr 172.21.15.133:0/3488240069 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:30.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.322+0000 7fbdf3d33640 1 --2- 172.21.15.133:0/3488240069 >> v2:172.21.15.52:3300/0 conn(0x556cbb908110 0x556cbb997b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59240/0 (socket says 172.21.15.133:59240) 2024-02-15T22:56:30.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.322+0000 7fbdf3d33640 1 -- 172.21.15.133:0/3488240069 >> v1:172.21.15.52:6789/0 conn(0x556cbb9980a0 legacy=0x556cbb99a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.322+0000 7fbdf3d33640 1 -- 172.21.15.133:0/3488240069 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cbb99ce00 con 0x556cbb908110 2024-02-15T22:56:30.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.324+0000 7fbdf3d33640 1 --2- 172.21.15.133:0/3488240069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbb997b00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbde400a470 tx=0x7fbde401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e4e5282b6e0ca5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.324+0000 7fbdf3532640 1 -- 172.21.15.133:0/3488240069 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbde4052570 con 0x556cbb908110 2024-02-15T22:56:30.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.324+0000 7fbdf3532640 1 -- 172.21.15.133:0/3488240069 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde40526d0 con 0x556cbb908110 2024-02-15T22:56:30.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.324+0000 7fbdf3532640 1 -- 172.21.15.133:0/3488240069 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbde4052990 con 0x556cbb908110 2024-02-15T22:56:30.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.324+0000 7fbdf8a30800 1 -- 172.21.15.133:0/3488240069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 msgr2=0x556cbb997b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.324+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/3488240069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbb997b00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbde400a470 tx=0x7fbde401cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:30.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.324+0000 7fbdf8a30800 1 -- 172.21.15.133:0/3488240069 shutdown_connections 2024-02-15T22:56:30.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.324+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/3488240069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbb997b00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.324+0000 7fbdf8a30800 1 -- 172.21.15.133:0/3488240069 >> 172.21.15.133:0/3488240069 conn(0x556cbb98f4c0 msgr2=0x556cbb9918e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.325+0000 7fbdf8a30800 1 -- 172.21.15.133:0/3488240069 shutdown_connections 2024-02-15T22:56:30.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.325+0000 7fbdf8a30800 1 -- 172.21.15.133:0/3488240069 wait complete. 2024-02-15T22:56:30.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.336+0000 7fbdf8a30800 1 Processor -- start 2024-02-15T22:56:30.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.336+0000 7fbdf8a30800 1 -- start start 2024-02-15T22:56:30.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.336+0000 7fbdf8a30800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbba84fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.336+0000 7fbdf8a30800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cbb894980 con 0x556cbb908110 2024-02-15T22:56:30.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.336+0000 7fbdf3d33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbba84fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.336+0000 7fbdf3d33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbba84fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59250/0 (socket says 172.21.15.133:59250) 2024-02-15T22:56:30.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.336+0000 7fbdf3d33640 1 -- 172.21.15.133:0/1399934780 learned_addr learned my addr 172.21.15.133:0/1399934780 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.337+0000 7fbdf3d33640 1 -- 172.21.15.133:0/1399934780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde4005d20 con 0x556cbb908110 2024-02-15T22:56:30.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.337+0000 7fbdf3d33640 1 --2- 172.21.15.133:0/1399934780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbba84fe0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbde4055040 tx=0x7fbde404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7db5314e11138a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.337+0000 7fbce1e0b640 1 -- 172.21.15.133:0/1399934780 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbde400a180 con 0x556cbb908110 2024-02-15T22:56:30.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.337+0000 7fbce1e0b640 1 -- 172.21.15.133:0/1399934780 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde400a2e0 con 0x556cbb908110 2024-02-15T22:56:30.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.337+0000 7fbce1e0b640 1 -- 172.21.15.133:0/1399934780 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbde40529b0 con 0x556cbb908110 2024-02-15T22:56:30.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1399934780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 msgr2=0x556cbba84fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/1399934780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbba84fe0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbde4055040 tx=0x7fbde404c000 comp rx=0 tx=0).stop 2024-02-15T22:56:30.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1399934780 shutdown_connections 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/1399934780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbba84fe0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1399934780 >> 172.21.15.133:0/1399934780 conn(0x556cbb98f4c0 msgr2=0x556cbba80900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1399934780 shutdown_connections 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1399934780 wait complete. 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf8a30800 1 Processor -- start 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf8a30800 1 -- start start 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf8a30800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbb995430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf8a30800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cbb890160 con 0x556cbb908110 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf3d33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbb995430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf3d33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbb995430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59256/0 (socket says 172.21.15.133:59256) 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.338+0000 7fbdf3d33640 1 -- 172.21.15.133:0/2490765622 learned_addr learned my addr 172.21.15.133:0/2490765622 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.339+0000 7fbdf3d33640 1 -- 172.21.15.133:0/2490765622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cbb99ce00 con 0x556cbb908110 2024-02-15T22:56:30.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.339+0000 7fbdf3d33640 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbb995430 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbde400a470 tx=0x7fbde4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.339+0000 7fbcdbfff640 1 -- 172.21.15.133:0/2490765622 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbde406a070 con 0x556cbb908110 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.339+0000 7fbcdbfff640 1 -- 172.21.15.133:0/2490765622 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde405d420 con 0x556cbb908110 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.339+0000 7fbcdbfff640 1 -- 172.21.15.133:0/2490765622 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbde405d5d0 con 0x556cbb908110 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.339+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556cbb993b20 con 0x556cbb908110 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.339+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556cbb994000 con 0x556cbb908110 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.340+0000 7fbcdbfff640 1 -- 172.21.15.133:0/2490765622 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbde405d730 con 0x556cbb908110 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.340+0000 7fbcdbfff640 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbcdc0367e0 0x7fbcdc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.340+0000 7fbcdbfff640 1 -- 172.21.15.133:0/2490765622 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fbde408d960 con 0x556cbb908110 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.340+0000 7fbdeb532640 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbcdc0367e0 0x7fbcdc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.340+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556cbb9980a0 0x556cbba95960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.340+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbb994830 con 0x556cbb9980a0 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.340+0000 7fbdf4534640 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556cbb9980a0 0x556cbba95960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.340+0000 7fbdeb532640 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbcdc0367e0 0x7fbcdc038ca0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbddc000f60 tx=0x7fbddc0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.341+0000 7fbdf4534640 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556cbb9980a0 0x556cbba95960 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.341+0000 7fbdf4534640 1 -- 172.21.15.133:0/2490765622 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbdec00a4a0 con 0x556cbb9980a0 2024-02-15T22:56:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.341+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbb994330 con 0x556cbb9980a0 2024-02-15T22:56:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.341+0000 7fbdf4534640 1 -- 172.21.15.133:0/2490765622 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbdec00a4a0 con 0x556cbb9980a0 2024-02-15T22:56:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.341+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbba97870 con 0x556cbb9980a0 2024-02-15T22:56:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.341+0000 7fbdf4534640 1 -- 172.21.15.133:0/2490765622 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fbdec00a4a0 con 0x556cbb9980a0 2024-02-15T22:56:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.341+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbba96a70 con 0x556cbb9980a0 2024-02-15T22:56:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.342+0000 7fbdf4534640 1 -- 172.21.15.133:0/2490765622 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbdec00a4a0 con 0x556cbb9980a0 2024-02-15T22:56:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.342+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbba96e80 con 0x556cbb9980a0 2024-02-15T22:56:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.342+0000 7fbdf4534640 1 -- 172.21.15.133:0/2490765622 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbdec00a4a0 con 0x556cbb9980a0 2024-02-15T22:56:30.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.342+0000 7fbdf8a30800 1 Processor -- start 2024-02-15T22:56:30.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.342+0000 7fbdf8a30800 1 -- start start 2024-02-15T22:56:30.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.342+0000 7fbdf8a30800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbaa6260 0x556cbbaa6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.342+0000 7fbdf8a30800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cbb832e80 con 0x556cbbaa6260 2024-02-15T22:56:30.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.343+0000 7fbdeb532640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbaa6260 0x556cbbaa6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.343+0000 7fbdeb532640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbaa6260 0x556cbbaa6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59260/0 (socket says 172.21.15.133:59260) 2024-02-15T22:56:30.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.343+0000 7fbdeb532640 1 -- 172.21.15.133:0/1880855577 learned_addr learned my addr 172.21.15.133:0/1880855577 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.343+0000 7fbdeb532640 1 -- 172.21.15.133:0/1880855577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cbbaa6bc0 con 0x556cbbaa6260 2024-02-15T22:56:30.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.343+0000 7fbdeb532640 1 --2- 172.21.15.133:0/1880855577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbaa6260 0x556cbbaa6680 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbddc001ed0 tx=0x7fbddc00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.343+0000 7fbcd97fa640 1 -- 172.21.15.133:0/1880855577 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbddc020070 con 0x556cbbaa6260 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.343+0000 7fbcd97fa640 1 -- 172.21.15.133:0/1880855577 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc01b550 con 0x556cbbaa6260 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.343+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1880855577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556cbbaa7630 con 0x556cbbaa6260 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.343+0000 7fbcd97fa640 1 -- 172.21.15.133:0/1880855577 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbddc013040 con 0x556cbbaa6260 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.344+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1880855577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556cbbaa7af0 con 0x556cbbaa6260 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.344+0000 7fbcd97fa640 1 -- 172.21.15.133:0/1880855577 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbddc01b7f0 con 0x556cbbaa6260 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.344+0000 7fbcd97fa640 1 --2- 172.21.15.133:0/1880855577 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbccc0367e0 0x7fbccc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.344+0000 7fbcd97fa640 1 -- 172.21.15.133:0/1880855577 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fbddc04e230 con 0x556cbbaa6260 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.344+0000 7fbdf4534640 1 --2- 172.21.15.133:0/1880855577 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbccc0367e0 0x7fbccc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.345+0000 7fbdf8a30800 1 Processor -- start 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.345+0000 7fbdf4534640 1 --2- 172.21.15.133:0/1880855577 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbccc0367e0 0x7fbccc038ca0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x556cbba964b0 tx=0x7fbdec005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.345+0000 7fbdf8a30800 1 -- start start 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.345+0000 7fbdf8a30800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 0x556cbbab3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.345+0000 7fbdf8a30800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cbb8085d0 con 0x556cbbab3560 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.345+0000 7fbdeb532640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 0x556cbbab3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.345+0000 7fbdeb532640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 0x556cbbab3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59272/0 (socket says 172.21.15.133:59272) 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.345+0000 7fbdeb532640 1 -- 172.21.15.133:0/1562891771 learned_addr learned my addr 172.21.15.133:0/1562891771 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.345+0000 7fbdeb532640 1 -- 172.21.15.133:0/1562891771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cbbab3f50 con 0x556cbbab3560 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.345+0000 7fbdeb532640 1 --2- 172.21.15.133:0/1562891771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 0x556cbbab3980 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbddc04c750 tx=0x7fbddc019bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce46aa2bc99a200 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbcd2ffd640 1 -- 172.21.15.133:0/1562891771 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbddc025930 con 0x556cbbab3560 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbcd2ffd640 1 -- 172.21.15.133:0/1562891771 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc040e90 con 0x556cbbab3560 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbcd2ffd640 1 -- 172.21.15.133:0/1562891771 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbddc025410 con 0x556cbbab3560 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1562891771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 msgr2=0x556cbbab3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/1562891771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 0x556cbbab3980 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbddc04c750 tx=0x7fbddc019bb0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1562891771 shutdown_connections 2024-02-15T22:56:30.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/1562891771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 0x556cbbab3980 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1562891771 >> 172.21.15.133:0/1562891771 conn(0x556cbbaaf8c0 msgr2=0x556cbbaad920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1562891771 shutdown_connections 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1562891771 wait complete. 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbdf8a30800 1 Processor -- start 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.346+0000 7fbdf8a30800 1 -- start start 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbdf8a30800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 0x556cbbaba590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbdf8a30800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cbbabaad0 con 0x556cbbab3560 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbdeb532640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 0x556cbbaba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbdeb532640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 0x556cbbaba590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59274/0 (socket says 172.21.15.133:59274) 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 learned_addr learned my addr 172.21.15.133:0/916579882 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cbbaa7af0 con 0x556cbbab3560 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbdeb532640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 0x556cbbaba590 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbddc04ca70 tx=0x7fbddc04c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbcd17fa640 1 -- 172.21.15.133:0/916579882 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbddc025a70 con 0x556cbbab3560 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbcd17fa640 1 -- 172.21.15.133:0/916579882 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc025410 con 0x556cbbab3560 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556cbbabacd0 con 0x556cbbab3560 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbcd17fa640 1 -- 172.21.15.133:0/916579882 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbddc01bc80 con 0x556cbbab3560 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.347+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556cbbabacd0 con 0x556cbbab3560 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.348+0000 7fbcd17fa640 1 -- 172.21.15.133:0/916579882 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbddc00cc60 con 0x556cbbab3560 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.348+0000 7fbcd17fa640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbcbc0367e0 0x7fbcbc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.348+0000 7fbdf8a30800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.348+0000 7fbcd17fa640 1 -- 172.21.15.133:0/916579882 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fbddc039b00 con 0x556cbbab3560 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.348+0000 7fbdf4534640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbcbc0367e0 0x7fbcbc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556cbbac5fb0 0x556cbbac83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbac8b30 con 0x556cbbac5fb0 2024-02-15T22:56:30.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf3d33640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556cbbac5fb0 0x556cbbac83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf4534640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbcbc0367e0 0x7fbcbc038ca0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00b010 tx=0x7fbdec020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf3d33640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556cbbac5fb0 0x556cbbac83e0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbde4059040 con 0x556cbbac5fb0 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf8a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf8a30800 20 realm 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf8a30800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbac8f00 con 0x556cbbac5fb0 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbde4059040 con 0x556cbbac5fb0 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf8a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf8a30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf8a30800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.349+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbac9750 con 0x556cbbac5fb0 2024-02-15T22:56:30.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbde4059040 con 0x556cbbac5fb0 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf8a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf8a30800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbac9ab0 con 0x556cbbac5fb0 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbde4059040 con 0x556cbbac5fb0 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf8a30800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf8a30800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbac93f0 con 0x556cbbac5fb0 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fbde407e040 con 0x556cbbac5fb0 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf8a30800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf8a30800 20 searching for the correct realm 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556cbbacbe70 0x556cbbace260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdeb532640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556cbbacbe70 0x556cbbace260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.350+0000 7fbdeb532640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556cbbacbe70 0x556cbbace260 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.351+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.351+0000 7fbdeb532640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fbddc038070 0x7fbddc02f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.351+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.351+0000 7fbdf4534640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fbddc038070 0x7fbddc02f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.351+0000 7fbdf4534640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fbddc038070 0x7fbddc02f8c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.352+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdec00a4a0 con 0x7fbddc038070 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.352+0000 7fbdf4534640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fbdec0141d0 0x7fbdec015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.352+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.352+0000 7fbdf3d33640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fbdec0141d0 0x7fbdec015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.352+0000 7fbdf3d33640 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fbdec0141d0 0x7fbdec015940 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.352+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde407e040 con 0x7fbdec0141d0 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.352+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.353+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde407e040 con 0x556cbbac5fb0 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.353+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.353+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde407e040 con 0x556cbbac5fb0 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.353+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.353+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde407e040 con 0x7fbdec0141d0 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.353+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.353+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde407e040 con 0x7fbdec0141d0 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.353+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.354+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdec00a4a0 con 0x7fbddc038070 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.354+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.354+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.354+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.354+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde407e040 con 0x556cbbac5fb0 2024-02-15T22:56:30.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.354+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.354+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde407e040 con 0x7fbdec0141d0 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.354+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.355+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde407e040 con 0x556cbbac5fb0 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.355+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.355+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.355+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.355+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.355+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.355+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.355+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.356+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde407e040 con 0x7fbdec0141d0 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.356+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.356+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.356+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.356+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.356+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.357+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde407e040 con 0x556cbbac5fb0 2024-02-15T22:56:30.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.357+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.357+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbde407e040 con 0x556cbbac5fb0 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.357+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.357+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.357+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.357+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.357+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.358+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.358+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.358+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.358+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.358+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.358+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.358+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.358+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.359+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.359+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.359+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.359+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.359+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.359+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.359+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.359+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbaca950 con 0x556cbbac5fb0 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbaca5d0 con 0x556cbbac5fb0 2024-02-15T22:56:30.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.360+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbacb2e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 20 zone default found 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 4 Realm: () 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 20 zonegroup default 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbaced00 con 0x7fbdec0141d0 2024-02-15T22:56:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad0a90 con 0x556cbbacbe70 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad0df0 con 0x556cbbacbe70 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 20 started sync module instance, tier type = 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.361+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad0370 con 0x7fbddc038070 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.362+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.362+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93925493505744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad02f0 con 0x7fbddc038070 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.362+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad1b00 con 0x556cbbac5fb0 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.363+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93925493505744] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.364+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.364+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93925493510592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad1a80 con 0x556cbbac5fb0 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.364+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad2430 con 0x556cbbacbe70 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.365+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93925493510592] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.365+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.365+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93925493511648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad1a00 con 0x556cbbacbe70 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.365+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad3290 con 0x7fbddc038070 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.366+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93925493511648] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.366+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.366+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93925493517808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad36b0 con 0x7fbddc038070 2024-02-15T22:56:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.366+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad4020 con 0x556cbbac5fb0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.367+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.367+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93925493521280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad3fe0 con 0x556cbbac5fb0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.367+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad4f60 con 0x7fbdec0141d0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.367+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93925493517808] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.368+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.368+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93925493521280] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.368+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93925493518864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad4f60 con 0x7fbdec0141d0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.368+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad43b0 con 0x7fbdec0141d0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.369+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93925493518864] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.369+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.369+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93925493525184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad4ee0 con 0x7fbdec0141d0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.369+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad5de0 con 0x7fbdec0141d0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.370+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93925493525184] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.370+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.370+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93925493527648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad5d20 con 0x7fbdec0141d0 2024-02-15T22:56:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.370+0000 7fbdf8a30800 20 add_watcher() i=0 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.370+0000 7fbdf8a30800 20 add_watcher() i=1 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.370+0000 7fbdf8a30800 20 add_watcher() i=2 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.370+0000 7fbdf8a30800 20 add_watcher() i=3 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.370+0000 7fbdf8a30800 20 add_watcher() i=4 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.370+0000 7fbdf8a30800 20 add_watcher() i=5 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.370+0000 7fbdf8a30800 20 add_watcher() i=6 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.371+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93925493527648] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.371+0000 7fbdf8a30800 20 add_watcher() i=7 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.371+0000 7fbdf8a30800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.371+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad5cf0 con 0x556cbbac5fb0 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.371+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.371+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93925493531120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad6ab0 con 0x556cbbac5fb0 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.372+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93925493531120] v30'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.372+0000 7fbca9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.373+0000 7fbdf8a30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.373+0000 7fbdf8a30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.373+0000 7fbdf8a30800 5 note: GC not initialized 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.373+0000 7fbca8fe1640 20 reqs_thread_entry: start 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.373+0000 7fbdf8a30800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.373+0000 7fbdf8a30800 20 Filter name: none 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.373+0000 7fbc227fc640 20 reqs_thread_entry: start 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.373+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbb0a8c0 con 0x7fbdec0141d0 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.374+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(62 [pgnls start_epoch 30 out=254b] v30'34 uv18 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.374+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbaca5d0 con 0x7fbdec0141d0 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.374+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(63 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.374+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbaca5d0 con 0x556cbbacbe70 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.374+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.374+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbaca5d0 con 0x7fbdec0141d0 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.375+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(65 [pgnls start_epoch 30 out=172b] v30'18 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.375+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbaca5d0 con 0x556cbbac5fb0 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.375+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(66 [pgnls start_epoch 30 out=335b] v30'146 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.375+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbaca5d0 con 0x7fbddc038070 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.375+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(67 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.375+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.376+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(68 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.376+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.376+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(69 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.376+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.376+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(70 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.376+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.377+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(71 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.377+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.377+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 [pgnls start_epoch 30 out=336b] v30'27 uv19 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.377+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.377+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=131b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.377+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.377+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.377+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.378+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(75 [pgnls start_epoch 30 out=90b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.378+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.378+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(76 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.378+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.378+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.378+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.379+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(78 [pgnls start_epoch 30 out=254b] v30'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.379+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.379+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(79 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.379+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.379+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(80 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.379+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.379+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(81 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.379+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.380+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(82 [pgnls start_epoch 30 out=276b] v30'16 uv15 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.380+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.380+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(83 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.380+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.380+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(84 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.380+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.381+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(85 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.381+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.381+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(86 [pgnls start_epoch 30 out=213b] v30'43 uv19 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.381+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.381+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(87 [pgnls start_epoch 30 out=172b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.381+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.382+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(88 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.382+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.382+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(89 [pgnls start_epoch 30 out=90b] v30'13 uv5 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.382+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbacbe70 2024-02-15T22:56:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.382+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(90 [pgnls start_epoch 30 out=90b] v30'37 uv13 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.382+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x556cbbac5fb0 2024-02-15T22:56:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.382+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=131b] v30'6 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.382+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbddc038070 2024-02-15T22:56:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.383+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(92 [pgnls start_epoch 30 out=295b] v30'24 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.383+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbace8e0 con 0x7fbdec0141d0 2024-02-15T22:56:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.383+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(93 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.397 INFO:teuthology.orchestra.run.smithi133.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-02-15T22:56:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.385+0000 7fbca9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.385+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93925493531120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbb0a420 con 0x556cbbac5fb0 2024-02-15T22:56:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.386+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93925493531120] v30'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.386+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93925493505744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad61f0 con 0x7fbddc038070 2024-02-15T22:56:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.387+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93925493505744] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.387+0000 7fbdf8a30800 20 remove_watcher() i=0 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.387+0000 7fbdf8a30800 2 removed watcher, disabling cache 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.387+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93925493510592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbacfed0 con 0x556cbbac5fb0 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.388+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93925493510592] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.388+0000 7fbdf8a30800 20 remove_watcher() i=1 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.388+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93925493511648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbacfed0 con 0x556cbbacbe70 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.389+0000 7fbdeb532640 1 -- 172.21.15.133:0/916579882 <== osd.3 v2:172.21.15.133:6816/1065500544 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93925493511648] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbddc022070 con 0x556cbbacbe70 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.389+0000 7fbdf8a30800 20 remove_watcher() i=2 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.389+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93925493517808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad11c0 con 0x7fbddc038070 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.390+0000 7fbdf4534640 1 -- 172.21.15.133:0/916579882 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93925493517808] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdec03a040 con 0x7fbddc038070 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.390+0000 7fbdf8a30800 20 remove_watcher() i=3 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.390+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93925493521280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad2df0 con 0x556cbbac5fb0 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.391+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93925493521280] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x556cbbac5fb0 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.391+0000 7fbdf8a30800 20 remove_watcher() i=4 2024-02-15T22:56:30.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.391+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93925493518864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad2df0 con 0x7fbdec0141d0 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.392+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93925493518864] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.392+0000 7fbdf8a30800 20 remove_watcher() i=5 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.392+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93925493525184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad3b80 con 0x7fbdec0141d0 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.393+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93925493525184] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.393+0000 7fbdf8a30800 20 remove_watcher() i=6 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.393+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93925493527648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556cbbad3b80 con 0x7fbdec0141d0 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93925493527648] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbde409d040 con 0x7fbdec0141d0 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 20 remove_watcher() i=7 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fbdec0141d0 msgr2=0x7fbdec015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fbdec0141d0 0x7fbdec015940 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556cbbac5fb0 msgr2=0x556cbbac83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556cbbac5fb0 0x556cbbac83e0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fbddc038070 msgr2=0x7fbddc02f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fbddc038070 0x7fbddc02f8c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556cbbacbe70 msgr2=0x556cbbace260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556cbbacbe70 0x556cbbace260 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbcbc0367e0 msgr2=0x7fbcbc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbcbc0367e0 0x7fbcbc038ca0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00b010 tx=0x7fbdec020000 comp rx=0 tx=0).stop 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 msgr2=0x556cbbaba590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/916579882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbab3560 0x556cbbaba590 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbddc04ca70 tx=0x7fbddc04c6e0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 reap_dead start 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf3d33640 1 -- 172.21.15.133:0/916579882 reap_dead start 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 shutdown_connections 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 >> 172.21.15.133:0/916579882 conn(0x556cbbaaf8c0 msgr2=0x556cbbaacf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 shutdown_connections 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/916579882 wait complete. 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1880855577 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbccc0367e0 msgr2=0x7fbccc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/1880855577 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbccc0367e0 0x7fbccc038ca0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x556cbba964b0 tx=0x7fbdec005840 comp rx=0 tx=0).stop 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1880855577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbaa6260 msgr2=0x556cbbaa6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.394+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/1880855577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbaa6260 0x556cbbaa6680 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbddc001ed0 tx=0x7fbddc00d7a0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1880855577 shutdown_connections 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/1880855577 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbccc0367e0 0x7fbccc038ca0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/1880855577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbbaa6260 0x556cbbaa6680 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1880855577 >> 172.21.15.133:0/1880855577 conn(0x556cbba9a300 msgr2=0x556cbba9a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1880855577 shutdown_connections 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 -- 172.21.15.133:0/1880855577 wait complete. 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556cbb9980a0 msgr2=0x556cbba95960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556cbb9980a0 0x556cbba95960 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbcdc0367e0 msgr2=0x7fbcdc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbcdc0367e0 0x7fbcdc038ca0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbddc000f60 tx=0x7fbddc0012b0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 msgr2=0x556cbb995430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbb995430 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbde400a470 tx=0x7fbde4002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 shutdown_connections 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556cbb9980a0 0x556cbba95960 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fbcdc0367e0 0x7fbcdc038ca0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 --2- 172.21.15.133:0/2490765622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cbb908110 0x556cbb995430 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 >> 172.21.15.133:0/2490765622 conn(0x556cbb98f4c0 msgr2=0x556cbba7f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 shutdown_connections 2024-02-15T22:56:30.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.395+0000 7fbdf8a30800 1 -- 172.21.15.133:0/2490765622 wait complete. 2024-02-15T22:56:30.408 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-02-15T22:56:30.408 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-15T22:56:30.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-15T22:56:30.408 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-15T22:56:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.489+0000 7fe356131800 1 Processor -- start 2024-02-15T22:56:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.489+0000 7fe356131800 1 -- start start 2024-02-15T22:56:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.489+0000 7fe356131800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d1b06748b0 0x55d1b0674cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.489+0000 7fe356131800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d1b05c0bb0 con 0x55d1b0675210 2024-02-15T22:56:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.489+0000 7fe356131800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d1b0578450 con 0x55d1b06748b0 2024-02-15T22:56:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.489+0000 7fe351e34640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d1b06748b0 0x55d1b0674cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.489+0000 7fe351633640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55d1b0675210 0x55d1b06756c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45226/0 (socket says 172.21.15.133:45226) 2024-02-15T22:56:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.489+0000 7fe351633640 1 -- 172.21.15.133:0/806482139 learned_addr learned my addr 172.21.15.133:0/806482139 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.489+0000 7fe351e34640 1 -- 172.21.15.133:0/806482139 >> v1:172.21.15.52:6789/0 conn(0x55d1b0675210 legacy=0x55d1b06756c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.489+0000 7fe351e34640 1 -- 172.21.15.133:0/806482139 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1b05e92f0 con 0x55d1b06748b0 2024-02-15T22:56:30.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.489+0000 7fe350e32640 1 -- 172.21.15.133:0/806482139 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385343240 0 0) 0x55d1b05c0bb0 con 0x55d1b0675210 2024-02-15T22:56:30.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.491+0000 7fe351e34640 1 --2- 172.21.15.133:0/806482139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b0674cd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00a470 tx=0x7fe34c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801ba3772ca57459 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.491+0000 7fe350e32640 1 -- 172.21.15.133:0/806482139 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe34c052570 con 0x55d1b06748b0 2024-02-15T22:56:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.491+0000 7fe350e32640 1 -- 172.21.15.133:0/806482139 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c0526d0 con 0x55d1b06748b0 2024-02-15T22:56:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.491+0000 7fe350e32640 1 -- 172.21.15.133:0/806482139 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe34c052990 con 0x55d1b06748b0 2024-02-15T22:56:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.492+0000 7fe356131800 1 -- 172.21.15.133:0/806482139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 msgr2=0x55d1b0674cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.492+0000 7fe356131800 1 --2- 172.21.15.133:0/806482139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b0674cd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00a470 tx=0x7fe34c01cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.492+0000 7fe356131800 1 -- 172.21.15.133:0/806482139 shutdown_connections 2024-02-15T22:56:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.492+0000 7fe356131800 1 --2- 172.21.15.133:0/806482139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b0674cd0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.492+0000 7fe356131800 1 -- 172.21.15.133:0/806482139 >> 172.21.15.133:0/806482139 conn(0x55d1b06704d0 msgr2=0x55d1b06728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.492+0000 7fe356131800 1 -- 172.21.15.133:0/806482139 shutdown_connections 2024-02-15T22:56:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.492+0000 7fe356131800 1 -- 172.21.15.133:0/806482139 wait complete. 2024-02-15T22:56:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.503+0000 7fe356131800 1 Processor -- start 2024-02-15T22:56:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.503+0000 7fe356131800 1 -- start start 2024-02-15T22:56:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.503+0000 7fe356131800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b0768050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.503+0000 7fe356131800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1b0575980 con 0x55d1b06748b0 2024-02-15T22:56:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.504+0000 7fe351e34640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b0768050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.504+0000 7fe351e34640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b0768050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59282/0 (socket says 172.21.15.133:59282) 2024-02-15T22:56:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.504+0000 7fe351e34640 1 -- 172.21.15.133:0/465614419 learned_addr learned my addr 172.21.15.133:0/465614419 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.504+0000 7fe351e34640 1 -- 172.21.15.133:0/465614419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c005d20 con 0x55d1b06748b0 2024-02-15T22:56:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.504+0000 7fe351e34640 1 --2- 172.21.15.133:0/465614419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b0768050 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe34c055040 tx=0x7fe34c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7cf53d03a3b08 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.504+0000 7fe23fe07640 1 -- 172.21.15.133:0/465614419 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe34c00a180 con 0x55d1b06748b0 2024-02-15T22:56:30.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.504+0000 7fe23fe07640 1 -- 172.21.15.133:0/465614419 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c00a2e0 con 0x55d1b06748b0 2024-02-15T22:56:30.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.504+0000 7fe23fe07640 1 -- 172.21.15.133:0/465614419 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0529b0 con 0x55d1b06748b0 2024-02-15T22:56:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.505+0000 7fe356131800 1 -- 172.21.15.133:0/465614419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 msgr2=0x55d1b0768050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.505+0000 7fe356131800 1 --2- 172.21.15.133:0/465614419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b0768050 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe34c055040 tx=0x7fe34c04c000 comp rx=0 tx=0).stop 2024-02-15T22:56:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.505+0000 7fe356131800 1 -- 172.21.15.133:0/465614419 shutdown_connections 2024-02-15T22:56:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.505+0000 7fe356131800 1 --2- 172.21.15.133:0/465614419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b0768050 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.505+0000 7fe356131800 1 -- 172.21.15.133:0/465614419 >> 172.21.15.133:0/465614419 conn(0x55d1b06704d0 msgr2=0x55d1b0763970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.505+0000 7fe356131800 1 -- 172.21.15.133:0/465614419 shutdown_connections 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.505+0000 7fe356131800 1 -- 172.21.15.133:0/465614419 wait complete. 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.505+0000 7fe356131800 1 Processor -- start 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.505+0000 7fe356131800 1 -- start start 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe356131800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b076f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe356131800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1b0571160 con 0x55d1b06748b0 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe351e34640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b076f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe351e34640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b076f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59294/0 (socket says 172.21.15.133:59294) 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe351e34640 1 -- 172.21.15.133:0/477566858 learned_addr learned my addr 172.21.15.133:0/477566858 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe351e34640 1 -- 172.21.15.133:0/477566858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1b05e92f0 con 0x55d1b06748b0 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe351e34640 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b076f5b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00a470 tx=0x7fe34c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe23e604640 1 -- 172.21.15.133:0/477566858 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe34c06a070 con 0x55d1b06748b0 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe23e604640 1 -- 172.21.15.133:0/477566858 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c05d420 con 0x55d1b06748b0 2024-02-15T22:56:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d1b076faf0 con 0x55d1b06748b0 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe23e604640 1 -- 172.21.15.133:0/477566858 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe34c05d5d0 con 0x55d1b06748b0 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.506+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1b076ffd0 con 0x55d1b06748b0 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.507+0000 7fe23e604640 1 -- 172.21.15.133:0/477566858 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe34c05d730 con 0x55d1b06748b0 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.507+0000 7fe23e604640 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2380367e0 0x7fe238038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.507+0000 7fe23e604640 1 -- 172.21.15.133:0/477566858 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fe34c08d8e0 con 0x55d1b06748b0 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.507+0000 7fe351633640 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2380367e0 0x7fe238038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.507+0000 7fe356131800 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d1b0675210 0x55d1b0776290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.507+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07768b0 con 0x55d1b0675210 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.508+0000 7fe352635640 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d1b0675210 0x55d1b0776290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.508+0000 7fe351633640 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2380367e0 0x7fe238038ca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe348000c00 tx=0x7fe3480013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.508+0000 7fe352635640 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d1b0675210 0x55d1b0776290 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.508+0000 7fe352635640 1 -- 172.21.15.133:0/477566858 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe34400a4a0 con 0x55d1b0675210 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.508+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b0773980 con 0x55d1b0675210 2024-02-15T22:56:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.508+0000 7fe352635640 1 -- 172.21.15.133:0/477566858 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe34400a4a0 con 0x55d1b0675210 2024-02-15T22:56:30.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.508+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b0776d70 con 0x55d1b0675210 2024-02-15T22:56:30.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.509+0000 7fe352635640 1 -- 172.21.15.133:0/477566858 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe34400a4a0 con 0x55d1b0675210 2024-02-15T22:56:30.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.509+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b0777a40 con 0x55d1b0675210 2024-02-15T22:56:30.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.509+0000 7fe352635640 1 -- 172.21.15.133:0/477566858 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe34400a4a0 con 0x55d1b0675210 2024-02-15T22:56:30.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.509+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b0777e50 con 0x55d1b0675210 2024-02-15T22:56:30.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.509+0000 7fe352635640 1 -- 172.21.15.133:0/477566858 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe34400a4a0 con 0x55d1b0675210 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.509+0000 7fe356131800 1 Processor -- start 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe356131800 1 -- start start 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe356131800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0787010 0x55d1b0787430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe356131800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1b0513e80 con 0x55d1b0787010 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe351633640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0787010 0x55d1b0787430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe351633640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0787010 0x55d1b0787430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59308/0 (socket says 172.21.15.133:59308) 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe351633640 1 -- 172.21.15.133:0/1341664344 learned_addr learned my addr 172.21.15.133:0/1341664344 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe351633640 1 -- 172.21.15.133:0/1341664344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1b0787970 con 0x55d1b0787010 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe351633640 1 --2- 172.21.15.133:0/1341664344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0787010 0x55d1b0787430 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe34800e610 tx=0x7fe34800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe2377fe640 1 -- 172.21.15.133:0/1341664344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe34800bea0 con 0x55d1b0787010 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe2377fe640 1 -- 172.21.15.133:0/1341664344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800d500 con 0x55d1b0787010 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe2377fe640 1 -- 172.21.15.133:0/1341664344 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe34800d7a0 con 0x55d1b0787010 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.510+0000 7fe356131800 1 -- 172.21.15.133:0/1341664344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d1b07883e0 con 0x55d1b0787010 2024-02-15T22:56:30.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.511+0000 7fe356131800 1 -- 172.21.15.133:0/1341664344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1b07888a0 con 0x55d1b0787010 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.511+0000 7fe2377fe640 1 -- 172.21.15.133:0/1341664344 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe34801a070 con 0x55d1b0787010 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.511+0000 7fe2377fe640 1 --2- 172.21.15.133:0/1341664344 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe22c0367e0 0x7fe22c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.511+0000 7fe2377fe640 1 -- 172.21.15.133:0/1341664344 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fe348017050 con 0x55d1b0787010 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.511+0000 7fe352635640 1 --2- 172.21.15.133:0/1341664344 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe22c0367e0 0x7fe22c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.512+0000 7fe356131800 1 Processor -- start 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.512+0000 7fe356131800 1 -- start start 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.512+0000 7fe352635640 1 --2- 172.21.15.133:0/1341664344 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe22c0367e0 0x7fe22c038ca0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55d1b0777480 tx=0x7fe344005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.512+0000 7fe356131800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b0794650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.512+0000 7fe356131800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1b04e95d0 con 0x55d1b0794230 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.512+0000 7fe351633640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b0794650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.512+0000 7fe351633640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b0794650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59310/0 (socket says 172.21.15.133:59310) 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.512+0000 7fe351633640 1 -- 172.21.15.133:0/1414959655 learned_addr learned my addr 172.21.15.133:0/1414959655 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.512+0000 7fe351633640 1 -- 172.21.15.133:0/1414959655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1b0794c20 con 0x55d1b0794230 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.512+0000 7fe351633640 1 --2- 172.21.15.133:0/1414959655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b0794650 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe34804b9d0 tx=0x7fe34804bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a550276fd0bc1e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe2357fa640 1 -- 172.21.15.133:0/1414959655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe34801a530 con 0x55d1b0794230 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe2357fa640 1 -- 172.21.15.133:0/1414959655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34804d0d0 con 0x55d1b0794230 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe2357fa640 1 -- 172.21.15.133:0/1414959655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe34801ac40 con 0x55d1b0794230 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe356131800 1 -- 172.21.15.133:0/1414959655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 msgr2=0x55d1b0794650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe356131800 1 --2- 172.21.15.133:0/1414959655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b0794650 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe34804b9d0 tx=0x7fe34804bc50 comp rx=0 tx=0).stop 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe356131800 1 -- 172.21.15.133:0/1414959655 shutdown_connections 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe356131800 1 --2- 172.21.15.133:0/1414959655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b0794650 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe356131800 1 -- 172.21.15.133:0/1414959655 >> 172.21.15.133:0/1414959655 conn(0x55d1b0790590 msgr2=0x55d1b078e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe356131800 1 -- 172.21.15.133:0/1414959655 shutdown_connections 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe356131800 1 -- 172.21.15.133:0/1414959655 wait complete. 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe356131800 1 Processor -- start 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.513+0000 7fe356131800 1 -- start start 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe356131800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b079b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe356131800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1b079b790 con 0x55d1b0794230 2024-02-15T22:56:30.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe351633640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b079b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe351633640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b079b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59316/0 (socket says 172.21.15.133:59316) 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 learned_addr learned my addr 172.21.15.133:0/3072562809 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1b07888a0 con 0x55d1b0794230 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe351633640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b079b250 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe348048040 tx=0x7fe34804b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe2237fe640 1 -- 172.21.15.133:0/3072562809 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3480242c0 con 0x55d1b0794230 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe2237fe640 1 -- 172.21.15.133:0/3072562809 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe348024680 con 0x55d1b0794230 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe2237fe640 1 -- 172.21.15.133:0/3072562809 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe34801a7e0 con 0x55d1b0794230 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d1b079b990 con 0x55d1b0794230 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.514+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1b079be50 con 0x55d1b0794230 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.515+0000 7fe2237fe640 1 -- 172.21.15.133:0/3072562809 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe34800d040 con 0x55d1b0794230 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.515+0000 7fe2237fe640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe21c036790 0x7fe21c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.515+0000 7fe2237fe640 1 -- 172.21.15.133:0/3072562809 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fe34800a040 con 0x55d1b0794230 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.515+0000 7fe352635640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe21c036790 0x7fe21c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.516+0000 7fe352635640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe21c036790 0x7fe21c038c50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe34400b010 tx=0x7fe344020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.516+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.516+0000 7fe356131800 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d1b07a6fa0 0x55d1b07a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.516+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07a9bb0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.516+0000 7fe351e34640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d1b07a6fa0 0x55d1b07a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.516+0000 7fe351e34640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d1b07a6fa0 0x55d1b07a9460 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.516+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe34c059040 con 0x55d1b07a6fa0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.516+0000 7fe356131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.516+0000 7fe356131800 20 realm 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.516+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07a9f40 con 0x55d1b07a6fa0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe34c059040 con 0x55d1b07a6fa0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07aa7c0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe34c059040 con 0x55d1b07a6fa0 2024-02-15T22:56:30.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07aab20 con 0x55d1b07a6fa0 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe34c059040 con 0x55d1b07a6fa0 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07ab320 con 0x55d1b07a6fa0 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 20 searching for the correct realm 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55d1b07ad240 0x55d1b07af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.517+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.518+0000 7fe351633640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55d1b07ad240 0x55d1b07af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.518+0000 7fe351633640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55d1b07ad240 0x55d1b07af6e0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.518+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.518+0000 7fe351633640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe348027060 0x7fe34803a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.518+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe348027060 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.518+0000 7fe352635640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe348027060 0x7fe34803a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.519+0000 7fe352635640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe348027060 0x7fe34803a340 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.519+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34400a4a0 con 0x7fe348027060 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.519+0000 7fe352635640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe3440141d0 0x7fe344015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.519+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe3440141d0 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.519+0000 7fe351e34640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe3440141d0 0x7fe344015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.520+0000 7fe351e34640 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe3440141d0 0x7fe344015940 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.520+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.520+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.520+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.520+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.520+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.520+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe3440141d0 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.520+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.520+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe3440141d0 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.521+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.521+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe348027060 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.521+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34400a4a0 con 0x7fe348027060 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.521+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.521+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.521+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.521+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.521+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe3440141d0 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.522+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.522+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.522+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.522+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe348027060 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.522+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.522+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.522+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.522+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.522+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.522+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe3440141d0 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.523+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.523+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.523+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.523+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.523+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.523+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.523+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.523+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.523+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.523+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe3440141d0 2024-02-15T22:56:30.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.524+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.524+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.524+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.524+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe348027060 2024-02-15T22:56:30.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.524+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.524+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.524+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.524+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe3440141d0 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.525+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.525+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.525+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.525+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe3440141d0 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.525+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.525+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe348027060 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.525+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.525+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe3440141d0 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07afdb0 con 0x7fe348027060 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe356131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe356131800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe356131800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe356131800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe356131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe356131800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.526+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07abb80 con 0x55d1b07a6fa0 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07abf30 con 0x55d1b07a6fa0 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07ac310 con 0x55d1b07a6fa0 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 20 zone default found 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 4 Realm: () 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 20 zonegroup default 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b01f0 con 0x7fe3440141d0 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.527+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b2070 con 0x55d1b07ad240 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.528+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.528+0000 7fe356131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.528+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.528+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b23d0 con 0x55d1b07ad240 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.528+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.528+0000 7fe356131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.528+0000 7fe356131800 20 started sync module instance, tier type = 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.528+0000 7fe356131800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:30.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.528+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b1640 con 0x7fe348027060 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.529+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.529+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94359097383408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b12d0 con 0x7fe348027060 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.529+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b31e0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.530+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94359097383408] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.530+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.530+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94359097388352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b3160 con 0x55d1b07a6fa0 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.530+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b4040 con 0x55d1b07ad240 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.531+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94359097388352] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.531+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.531+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94359097392032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b43a0 con 0x55d1b07ad240 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.531+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b4d50 con 0x7fe348027060 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.532+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.532+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94359097395312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b55a0 con 0x7fe348027060 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.532+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b6070 con 0x55d1b07a6fa0 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.532+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94359097392032] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.533+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94359097395312] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.533+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.533+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94359097400144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b5100 con 0x55d1b07a6fa0 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.533+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b68c0 con 0x7fe3440141d0 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.534+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94359097400144] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.534+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.534+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94359097390320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b5100 con 0x7fe3440141d0 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.534+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b6ed0 con 0x7fe3440141d0 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.535+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94359097390320] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.536+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.536+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94359097403856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b6e90 con 0x7fe3440141d0 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.536+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b7890 con 0x7fe3440141d0 2024-02-15T22:56:30.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94359097403856] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94359097406352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b7850 con 0x7fe3440141d0 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe356131800 20 add_watcher() i=0 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe356131800 20 add_watcher() i=1 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe356131800 20 add_watcher() i=2 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe356131800 20 add_watcher() i=3 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe356131800 20 add_watcher() i=4 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe356131800 20 add_watcher() i=5 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe356131800 20 add_watcher() i=6 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94359097406352] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe356131800 20 add_watcher() i=7 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.537+0000 7fe356131800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.538+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07bae40 con 0x55d1b07a6fa0 2024-02-15T22:56:30.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.538+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.538+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94359097402096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07b8170 con 0x55d1b07a6fa0 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.539+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94359097402096] v30'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.539+0000 7fe2037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.539+0000 7fe356131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.539+0000 7fe356131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.539+0000 7fe356131800 5 note: GC not initialized 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.539+0000 7fe2027fc640 20 reqs_thread_entry: start 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.539+0000 7fe356131800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.539+0000 7fe356131800 20 Filter name: none 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.539+0000 7fe173fff640 20 reqs_thread_entry: start 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07ecdb0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07ef2d0 con 0x7fe348027060 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 20 disabling bucket name=myfoo 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.540+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07ed750 con 0x7fe348027060 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 : miss 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:65 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07eefe0 con 0x55d1b07ad240 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(65 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.541+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07f7da0 con 0x55d1b07ad240 2024-02-15T22:56:30.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(66 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'6 uv6 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe356131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe356131800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe356131800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe356131800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1, ofs0, ns] 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94359097646784 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07f2780 con 0x55d1b07a6fa0 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== watch-notify(notify (1) cookie 94359097400144 notify 128849018899 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55d1b076ffd0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe2357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018899 cookie 94359097400144 notifier 4586 bl.length()=725 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe2357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe2357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe2357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe2357fa640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe214003e90 con 0x55d1b07a6fa0 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.542+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(67 notify.4 [notify cookie 94359097646784 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.543+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.543+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== watch-notify(notify_complete (2) cookie 94359097646784 notify 128849018899 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d1b076faf0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.543+0000 7fe356131800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_sources= new_sources= 2024-02-15T22:56:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.543+0000 7fe356131800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential sources added=[] removed=[] 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.543+0000 7fe356131800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_dests= new_dests= 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.543+0000 7fe356131800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential dests added=[] removed=[] 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.543+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07f6ca0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~358] v30'12 uv12 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe356131800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe356131800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe356131800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94359097665536 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07f77a0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== watch-notify(notify (1) cookie 94359097400144 notify 128849018900 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x55d1b076faf0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe234ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018900 cookie 94359097400144 notifier 4586 bl.length()=534 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe234ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe234ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe234ff9640 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe17c003420 con 0x55d1b07a6fa0 2024-02-15T22:56:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(70 notify.4 [notify cookie 94359097665536 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.544+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.545+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== watch-notify(notify_complete (2) cookie 94359097665536 notify 128849018900 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d1b05e92f0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.561 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:30.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.545+0000 7fe2037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:30.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.545+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94359097402096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07d6dc0 con 0x55d1b07a6fa0 2024-02-15T22:56:30.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.546+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94359097402096] v30'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.546+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94359097383408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07f7240 con 0x7fe348027060 2024-02-15T22:56:30.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.547+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94359097383408] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.547+0000 7fe356131800 20 remove_watcher() i=0 2024-02-15T22:56:30.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.547+0000 7fe356131800 2 removed watcher, disabling cache 2024-02-15T22:56:30.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.547+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94359097388352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07abf30 con 0x55d1b07a6fa0 2024-02-15T22:56:30.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.549+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94359097388352] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.549+0000 7fe356131800 20 remove_watcher() i=1 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.549+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94359097392032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07abf30 con 0x55d1b07ad240 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.550+0000 7fe351633640 1 -- 172.21.15.133:0/3072562809 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94359097392032] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34804bdb0 con 0x55d1b07ad240 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.550+0000 7fe356131800 20 remove_watcher() i=2 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.550+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94359097395312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07f7240 con 0x7fe348027060 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.550+0000 7fe352635640 1 -- 172.21.15.133:0/3072562809 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94359097395312] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34403a040 con 0x7fe348027060 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.550+0000 7fe356131800 20 remove_watcher() i=3 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.550+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94359097400144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07f7240 con 0x55d1b07a6fa0 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.551+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94359097400144] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x55d1b07a6fa0 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.551+0000 7fe356131800 20 remove_watcher() i=4 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.551+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94359097390320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07f7240 con 0x7fe3440141d0 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.552+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94359097390320] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.552+0000 7fe356131800 20 remove_watcher() i=5 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.552+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94359097403856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07f7240 con 0x7fe3440141d0 2024-02-15T22:56:30.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.554+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94359097403856] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.554+0000 7fe356131800 20 remove_watcher() i=6 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.554+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94359097406352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d1b07f7240 con 0x7fe3440141d0 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94359097406352] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe34c07e380 con 0x7fe3440141d0 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 20 remove_watcher() i=7 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe3440141d0 msgr2=0x7fe344015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe3440141d0 0x7fe344015940 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d1b07a6fa0 msgr2=0x55d1b07a9460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d1b07a6fa0 0x55d1b07a9460 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe348027060 msgr2=0x7fe34803a340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe348027060 0x7fe34803a340 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55d1b07ad240 msgr2=0x55d1b07af6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55d1b07ad240 0x55d1b07af6e0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe21c036790 msgr2=0x7fe21c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe21c036790 0x7fe21c038c50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe34400b010 tx=0x7fe344020000 comp rx=0 tx=0).stop 2024-02-15T22:56:30.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 msgr2=0x55d1b079b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b079b250 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe348048040 tx=0x7fe34804b930 comp rx=0 tx=0).stop 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe351e34640 1 -- 172.21.15.133:0/3072562809 reap_dead start 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 shutdown_connections 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 --2- 172.21.15.133:0/3072562809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0794230 0x55d1b079b250 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 >> 172.21.15.133:0/3072562809 conn(0x55d1b0790590 msgr2=0x55d1b078dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 shutdown_connections 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/3072562809 wait complete. 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/1341664344 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe22c0367e0 msgr2=0x7fe22c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 --2- 172.21.15.133:0/1341664344 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe22c0367e0 0x7fe22c038ca0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55d1b0777480 tx=0x7fe344005840 comp rx=0 tx=0).stop 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 -- 172.21.15.133:0/1341664344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0787010 msgr2=0x55d1b0787430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.555+0000 7fe356131800 1 --2- 172.21.15.133:0/1341664344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0787010 0x55d1b0787430 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe34800e610 tx=0x7fe34800ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 -- 172.21.15.133:0/1341664344 shutdown_connections 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 --2- 172.21.15.133:0/1341664344 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe22c0367e0 0x7fe22c038ca0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 --2- 172.21.15.133:0/1341664344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b0787010 0x55d1b0787430 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 -- 172.21.15.133:0/1341664344 >> 172.21.15.133:0/1341664344 conn(0x55d1b077b0b0 msgr2=0x55d1b077b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 -- 172.21.15.133:0/1341664344 shutdown_connections 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 -- 172.21.15.133:0/1341664344 wait complete. 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d1b0675210 msgr2=0x55d1b0776290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d1b0675210 0x55d1b0776290 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2380367e0 msgr2=0x7fe238038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2380367e0 0x7fe238038ca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe348000c00 tx=0x7fe3480013b0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 msgr2=0x55d1b076f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b076f5b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00a470 tx=0x7fe34c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 shutdown_connections 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55d1b0675210 0x55d1b0776290 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2380367e0 0x7fe238038ca0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 --2- 172.21.15.133:0/477566858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1b06748b0 0x55d1b076f5b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 >> 172.21.15.133:0/477566858 conn(0x55d1b06704d0 msgr2=0x55d1b0762250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 shutdown_connections 2024-02-15T22:56:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.556+0000 7fe356131800 1 -- 172.21.15.133:0/477566858 wait complete. 2024-02-15T22:56:30.571 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:30.573 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-15T22:56:30.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-15T22:56:30.573 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-15T22:56:30.654 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:30.654 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:30.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.652+0000 7fe4df5af800 1 Processor -- start 2024-02-15T22:56:30.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.652+0000 7fe4df5af800 1 -- start start 2024-02-15T22:56:30.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.652+0000 7fe4df5af800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55de9444c510 0x55de9444e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.652+0000 7fe4df5af800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55de94392bb0 con 0x55de94448a00 2024-02-15T22:56:30.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.652+0000 7fe4df5af800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55de9434a450 con 0x55de9444c510 2024-02-15T22:56:30.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.652+0000 7fe4dc8ad640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55de9444c510 0x55de9444e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.652+0000 7fe4dd0ae640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55de94448a00 0x55de9444adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45230/0 (socket says 172.21.15.133:45230) 2024-02-15T22:56:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.652+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3130973659 learned_addr learned my addr 172.21.15.133:0/3130973659 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.653+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3130973659 >> v1:172.21.15.52:6789/0 conn(0x55de94448a00 legacy=0x55de9444adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.653+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3130973659 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de9444fe50 con 0x55de9444c510 2024-02-15T22:56:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.653+0000 7fe4cffff640 1 -- 172.21.15.133:0/3130973659 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516113321 0 0) 0x55de94392bb0 con 0x55de94448a00 2024-02-15T22:56:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.654+0000 7fe4dc8ad640 1 --2- 172.21.15.133:0/3130973659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de9444c510 0x55de9444e900 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000a470 tx=0x7fe4d001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe9f68812ca965a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.655+0000 7fe4cffff640 1 -- 172.21.15.133:0/3130973659 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d0052570 con 0x55de9444c510 2024-02-15T22:56:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.655+0000 7fe4cffff640 1 -- 172.21.15.133:0/3130973659 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d00526d0 con 0x55de9444c510 2024-02-15T22:56:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.655+0000 7fe4cffff640 1 -- 172.21.15.133:0/3130973659 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d0052990 con 0x55de9444c510 2024-02-15T22:56:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.655+0000 7fe4df5af800 1 -- 172.21.15.133:0/3130973659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de9444c510 msgr2=0x55de9444e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.655+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3130973659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de9444c510 0x55de9444e900 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000a470 tx=0x7fe4d001cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.655+0000 7fe4df5af800 1 -- 172.21.15.133:0/3130973659 shutdown_connections 2024-02-15T22:56:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.655+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3130973659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de9444c510 0x55de9444e900 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.655+0000 7fe4df5af800 1 -- 172.21.15.133:0/3130973659 >> 172.21.15.133:0/3130973659 conn(0x55de944424d0 msgr2=0x55de944448f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.655+0000 7fe4df5af800 1 -- 172.21.15.133:0/3130973659 shutdown_connections 2024-02-15T22:56:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.655+0000 7fe4df5af800 1 -- 172.21.15.133:0/3130973659 wait complete. 2024-02-15T22:56:30.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.667+0000 7fe4df5af800 1 Processor -- start 2024-02-15T22:56:30.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.667+0000 7fe4df5af800 1 -- start start 2024-02-15T22:56:30.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.667+0000 7fe4df5af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94448340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.667+0000 7fe4df5af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de94347980 con 0x55de94448a00 2024-02-15T22:56:30.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.667+0000 7fe4dd0ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94448340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.667+0000 7fe4dd0ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94448340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59338/0 (socket says 172.21.15.133:59338) 2024-02-15T22:56:30.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.667+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/174372562 learned_addr learned my addr 172.21.15.133:0/174372562 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.667+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/174372562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0005d20 con 0x55de94448a00 2024-02-15T22:56:30.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.668+0000 7fe4dd0ae640 1 --2- 172.21.15.133:0/174372562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94448340 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400b210 tx=0x7fe4d400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99dc061a90bbbc86 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.668+0000 7fe3cb606640 1 -- 172.21.15.133:0/174372562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d4014070 con 0x55de94448a00 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.668+0000 7fe3cb606640 1 -- 172.21.15.133:0/174372562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d400d500 con 0x55de94448a00 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.668+0000 7fe3cb606640 1 -- 172.21.15.133:0/174372562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d400d800 con 0x55de94448a00 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.668+0000 7fe4df5af800 1 -- 172.21.15.133:0/174372562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 msgr2=0x55de94448340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.668+0000 7fe4df5af800 1 --2- 172.21.15.133:0/174372562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94448340 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400b210 tx=0x7fe4d400b6d0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.668+0000 7fe4df5af800 1 -- 172.21.15.133:0/174372562 shutdown_connections 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.668+0000 7fe4df5af800 1 --2- 172.21.15.133:0/174372562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94448340 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.668+0000 7fe4df5af800 1 -- 172.21.15.133:0/174372562 >> 172.21.15.133:0/174372562 conn(0x55de944424d0 msgr2=0x55de94533760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.669+0000 7fe4df5af800 1 -- 172.21.15.133:0/174372562 shutdown_connections 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.669+0000 7fe4df5af800 1 -- 172.21.15.133:0/174372562 wait complete. 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.669+0000 7fe4df5af800 1 Processor -- start 2024-02-15T22:56:30.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.669+0000 7fe4df5af800 1 -- start start 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.669+0000 7fe4df5af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94541700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.669+0000 7fe4df5af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de94343160 con 0x55de94448a00 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.669+0000 7fe4dd0ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94541700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.669+0000 7fe4dd0ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94541700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59346/0 (socket says 172.21.15.133:59346) 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.669+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/2965186933 learned_addr learned my addr 172.21.15.133:0/2965186933 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.669+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/2965186933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d4001b70 con 0x55de94448a00 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.670+0000 7fe4dd0ae640 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94541700 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400b210 tx=0x7fe4d4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.670+0000 7fe3c9e03640 1 -- 172.21.15.133:0/2965186933 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d400f950 con 0x55de94448a00 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.670+0000 7fe3c9e03640 1 -- 172.21.15.133:0/2965186933 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d4020070 con 0x55de94448a00 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.670+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de94541c40 con 0x55de94448a00 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.670+0000 7fe3c9e03640 1 -- 172.21.15.133:0/2965186933 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d400fc20 con 0x55de94448a00 2024-02-15T22:56:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.670+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de94542120 con 0x55de94448a00 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.670+0000 7fe3c9e03640 1 -- 172.21.15.133:0/2965186933 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe4d400d040 con 0x55de94448a00 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.671+0000 7fe3c9e03640 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c40367e0 0x7fe3c4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.671+0000 7fe3c9e03640 1 -- 172.21.15.133:0/2965186933 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fe4d400a040 con 0x55de94448a00 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.671+0000 7fe4dc8ad640 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c40367e0 0x7fe3c4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.671+0000 7fe4df5af800 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55de9444c510 0x55de94548400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.671+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945489d0 con 0x55de9444c510 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.671+0000 7fe4dd8af640 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55de9444c510 0x55de94548400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.671+0000 7fe4dc8ad640 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c40367e0 0x7fe3c4038ca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0054000 tx=0x7fe4d004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.671+0000 7fe4dd8af640 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55de9444c510 0x55de94548400 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.671+0000 7fe4dd8af640 1 -- 172.21.15.133:0/2965186933 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4d800a4a0 con 0x55de9444c510 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.672+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94545af0 con 0x55de9444c510 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.672+0000 7fe4dd8af640 1 -- 172.21.15.133:0/2965186933 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe4d800a4a0 con 0x55de9444c510 2024-02-15T22:56:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.672+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9454a700 con 0x55de9444c510 2024-02-15T22:56:30.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.672+0000 7fe4dd8af640 1 -- 172.21.15.133:0/2965186933 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe4d800a4a0 con 0x55de9444c510 2024-02-15T22:56:30.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.672+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94549900 con 0x55de9444c510 2024-02-15T22:56:30.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.672+0000 7fe4dd8af640 1 -- 172.21.15.133:0/2965186933 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe4d800a4a0 con 0x55de9444c510 2024-02-15T22:56:30.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.672+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94549d10 con 0x55de9444c510 2024-02-15T22:56:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.673+0000 7fe4dd8af640 1 -- 172.21.15.133:0/2965186933 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe4d800a4a0 con 0x55de9444c510 2024-02-15T22:56:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.673+0000 7fe4df5af800 1 Processor -- start 2024-02-15T22:56:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.673+0000 7fe4df5af800 1 -- start start 2024-02-15T22:56:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.673+0000 7fe4df5af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94559180 0x55de945595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.673+0000 7fe4df5af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de942e5e80 con 0x55de94559180 2024-02-15T22:56:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.673+0000 7fe4dc8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94559180 0x55de945595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.673+0000 7fe4dc8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94559180 0x55de945595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59360/0 (socket says 172.21.15.133:59360) 2024-02-15T22:56:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.673+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3984754939 learned_addr learned my addr 172.21.15.133:0/3984754939 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.674+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3984754939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de94559ae0 con 0x55de94559180 2024-02-15T22:56:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.674+0000 7fe4dc8ad640 1 --2- 172.21.15.133:0/3984754939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94559180 0x55de945595a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00447c0 tx=0x7fe4d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.674+0000 7fe3c2ffd640 1 -- 172.21.15.133:0/3984754939 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d005d9b0 con 0x55de94559180 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.674+0000 7fe3c2ffd640 1 -- 172.21.15.133:0/3984754939 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d005db10 con 0x55de94559180 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.674+0000 7fe3c2ffd640 1 -- 172.21.15.133:0/3984754939 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d005ddd0 con 0x55de94559180 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.674+0000 7fe4df5af800 1 -- 172.21.15.133:0/3984754939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de94559cd0 con 0x55de94559180 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.674+0000 7fe4df5af800 1 -- 172.21.15.133:0/3984754939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de9455a7c0 con 0x55de94559180 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe3c2ffd640 1 -- 172.21.15.133:0/3984754939 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe4d0066040 con 0x55de94559180 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe3c2ffd640 1 --2- 172.21.15.133:0/3984754939 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3b40367e0 0x7fe3b4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe3c2ffd640 1 -- 172.21.15.133:0/3984754939 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fe4d0063040 con 0x55de94559180 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe4dd8af640 1 --2- 172.21.15.133:0/3984754939 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3b40367e0 0x7fe3b4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe4df5af800 1 Processor -- start 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe4df5af800 1 -- start start 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe4dd8af640 1 --2- 172.21.15.133:0/3984754939 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3b40367e0 0x7fe3b4038ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55de94549340 tx=0x7fe4d8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe4df5af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 0x55de94566700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe4df5af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de942bb5d0 con 0x55de945662e0 2024-02-15T22:56:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe4dc8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 0x55de94566700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe4dc8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 0x55de94566700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59372/0 (socket says 172.21.15.133:59372) 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.675+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/2758505047 learned_addr learned my addr 172.21.15.133:0/2758505047 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.676+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/2758505047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de94566cd0 con 0x55de945662e0 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.676+0000 7fe4dc8ad640 1 --2- 172.21.15.133:0/2758505047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 0x55de94566700 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00059a0 tx=0x7fe4d005c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fc44dcbc2b654d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.676+0000 7fe3c0ff9640 1 -- 172.21.15.133:0/2758505047 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d007e070 con 0x55de945662e0 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.676+0000 7fe3c0ff9640 1 -- 172.21.15.133:0/2758505047 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d00688e0 con 0x55de945662e0 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.676+0000 7fe3c0ff9640 1 -- 172.21.15.133:0/2758505047 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d0067bf0 con 0x55de945662e0 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.676+0000 7fe4df5af800 1 -- 172.21.15.133:0/2758505047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 msgr2=0x55de94566700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.676+0000 7fe4df5af800 1 --2- 172.21.15.133:0/2758505047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 0x55de94566700 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00059a0 tx=0x7fe4d005c950 comp rx=0 tx=0).stop 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.676+0000 7fe4df5af800 1 -- 172.21.15.133:0/2758505047 shutdown_connections 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.676+0000 7fe4df5af800 1 --2- 172.21.15.133:0/2758505047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 0x55de94566700 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.676+0000 7fe4df5af800 1 -- 172.21.15.133:0/2758505047 >> 172.21.15.133:0/2758505047 conn(0x55de94562640 msgr2=0x55de945606a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.677+0000 7fe4df5af800 1 -- 172.21.15.133:0/2758505047 shutdown_connections 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.677+0000 7fe4df5af800 1 -- 172.21.15.133:0/2758505047 wait complete. 2024-02-15T22:56:30.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.677+0000 7fe4df5af800 1 Processor -- start 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.677+0000 7fe4df5af800 1 -- start start 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.677+0000 7fe4df5af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 0x55de9456d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.677+0000 7fe4df5af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de9456d880 con 0x55de945662e0 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.677+0000 7fe4dc8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 0x55de9456d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.677+0000 7fe4dc8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 0x55de9456d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:59384/0 (socket says 172.21.15.133:59384) 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.677+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 learned_addr learned my addr 172.21.15.133:0/3228530643 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.677+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de9455a7c0 con 0x55de945662e0 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.678+0000 7fe4dc8ad640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 0x55de9456d340 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00059a0 tx=0x7fe4d008de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.678+0000 7fe3b2ffd640 1 -- 172.21.15.133:0/3228530643 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d007e040 con 0x55de945662e0 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.678+0000 7fe3b2ffd640 1 -- 172.21.15.133:0/3228530643 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d005c590 con 0x55de945662e0 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.678+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de9456da80 con 0x55de945662e0 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.678+0000 7fe3b2ffd640 1 -- 172.21.15.133:0/3228530643 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4d008f9e0 con 0x55de945662e0 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.678+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de9456dee0 con 0x55de945662e0 2024-02-15T22:56:30.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.678+0000 7fe3b2ffd640 1 -- 172.21.15.133:0/3228530643 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe4d008fb40 con 0x55de945662e0 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.679+0000 7fe3b2ffd640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3a80367e0 0x7fe3a8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.679+0000 7fe3b2ffd640 1 -- 172.21.15.133:0/3228530643 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fe4d0099ab0 con 0x55de945662e0 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.679+0000 7fe4dd8af640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3a80367e0 0x7fe3a8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.679+0000 7fe4dd8af640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3a80367e0 0x7fe3a8038ca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800b010 tx=0x7fe4d8020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.679+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.679+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55de94578f10 0x55de9457b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.679+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457bb20 con 0x55de94578f10 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.679+0000 7fe4dd0ae640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55de94578f10 0x55de9457b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4dd0ae640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55de94578f10 0x55de9457b3d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4d4016070 con 0x55de94578f10 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 20 realm 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457bef0 con 0x55de94578f10 2024-02-15T22:56:30.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4d4016070 con 0x55de94578f10 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457c770 con 0x55de94578f10 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4d4016070 con 0x55de94578f10 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457cad0 con 0x55de94578f10 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe4d4016070 con 0x55de94578f10 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.680+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457d2d0 con 0x55de94578f10 2024-02-15T22:56:30.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.681+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe4d4016070 con 0x55de94578f10 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.681+0000 7fe4df5af800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.681+0000 7fe4df5af800 20 searching for the correct realm 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.681+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55de9457f1f0 0x55de94581690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.681+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de9457f1f0 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.681+0000 7fe4dc8ad640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55de9457f1f0 0x55de94581690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.681+0000 7fe4dc8ad640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55de9457f1f0 0x55de94581690 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.682+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.682+0000 7fe4dc8ad640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe4d0098020 0x7fe4d008c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.682+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d0098020 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.682+0000 7fe4dd8af640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe4d0098020 0x7fe4d008c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.682+0000 7fe4dd8af640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe4d0098020 0x7fe4d008c250 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.682+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d800a4a0 con 0x7fe4d0098020 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.682+0000 7fe4dd8af640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe4d80141d0 0x7fe4d8015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.682+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d80141d0 2024-02-15T22:56:30.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.683+0000 7fe4dd0ae640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe4d80141d0 0x7fe4d8015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.683+0000 7fe4dd0ae640 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe4d80141d0 0x7fe4d8015940 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.683+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x7fe4d80141d0 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.683+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de94578f10 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.683+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x55de94578f10 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.683+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de94578f10 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.683+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x55de94578f10 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.684+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d80141d0 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.684+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x7fe4d80141d0 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.684+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d80141d0 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.684+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x7fe4d80141d0 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.684+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d0098020 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.684+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d800a4a0 con 0x7fe4d0098020 2024-02-15T22:56:30.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.684+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de9457f1f0 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.684+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.684+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de94578f10 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.685+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x55de94578f10 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.685+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d80141d0 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.685+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x7fe4d80141d0 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.685+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de94578f10 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.685+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x55de94578f10 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.685+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d0098020 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.685+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.685+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de9457f1f0 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.686+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.686+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de9457f1f0 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.686+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.686+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d80141d0 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.686+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x7fe4d80141d0 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.686+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de9457f1f0 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.686+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.686+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de9457f1f0 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.687+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.687+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de94578f10 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.687+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4016070 con 0x55de94578f10 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.687+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de94578f10 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.687+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe4d4016070 con 0x55de94578f10 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.687+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d80141d0 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.687+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.687+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de9457f1f0 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.688+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.688+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d0098020 2024-02-15T22:56:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.688+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.688+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de94578f10 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.688+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.688+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d80141d0 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.689+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.689+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de9457f1f0 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.689+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.689+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d80141d0 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.689+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.689+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d0098020 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.689+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.689+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de9457f1f0 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d80141d0 2024-02-15T22:56:30.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x55de94578f10 2024-02-15T22:56:30.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94581d60 con 0x7fe4d0098020 2024-02-15T22:56:30.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4df5af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:30.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4df5af800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:30.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4df5af800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:30.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4df5af800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:30.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4df5af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:30.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4df5af800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:30.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.690+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457e7d0 con 0x55de94578f10 2024-02-15T22:56:30.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457d7b0 con 0x55de94578f10 2024-02-15T22:56:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457e0a0 con 0x55de94578f10 2024-02-15T22:56:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 20 zone default found 2024-02-15T22:56:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 4 Realm: () 2024-02-15T22:56:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 20 zonegroup default 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457e0a0 con 0x7fe4d80141d0 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.691+0000 7fe4df5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.692+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.692+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94583b80 con 0x55de9457f1f0 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.692+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.692+0000 7fe4df5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.692+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.692+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94583ee0 con 0x55de9457f1f0 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.692+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.692+0000 7fe4df5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.692+0000 7fe4df5af800 20 started sync module instance, tier type = 2024-02-15T22:56:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.692+0000 7fe4df5af800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.692+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94583460 con 0x7fe4d0098020 2024-02-15T22:56:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.693+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.693+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94414459908032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945833e0 con 0x7fe4d0098020 2024-02-15T22:56:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.693+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94584bd0 con 0x55de94578f10 2024-02-15T22:56:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.694+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94414459908032] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.694+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.694+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94414459912848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94584b50 con 0x55de94578f10 2024-02-15T22:56:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.694+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945854c0 con 0x55de9457f1f0 2024-02-15T22:56:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.695+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.695+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94414459916320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94585d10 con 0x55de9457f1f0 2024-02-15T22:56:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.695+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94586760 con 0x7fe4d0098020 2024-02-15T22:56:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.695+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94414459912848] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.696+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94414459916320] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.696+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.696+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94414459918448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945846b0 con 0x7fe4d0098020 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.696+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94587120 con 0x55de94578f10 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.697+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94414459918448] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.698+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.698+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94414459920960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94587120 con 0x55de94578f10 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.698+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94587ad0 con 0x7fe4d80141d0 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.699+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94414459920960] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.699+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.699+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94414459926000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94587120 con 0x7fe4d80141d0 2024-02-15T22:56:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.699+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945884d0 con 0x7fe4d80141d0 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.700+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94414459926000] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.700+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.700+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94414459928560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945886b0 con 0x7fe4d80141d0 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.700+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94588eb0 con 0x7fe4d80141d0 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.701+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.701+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94414459928560] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.701+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94414459930768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94589310 con 0x7fe4d80141d0 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.701+0000 7fe4df5af800 20 add_watcher() i=0 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.701+0000 7fe4df5af800 20 add_watcher() i=1 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.701+0000 7fe4df5af800 20 add_watcher() i=2 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.701+0000 7fe4df5af800 20 add_watcher() i=3 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.701+0000 7fe4df5af800 20 add_watcher() i=4 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.701+0000 7fe4df5af800 20 add_watcher() i=5 2024-02-15T22:56:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.701+0000 7fe4df5af800 20 add_watcher() i=6 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.702+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94414459930768] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.702+0000 7fe4df5af800 20 add_watcher() i=7 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.702+0000 7fe4df5af800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.702+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9458c780 con 0x55de94578f10 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.702+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.702+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94414459932080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de94589bf0 con 0x55de94578f10 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.703+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94414459932080] v30'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.703+0000 7fe3937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.703+0000 7fe4df5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.703+0000 7fe4df5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.703+0000 7fe4df5af800 5 note: GC not initialized 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.703+0000 7fe3927e4640 20 reqs_thread_entry: start 2024-02-15T22:56:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.703+0000 7fe4df5af800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.703+0000 7fe4df5af800 20 Filter name: none 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe303fff640 20 reqs_thread_entry: start 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945be490 con 0x55de94578f10 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv12 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945c09b0 con 0x7fe4d0098020 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 20 enabling bucket name=myfoo 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.704+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945bee30 con 0x7fe4d0098020 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 : miss 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 20 rados->read ofs=0 len=0 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:65 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945c06c0 con 0x55de9457f1f0 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(65 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.705+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 8.16 8:6a37fcdf:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945c93e0 con 0x55de9457f1f0 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.706+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(66 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'7 uv7 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.706+0000 7fe4df5af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.706+0000 7fe4df5af800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.706+0000 7fe4df5af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.706+0000 7fe4df5af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1, ofs0, ns] 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.706+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94414460175776 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945c4e60 con 0x55de94578f10 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== watch-notify(notify (1) cookie 94414459920960 notify 128849018901 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55de94542120 con 0x55de94578f10 2024-02-15T22:56:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe3c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018901 cookie 94414459920960 notifier 4593 bl.length()=725 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe3c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 info.flags=0x17 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe3c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1 to cache LRU end 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe3c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe3c0ff9640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe3a0003e90 con 0x55de94578f10 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(67 notify.4 [notify cookie 94414460175776 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== watch-notify(notify_complete (2) cookie 94414460175776 notify 128849018901 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55de94541c40 con 0x55de94578f10 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe4df5af800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_sources= new_sources= 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe4df5af800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential sources added=[] removed=[] 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe4df5af800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): orig_dests= new_dests= 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe4df5af800 20 handle_bi_update(): bucket=:myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1]): potential dests added=[] removed=[] 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.707+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945c14d0 con 0x55de94578f10 2024-02-15T22:56:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.708+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~358] v30'13 uv13 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.708+0000 7fe4df5af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.708+0000 7fe4df5af800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.708+0000 7fe4df5af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.708+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94414460162096 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945c1450 con 0x55de94578f10 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.709+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== watch-notify(notify (1) cookie 94414459920960 notify 128849018902 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x55de94541c40 con 0x55de94578f10 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.709+0000 7fe3b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018902 cookie 94414459920960 notifier 4593 bl.length()=534 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.709+0000 7fe3b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.709+0000 7fe3b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.709+0000 7fe3b3fff640 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe310003420 con 0x55de94578f10 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.709+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(70 notify.4 [notify cookie 94414460162096 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.709+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.709+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== watch-notify(notify_complete (2) cookie 94414460162096 notify 128849018902 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe4d4001b70 con 0x55de94578f10 2024-02-15T22:56:30.729 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:30.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.710+0000 7fe3937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:30.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.710+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94414459932080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945a83a0 con 0x55de94578f10 2024-02-15T22:56:30.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.711+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94414459932080] v30'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.711+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94414459908032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de945c1440 con 0x7fe4d0098020 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.712+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94414459908032] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.712+0000 7fe4df5af800 20 remove_watcher() i=0 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.712+0000 7fe4df5af800 2 removed watcher, disabling cache 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.712+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94414459912848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457e7d0 con 0x55de94578f10 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.713+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94414459912848] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.713+0000 7fe4df5af800 20 remove_watcher() i=1 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.713+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94414459916320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457e7d0 con 0x55de9457f1f0 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.714+0000 7fe4dc8ad640 1 -- 172.21.15.133:0/3228530643 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94414459916320] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d0095070 con 0x55de9457f1f0 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.714+0000 7fe4df5af800 20 remove_watcher() i=2 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.714+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94414459918448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457e7d0 con 0x7fe4d0098020 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.715+0000 7fe4dd8af640 1 -- 172.21.15.133:0/3228530643 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94414459918448] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d803a040 con 0x7fe4d0098020 2024-02-15T22:56:30.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.715+0000 7fe4df5af800 20 remove_watcher() i=3 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.715+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94414459920960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457e7d0 con 0x55de94578f10 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.715+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94414459920960] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x55de94578f10 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.716+0000 7fe4df5af800 20 remove_watcher() i=4 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.716+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94414459926000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457e7d0 con 0x7fe4d80141d0 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.716+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94414459926000] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.717+0000 7fe4df5af800 20 remove_watcher() i=5 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.717+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94414459928560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457e7d0 con 0x7fe4d80141d0 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.717+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94414459928560] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.717+0000 7fe4df5af800 20 remove_watcher() i=6 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.717+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94414459930768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55de9457e7d0 con 0x7fe4d80141d0 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.718+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94414459930768] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4d4052040 con 0x7fe4d80141d0 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.718+0000 7fe4df5af800 20 remove_watcher() i=7 2024-02-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.718+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe4d80141d0 msgr2=0x7fe4d8015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.718+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe4d80141d0 0x7fe4d8015940 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.718+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55de94578f10 msgr2=0x55de9457b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55de94578f10 0x55de9457b3d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe4d0098020 msgr2=0x7fe4d008c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe4d0098020 0x7fe4d008c250 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55de9457f1f0 msgr2=0x55de94581690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55de9457f1f0 0x55de94581690 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3a80367e0 msgr2=0x7fe3a8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3a80367e0 0x7fe3a8038ca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800b010 tx=0x7fe4d8020000 comp rx=0 tx=0).stop 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 msgr2=0x55de9456d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3228530643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de945662e0 0x55de9456d340 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00059a0 tx=0x7fe4d008de40 comp rx=0 tx=0).stop 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 reap_dead start 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4dd0ae640 1 -- 172.21.15.133:0/3228530643 reap_dead start 2024-02-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 shutdown_connections 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 >> 172.21.15.133:0/3228530643 conn(0x55de94562640 msgr2=0x55de9455fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 shutdown_connections 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3228530643 wait complete. 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3984754939 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3b40367e0 msgr2=0x7fe3b4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3984754939 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3b40367e0 0x7fe3b4038ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55de94549340 tx=0x7fe4d8005840 comp rx=0 tx=0).stop 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3984754939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94559180 msgr2=0x55de945595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3984754939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94559180 0x55de945595a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00447c0 tx=0x7fe4d0002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3984754939 shutdown_connections 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3984754939 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3b40367e0 0x7fe3b4038ca0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 --2- 172.21.15.133:0/3984754939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94559180 0x55de945595a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3984754939 >> 172.21.15.133:0/3984754939 conn(0x55de9454d220 msgr2=0x55de9454d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3984754939 shutdown_connections 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/3984754939 wait complete. 2024-02-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55de9444c510 msgr2=0x55de94548400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.719+0000 7fe4df5af800 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55de9444c510 0x55de94548400 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.720+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c40367e0 msgr2=0x7fe3c4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.720+0000 7fe4df5af800 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c40367e0 0x7fe3c4038ca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0054000 tx=0x7fe4d004e000 comp rx=0 tx=0).stop 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.720+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 msgr2=0x55de94541700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.720+0000 7fe4df5af800 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94541700 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400b210 tx=0x7fe4d4000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.720+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 shutdown_connections 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.720+0000 7fe4df5af800 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55de9444c510 0x55de94548400 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.720+0000 7fe4df5af800 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe3c40367e0 0x7fe3c4038ca0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.720+0000 7fe4df5af800 1 --2- 172.21.15.133:0/2965186933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de94448a00 0x55de94541700 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.720+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 >> 172.21.15.133:0/2965186933 conn(0x55de944424d0 msgr2=0x55de94446da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.720+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 shutdown_connections 2024-02-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:30.720+0000 7fe4df5af800 1 -- 172.21.15.133:0/2965186933 wait complete. 2024-02-15T22:56:30.740 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:30.746 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-15T22:56:30.994 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-02-15T22:56:31.000 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:46.001 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-15T22:56:46.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-15T22:56:46.001 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-15T22:56:46.052 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:46.052 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.050+0000 7facd972b800 1 Processor -- start 2024-02-15T22:56:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.050+0000 7facd972b800 1 -- start start 2024-02-15T22:56:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.051+0000 7facd972b800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562c9170a3d0 0x562c91712ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.051+0000 7facd972b800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562c91654bb0 con 0x562c91708890 2024-02-15T22:56:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.051+0000 7facd972b800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x562c9160c450 con 0x562c9170a3d0 2024-02-15T22:56:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.051+0000 7facccb5d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562c9170a3d0 0x562c91712ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.051+0000 7facccb5d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562c9170a3d0 0x562c91712ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53760/0 (socket says 172.21.15.133:53760) 2024-02-15T22:56:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.051+0000 7facccb5d640 1 -- 172.21.15.133:0/1065648807 learned_addr learned my addr 172.21.15.133:0/1065648807 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.051+0000 7facd535e640 1 --1- 172.21.15.133:0/1065648807 >> v1:172.21.15.52:6789/0 conn(0x562c91708890 0x562c91708cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:56466/0 (socket says 172.21.15.133:56466) 2024-02-15T22:56:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.051+0000 7facccb5d640 1 -- 172.21.15.133:0/1065648807 >> v1:172.21.15.52:6789/0 conn(0x562c91708890 legacy=0x562c91708cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.051+0000 7facccb5d640 1 -- 172.21.15.133:0/1065648807 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c9167d180 con 0x562c9170a3d0 2024-02-15T22:56:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.053+0000 7facccb5d640 1 --2- 172.21.15.133:0/1065648807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c9170a3d0 0x562c91712ed0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7facc000a520 tx=0x7facc001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddda7f0d70301675 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.053+0000 7facd4b5d640 1 -- 172.21.15.133:0/1065648807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc0052570 con 0x562c9170a3d0 2024-02-15T22:56:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.054+0000 7facd4b5d640 1 -- 172.21.15.133:0/1065648807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc00526d0 con 0x562c9170a3d0 2024-02-15T22:56:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.054+0000 7facd4b5d640 1 -- 172.21.15.133:0/1065648807 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc0052990 con 0x562c9170a3d0 2024-02-15T22:56:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.054+0000 7facd972b800 1 -- 172.21.15.133:0/1065648807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c9170a3d0 msgr2=0x562c91712ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.054+0000 7facd972b800 1 --2- 172.21.15.133:0/1065648807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c9170a3d0 0x562c91712ed0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7facc000a520 tx=0x7facc001cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.054+0000 7facd972b800 1 -- 172.21.15.133:0/1065648807 shutdown_connections 2024-02-15T22:56:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.054+0000 7facd972b800 1 --2- 172.21.15.133:0/1065648807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c9170a3d0 0x562c91712ed0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.054+0000 7facd972b800 1 -- 172.21.15.133:0/1065648807 >> 172.21.15.133:0/1065648807 conn(0x562c917044d0 msgr2=0x562c917068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.054+0000 7facd972b800 1 -- 172.21.15.133:0/1065648807 shutdown_connections 2024-02-15T22:56:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.054+0000 7facd972b800 1 -- 172.21.15.133:0/1065648807 wait complete. 2024-02-15T22:56:46.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.068+0000 7facd972b800 1 Processor -- start 2024-02-15T22:56:46.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.068+0000 7facd972b800 1 -- start start 2024-02-15T22:56:46.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.068+0000 7facd972b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c917fc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.068+0000 7facd972b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c91609980 con 0x562c91708890 2024-02-15T22:56:46.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.068+0000 7facd535e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c917fc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.068+0000 7facd535e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c917fc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53772/0 (socket says 172.21.15.133:53772) 2024-02-15T22:56:46.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.068+0000 7facd535e640 1 -- 172.21.15.133:0/3444423238 learned_addr learned my addr 172.21.15.133:0/3444423238 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.069+0000 7facd535e640 1 -- 172.21.15.133:0/3444423238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc0005de0 con 0x562c91708890 2024-02-15T22:56:46.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.069+0000 7facd535e640 1 --2- 172.21.15.133:0/3444423238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c917fc2e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7facc8001d00 tx=0x7facc800b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca9454e676699d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.069+0000 7fabc3606640 1 -- 172.21.15.133:0/3444423238 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc8014070 con 0x562c91708890 2024-02-15T22:56:46.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.069+0000 7fabc3606640 1 -- 172.21.15.133:0/3444423238 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc800f450 con 0x562c91708890 2024-02-15T22:56:46.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.069+0000 7fabc3606640 1 -- 172.21.15.133:0/3444423238 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc800f730 con 0x562c91708890 2024-02-15T22:56:46.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.070+0000 7facd972b800 1 -- 172.21.15.133:0/3444423238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 msgr2=0x562c917fc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.070+0000 7facd972b800 1 --2- 172.21.15.133:0/3444423238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c917fc2e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7facc8001d00 tx=0x7facc800b600 comp rx=0 tx=0).stop 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.070+0000 7facd972b800 1 -- 172.21.15.133:0/3444423238 shutdown_connections 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.070+0000 7facd972b800 1 --2- 172.21.15.133:0/3444423238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c917fc2e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.070+0000 7facd972b800 1 -- 172.21.15.133:0/3444423238 >> 172.21.15.133:0/3444423238 conn(0x562c917044d0 msgr2=0x562c917f7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.070+0000 7facd972b800 1 -- 172.21.15.133:0/3444423238 shutdown_connections 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.070+0000 7facd972b800 1 -- 172.21.15.133:0/3444423238 wait complete. 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.070+0000 7facd972b800 1 Processor -- start 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.070+0000 7facd972b800 1 -- start start 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.071+0000 7facd972b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c91803990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.071+0000 7facd972b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c91605160 con 0x562c91708890 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.071+0000 7facd535e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c91803990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.071+0000 7facd535e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c91803990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53784/0 (socket says 172.21.15.133:53784) 2024-02-15T22:56:46.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.071+0000 7facd535e640 1 -- 172.21.15.133:0/3226869766 learned_addr learned my addr 172.21.15.133:0/3226869766 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.071+0000 7facd535e640 1 -- 172.21.15.133:0/3226869766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c91654bb0 con 0x562c91708890 2024-02-15T22:56:46.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.071+0000 7facd535e640 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c91803990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x562c917fd070 tx=0x7facc8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.072+0000 7fabc1e03640 1 -- 172.21.15.133:0/3226869766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc8014050 con 0x562c91708890 2024-02-15T22:56:46.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.072+0000 7fabc1e03640 1 -- 172.21.15.133:0/3226869766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc801ba30 con 0x562c91708890 2024-02-15T22:56:46.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.072+0000 7fabc1e03640 1 -- 172.21.15.133:0/3226869766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc801bcd0 con 0x562c91708890 2024-02-15T22:56:46.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.072+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c91803ed0 con 0x562c91708890 2024-02-15T22:56:46.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.072+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c918043b0 con 0x562c91708890 2024-02-15T22:56:46.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.073+0000 7fabc1e03640 1 -- 172.21.15.133:0/3226869766 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7facc8022020 con 0x562c91708890 2024-02-15T22:56:46.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.073+0000 7fabc1e03640 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabbc0367e0 0x7fabbc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.073+0000 7fabc1e03640 1 -- 172.21.15.133:0/3226869766 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7facc8008030 con 0x562c91708890 2024-02-15T22:56:46.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.073+0000 7facccb5d640 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabbc0367e0 0x7fabbc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.073+0000 7facd972b800 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562c9170a3d0 0x562c9180a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.073+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9180acd0 con 0x562c9170a3d0 2024-02-15T22:56:46.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.073+0000 7facd5b5f640 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562c9170a3d0 0x562c9180a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.074+0000 7facccb5d640 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabbc0367e0 0x7fabbc038ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7facc0054000 tx=0x7facc004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.074+0000 7facd5b5f640 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562c9170a3d0 0x562c9180a700 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.074+0000 7facd5b5f640 1 -- 172.21.15.133:0/3226869766 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7facd000a4a0 con 0x562c9170a3d0 2024-02-15T22:56:46.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.074+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91807da0 con 0x562c9170a3d0 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.074+0000 7facd5b5f640 1 -- 172.21.15.133:0/3226869766 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7facd000a4a0 con 0x562c9170a3d0 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.074+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9180b1a0 con 0x562c9170a3d0 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.075+0000 7facd5b5f640 1 -- 172.21.15.133:0/3226869766 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7facd000a4a0 con 0x562c9170a3d0 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.075+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9180be90 con 0x562c9170a3d0 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.075+0000 7facd5b5f640 1 -- 172.21.15.133:0/3226869766 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7facd000a4a0 con 0x562c9170a3d0 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.075+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9180c2a0 con 0x562c9170a3d0 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.075+0000 7facd5b5f640 1 -- 172.21.15.133:0/3226869766 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7facd000a4a0 con 0x562c9170a3d0 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.075+0000 7facd972b800 1 Processor -- start 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.076+0000 7facd972b800 1 -- start start 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.076+0000 7facd972b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c9181b480 0x562c9181b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.076+0000 7facd972b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c915a7e80 con 0x562c9181b480 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.076+0000 7facccb5d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c9181b480 0x562c9181b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.076+0000 7facccb5d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c9181b480 0x562c9181b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53790/0 (socket says 172.21.15.133:53790) 2024-02-15T22:56:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.076+0000 7facccb5d640 1 -- 172.21.15.133:0/1473623783 learned_addr learned my addr 172.21.15.133:0/1473623783 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.076+0000 7facccb5d640 1 -- 172.21.15.133:0/1473623783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c9181bde0 con 0x562c9181b480 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.076+0000 7facccb5d640 1 --2- 172.21.15.133:0/1473623783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c9181b480 0x562c9181b8a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7facc0044830 tx=0x7facc0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.077+0000 7fabbaffd640 1 -- 172.21.15.133:0/1473623783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc005db80 con 0x562c9181b480 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.077+0000 7fabbaffd640 1 -- 172.21.15.133:0/1473623783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc005dd00 con 0x562c9181b480 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.077+0000 7facd972b800 1 -- 172.21.15.133:0/1473623783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c9181bfd0 con 0x562c9181b480 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.077+0000 7fabbaffd640 1 -- 172.21.15.133:0/1473623783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc0069400 con 0x562c9181b480 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.077+0000 7facd972b800 1 -- 172.21.15.133:0/1473623783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c9181cb20 con 0x562c9181b480 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.078+0000 7fabbaffd640 1 -- 172.21.15.133:0/1473623783 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7facc0059040 con 0x562c9181b480 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.078+0000 7fabbaffd640 1 --2- 172.21.15.133:0/1473623783 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabb00367e0 0x7fabb0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.078+0000 7fabbaffd640 1 -- 172.21.15.133:0/1473623783 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7facc008f470 con 0x562c9181b480 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.078+0000 7facd5b5f640 1 --2- 172.21.15.133:0/1473623783 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabb00367e0 0x7fabb0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.078+0000 7facd972b800 1 Processor -- start 2024-02-15T22:56:46.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.078+0000 7facd972b800 1 -- start start 2024-02-15T22:56:46.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.078+0000 7facd5b5f640 1 --2- 172.21.15.133:0/1473623783 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabb00367e0 0x7fabb0038ca0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x562c91807cc0 tx=0x7facd0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.078+0000 7facd972b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c91828af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.078+0000 7facd972b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c9157d5d0 con 0x562c918286d0 2024-02-15T22:56:46.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.079+0000 7facccb5d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c91828af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.079+0000 7facccb5d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c91828af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53792/0 (socket says 172.21.15.133:53792) 2024-02-15T22:56:46.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.079+0000 7facccb5d640 1 -- 172.21.15.133:0/2225480651 learned_addr learned my addr 172.21.15.133:0/2225480651 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.079+0000 7facccb5d640 1 -- 172.21.15.133:0/2225480651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c918290c0 con 0x562c918286d0 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.079+0000 7facccb5d640 1 --2- 172.21.15.133:0/2225480651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c91828af0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7facc008d910 tx=0x7facc0068e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c7737003ba0a78 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.079+0000 7fabb8ff9640 1 -- 172.21.15.133:0/2225480651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc008c070 con 0x562c918286d0 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.079+0000 7fabb8ff9640 1 -- 172.21.15.133:0/2225480651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc0006380 con 0x562c918286d0 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.079+0000 7fabb8ff9640 1 -- 172.21.15.133:0/2225480651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc0009410 con 0x562c918286d0 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.080+0000 7facd972b800 1 -- 172.21.15.133:0/2225480651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 msgr2=0x562c91828af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.080+0000 7facd972b800 1 --2- 172.21.15.133:0/2225480651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c91828af0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7facc008d910 tx=0x7facc0068e80 comp rx=0 tx=0).stop 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.080+0000 7facd972b800 1 -- 172.21.15.133:0/2225480651 shutdown_connections 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.080+0000 7facd972b800 1 --2- 172.21.15.133:0/2225480651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c91828af0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.080+0000 7facd972b800 1 -- 172.21.15.133:0/2225480651 >> 172.21.15.133:0/2225480651 conn(0x562c918249a0 msgr2=0x562c91822a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.080+0000 7facd972b800 1 -- 172.21.15.133:0/2225480651 shutdown_connections 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.080+0000 7facd972b800 1 -- 172.21.15.133:0/2225480651 wait complete. 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.080+0000 7facd972b800 1 Processor -- start 2024-02-15T22:56:46.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.080+0000 7facd972b800 1 -- start start 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.080+0000 7facd972b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c9182f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.080+0000 7facd972b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c9182fc00 con 0x562c918286d0 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.081+0000 7facccb5d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c9182f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.081+0000 7facccb5d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c9182f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53802/0 (socket says 172.21.15.133:53802) 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.081+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 learned_addr learned my addr 172.21.15.133:0/3756387422 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.081+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c9181cb20 con 0x562c918286d0 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.081+0000 7facccb5d640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c9182f6c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7facc00066e0 tx=0x7facc008d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.081+0000 7faba6ffd640 1 -- 172.21.15.133:0/3756387422 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc008da50 con 0x562c918286d0 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.081+0000 7faba6ffd640 1 -- 172.21.15.133:0/3756387422 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc008dbf0 con 0x562c918286d0 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.081+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c9181cb20 con 0x562c918286d0 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.081+0000 7faba6ffd640 1 -- 172.21.15.133:0/3756387422 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc008c070 con 0x562c918286d0 2024-02-15T22:56:46.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.081+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c9181cb20 con 0x562c918286d0 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.082+0000 7faba6ffd640 1 -- 172.21.15.133:0/3756387422 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7facc008c1d0 con 0x562c918286d0 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.082+0000 7facd972b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.082+0000 7faba6ffd640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faba00367e0 0x7faba0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.082+0000 7faba6ffd640 1 -- 172.21.15.133:0/3756387422 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7facc0099bb0 con 0x562c918286d0 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.083+0000 7facd5b5f640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faba00367e0 0x7faba0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.083+0000 7facd972b800 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562c9183af50 0x562c9183d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.083+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183db40 con 0x562c9183af50 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.083+0000 7facd535e640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562c9183af50 0x562c9183d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.083+0000 7facd5b5f640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faba00367e0 0x7faba0038ca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7facd000b010 tx=0x7facd0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.083+0000 7facd535e640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562c9183af50 0x562c9183d3f0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.083+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.083+0000 7facd972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.083+0000 7facd972b800 20 realm 2024-02-15T22:56:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.083+0000 7facd972b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.083+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183df10 con 0x562c9183af50 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e760 con 0x562c9183af50 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183eac0 con 0x562c9183af50 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c9183af50 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 20 searching for the correct realm 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562c91840e80 0x562c91843270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.084+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918438f0 con 0x562c91840e80 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.085+0000 7facccb5d640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562c91840e80 0x562c91843270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.085+0000 7facccb5d640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562c91840e80 0x562c91843270 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.085+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.085+0000 7facccb5d640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7facc0098020 0x7facc0055120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.085+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918438f0 con 0x7facc0098020 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.085+0000 7facd5b5f640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7facc0098020 0x7facc0055120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.086+0000 7facd5b5f640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7facc0098020 0x7facc0055120 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.086+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facd000a4a0 con 0x7facc0098020 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.086+0000 7facd5b5f640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7facd00141d0 0x7facd0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.086+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918438f0 con 0x7facd00141d0 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.086+0000 7facd535e640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7facd00141d0 0x7facd0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.086+0000 7facd535e640 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7facd00141d0 0x7facd0015940 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.087+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.087+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c9183af50 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.087+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.087+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c9183af50 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.087+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.087+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facd00141d0 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.088+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.088+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facd00141d0 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.088+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.088+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facc0098020 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.088+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facd000a4a0 con 0x7facc0098020 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.088+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c91840e80 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.088+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.088+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c9183af50 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.089+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.089+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facd00141d0 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.089+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.089+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c9183af50 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.089+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.089+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facc0098020 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.089+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.089+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c91840e80 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.090+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.090+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c91840e80 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.090+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.090+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facd00141d0 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.090+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.090+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c91840e80 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.091+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.091+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c91840e80 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.091+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.091+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c9183af50 2024-02-15T22:56:46.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.091+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.091+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c9183af50 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.091+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.091+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facd00141d0 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.092+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.092+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c91840e80 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.092+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.092+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facc0098020 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.092+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.092+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c9183af50 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.092+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.092+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facd00141d0 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.093+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.093+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c91840e80 2024-02-15T22:56:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.093+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.093+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facd00141d0 2024-02-15T22:56:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.093+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.093+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facc0098020 2024-02-15T22:56:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.094+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.094+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c91840e80 2024-02-15T22:56:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.094+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.094+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facd00141d0 2024-02-15T22:56:46.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.094+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.094+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x562c9183af50 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.094+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183e400 con 0x7facc0098020 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183f7f0 con 0x562c9183af50 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183fba0 con 0x562c9183af50 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.095+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183fba0 con 0x562c9183af50 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 20 zone default found 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 4 Realm: () 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:46.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 20 zonegroup default 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9183f440 con 0x7facd00141d0 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91840470 con 0x562c91840e80 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.096+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91845710 con 0x562c91840e80 2024-02-15T22:56:46.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.097+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.097+0000 7facd972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.097+0000 7facd972b800 20 started sync module instance, tier type = 2024-02-15T22:56:46.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.097+0000 7facd972b800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:46.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.097+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91844ff0 con 0x7facc0098020 2024-02-15T22:56:46.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.098+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.098+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94749419916112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918453a0 con 0x7facc0098020 2024-02-15T22:56:46.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.098+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91846420 con 0x562c9183af50 2024-02-15T22:56:46.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.099+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.099+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94749419921552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91846ab0 con 0x562c9183af50 2024-02-15T22:56:46.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.099+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91847560 con 0x562c91840e80 2024-02-15T22:56:46.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.100+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94749419921552] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.100+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94749419916112] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.101+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.101+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94749419920096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91846510 con 0x562c91840e80 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.101+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91847f50 con 0x7facc0098020 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.102+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94749419920096] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.102+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.102+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94749419928240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91848370 con 0x7facc0098020 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.102+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91848bb0 con 0x562c9183af50 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.103+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94749419928240] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.103+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.103+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94749419929296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91848790 con 0x562c9183af50 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.103+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918495c0 con 0x7facd00141d0 2024-02-15T22:56:46.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.104+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94749419929296] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.106+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.106+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94749419933952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91848790 con 0x7facd00141d0 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.106+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91849ff0 con 0x7facd00141d0 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.107+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94749419933952] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.107+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.107+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94749419936528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91848790 con 0x7facd00141d0 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.107+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9184a9b0 con 0x7facd00141d0 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.108+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94749419936528] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.108+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.108+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94749419930352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9184ab90 con 0x7facd00141d0 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.108+0000 7facd972b800 20 add_watcher() i=0 2024-02-15T22:56:46.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.108+0000 7facd972b800 20 add_watcher() i=1 2024-02-15T22:56:46.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.108+0000 7facd972b800 20 add_watcher() i=2 2024-02-15T22:56:46.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.108+0000 7facd972b800 20 add_watcher() i=3 2024-02-15T22:56:46.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.108+0000 7facd972b800 20 add_watcher() i=4 2024-02-15T22:56:46.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.108+0000 7facd972b800 20 add_watcher() i=5 2024-02-15T22:56:46.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.108+0000 7facd972b800 20 add_watcher() i=6 2024-02-15T22:56:46.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.109+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94749419930352] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.109+0000 7facd972b800 20 add_watcher() i=7 2024-02-15T22:56:46.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.109+0000 7facd972b800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:46.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.109+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9184def0 con 0x562c9183af50 2024-02-15T22:56:46.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.110+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.110+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94749419952336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9184ab30 con 0x562c9183af50 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.111+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94749419952336] v32'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.111+0000 7fab8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.111+0000 7facd972b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.111+0000 7facd972b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.111+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9184cbf0 con 0x562c9183af50 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.112+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.112+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9184cbf0 con 0x7facd00141d0 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.114+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.114+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918570d0 con 0x562c91840e80 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.115+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.115+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91857aa0 con 0x562c9183af50 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.116+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'153 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.116+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91857aa0 con 0x7facc0098020 2024-02-15T22:56:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.117+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'44 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.117+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91857ff0 con 0x562c91840e80 2024-02-15T22:56:46.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.118+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'29 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.118+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918589c0 con 0x562c9183af50 2024-02-15T22:56:46.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.119+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.119+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918589c0 con 0x7facd00141d0 2024-02-15T22:56:46.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.121+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'29 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.121+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918589c0 con 0x7facc0098020 2024-02-15T22:56:46.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.122+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.122+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91858dc0 con 0x562c91840e80 2024-02-15T22:56:46.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.123+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.123+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91859790 con 0x7facc0098020 2024-02-15T22:56:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.124+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'45 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.124+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91856820 con 0x7facd00141d0 2024-02-15T22:56:46.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.125+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.125+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91856820 con 0x7facc0098020 2024-02-15T22:56:46.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.126+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.126+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918567c0 con 0x7facd00141d0 2024-02-15T22:56:46.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.127+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'35 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.127+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a300 con 0x562c9183af50 2024-02-15T22:56:46.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.128+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'154 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.128+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a300 con 0x562c91840e80 2024-02-15T22:56:46.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.129+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.129+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x7facc0098020 2024-02-15T22:56:46.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.130+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'46 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.130+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x562c91840e80 2024-02-15T22:56:46.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.131+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.131+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x562c9183af50 2024-02-15T22:56:46.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.132+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.133+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x562c9183af50 2024-02-15T22:56:46.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.133+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'155 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.133+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x562c91840e80 2024-02-15T22:56:46.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.135+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.135+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x7facc0098020 2024-02-15T22:56:46.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.136+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.136+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x562c91840e80 2024-02-15T22:56:46.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.137+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.137+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x562c91840e80 2024-02-15T22:56:46.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.138+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.138+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x562c91840e80 2024-02-15T22:56:46.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.138+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'15 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.138+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x562c91840e80 2024-02-15T22:56:46.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.139+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.139+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x7facd00141d0 2024-02-15T22:56:46.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.141+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.141+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x562c91840e80 2024-02-15T22:56:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.142+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.142+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x7facd00141d0 2024-02-15T22:56:46.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.143+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.143+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x562c91840e80 2024-02-15T22:56:46.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.144+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'40 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.144+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x7facd00141d0 2024-02-15T22:56:46.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.145+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'36 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.145+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c9185a130 con 0x7facc0098020 2024-02-15T22:56:46.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.146+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.147+0000 7fab8a7e4640 20 reqs_thread_entry: start 2024-02-15T22:56:46.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.147+0000 7facd972b800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:46.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.147+0000 7facd972b800 20 Filter name: none 2024-02-15T22:56:46.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.147+0000 7faafbfff640 20 reqs_thread_entry: start 2024-02-15T22:56:46.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.147+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.147+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.147+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c9183af50 2024-02-15T22:56:46.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.148+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.148+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.148+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.148+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facd00141d0 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.148+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.148+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x7facd00141d0 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.149+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.149+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facd00141d0 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.149+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.149+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.149+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.149+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c91840e80 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.150+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.150+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.150+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.150+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.150+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.150+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c9183af50 2024-02-15T22:56:46.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.150+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.150+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.151+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.151+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.151+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.151+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x7facc0098020 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.151+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.151+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.151+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.151+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.152+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.152+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c91840e80 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.152+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.152+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.152+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.152+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.152+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.152+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c9183af50 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.153+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.153+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.153+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.153+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facd00141d0 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.153+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.153+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x7facd00141d0 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.154+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.154+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facd00141d0 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.154+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.154+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.154+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.154+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x7facc0098020 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.155+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.155+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.155+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.155+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.155+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.155+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c91840e80 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.155+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.155+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.156+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.156+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.156+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.156+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x7facc0098020 2024-02-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.156+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.156+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.156+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.156+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facd00141d0 2024-02-15T22:56:46.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.157+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.157+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x7facd00141d0 2024-02-15T22:56:46.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.157+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.157+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facd00141d0 2024-02-15T22:56:46.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.158+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.158+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.158+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.158+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x7facc0098020 2024-02-15T22:56:46.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.158+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.158+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.158+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.158+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facd00141d0 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.159+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.159+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x7facd00141d0 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.159+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.159+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facd00141d0 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.159+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.159+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.160+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.160+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c9183af50 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.160+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.160+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.160+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.160+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.161+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.161+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c91840e80 2024-02-15T22:56:46.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.161+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.161+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.161+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.161+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.161+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.161+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x7facc0098020 2024-02-15T22:56:46.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.162+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.162+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.162+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.162+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.162+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.162+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c91840e80 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.162+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.162+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.162+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.163+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.163+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.163+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c9183af50 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.163+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.163+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.163+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.163+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.164+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.164+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c9183af50 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.164+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.164+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c9183af50 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.164+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.164+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.164+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.164+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c91840e80 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.165+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.165+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.165+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.165+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.165+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.165+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x7facc0098020 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.165+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.165+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x7facc0098020 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.166+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.166+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.166+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.166+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c91840e80 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.166+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.166+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.166+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.166+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.166+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.167+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.167+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.167+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.167+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.167+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.167+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv14 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.167+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91883540 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.167+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv14 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.167+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91884550 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.168+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 52 ==== osd_op_reply(168 gc.24 [call out=1701b] v0'0 uv14 ondisk = 0) v8 ==== 149+0+1701 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.168+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.168+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.168+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918840a0 con 0x562c91840e80 2024-02-15T22:56:46.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.168+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.168+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x562c91840e80 2024-02-15T22:56:46.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.168+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.168+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x7facd00141d0 2024-02-15T22:56:46.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.169+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.169+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918840a0 con 0x7facd00141d0 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.169+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.169+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x7facd00141d0 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.170+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.170+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x562c91840e80 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.170+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.170+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918840a0 con 0x562c91840e80 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.170+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.170+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x562c91840e80 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.170+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.170+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x7facd00141d0 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.171+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.171+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918840a0 con 0x7facd00141d0 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.171+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.172+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x7facd00141d0 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.172+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.172+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x562c91840e80 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.172+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.172+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918840a0 con 0x562c91840e80 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.172+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.172+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x562c91840e80 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.173+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.173+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x7facd00141d0 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.173+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.173+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918840a0 con 0x7facd00141d0 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.173+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.173+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x7facd00141d0 2024-02-15T22:56:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.174+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.174+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x7facc0098020 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.174+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.174+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918840a0 con 0x7facc0098020 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.174+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.174+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c918850b0 con 0x7facc0098020 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.174+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.175+0000 7fab8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.175+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94749419952336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91882530 con 0x562c9183af50 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.176+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94749419952336] v32'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.176+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94749419916112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91853da0 con 0x7facc0098020 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.177+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94749419916112] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.177+0000 7facd972b800 20 remove_watcher() i=0 2024-02-15T22:56:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.177+0000 7facd972b800 2 removed watcher, disabling cache 2024-02-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.177+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94749419921552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91853da0 con 0x562c9183af50 2024-02-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.178+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94749419921552] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.178+0000 7facd972b800 20 remove_watcher() i=1 2024-02-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.178+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94749419920096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91846090 con 0x562c91840e80 2024-02-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.180+0000 7facccb5d640 1 -- 172.21.15.133:0/3756387422 <== osd.3 v2:172.21.15.133:6816/1065500544 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94749419920096] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc0095070 con 0x562c91840e80 2024-02-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.180+0000 7facd972b800 20 remove_watcher() i=2 2024-02-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.180+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94749419928240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91853da0 con 0x7facc0098020 2024-02-15T22:56:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.181+0000 7facd5b5f640 1 -- 172.21.15.133:0/3756387422 <== osd.2 v2:172.21.15.133:6800/2073628168 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94749419928240] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facd003a040 con 0x7facc0098020 2024-02-15T22:56:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.181+0000 7facd972b800 20 remove_watcher() i=3 2024-02-15T22:56:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.181+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94749419929296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91846090 con 0x562c9183af50 2024-02-15T22:56:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.182+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.1 v2:172.21.15.133:6808/2671624067 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94749419929296] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x562c9183af50 2024-02-15T22:56:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.182+0000 7facd972b800 20 remove_watcher() i=4 2024-02-15T22:56:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.182+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94749419933952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91853da0 con 0x7facd00141d0 2024-02-15T22:56:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.183+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94749419933952] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.183+0000 7facd972b800 20 remove_watcher() i=5 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.183+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94749419936528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91846090 con 0x7facd00141d0 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.184+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94749419936528] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.184+0000 7facd972b800 20 remove_watcher() i=6 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.184+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94749419930352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c91853da0 con 0x7facd00141d0 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.185+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 <== osd.0 v2:172.21.15.52:6800/431200118 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94749419930352] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7facc8016070 con 0x7facd00141d0 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.185+0000 7facd972b800 20 remove_watcher() i=7 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.185+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7facd00141d0 msgr2=0x7facd0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.185+0000 7facd972b800 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7facd00141d0 0x7facd0015940 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.185+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562c9183af50 msgr2=0x562c9183d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.185+0000 7facd972b800 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562c9183af50 0x562c9183d3f0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.185+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7facc0098020 msgr2=0x7facc0055120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.185+0000 7facd972b800 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7facc0098020 0x7facc0055120 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.185+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562c91840e80 msgr2=0x562c91843270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.185+0000 7facd972b800 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562c91840e80 0x562c91843270 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faba00367e0 msgr2=0x7faba0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faba00367e0 0x7faba0038ca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7facd000b010 tx=0x7facd0020000 comp rx=0 tx=0).stop 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 msgr2=0x562c9182f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c9182f6c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7facc00066e0 tx=0x7facc008d8a0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd535e640 1 -- 172.21.15.133:0/3756387422 reap_dead start 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 shutdown_connections 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 --2- 172.21.15.133:0/3756387422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c918286d0 0x562c9182f6c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 >> 172.21.15.133:0/3756387422 conn(0x562c918249a0 msgr2=0x562c91822000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 shutdown_connections 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/3756387422 wait complete. 2024-02-15T22:56:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/1473623783 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabb00367e0 msgr2=0x7fabb0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 --2- 172.21.15.133:0/1473623783 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabb00367e0 0x7fabb0038ca0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x562c91807cc0 tx=0x7facd0005840 comp rx=0 tx=0).stop 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/1473623783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c9181b480 msgr2=0x562c9181b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 --2- 172.21.15.133:0/1473623783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c9181b480 0x562c9181b8a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7facc0044830 tx=0x7facc0002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/1473623783 shutdown_connections 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 --2- 172.21.15.133:0/1473623783 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabb00367e0 0x7fabb0038ca0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 --2- 172.21.15.133:0/1473623783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c9181b480 0x562c9181b8a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/1473623783 >> 172.21.15.133:0/1473623783 conn(0x562c9180f520 msgr2=0x562c9180f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/1473623783 shutdown_connections 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/1473623783 wait complete. 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562c9170a3d0 msgr2=0x562c9180a700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.186+0000 7facd972b800 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562c9170a3d0 0x562c9180a700 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.187+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabbc0367e0 msgr2=0x7fabbc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.187+0000 7facd972b800 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabbc0367e0 0x7fabbc038ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7facc0054000 tx=0x7facc004e000 comp rx=0 tx=0).stop 2024-02-15T22:56:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.187+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 msgr2=0x562c91803990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.187+0000 7facd972b800 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c91803990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x562c917fd070 tx=0x7facc8000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.187+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 shutdown_connections 2024-02-15T22:56:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.187+0000 7facd972b800 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562c9170a3d0 0x562c9180a700 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.187+0000 7facd972b800 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fabbc0367e0 0x7fabbc038ca0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.187+0000 7facd972b800 1 --2- 172.21.15.133:0/3226869766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c91708890 0x562c91803990 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.187+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 >> 172.21.15.133:0/3226869766 conn(0x562c917044d0 msgr2=0x562c917f64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.187+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 shutdown_connections 2024-02-15T22:56:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.187+0000 7facd972b800 1 -- 172.21.15.133:0/3226869766 wait complete. 2024-02-15T22:56:46.197 INFO:teuthology.orchestra.run.smithi133.stdout:[{"tag":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5785048098609248903\u0000","time":"2024-02-15T22:56:45.998350+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_7","key":"","instance":""}]}] 2024-02-15T22:56:46.197 DEBUG:tasks.util.rgw: json result: [{'tag': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5785048098609248903\x00', 'time': '2024-02-15T22:56:45.998350+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_7', 'key': '', 'instance': ''}]}] 2024-02-15T22:56:46.197 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-02-15T22:56:46.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-02-15T22:56:46.198 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-02-15T22:56:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:46.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.236+0000 7f854c9a2800 1 Processor -- start 2024-02-15T22:56:46.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.236+0000 7f854c9a2800 1 -- start start 2024-02-15T22:56:46.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.236+0000 7f854c9a2800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563b7732ca70 0x563b7732ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.236+0000 7f854c9a2800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563b77276ba0 con 0x563b7732f3a0 2024-02-15T22:56:46.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.236+0000 7f854c9a2800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x563b7722e450 con 0x563b7732ca70 2024-02-15T22:56:46.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.236+0000 7f854a4a1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563b7732ca70 0x563b7732ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.236+0000 7f854a4a1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563b7732ca70 0x563b7732ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53812/0 (socket says 172.21.15.133:53812) 2024-02-15T22:56:46.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.236+0000 7f8549ca0640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x563b7732f3a0 0x563b77331790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:56482/0 (socket says 172.21.15.133:56482) 2024-02-15T22:56:46.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.236+0000 7f854a4a1640 1 -- 172.21.15.133:0/3678610588 learned_addr learned my addr 172.21.15.133:0/3678610588 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.237+0000 7f854a4a1640 1 -- 172.21.15.133:0/3678610588 >> v1:172.21.15.52:6789/0 conn(0x563b7732f3a0 legacy=0x563b77331790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.237+0000 7f854949f640 1 -- 172.21.15.133:0/3678610588 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808880492 0 0) 0x563b77276ba0 con 0x563b7732f3a0 2024-02-15T22:56:46.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.237+0000 7f854a4a1640 1 -- 172.21.15.133:0/3678610588 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b77333ec0 con 0x563b7732ca70 2024-02-15T22:56:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.238+0000 7f854a4a1640 1 --2- 172.21.15.133:0/3678610588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732ca70 0x563b7732ee60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f853c00a520 tx=0x7f853c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357becede019ba server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.239+0000 7f854949f640 1 -- 172.21.15.133:0/3678610588 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f853c052570 con 0x563b7732ca70 2024-02-15T22:56:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.239+0000 7f854949f640 1 -- 172.21.15.133:0/3678610588 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c0526d0 con 0x563b7732ca70 2024-02-15T22:56:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.239+0000 7f854949f640 1 -- 172.21.15.133:0/3678610588 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f853c052990 con 0x563b7732ca70 2024-02-15T22:56:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.239+0000 7f854c9a2800 1 -- 172.21.15.133:0/3678610588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732ca70 msgr2=0x563b7732ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.239+0000 7f854c9a2800 1 --2- 172.21.15.133:0/3678610588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732ca70 0x563b7732ee60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f853c00a520 tx=0x7f853c01cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.239+0000 7f854c9a2800 1 -- 172.21.15.133:0/3678610588 shutdown_connections 2024-02-15T22:56:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.239+0000 7f854c9a2800 1 --2- 172.21.15.133:0/3678610588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732ca70 0x563b7732ee60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.239+0000 7f854c9a2800 1 -- 172.21.15.133:0/3678610588 >> 172.21.15.133:0/3678610588 conn(0x563b773264c0 msgr2=0x563b773288e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.239+0000 7f854c9a2800 1 -- 172.21.15.133:0/3678610588 shutdown_connections 2024-02-15T22:56:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.239+0000 7f854c9a2800 1 -- 172.21.15.133:0/3678610588 wait complete. 2024-02-15T22:56:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.251+0000 7f854c9a2800 1 Processor -- start 2024-02-15T22:56:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.251+0000 7f854c9a2800 1 -- start start 2024-02-15T22:56:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.251+0000 7f854c9a2800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b7741bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.251+0000 7f854c9a2800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b7722b980 con 0x563b7732f3a0 2024-02-15T22:56:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.251+0000 7f854a4a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b7741bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.251+0000 7f854a4a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b7741bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53820/0 (socket says 172.21.15.133:53820) 2024-02-15T22:56:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.251+0000 7f854a4a1640 1 -- 172.21.15.133:0/2238040238 learned_addr learned my addr 172.21.15.133:0/2238040238 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.251+0000 7f854a4a1640 1 -- 172.21.15.133:0/2238040238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c005de0 con 0x563b7732f3a0 2024-02-15T22:56:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.252+0000 7f854a4a1640 1 --2- 172.21.15.133:0/2238040238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b7741bef0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f853c0448c0 tx=0x7f853c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f91991a81702960 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.252+0000 7f8438608640 1 -- 172.21.15.133:0/2238040238 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f853c052570 con 0x563b7732f3a0 2024-02-15T22:56:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.252+0000 7f8438608640 1 -- 172.21.15.133:0/2238040238 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c052840 con 0x563b7732f3a0 2024-02-15T22:56:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.252+0000 7f8438608640 1 -- 172.21.15.133:0/2238040238 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f853c052b20 con 0x563b7732f3a0 2024-02-15T22:56:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854c9a2800 1 -- 172.21.15.133:0/2238040238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 msgr2=0x563b7741bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854c9a2800 1 --2- 172.21.15.133:0/2238040238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b7741bef0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f853c0448c0 tx=0x7f853c04c000 comp rx=0 tx=0).stop 2024-02-15T22:56:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854c9a2800 1 -- 172.21.15.133:0/2238040238 shutdown_connections 2024-02-15T22:56:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854c9a2800 1 --2- 172.21.15.133:0/2238040238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b7741bef0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854c9a2800 1 -- 172.21.15.133:0/2238040238 >> 172.21.15.133:0/2238040238 conn(0x563b773264c0 msgr2=0x563b77417770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854c9a2800 1 -- 172.21.15.133:0/2238040238 shutdown_connections 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854c9a2800 1 -- 172.21.15.133:0/2238040238 wait complete. 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854c9a2800 1 Processor -- start 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854c9a2800 1 -- start start 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854c9a2800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b77423420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854c9a2800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b77227160 con 0x563b7732f3a0 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854a4a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b77423420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854a4a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b77423420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53834/0 (socket says 172.21.15.133:53834) 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.253+0000 7f854a4a1640 1 -- 172.21.15.133:0/3978477354 learned_addr learned my addr 172.21.15.133:0/3978477354 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.254+0000 7f854a4a1640 1 -- 172.21.15.133:0/3978477354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b77333ec0 con 0x563b7732f3a0 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.254+0000 7f854a4a1640 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b77423420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f853c0448c0 tx=0x7f853c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.254+0000 7f8436e05640 1 -- 172.21.15.133:0/3978477354 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f853c05d480 con 0x563b7732f3a0 2024-02-15T22:56:46.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.254+0000 7f8436e05640 1 -- 172.21.15.133:0/3978477354 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c06e070 con 0x563b7732f3a0 2024-02-15T22:56:46.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.254+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b77423960 con 0x563b7732f3a0 2024-02-15T22:56:46.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.254+0000 7f8436e05640 1 -- 172.21.15.133:0/3978477354 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f853c05d750 con 0x563b7732f3a0 2024-02-15T22:56:46.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.254+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b77423ea0 con 0x563b7732f3a0 2024-02-15T22:56:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.255+0000 7f8436e05640 1 -- 172.21.15.133:0/3978477354 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f853c070070 con 0x563b7732f3a0 2024-02-15T22:56:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.255+0000 7f8436e05640 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8430036790 0x7f8430038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.255+0000 7f8436e05640 1 -- 172.21.15.133:0/3978477354 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f853c000e40 con 0x563b7732f3a0 2024-02-15T22:56:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.255+0000 7f8549ca0640 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8430036790 0x7f8430038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.255+0000 7f854c9a2800 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563b774281f0 0x563b7742a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.255+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7742ab20 con 0x563b774281f0 2024-02-15T22:56:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.255+0000 7f854aca2640 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563b774281f0 0x563b7742a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.256+0000 7f8549ca0640 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8430036790 0x7f8430038c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8540000c00 tx=0x7f85400013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.256+0000 7f854aca2640 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563b774281f0 0x563b7742a5e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.256+0000 7f854aca2640 1 -- 172.21.15.133:0/3978477354 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f854400a4a0 con 0x563b774281f0 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.256+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774277a0 con 0x563b774281f0 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.256+0000 7f854aca2640 1 -- 172.21.15.133:0/3978477354 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f854400a4a0 con 0x563b774281f0 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.256+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7742afe0 con 0x563b774281f0 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.256+0000 7f854aca2640 1 -- 172.21.15.133:0/3978477354 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f854400a4a0 con 0x563b774281f0 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.256+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7742bcb0 con 0x563b774281f0 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.257+0000 7f854aca2640 1 -- 172.21.15.133:0/3978477354 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f854400a4a0 con 0x563b774281f0 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.257+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7742c0c0 con 0x563b774281f0 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.257+0000 7f854aca2640 1 -- 172.21.15.133:0/3978477354 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f854400a4a0 con 0x563b774281f0 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.257+0000 7f854c9a2800 1 Processor -- start 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.257+0000 7f854c9a2800 1 -- start start 2024-02-15T22:56:46.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.257+0000 7f854c9a2800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732c610 0x563b7732aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.257+0000 7f854c9a2800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b771c9e80 con 0x563b7732c610 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.258+0000 7f8549ca0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732c610 0x563b7732aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.258+0000 7f8549ca0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732c610 0x563b7732aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53842/0 (socket says 172.21.15.133:53842) 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.258+0000 7f8549ca0640 1 -- 172.21.15.133:0/1771949134 learned_addr learned my addr 172.21.15.133:0/1771949134 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.258+0000 7f8549ca0640 1 -- 172.21.15.133:0/1771949134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b7732afc0 con 0x563b7732c610 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.258+0000 7f8549ca0640 1 --2- 172.21.15.133:0/1771949134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732c610 0x563b7732aa80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f854000e610 tx=0x7f854000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.259+0000 7f842ffff640 1 -- 172.21.15.133:0/1771949134 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f854000bea0 con 0x563b7732c610 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.259+0000 7f842ffff640 1 -- 172.21.15.133:0/1771949134 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854000d500 con 0x563b7732c610 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.259+0000 7f854c9a2800 1 -- 172.21.15.133:0/1771949134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b7732b210 con 0x563b7732c610 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.259+0000 7f842ffff640 1 -- 172.21.15.133:0/1771949134 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f854000d7a0 con 0x563b7732c610 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.259+0000 7f854c9a2800 1 -- 172.21.15.133:0/1771949134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b7732b6d0 con 0x563b7732c610 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.259+0000 7f842ffff640 1 -- 172.21.15.133:0/1771949134 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f854001a070 con 0x563b7732c610 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.260+0000 7f842ffff640 1 --2- 172.21.15.133:0/1771949134 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84240367e0 0x7f8424038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.260+0000 7f842ffff640 1 -- 172.21.15.133:0/1771949134 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f8540017050 con 0x563b7732c610 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.260+0000 7f854aca2640 1 --2- 172.21.15.133:0/1771949134 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84240367e0 0x7f8424038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.260+0000 7f854c9a2800 1 Processor -- start 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.260+0000 7f854c9a2800 1 -- start start 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.260+0000 7f854aca2640 1 --2- 172.21.15.133:0/1771949134 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84240367e0 0x7f8424038ca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x563b7742b6f0 tx=0x7f8544005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.260+0000 7f854c9a2800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b7744aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.260+0000 7f854c9a2800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b7719f5d0 con 0x563b7744a6a0 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.260+0000 7f8549ca0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b7744aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.261+0000 7f8549ca0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b7744aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53854/0 (socket says 172.21.15.133:53854) 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.261+0000 7f8549ca0640 1 -- 172.21.15.133:0/1617542431 learned_addr learned my addr 172.21.15.133:0/1617542431 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.261+0000 7f8549ca0640 1 -- 172.21.15.133:0/1617542431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b7744b090 con 0x563b7744a6a0 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.261+0000 7f8549ca0640 1 --2- 172.21.15.133:0/1617542431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b7744aac0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f854004b9d0 tx=0x7f854004bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494affbe908d78c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.261+0000 7f842dffb640 1 -- 172.21.15.133:0/1617542431 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f854001a530 con 0x563b7744a6a0 2024-02-15T22:56:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.261+0000 7f842dffb640 1 -- 172.21.15.133:0/1617542431 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854001ac40 con 0x563b7744a6a0 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.261+0000 7f842dffb640 1 -- 172.21.15.133:0/1617542431 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f854004d0d0 con 0x563b7744a6a0 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f854c9a2800 1 -- 172.21.15.133:0/1617542431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 msgr2=0x563b7744aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f854c9a2800 1 --2- 172.21.15.133:0/1617542431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b7744aac0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f854004b9d0 tx=0x7f854004bc50 comp rx=0 tx=0).stop 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f854c9a2800 1 -- 172.21.15.133:0/1617542431 shutdown_connections 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f854c9a2800 1 --2- 172.21.15.133:0/1617542431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b7744aac0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f854c9a2800 1 -- 172.21.15.133:0/1617542431 >> 172.21.15.133:0/1617542431 conn(0x563b77446a00 msgr2=0x563b77444a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f854c9a2800 1 -- 172.21.15.133:0/1617542431 shutdown_connections 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f854c9a2800 1 -- 172.21.15.133:0/1617542431 wait complete. 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f854c9a2800 1 Processor -- start 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f854c9a2800 1 -- start start 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f854c9a2800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b774516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f854c9a2800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b77451bf0 con 0x563b7744a6a0 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f8549ca0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b774516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f8549ca0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b774516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53864/0 (socket says 172.21.15.133:53864) 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.262+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 learned_addr learned my addr 172.21.15.133:0/871475655 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.263+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b7732b6d0 con 0x563b7744a6a0 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.263+0000 7f8549ca0640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b774516b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8540048040 tx=0x7f854004b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.263+0000 7f841bfff640 1 -- 172.21.15.133:0/871475655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85400242c0 con 0x563b7744a6a0 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.263+0000 7f841bfff640 1 -- 172.21.15.133:0/871475655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8540024680 con 0x563b7744a6a0 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.263+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b77451df0 con 0x563b7744a6a0 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.263+0000 7f841bfff640 1 -- 172.21.15.133:0/871475655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f854001a7e0 con 0x563b7744a6a0 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.263+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b774522b0 con 0x563b7744a6a0 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.264+0000 7f841bfff640 1 -- 172.21.15.133:0/871475655 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f854000d040 con 0x563b7744a6a0 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.264+0000 7f841bfff640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8414036740 0x7f8414038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.264+0000 7f841bfff640 1 -- 172.21.15.133:0/871475655 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f854000a040 con 0x563b7744a6a0 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.264+0000 7f854aca2640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8414036740 0x7f8414038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.264+0000 7f854c9a2800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.264+0000 7f854c9a2800 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563b7745d4c0 0x563b7745f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.264+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774600d0 con 0x563b7745d4c0 2024-02-15T22:56:46.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.264+0000 7f854a4a1640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563b7745d4c0 0x563b7745f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.264+0000 7f854aca2640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8414036740 0x7f8414038c00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f854400b010 tx=0x7f8544020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854a4a1640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563b7745d4c0 0x563b7745f980 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f853c05d8b0 con 0x563b7745d4c0 2024-02-15T22:56:46.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854c9a2800 20 realm 2024-02-15T22:56:46.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854c9a2800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774604a0 con 0x563b7745d4c0 2024-02-15T22:56:46.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f853c05d8b0 con 0x563b7745d4c0 2024-02-15T22:56:46.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854c9a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:46.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854c9a2800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77460d20 con 0x563b7745d4c0 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f853c05d8b0 con 0x563b7745d4c0 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854c9a2800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.265+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77461080 con 0x563b7745d4c0 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.266+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f853c05d8b0 con 0x563b7745d4c0 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.266+0000 7f854c9a2800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.266+0000 7f854c9a2800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.266+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77461880 con 0x563b7745d4c0 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.266+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f853c05d8b0 con 0x563b7745d4c0 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.266+0000 7f854c9a2800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.266+0000 7f854c9a2800 20 searching for the correct realm 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.266+0000 7f854c9a2800 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563b77463740 0x563b77465be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.266+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b77463740 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.266+0000 7f8549ca0640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563b77463740 0x563b77465be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.266+0000 7f8549ca0640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563b77463740 0x563b77465be0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.267+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.267+0000 7f8549ca0640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f8540027060 0x7f8540027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.267+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f8540027060 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.267+0000 7f854aca2640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f8540027060 0x7f8540027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.267+0000 7f854aca2640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f8540027060 0x7f8540027440 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.267+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854400a4a0 con 0x7f8540027060 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.267+0000 7f854aca2640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f85440141d0 0x7f8544015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.267+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f85440141d0 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.267+0000 7f854a4a1640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f85440141d0 0x7f8544015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.268+0000 7f854a4a1640 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f85440141d0 0x7f8544015940 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.268+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c084040 con 0x7f85440141d0 2024-02-15T22:56:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.268+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b7745d4c0 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.268+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c084040 con 0x563b7745d4c0 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.268+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b7745d4c0 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.269+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c084040 con 0x563b7745d4c0 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.269+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f85440141d0 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.269+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c084040 con 0x7f85440141d0 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.269+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f85440141d0 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.269+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c084040 con 0x7f85440141d0 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.269+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f8540027060 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.269+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854400a4a0 con 0x7f8540027060 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.269+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b77463740 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.270+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.270+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b7745d4c0 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.270+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c084040 con 0x563b7745d4c0 2024-02-15T22:56:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.270+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f85440141d0 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.270+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c084040 con 0x7f85440141d0 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.271+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b7745d4c0 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.271+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c084040 con 0x563b7745d4c0 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.271+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f8540027060 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.271+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.271+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b77463740 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.271+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.271+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b77463740 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.271+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.271+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f85440141d0 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.272+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c084040 con 0x7f85440141d0 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.272+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b77463740 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.272+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.272+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b77463740 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.272+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.272+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b7745d4c0 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.272+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c084040 con 0x563b7745d4c0 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.272+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b7745d4c0 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.273+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.273+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f85440141d0 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.273+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.273+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b77463740 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.273+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.273+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f8540027060 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.273+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.273+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b7745d4c0 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.274+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.274+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f85440141d0 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.274+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.274+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b77463740 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.274+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.274+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f85440141d0 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.274+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.274+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f8540027060 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.275+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.275+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b77463740 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.275+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.275+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f85440141d0 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.275+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.275+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x563b7745d4c0 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.275+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.275+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774662b0 con 0x7f8540027060 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77462080 con 0x563b7745d4c0 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77462430 con 0x563b7745d4c0 2024-02-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77462430 con 0x563b7745d4c0 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.276+0000 7f854c9a2800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 20 zone default found 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 4 Realm: () 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 20 zonegroup default 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77462810 con 0x7f85440141d0 2024-02-15T22:56:46.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77468120 con 0x563b77463740 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77468500 con 0x563b77463740 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 20 started sync module instance, tier type = 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.277+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77467a00 con 0x7f8540027060 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.278+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.278+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94813404165472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77467db0 con 0x7f8540027060 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.278+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77469410 con 0x563b7745d4c0 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.279+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94813404165472] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.280+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.280+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94813404170528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774697c0 con 0x563b7745d4c0 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.280+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746a1f0 con 0x563b77463740 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.281+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94813404170528] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.281+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.281+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94813404175600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746a5a0 con 0x563b77463740 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.281+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746af90 con 0x7f8540027060 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.282+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.282+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94813404179056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746b820 con 0x7f8540027060 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.282+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746c2d0 con 0x563b7745d4c0 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.282+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94813404175600] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.283+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.283+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94813404184016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746c290 con 0x563b7745d4c0 2024-02-15T22:56:46.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.283+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746cd00 con 0x7f85440141d0 2024-02-15T22:56:46.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.283+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94813404179056] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.284+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94813404184016] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.284+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.284+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94813404172080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746c820 con 0x7f85440141d0 2024-02-15T22:56:46.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.284+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746ccc0 con 0x7f85440141d0 2024-02-15T22:56:46.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.285+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94813404172080] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.285+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.285+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94813404181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746cc80 con 0x7f85440141d0 2024-02-15T22:56:46.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.285+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746db60 con 0x7f85440141d0 2024-02-15T22:56:46.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.286+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94813404181312] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.286+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.287+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94813404188848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746db60 con 0x7f85440141d0 2024-02-15T22:56:46.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.287+0000 7f854c9a2800 20 add_watcher() i=0 2024-02-15T22:56:46.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.287+0000 7f854c9a2800 20 add_watcher() i=1 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.287+0000 7f854c9a2800 20 add_watcher() i=2 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.287+0000 7f854c9a2800 20 add_watcher() i=3 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.287+0000 7f854c9a2800 20 add_watcher() i=4 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.287+0000 7f854c9a2800 20 add_watcher() i=5 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.287+0000 7f854c9a2800 20 add_watcher() i=6 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.287+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94813404188848] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.287+0000 7f854c9a2800 20 add_watcher() i=7 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.287+0000 7f854c9a2800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.288+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746db50 con 0x563b7745d4c0 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.288+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.288+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94813404192592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7746e8f0 con 0x563b7745d4c0 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.289+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94813404192592] v32'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.289+0000 7f8400fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.289+0000 7f854c9a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.289+0000 7f854c9a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.289+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77470eb0 con 0x563b7745d4c0 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.290+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.290+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747a3c0 con 0x7f85440141d0 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.292+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.292+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747a8f0 con 0x563b77463740 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.292+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.293+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747b2c0 con 0x563b7745d4c0 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.293+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'158 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.293+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747b2c0 con 0x7f8540027060 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.294+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'47 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.294+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747b7f0 con 0x563b77463740 2024-02-15T22:56:46.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.295+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'31 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.295+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747c1c0 con 0x563b7745d4c0 2024-02-15T22:56:46.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.296+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.296+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747c250 con 0x7f85440141d0 2024-02-15T22:56:46.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.297+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'31 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.297+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747c2e0 con 0x7f8540027060 2024-02-15T22:56:46.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.298+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.298+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747c830 con 0x563b77463740 2024-02-15T22:56:46.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.299+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.299+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747d030 con 0x7f8540027060 2024-02-15T22:56:46.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.300+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'48 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.300+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77479900 con 0x7f85440141d0 2024-02-15T22:56:46.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.301+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.301+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77479ef0 con 0x7f8540027060 2024-02-15T22:56:46.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.302+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.302+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77479ef0 con 0x7f85440141d0 2024-02-15T22:56:46.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.303+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'37 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.303+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77479730 con 0x563b7745d4c0 2024-02-15T22:56:46.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.304+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'159 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.304+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77479730 con 0x563b77463740 2024-02-15T22:56:46.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.305+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'41 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.305+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b77479730 con 0x7f8540027060 2024-02-15T22:56:46.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.306+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'49 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.306+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x563b77463740 2024-02-15T22:56:46.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.307+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.307+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x563b7745d4c0 2024-02-15T22:56:46.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.308+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'27 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.308+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x563b7745d4c0 2024-02-15T22:56:46.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.309+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'160 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.309+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x563b77463740 2024-02-15T22:56:46.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.310+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.310+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x7f8540027060 2024-02-15T22:56:46.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.311+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.311+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x563b77463740 2024-02-15T22:56:46.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.312+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.312+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x563b77463740 2024-02-15T22:56:46.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.313+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.313+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x563b77463740 2024-02-15T22:56:46.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.314+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'16 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.314+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x563b77463740 2024-02-15T22:56:46.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.315+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.315+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x7f85440141d0 2024-02-15T22:56:46.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.316+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.316+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x563b77463740 2024-02-15T22:56:46.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.317+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.317+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x7f85440141d0 2024-02-15T22:56:46.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.318+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.318+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x563b77463740 2024-02-15T22:56:46.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.319+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'43 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.319+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x7f85440141d0 2024-02-15T22:56:46.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.320+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'38 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.320+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b7747dba0 con 0x7f8540027060 2024-02-15T22:56:46.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.321+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.321+0000 7f837b7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:46.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.321+0000 7f854c9a2800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:46.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.321+0000 7f854c9a2800 20 Filter name: none 2024-02-15T22:56:46.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.321+0000 7f83797fa640 20 reqs_thread_entry: start 2024-02-15T22:56:46.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.322+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-02-15T22:56:46.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.322+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:94 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.323+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(94 gc.9 [call] v32'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.323+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:95 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.323+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 27 ==== osd_op_reply(95 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.323+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.323+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:96 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x563b77463740 2024-02-15T22:56:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.323+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 28 ==== osd_op_reply(96 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.323+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:97 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.323+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 29 ==== osd_op_reply(97 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.323+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.323+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:98 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.324+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 30 ==== osd_op_reply(98 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.324+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.324+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:99 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.324+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 31 ==== osd_op_reply(99 gc.9 [call] v32'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.324+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-02-15T22:56:46.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.324+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:100 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.325+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(100 gc.10 [call] v32'50 uv50 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.325+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:101 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.326+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(101 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.326+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.326+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:102 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x7f8540027060 2024-02-15T22:56:46.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.326+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(102 gc.10 [call out=24b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.326+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:103 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.326+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 21 ==== osd_op_reply(103 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.326+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.326+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:104 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.326+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 22 ==== osd_op_reply(104 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.326+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.326+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:105 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.327+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 23 ==== osd_op_reply(105 gc.10 [call] v32'51 uv51 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.327+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-02-15T22:56:46.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.327+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:106 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f85440141d0 2024-02-15T22:56:46.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.329+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(106 gc.11 [call] v32'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.329+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:107 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f85440141d0 2024-02-15T22:56:46.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.329+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(107 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.329+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.329+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:108 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x7f85440141d0 2024-02-15T22:56:46.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.330+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(108 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.330+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:109 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f85440141d0 2024-02-15T22:56:46.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.330+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(109 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.330+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.330+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:110 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f85440141d0 2024-02-15T22:56:46.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.330+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(110 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.331+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.331+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:111 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f85440141d0 2024-02-15T22:56:46.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.332+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(111 gc.11 [call] v32'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.332+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-02-15T22:56:46.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.332+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:112 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.333+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 24 ==== osd_op_reply(112 gc.12 [call] v32'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.333+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:113 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.333+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 25 ==== osd_op_reply(113 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.333+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.333+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:114 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x7f8540027060 2024-02-15T22:56:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.333+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 26 ==== osd_op_reply(114 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.333+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:115 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.333+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 27 ==== osd_op_reply(115 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.333+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.333+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:116 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.334+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 28 ==== osd_op_reply(116 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.334+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.334+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:117 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.334+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 29 ==== osd_op_reply(117 gc.12 [call] v32'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.335+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-02-15T22:56:46.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.335+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:118 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f85440141d0 2024-02-15T22:56:46.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.336+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 30 ==== osd_op_reply(118 gc.13 [call] v32'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.336+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:119 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f85440141d0 2024-02-15T22:56:46.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.336+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 31 ==== osd_op_reply(119 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.336+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.336+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:120 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x7f85440141d0 2024-02-15T22:56:46.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.336+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 32 ==== osd_op_reply(120 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.336+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:121 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f85440141d0 2024-02-15T22:56:46.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.336+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 33 ==== osd_op_reply(121 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.336+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.336+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:122 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f85440141d0 2024-02-15T22:56:46.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.337+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 34 ==== osd_op_reply(122 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.337+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.337+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:123 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f85440141d0 2024-02-15T22:56:46.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.338+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 35 ==== osd_op_reply(123 gc.13 [call] v32'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.338+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-02-15T22:56:46.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.338+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:124 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.339+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(124 gc.14 [call] v32'161 uv161 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.339+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:125 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.339+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(125 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.339+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.339+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:126 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x563b7745d4c0 2024-02-15T22:56:46.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.339+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(126 gc.14 [call out=24b] v0'0 uv161 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.339+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:127 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.339+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(127 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.340+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.340+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:128 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.340+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(128 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.340+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.340+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:129 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.341+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(129 gc.14 [call] v32'162 uv162 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.341+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-02-15T22:56:46.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.341+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:130 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.342+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 32 ==== osd_op_reply(130 gc.15 [call] v32'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.342+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:131 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.342+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 33 ==== osd_op_reply(131 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.342+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.342+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:132 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x563b77463740 2024-02-15T22:56:46.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.342+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 34 ==== osd_op_reply(132 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.342+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:133 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.343+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 35 ==== osd_op_reply(133 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.343+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.343+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:134 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.343+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 36 ==== osd_op_reply(134 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.343+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.343+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:135 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.344+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 37 ==== osd_op_reply(135 gc.15 [call] v32'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.344+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-02-15T22:56:46.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.344+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:136 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.345+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 30 ==== osd_op_reply(136 gc.16 [call] v32'52 uv52 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.345+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:137 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.345+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 31 ==== osd_op_reply(137 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.345+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.345+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:138 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x7f8540027060 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.345+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 32 ==== osd_op_reply(138 gc.16 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.345+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:139 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.346+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 33 ==== osd_op_reply(139 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.346+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.346+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:140 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.346+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 34 ==== osd_op_reply(140 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.346+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.346+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:141 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.347+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 35 ==== osd_op_reply(141 gc.16 [call] v32'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.347+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-02-15T22:56:46.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.347+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:142 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.348+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 38 ==== osd_op_reply(142 gc.17 [call] v32'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.348+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:143 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.348+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 39 ==== osd_op_reply(143 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.348+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.348+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:144 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x563b77463740 2024-02-15T22:56:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.348+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 40 ==== osd_op_reply(144 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.348+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.348+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 41 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.348+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.348+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.349+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 42 ==== osd_op_reply(146 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.349+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.349+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.349+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 43 ==== osd_op_reply(147 gc.17 [call] v32'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.350+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-02-15T22:56:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.350+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.351+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(148 gc.18 [call] v32'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.351+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.351+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 36 ==== osd_op_reply(149 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.351+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.351+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x563b7745d4c0 2024-02-15T22:56:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.351+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 37 ==== osd_op_reply(150 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.351+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:151 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.351+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 38 ==== osd_op_reply(151 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.351+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.351+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:152 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.352+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 39 ==== osd_op_reply(152 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.352+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.352+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:153 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.353+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 40 ==== osd_op_reply(153 gc.18 [call] v32'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.353+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-02-15T22:56:46.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.353+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:154 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.354+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 41 ==== osd_op_reply(154 gc.19 [call] v32'163 uv163 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.354+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:155 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.354+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 42 ==== osd_op_reply(155 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.354+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.354+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:156 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x563b7745d4c0 2024-02-15T22:56:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.354+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 43 ==== osd_op_reply(156 gc.19 [call out=24b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.354+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:157 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.354+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 44 ==== osd_op_reply(157 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.355+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.355+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:158 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.355+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 45 ==== osd_op_reply(158 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.355+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.355+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:159 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b7745d4c0 2024-02-15T22:56:46.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.356+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 46 ==== osd_op_reply(159 gc.19 [call] v32'164 uv164 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.356+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-02-15T22:56:46.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.356+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:160 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.357+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 44 ==== osd_op_reply(160 gc.20 [call] v32'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.357+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:161 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.357+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 45 ==== osd_op_reply(161 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.357+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.357+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:162 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x563b77463740 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.357+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 46 ==== osd_op_reply(162 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.357+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:163 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.358+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 47 ==== osd_op_reply(163 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.358+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.358+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:164 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.358+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 48 ==== osd_op_reply(164 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.358+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.358+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:165 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.359+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 49 ==== osd_op_reply(165 gc.20 [call] v32'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.359+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-02-15T22:56:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.359+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:166 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.360+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 36 ==== osd_op_reply(166 gc.21 [call] v32'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.360+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:167 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.360+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 37 ==== osd_op_reply(167 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.360+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.360+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:168 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x7f8540027060 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.360+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 38 ==== osd_op_reply(168 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.360+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:169 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.361+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 39 ==== osd_op_reply(169 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.361+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.361+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:170 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.361+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 40 ==== osd_op_reply(170 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.361+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.361+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:171 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x7f8540027060 2024-02-15T22:56:46.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.362+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 41 ==== osd_op_reply(171 gc.21 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.362+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-02-15T22:56:46.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.362+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:172 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.363+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 50 ==== osd_op_reply(172 gc.22 [call] v32'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.363+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:173 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.363+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 51 ==== osd_op_reply(173 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.363+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.363+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:174 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x563b77463740 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.363+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 52 ==== osd_op_reply(174 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.363+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:175 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.364+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 53 ==== osd_op_reply(175 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.364+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.364+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:176 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.364+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 54 ==== osd_op_reply(176 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.364+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.364+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:177 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.365+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 55 ==== osd_op_reply(177 gc.22 [call] v32'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.365+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-02-15T22:56:46.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.365+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:178 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.366+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 56 ==== osd_op_reply(178 gc.23 [call] v32'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.366+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:179 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.366+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 57 ==== osd_op_reply(179 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.366+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.366+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:180 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x563b77463740 2024-02-15T22:56:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.366+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 58 ==== osd_op_reply(180 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.366+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:181 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.366+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 59 ==== osd_op_reply(181 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.366+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.366+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:182 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.367+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 60 ==== osd_op_reply(182 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.367+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.367+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:183 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.368+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 61 ==== osd_op_reply(183 gc.23 [call] v32'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.368+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-02-15T22:56:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.368+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:184 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.369+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 62 ==== osd_op_reply(184 gc.24 [call] v32'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.369+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:185 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.369+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 63 ==== osd_op_reply(185 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.369+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.369+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:186 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7a60 con 0x563b77463740 2024-02-15T22:56:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.369+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 64 ==== osd_op_reply(186 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.369+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:187 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.369+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 65 ==== osd_op_reply(187 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.369+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.369+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:188 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8a70 con 0x563b77463740 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 66 ==== osd_op_reply(188 gc.24 [call out=1701b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+1701 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 20 garbage collection: RGWGC::process iterating over entry tag='b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5785048098609248903', time=2024-02-15T22:56:45.998350+0000, chain.objs.size()=7 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_1 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:189 3.2f 3:f6183269:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a8ca0 con 0x563b77463740 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_2 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:190 3.1f 3:fb346775:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774ab7c0 con 0x563b7745d4c0 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_3 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:191 3.f 3:f1f74640:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774ae040 con 0x7f8540027060 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_4 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:192 3.0 3:00b1d1e7:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774b09c0 con 0x7f85440141d0 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_5 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:193 3.7 3:e06c0064:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774b09c0 con 0x563b77463740 2024-02-15T22:56:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_6 2024-02-15T22:56:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:194 3.2f 3:f6e5b09e:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774b5760 con 0x563b77463740 2024-02-15T22:56:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_7 2024-02-15T22:56:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.370+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:195 3.8 3:131fc996:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774b8290 con 0x563b77463740 2024-02-15T22:56:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.373+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 47 ==== osd_op_reply(190 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_2 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.373+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 36 ==== osd_op_reply(192 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_4 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.373+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 42 ==== osd_op_reply(191 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_3 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.373+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 67 ==== osd_op_reply(195 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_7 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.373+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 68 ==== osd_op_reply(193 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_5 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.374+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 69 ==== osd_op_reply(189 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_1 [call] v32'3 uv3 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.374+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 70 ==== osd_op_reply(194 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1__shadow_.ct4IdAKZ-msmt70iMw0z2riiuQwZYFs_6 [call] v32'4 uv4 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.374+0000 7f854c9a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-15T22:56:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.374+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:196 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774b8290 con 0x563b77463740 2024-02-15T22:56:46.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.375+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 71 ==== osd_op_reply(196 gc.24 [call] v32'18 uv18 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.375+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:197 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774b8290 con 0x563b77463740 2024-02-15T22:56:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.376+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 72 ==== osd_op_reply(197 gc.24 [call] v32'19 uv19 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.376+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-02-15T22:56:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.376+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:198 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774b8290 con 0x563b77463740 2024-02-15T22:56:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.377+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 73 ==== osd_op_reply(198 gc.25 [call] v32'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.377+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:199 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774b8290 con 0x563b77463740 2024-02-15T22:56:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.378+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 74 ==== osd_op_reply(199 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.378+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.378+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:200 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774b8290 con 0x563b77463740 2024-02-15T22:56:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.378+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 75 ==== osd_op_reply(200 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.378+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:201 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a6720 con 0x563b77463740 2024-02-15T22:56:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.378+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 76 ==== osd_op_reply(201 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.378+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.378+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:202 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a6720 con 0x563b77463740 2024-02-15T22:56:46.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.378+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 77 ==== osd_op_reply(202 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.378+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.378+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:203 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a6720 con 0x563b77463740 2024-02-15T22:56:46.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.379+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 78 ==== osd_op_reply(203 gc.25 [call] v32'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.379+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-02-15T22:56:46.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.379+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:204 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a6720 con 0x7f85440141d0 2024-02-15T22:56:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.381+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 37 ==== osd_op_reply(204 gc.26 [call] v32'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.381+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:205 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a6720 con 0x7f85440141d0 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.381+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 38 ==== osd_op_reply(205 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.381+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.381+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:206 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aa620 con 0x7f85440141d0 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.381+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 39 ==== osd_op_reply(206 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.381+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:207 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a9170 con 0x7f85440141d0 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.381+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 40 ==== osd_op_reply(207 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.382+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.382+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:208 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.382+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 41 ==== osd_op_reply(208 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.382+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.382+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:209 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.383+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 42 ==== osd_op_reply(209 gc.26 [call] v32'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.383+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-02-15T22:56:46.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.383+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:210 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.384+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 79 ==== osd_op_reply(210 gc.27 [call] v32'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.384+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:211 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.384+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 80 ==== osd_op_reply(211 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.384+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.384+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:212 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.384+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 81 ==== osd_op_reply(212 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.384+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:213 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.385+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 82 ==== osd_op_reply(213 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.385+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.385+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:214 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.385+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 83 ==== osd_op_reply(214 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.385+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.385+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:215 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.386+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 84 ==== osd_op_reply(215 gc.27 [call] v32'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.386+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-02-15T22:56:46.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.386+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:216 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.387+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 43 ==== osd_op_reply(216 gc.28 [call] v32'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.387+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:217 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.387+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 44 ==== osd_op_reply(217 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.387+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.387+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:218 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.388+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 45 ==== osd_op_reply(218 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.388+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:219 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.388+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 46 ==== osd_op_reply(219 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.388+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.388+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:220 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.388+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 47 ==== osd_op_reply(220 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.388+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.388+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:221 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.389+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 48 ==== osd_op_reply(221 gc.28 [call] v32'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.389+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.389+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:222 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.390+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 85 ==== osd_op_reply(222 gc.29 [call] v32'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.390+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:223 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.390+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 86 ==== osd_op_reply(223 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.390+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.390+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:224 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.391+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 87 ==== osd_op_reply(224 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.391+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:225 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.391+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 88 ==== osd_op_reply(225 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.391+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.391+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:226 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.391+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 89 ==== osd_op_reply(226 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.391+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.391+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:227 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.392+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 90 ==== osd_op_reply(227 gc.29 [call] v32'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.392+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-02-15T22:56:46.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.392+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:228 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.393+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 49 ==== osd_op_reply(228 gc.30 [call] v32'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.393+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:229 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.394+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 50 ==== osd_op_reply(229 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.394+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.394+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:230 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.394+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 51 ==== osd_op_reply(230 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.394+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:231 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.394+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 52 ==== osd_op_reply(231 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.394+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.394+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:232 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.394+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 53 ==== osd_op_reply(232 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.394+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.394+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:233 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.395+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 54 ==== osd_op_reply(233 gc.30 [call] v32'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.395+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-02-15T22:56:46.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.395+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:234 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.396+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 43 ==== osd_op_reply(234 gc.31 [call] v32'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.396+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:235 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.397+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 44 ==== osd_op_reply(235 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.397+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.397+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:236 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.397+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 45 ==== osd_op_reply(236 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.397+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:237 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.397+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 46 ==== osd_op_reply(237 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.397+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.397+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:238 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.397+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 47 ==== osd_op_reply(238 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.397+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.397+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:239 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.398+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 48 ==== osd_op_reply(239 gc.31 [call] v32'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.398+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-02-15T22:56:46.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.398+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:240 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.400+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 48 ==== osd_op_reply(240 gc.0 [call] v32'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.400+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:241 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.400+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 49 ==== osd_op_reply(241 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.400+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.400+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:242 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.400+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 50 ==== osd_op_reply(242 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.400+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:243 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.401+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 51 ==== osd_op_reply(243 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.401+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.401+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:244 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.401+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 52 ==== osd_op_reply(244 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.401+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.401+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:245 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.402+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 53 ==== osd_op_reply(245 gc.0 [call] v32'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.402+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-02-15T22:56:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.402+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:246 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.403+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 55 ==== osd_op_reply(246 gc.1 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.403+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:247 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.403+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 56 ==== osd_op_reply(247 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.403+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.403+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:248 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.404+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 57 ==== osd_op_reply(248 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.404+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:249 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.404+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 58 ==== osd_op_reply(249 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.404+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.404+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:250 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.404+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 59 ==== osd_op_reply(250 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.404+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.404+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:251 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.405+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 60 ==== osd_op_reply(251 gc.1 [call] v32'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.405+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-02-15T22:56:46.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.405+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:252 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.406+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 91 ==== osd_op_reply(252 gc.2 [call] v32'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.406+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:253 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.406+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 92 ==== osd_op_reply(253 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.406+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.406+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:254 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.407+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 93 ==== osd_op_reply(254 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.407+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:255 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.407+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 94 ==== osd_op_reply(255 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.407+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.407+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:256 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.407+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 95 ==== osd_op_reply(256 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.407+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.407+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:257 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.408+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 96 ==== osd_op_reply(257 gc.2 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.408+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.408+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:258 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.409+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 54 ==== osd_op_reply(258 gc.3 [call] v32'165 uv165 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.409+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:259 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.409+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 55 ==== osd_op_reply(259 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.409+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.409+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:260 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.410+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 56 ==== osd_op_reply(260 gc.3 [call out=24b] v0'0 uv165 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.410+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:261 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.410+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 57 ==== osd_op_reply(261 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.410+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.410+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:262 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.410+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 58 ==== osd_op_reply(262 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.410+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.410+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:263 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.411+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 59 ==== osd_op_reply(263 gc.3 [call] v32'166 uv166 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.411+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.411+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:264 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.412+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 49 ==== osd_op_reply(264 gc.4 [call] v32'54 uv54 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.412+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:265 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.412+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 50 ==== osd_op_reply(265 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.412+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.412+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:266 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.412+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 51 ==== osd_op_reply(266 gc.4 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.412+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:267 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.413+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 52 ==== osd_op_reply(267 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.413+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.413+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:268 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.413+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 53 ==== osd_op_reply(268 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.413+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.413+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:269 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.414+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 54 ==== osd_op_reply(269 gc.4 [call] v32'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.414+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-02-15T22:56:46.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.414+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:270 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.415+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 97 ==== osd_op_reply(270 gc.5 [call] v32'35 uv35 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.415+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:271 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.415+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 98 ==== osd_op_reply(271 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.415+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.415+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:272 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.415+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 99 ==== osd_op_reply(272 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.415+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:273 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.416+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 100 ==== osd_op_reply(273 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.416+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.416+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:274 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774a7bd0 con 0x563b77463740 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.416+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 101 ==== osd_op_reply(274 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.416+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.416+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:275 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.417+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 102 ==== osd_op_reply(275 gc.5 [call] v32'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.417+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-02-15T22:56:46.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.417+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:276 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.418+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 60 ==== osd_op_reply(276 gc.6 [call] v32'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.418+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:277 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.418+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 61 ==== osd_op_reply(277 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.418+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.418+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:278 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.418+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 62 ==== osd_op_reply(278 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.418+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:279 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.419+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 63 ==== osd_op_reply(279 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.419+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.419+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:280 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.419+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 64 ==== osd_op_reply(280 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.419+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.419+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:281 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.420+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 65 ==== osd_op_reply(281 gc.6 [call] v32'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.420+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.420+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:282 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.421+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 61 ==== osd_op_reply(282 gc.7 [call] v32'35 uv35 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.421+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:283 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.421+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 62 ==== osd_op_reply(283 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.421+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.421+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:284 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.421+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 63 ==== osd_op_reply(284 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.421+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:285 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.422+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 64 ==== osd_op_reply(285 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.422+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.422+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:286 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.422+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 65 ==== osd_op_reply(286 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.422+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.422+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:287 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.423+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 66 ==== osd_op_reply(287 gc.7 [call] v32'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.423+0000 7f854c9a2800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.423+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:288 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.424+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 55 ==== osd_op_reply(288 gc.8 [call] v32'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.424+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:289 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.424+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 56 ==== osd_op_reply(289 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.424+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.424+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:290 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.424+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 57 ==== osd_op_reply(290 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.424+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:291 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.425+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 58 ==== osd_op_reply(291 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.425+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:56:46.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.425+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:292 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.425+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 59 ==== osd_op_reply(292 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.425+0000 7f854c9a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:56:46.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.425+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:293 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.426+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 60 ==== osd_op_reply(293 gc.8 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.427+0000 7f8400fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:46.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.427+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94813404192592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.428+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94813404192592] v32'167 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.428+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94813404165472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.428+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 61 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94813404165472] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.429+0000 7f854c9a2800 20 remove_watcher() i=0 2024-02-15T22:56:46.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.429+0000 7f854c9a2800 2 removed watcher, disabling cache 2024-02-15T22:56:46.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.429+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94813404170528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.430+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94813404170528] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.430+0000 7f854c9a2800 20 remove_watcher() i=1 2024-02-15T22:56:46.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.430+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94813404175600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b77463740 2024-02-15T22:56:46.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.431+0000 7f8549ca0640 1 -- 172.21.15.133:0/871475655 <== osd.3 v2:172.21.15.133:6816/1065500544 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94813404175600] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f854004bdb0 con 0x563b77463740 2024-02-15T22:56:46.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.431+0000 7f854c9a2800 20 remove_watcher() i=2 2024-02-15T22:56:46.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.431+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94813404179056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f8540027060 2024-02-15T22:56:46.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.432+0000 7f854aca2640 1 -- 172.21.15.133:0/871475655 <== osd.2 v2:172.21.15.133:6800/2073628168 62 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94813404179056] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f854403a040 con 0x7f8540027060 2024-02-15T22:56:46.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.432+0000 7f854c9a2800 20 remove_watcher() i=3 2024-02-15T22:56:46.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.432+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94813404184016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x563b7745d4c0 2024-02-15T22:56:46.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.433+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.1 v2:172.21.15.133:6808/2671624067 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94813404184016] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x563b7745d4c0 2024-02-15T22:56:46.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.433+0000 7f854c9a2800 20 remove_watcher() i=4 2024-02-15T22:56:46.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.433+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94813404172080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.434+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94813404172080] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.434+0000 7f854c9a2800 20 remove_watcher() i=5 2024-02-15T22:56:46.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.434+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94813404181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.435+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94813404181312] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.435+0000 7f854c9a2800 20 remove_watcher() i=6 2024-02-15T22:56:46.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.435+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94813404188848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b774aba20 con 0x7f85440141d0 2024-02-15T22:56:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 <== osd.0 v2:172.21.15.52:6800/431200118 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94813404188848] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f853c096060 con 0x7f85440141d0 2024-02-15T22:56:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 20 remove_watcher() i=7 2024-02-15T22:56:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f85440141d0 msgr2=0x7f8544015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f85440141d0 0x7f8544015940 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563b7745d4c0 msgr2=0x563b7745f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563b7745d4c0 0x563b7745f980 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f8540027060 msgr2=0x7f8540027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f8540027060 0x7f8540027440 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563b77463740 msgr2=0x563b77465be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x563b77463740 0x563b77465be0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8414036740 msgr2=0x7f8414038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8414036740 0x7f8414038c00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f854400b010 tx=0x7f8544020000 comp rx=0 tx=0).stop 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 msgr2=0x563b774516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b774516b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8540048040 tx=0x7f854004b930 comp rx=0 tx=0).stop 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854a4a1640 1 -- 172.21.15.133:0/871475655 reap_dead start 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 shutdown_connections 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 --2- 172.21.15.133:0/871475655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7744a6a0 0x563b774516b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 >> 172.21.15.133:0/871475655 conn(0x563b77446a00 msgr2=0x563b77444060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 shutdown_connections 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/871475655 wait complete. 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/1771949134 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84240367e0 msgr2=0x7f8424038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 --2- 172.21.15.133:0/1771949134 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84240367e0 0x7f8424038ca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x563b7742b6f0 tx=0x7f8544005840 comp rx=0 tx=0).stop 2024-02-15T22:56:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/1771949134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732c610 msgr2=0x563b7732aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 --2- 172.21.15.133:0/1771949134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732c610 0x563b7732aa80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f854000e610 tx=0x7f854000ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/1771949134 shutdown_connections 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 --2- 172.21.15.133:0/1771949134 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84240367e0 0x7f8424038ca0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 --2- 172.21.15.133:0/1771949134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732c610 0x563b7732aa80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.436+0000 7f854c9a2800 1 -- 172.21.15.133:0/1771949134 >> 172.21.15.133:0/1771949134 conn(0x563b7742f320 msgr2=0x563b7742f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 -- 172.21.15.133:0/1771949134 shutdown_connections 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 -- 172.21.15.133:0/1771949134 wait complete. 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563b774281f0 msgr2=0x563b7742a5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563b774281f0 0x563b7742a5e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8430036790 msgr2=0x7f8430038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8430036790 0x7f8430038c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8540000c00 tx=0x7f85400013b0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 msgr2=0x563b77423420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b77423420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f853c0448c0 tx=0x7f853c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 shutdown_connections 2024-02-15T22:56:46.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x563b774281f0 0x563b7742a5e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8430036790 0x7f8430038c50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 --2- 172.21.15.133:0/3978477354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b7732f3a0 0x563b77423420 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 >> 172.21.15.133:0/3978477354 conn(0x563b773264c0 msgr2=0x563b7741a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 shutdown_connections 2024-02-15T22:56:46.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.437+0000 7f854c9a2800 1 -- 172.21.15.133:0/3978477354 wait complete. 2024-02-15T22:56:46.447 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-15T22:56:46.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-15T22:56:46.448 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-15T22:56:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:46.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.527+0000 7f47a3f4b800 1 Processor -- start 2024-02-15T22:56:46.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.527+0000 7f47a3f4b800 1 -- start start 2024-02-15T22:56:46.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.527+0000 7f47a3f4b800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a03c40a4b0 0x55a03c40c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.527+0000 7f47a3f4b800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a03c350bb0 con 0x55a03c406020 2024-02-15T22:56:46.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.527+0000 7f47a3f4b800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a03c308450 con 0x55a03c40a4b0 2024-02-15T22:56:46.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.527+0000 7f479bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a03c40a4b0 0x55a03c40c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.527+0000 7f479bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a03c40a4b0 0x55a03c40c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53874/0 (socket says 172.21.15.133:53874) 2024-02-15T22:56:46.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.528+0000 7f479bfff640 1 -- 172.21.15.133:0/2345716090 learned_addr learned my addr 172.21.15.133:0/2345716090 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.527+0000 7f47a1a51640 1 --1- 172.21.15.133:0/2345716090 >> v1:172.21.15.52:6789/0 conn(0x55a03c406020 0x55a03c406440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:56496/0 (socket says 172.21.15.133:56496) 2024-02-15T22:56:46.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.528+0000 7f479bfff640 1 -- 172.21.15.133:0/2345716090 >> v1:172.21.15.52:6789/0 conn(0x55a03c406020 legacy=0x55a03c406440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.528+0000 7f479bfff640 1 -- 172.21.15.133:0/2345716090 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a03c40ded0 con 0x55a03c40a4b0 2024-02-15T22:56:46.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.530+0000 7f479bfff640 1 --2- 172.21.15.133:0/2345716090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c40a4b0 0x55a03c40c8a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f478c00a520 tx=0x7f478c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e444f43344e86c06 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.530+0000 7f47a1250640 1 -- 172.21.15.133:0/2345716090 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c052570 con 0x55a03c40a4b0 2024-02-15T22:56:46.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.530+0000 7f47a1250640 1 -- 172.21.15.133:0/2345716090 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c0526d0 con 0x55a03c40a4b0 2024-02-15T22:56:46.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.530+0000 7f47a1250640 1 -- 172.21.15.133:0/2345716090 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c052990 con 0x55a03c40a4b0 2024-02-15T22:56:46.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.530+0000 7f47a3f4b800 1 -- 172.21.15.133:0/2345716090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c40a4b0 msgr2=0x55a03c40c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.530+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/2345716090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c40a4b0 0x55a03c40c8a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f478c00a520 tx=0x7f478c01cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.530+0000 7f47a3f4b800 1 -- 172.21.15.133:0/2345716090 shutdown_connections 2024-02-15T22:56:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.530+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/2345716090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c40a4b0 0x55a03c40c8a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.530+0000 7f47a3f4b800 1 -- 172.21.15.133:0/2345716090 >> 172.21.15.133:0/2345716090 conn(0x55a03c4015c0 msgr2=0x55a03c4039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.530+0000 7f47a3f4b800 1 -- 172.21.15.133:0/2345716090 shutdown_connections 2024-02-15T22:56:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.530+0000 7f47a3f4b800 1 -- 172.21.15.133:0/2345716090 wait complete. 2024-02-15T22:56:46.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.542+0000 7f47a3f4b800 1 Processor -- start 2024-02-15T22:56:46.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.542+0000 7f47a3f4b800 1 -- start start 2024-02-15T22:56:46.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.542+0000 7f47a3f4b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c37b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.542+0000 7f47a3f4b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a03c305980 con 0x55a03c406020 2024-02-15T22:56:46.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.542+0000 7f47a1a51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c37b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.542+0000 7f47a1a51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c37b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53888/0 (socket says 172.21.15.133:53888) 2024-02-15T22:56:46.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.542+0000 7f47a1a51640 1 -- 172.21.15.133:0/1210824259 learned_addr learned my addr 172.21.15.133:0/1210824259 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.542+0000 7f47a1a51640 1 -- 172.21.15.133:0/1210824259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c005de0 con 0x55a03c406020 2024-02-15T22:56:46.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.543+0000 7f47a1a51640 1 --2- 172.21.15.133:0/1210824259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c37b050 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4794001cb0 tx=0x7f479400b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa99d3fba7f50e09 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.543+0000 7f468fe07640 1 -- 172.21.15.133:0/1210824259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4794014070 con 0x55a03c406020 2024-02-15T22:56:46.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.543+0000 7f468fe07640 1 -- 172.21.15.133:0/1210824259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479400f450 con 0x55a03c406020 2024-02-15T22:56:46.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.543+0000 7f468fe07640 1 -- 172.21.15.133:0/1210824259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f479400f750 con 0x55a03c406020 2024-02-15T22:56:46.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.543+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1210824259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 msgr2=0x55a03c37b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.543+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/1210824259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c37b050 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4794001cb0 tx=0x7f479400b600 comp rx=0 tx=0).stop 2024-02-15T22:56:46.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.543+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1210824259 shutdown_connections 2024-02-15T22:56:46.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.543+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/1210824259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c37b050 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.543+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1210824259 >> 172.21.15.133:0/1210824259 conn(0x55a03c4015c0 msgr2=0x55a03c4f18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.544+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1210824259 shutdown_connections 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.544+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1210824259 wait complete. 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.544+0000 7f47a3f4b800 1 Processor -- start 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.544+0000 7f47a3f4b800 1 -- start start 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.544+0000 7f47a3f4b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c4ff870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.544+0000 7f47a3f4b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a03c301160 con 0x55a03c406020 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.544+0000 7f47a1a51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c4ff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.544+0000 7f47a1a51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c4ff870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53902/0 (socket says 172.21.15.133:53902) 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.544+0000 7f47a1a51640 1 -- 172.21.15.133:0/1690508029 learned_addr learned my addr 172.21.15.133:0/1690508029 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.544+0000 7f47a1a51640 1 -- 172.21.15.133:0/1690508029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a03c350bb0 con 0x55a03c406020 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.545+0000 7f47a1a51640 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c4ff870 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4794004000 tx=0x7f4794000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.545+0000 7f468e604640 1 -- 172.21.15.133:0/1690508029 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4794014070 con 0x55a03c406020 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.545+0000 7f468e604640 1 -- 172.21.15.133:0/1690508029 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4794020070 con 0x55a03c406020 2024-02-15T22:56:46.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.545+0000 7f468e604640 1 -- 172.21.15.133:0/1690508029 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47940199e0 con 0x55a03c406020 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.545+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a03c4ffdb0 con 0x55a03c406020 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.545+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a03c500290 con 0x55a03c406020 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.546+0000 7f468e604640 1 -- 172.21.15.133:0/1690508029 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4794019c50 con 0x55a03c406020 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.546+0000 7f468e604640 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4688036790 0x7f4688038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.546+0000 7f468e604640 1 -- 172.21.15.133:0/1690508029 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f4794008030 con 0x55a03c406020 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.546+0000 7f479bfff640 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4688036790 0x7f4688038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.546+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a03c40a4b0 0x55a03c506600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.546+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c506bd0 con 0x55a03c40a4b0 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.546+0000 7f47a2252640 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a03c40a4b0 0x55a03c506600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.546+0000 7f479bfff640 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4688036790 0x7f4688038c50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f478c054000 tx=0x7f478c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.546+0000 7f47a2252640 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a03c40a4b0 0x55a03c506600 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.547+0000 7f47a2252640 1 -- 172.21.15.133:0/1690508029 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f479c00a4a0 con 0x55a03c40a4b0 2024-02-15T22:56:46.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.547+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c503c60 con 0x55a03c40a4b0 2024-02-15T22:56:46.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.547+0000 7f47a2252640 1 -- 172.21.15.133:0/1690508029 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f479c00a4a0 con 0x55a03c40a4b0 2024-02-15T22:56:46.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.547+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c508900 con 0x55a03c40a4b0 2024-02-15T22:56:46.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.547+0000 7f47a2252640 1 -- 172.21.15.133:0/1690508029 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f479c00a4a0 con 0x55a03c40a4b0 2024-02-15T22:56:46.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.547+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c507b00 con 0x55a03c40a4b0 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.548+0000 7f47a2252640 1 -- 172.21.15.133:0/1690508029 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f479c00a4a0 con 0x55a03c40a4b0 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.548+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c507f10 con 0x55a03c40a4b0 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.548+0000 7f47a2252640 1 -- 172.21.15.133:0/1690508029 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f479c00a4a0 con 0x55a03c40a4b0 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.548+0000 7f47a3f4b800 1 Processor -- start 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.548+0000 7f47a3f4b800 1 -- start start 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.548+0000 7f47a3f4b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c517380 0x55a03c5177a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.548+0000 7f47a3f4b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a03c2a3e80 con 0x55a03c517380 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.549+0000 7f479bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c517380 0x55a03c5177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.549+0000 7f479bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c517380 0x55a03c5177a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53916/0 (socket says 172.21.15.133:53916) 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.549+0000 7f479bfff640 1 -- 172.21.15.133:0/745952213 learned_addr learned my addr 172.21.15.133:0/745952213 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.549+0000 7f479bfff640 1 -- 172.21.15.133:0/745952213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a03c517ce0 con 0x55a03c517380 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.549+0000 7f479bfff640 1 --2- 172.21.15.133:0/745952213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c517380 0x55a03c5177a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f478c044940 tx=0x7f478c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.549+0000 7f46877fe640 1 -- 172.21.15.133:0/745952213 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c05dc30 con 0x55a03c517380 2024-02-15T22:56:46.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.549+0000 7f46877fe640 1 -- 172.21.15.133:0/745952213 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c064040 con 0x55a03c517380 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.549+0000 7f47a3f4b800 1 -- 172.21.15.133:0/745952213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a03c517ed0 con 0x55a03c517380 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.549+0000 7f46877fe640 1 -- 172.21.15.133:0/745952213 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c0683f0 con 0x55a03c517380 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.550+0000 7f47a3f4b800 1 -- 172.21.15.133:0/745952213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a03c518a20 con 0x55a03c517380 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.550+0000 7f46877fe640 1 -- 172.21.15.133:0/745952213 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f478c059040 con 0x55a03c517380 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.550+0000 7f46877fe640 1 --2- 172.21.15.133:0/745952213 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f467c036790 0x7f467c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.550+0000 7f46877fe640 1 -- 172.21.15.133:0/745952213 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f478c08f450 con 0x55a03c517380 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.550+0000 7f47a2252640 1 --2- 172.21.15.133:0/745952213 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f467c036790 0x7f467c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.551+0000 7f47a3f4b800 1 Processor -- start 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.551+0000 7f47a2252640 1 --2- 172.21.15.133:0/745952213 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f467c036790 0x7f467c038c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55a03c507540 tx=0x7f479c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.551+0000 7f47a3f4b800 1 -- start start 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.551+0000 7f47a3f4b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c524990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.551+0000 7f47a3f4b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a03c2795d0 con 0x55a03c524570 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.551+0000 7f479bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c524990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.551+0000 7f479bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c524990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53930/0 (socket says 172.21.15.133:53930) 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.551+0000 7f479bfff640 1 -- 172.21.15.133:0/325408341 learned_addr learned my addr 172.21.15.133:0/325408341 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.551+0000 7f479bfff640 1 -- 172.21.15.133:0/325408341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a03c524f60 con 0x55a03c524570 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.552+0000 7f479bfff640 1 --2- 172.21.15.133:0/325408341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c524990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f478c08d830 tx=0x7f478c006380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed83f0412c1e618 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.552+0000 7f46857fa640 1 -- 172.21.15.133:0/325408341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c08f070 con 0x55a03c524570 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.552+0000 7f46857fa640 1 -- 172.21.15.133:0/325408341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c08f1d0 con 0x55a03c524570 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.552+0000 7f46857fa640 1 -- 172.21.15.133:0/325408341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c006af0 con 0x55a03c524570 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.552+0000 7f47a3f4b800 1 -- 172.21.15.133:0/325408341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 msgr2=0x55a03c524990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.552+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/325408341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c524990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f478c08d830 tx=0x7f478c006380 comp rx=0 tx=0).stop 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.552+0000 7f47a3f4b800 1 -- 172.21.15.133:0/325408341 shutdown_connections 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.552+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/325408341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c524990 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.552+0000 7f47a3f4b800 1 -- 172.21.15.133:0/325408341 >> 172.21.15.133:0/325408341 conn(0x55a03c5208d0 msgr2=0x55a03c51e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.552+0000 7f47a3f4b800 1 -- 172.21.15.133:0/325408341 shutdown_connections 2024-02-15T22:56:46.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.552+0000 7f47a3f4b800 1 -- 172.21.15.133:0/325408341 wait complete. 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.553+0000 7f47a3f4b800 1 Processor -- start 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.553+0000 7f47a3f4b800 1 -- start start 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.553+0000 7f47a3f4b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c52b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.553+0000 7f47a3f4b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a03c52ba90 con 0x55a03c524570 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.553+0000 7f479bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c52b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.553+0000 7f479bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c52b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53942/0 (socket says 172.21.15.133:53942) 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.553+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 learned_addr learned my addr 172.21.15.133:0/3844431718 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.553+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a03c518a20 con 0x55a03c524570 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.554+0000 7f479bfff640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c52b550 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f478c006900 tx=0x7f478c08d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.554+0000 7f46737fe640 1 -- 172.21.15.133:0/3844431718 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c08f070 con 0x55a03c524570 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.554+0000 7f46737fe640 1 -- 172.21.15.133:0/3844431718 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c006ea0 con 0x55a03c524570 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.554+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a03c52bc90 con 0x55a03c524570 2024-02-15T22:56:46.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.554+0000 7f46737fe640 1 -- 172.21.15.133:0/3844431718 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c08c3e0 con 0x55a03c524570 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.554+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a03c52c0f0 con 0x55a03c524570 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.555+0000 7f46737fe640 1 -- 172.21.15.133:0/3844431718 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f478c067350 con 0x55a03c524570 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.555+0000 7f47a3f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.555+0000 7f46737fe640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f466c0367e0 0x7f466c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.555+0000 7f46737fe640 1 -- 172.21.15.133:0/3844431718 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f478c088070 con 0x55a03c524570 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.555+0000 7f47a2252640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f466c0367e0 0x7f466c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.555+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a03c536f70 0x55a03c5393f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.555+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c539b40 con 0x55a03c536f70 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.555+0000 7f47a1a51640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a03c536f70 0x55a03c5393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.555+0000 7f47a2252640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f466c0367e0 0x7f466c038ca0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f479c00b010 tx=0x7f479c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.555+0000 7f47a1a51640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a03c536f70 0x55a03c5393f0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4794016070 con 0x55a03c536f70 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 20 realm 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c539f10 con 0x55a03c536f70 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4794016070 con 0x55a03c536f70 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53a760 con 0x55a03c536f70 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4794016070 con 0x55a03c536f70 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53aac0 con 0x55a03c536f70 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4794016070 con 0x55a03c536f70 2024-02-15T22:56:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53b2c0 con 0x55a03c536f70 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4794016070 con 0x55a03c536f70 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.556+0000 7f47a3f4b800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.557+0000 7f47a3f4b800 20 searching for the correct realm 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.557+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a03c53cfe0 0x55a03c53f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.557+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c53cfe0 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.557+0000 7f479bfff640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a03c53cfe0 0x55a03c53f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.557+0000 7f479bfff640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a03c53cfe0 0x55a03c53f3d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.557+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.557+0000 7f479bfff640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f478c087040 0x7f478c08f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.557+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f478c087040 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.557+0000 7f47a2252640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f478c087040 0x7f478c08f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.558+0000 7f47a2252640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f478c087040 0x7f478c08f730 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.558+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f479c00a4a0 con 0x7f478c087040 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.558+0000 7f47a2252640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f479c0141d0 0x7f479c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.558+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f479c0141d0 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.558+0000 7f47a1a51640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f479c0141d0 0x7f479c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.558+0000 7f47a1a51640 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f479c0141d0 0x7f479c015940 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.559+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794016070 con 0x7f479c0141d0 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.559+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c536f70 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.559+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794016070 con 0x55a03c536f70 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.559+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c536f70 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.559+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794016070 con 0x55a03c536f70 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.559+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f479c0141d0 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.559+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794016070 con 0x7f479c0141d0 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.559+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f479c0141d0 2024-02-15T22:56:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.560+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794016070 con 0x7f479c0141d0 2024-02-15T22:56:46.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.560+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f478c087040 2024-02-15T22:56:46.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.560+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f479c00a4a0 con 0x7f478c087040 2024-02-15T22:56:46.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.560+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c53cfe0 2024-02-15T22:56:46.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.560+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.560+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c536f70 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.560+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794016070 con 0x55a03c536f70 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.560+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f479c0141d0 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.561+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794016070 con 0x7f479c0141d0 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.561+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c536f70 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.561+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794016070 con 0x55a03c536f70 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.561+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f478c087040 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.561+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.561+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c53cfe0 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.561+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.561+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c53cfe0 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.562+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.562+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f479c0141d0 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.562+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794016070 con 0x7f479c0141d0 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.562+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c53cfe0 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.562+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.562+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c53cfe0 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.562+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.562+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c536f70 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.563+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794016070 con 0x55a03c536f70 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.563+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c536f70 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.563+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4794016070 con 0x55a03c536f70 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.563+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f479c0141d0 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.563+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.563+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c53cfe0 2024-02-15T22:56:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.563+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.563+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f478c087040 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.564+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.564+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c536f70 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.564+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.564+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f479c0141d0 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.564+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.564+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c53cfe0 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.564+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.564+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f479c0141d0 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.565+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.565+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f478c087040 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.565+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.565+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c53cfe0 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.565+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.565+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f479c0141d0 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.565+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.565+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x55a03c536f70 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53f960 con 0x7f478c087040 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53bbf0 con 0x55a03c536f70 2024-02-15T22:56:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53b840 con 0x55a03c536f70 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.566+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53b890 con 0x55a03c536f70 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 20 zone default found 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 4 Realm: () 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 20 zonegroup default 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c53c0c0 con 0x7f479c0141d0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c541760 con 0x55a03c53cfe0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c541ac0 con 0x55a03c53cfe0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.567+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.568+0000 7f47a3f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.568+0000 7f47a3f4b800 20 started sync module instance, tier type = 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.568+0000 7f47a3f4b800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.568+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c541040 con 0x7f478c087040 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.569+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.569+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94146695269280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5413f0 con 0x7f478c087040 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.569+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5427b0 con 0x55a03c536f70 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.570+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94146695269280] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.570+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.570+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94146695274368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5428c0 con 0x55a03c536f70 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.570+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c543370 con 0x55a03c53cfe0 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.571+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94146695274368] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.571+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.571+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94146695278192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c543750 con 0x55a03c53cfe0 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.571+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c544140 con 0x7f478c087040 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.572+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94146695278192] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.572+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.572+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94146695281696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5444f0 con 0x7f478c087040 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.572+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c544f40 con 0x55a03c536f70 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.574+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.574+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94146695285280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c544f40 con 0x55a03c536f70 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.574+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c545ed0 con 0x7f479c0141d0 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.574+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94146695281696] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.575+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.575+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94146695289264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c545e90 con 0x7f479c0141d0 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.575+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5468d0 con 0x7f479c0141d0 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.575+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94146695285280] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.576+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94146695289264] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.576+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.576+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94146695275424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5463f0 con 0x7f479c0141d0 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.576+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c546d60 con 0x7f479c0141d0 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.577+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94146695275424] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.577+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.577+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94146695287536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c546d60 con 0x7f479c0141d0 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.577+0000 7f47a3f4b800 20 add_watcher() i=0 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.577+0000 7f47a3f4b800 20 add_watcher() i=1 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.577+0000 7f47a3f4b800 20 add_watcher() i=2 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.577+0000 7f47a3f4b800 20 add_watcher() i=3 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.577+0000 7f47a3f4b800 20 add_watcher() i=4 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.577+0000 7f47a3f4b800 20 add_watcher() i=5 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.577+0000 7f47a3f4b800 20 add_watcher() i=6 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.578+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94146695287536] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.578+0000 7f47a3f4b800 20 add_watcher() i=7 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.578+0000 7f47a3f4b800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.578+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c546d50 con 0x55a03c536f70 2024-02-15T22:56:46.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.578+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.578+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94146695295296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c547ae0 con 0x55a03c536f70 2024-02-15T22:56:46.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.579+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94146695295296] v32'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.579+0000 7f46537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:46.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.579+0000 7f47a3f4b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:46.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.579+0000 7f47a3f4b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:46.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.579+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c549e30 con 0x55a03c536f70 2024-02-15T22:56:46.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.580+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.580+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c553490 con 0x7f479c0141d0 2024-02-15T22:56:46.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.582+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'23 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.582+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c553490 con 0x55a03c53cfe0 2024-02-15T22:56:46.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.583+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.583+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c553e60 con 0x55a03c536f70 2024-02-15T22:56:46.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.584+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'169 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.584+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c552b80 con 0x7f478c087040 2024-02-15T22:56:46.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.585+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'56 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.585+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c552b80 con 0x55a03c53cfe0 2024-02-15T22:56:46.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.586+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'37 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.586+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c555040 con 0x55a03c536f70 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.587+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.587+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c555040 con 0x7f479c0141d0 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.588+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'37 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.588+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c555040 con 0x7f478c087040 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.589+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.589+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c551ba0 con 0x55a03c53cfe0 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.590+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.590+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c555bb0 con 0x7f478c087040 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.591+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'57 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.591+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5560e0 con 0x7f479c0141d0 2024-02-15T22:56:46.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.592+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.592+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5560e0 con 0x7f478c087040 2024-02-15T22:56:46.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.593+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.593+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556580 con 0x7f479c0141d0 2024-02-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.594+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'43 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.594+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556580 con 0x55a03c536f70 2024-02-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.595+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'170 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.595+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556580 con 0x55a03c53cfe0 2024-02-15T22:56:46.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.596+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'50 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.596+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556580 con 0x7f478c087040 2024-02-15T22:56:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.597+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'58 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.597+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x55a03c53cfe0 2024-02-15T22:56:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.598+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.598+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x55a03c536f70 2024-02-15T22:56:46.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.599+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.599+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x55a03c536f70 2024-02-15T22:56:46.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.600+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'171 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.600+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x55a03c53cfe0 2024-02-15T22:56:46.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.601+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'51 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.601+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x7f478c087040 2024-02-15T22:56:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.602+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.602+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x55a03c53cfe0 2024-02-15T22:56:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.603+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.603+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x55a03c53cfe0 2024-02-15T22:56:46.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.604+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.604+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x55a03c53cfe0 2024-02-15T22:56:46.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.605+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'20 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.605+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x55a03c53cfe0 2024-02-15T22:56:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.606+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.606+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x7f479c0141d0 2024-02-15T22:56:46.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.607+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.607+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x55a03c53cfe0 2024-02-15T22:56:46.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.608+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.608+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x7f479c0141d0 2024-02-15T22:56:46.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.609+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'38 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.609+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556640 con 0x55a03c53cfe0 2024-02-15T22:56:46.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.609+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'52 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.609+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556640 con 0x7f479c0141d0 2024-02-15T22:56:46.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.610+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'44 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.610+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c556610 con 0x7f478c087040 2024-02-15T22:56:46.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.612+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'29 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.612+0000 7f46527fc640 20 reqs_thread_entry: start 2024-02-15T22:56:46.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.612+0000 7f47a3f4b800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:46.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.612+0000 7f47a3f4b800 20 Filter name: none 2024-02-15T22:56:46.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.612+0000 7f45c3fff640 20 reqs_thread_entry: start 2024-02-15T22:56:46.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.612+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.613+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.613+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c536f70 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.613+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.613+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.613+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.613+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.614+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.614+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f479c0141d0 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.614+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.614+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.614+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.614+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.614+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.614+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.615+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.615+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.615+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.615+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.615+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.615+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c536f70 2024-02-15T22:56:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.615+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv166 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.615+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.616+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.616+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.616+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.616+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f478c087040 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.616+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.616+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.617+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.617+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.617+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.617+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.617+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.617+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.617+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.617+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.617+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.617+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c536f70 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.618+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.618+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.618+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.618+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.618+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.618+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f479c0141d0 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.619+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.619+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.619+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.619+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.619+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.619+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f478c087040 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.619+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.619+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.620+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.620+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.620+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.620+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.620+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.620+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.620+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.620+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.621+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.621+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f478c087040 2024-02-15T22:56:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.621+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.621+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.621+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.621+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.622+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.622+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f479c0141d0 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.622+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.622+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.622+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.622+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.623+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.623+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f478c087040 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.623+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.623+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.623+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.623+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.624+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.624+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f479c0141d0 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.624+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.624+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.624+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.624+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.624+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.624+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c536f70 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.625+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv162 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.625+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.625+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.625+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.625+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.625+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.625+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.625+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.626+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.626+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.626+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.626+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f478c087040 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.626+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.626+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.626+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.626+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.627+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.627+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.627+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.627+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.627+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.627+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.627+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.627+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c536f70 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.628+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.628+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.628+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.628+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.628+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.628+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c536f70 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.628+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.628+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c536f70 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.629+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.629+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.629+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.629+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.629+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.629+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.629+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.629+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.630+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.630+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f478c087040 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.630+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.630+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.630+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.630+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.631+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.631+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.631+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.631+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.631+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.631+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.631+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.631+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.631+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.632+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.632+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.632+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.632+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.632+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.632+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.632+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.632+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.632+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.633+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.633+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.633+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.633+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.633+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.633+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.633+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.634+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f479c0141d0 2024-02-15T22:56:46.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.634+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.634+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.634+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.634+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.634+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.634+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.634+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.634+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.635+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.635+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.635+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.635+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f479c0141d0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.635+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.635+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.636+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.636+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.636+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.636+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x55a03c53cfe0 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.636+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.636+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x55a03c53cfe0 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.636+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.636+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.637+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.637+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f479c0141d0 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.637+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.637+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f479c0141d0 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.637+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.637+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.638+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.638+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5802a0 con 0x7f478c087040 2024-02-15T22:56:46.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.638+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.638+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c5812b0 con 0x7f478c087040 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.638+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.639+0000 7f46537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.639+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94146695295296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c554ba0 con 0x55a03c536f70 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.640+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94146695295296] v32'172 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.640+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94146695269280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c547140 con 0x7f478c087040 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.641+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94146695269280] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.641+0000 7f47a3f4b800 20 remove_watcher() i=0 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.641+0000 7f47a3f4b800 2 removed watcher, disabling cache 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.641+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94146695274368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c547140 con 0x55a03c536f70 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.642+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94146695274368] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.642+0000 7f47a3f4b800 20 remove_watcher() i=1 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.642+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94146695278192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c541f80 con 0x55a03c53cfe0 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.643+0000 7f479bfff640 1 -- 172.21.15.133:0/3844431718 <== osd.3 v2:172.21.15.133:6816/1065500544 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94146695278192] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f478c084070 con 0x55a03c53cfe0 2024-02-15T22:56:46.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.643+0000 7f47a3f4b800 20 remove_watcher() i=2 2024-02-15T22:56:46.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.643+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94146695281696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c547140 con 0x7f478c087040 2024-02-15T22:56:46.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.644+0000 7f47a2252640 1 -- 172.21.15.133:0/3844431718 <== osd.2 v2:172.21.15.133:6800/2073628168 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94146695281696] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f479c03a040 con 0x7f478c087040 2024-02-15T22:56:46.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.644+0000 7f47a3f4b800 20 remove_watcher() i=3 2024-02-15T22:56:46.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.644+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94146695285280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c541f80 con 0x55a03c536f70 2024-02-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.645+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.1 v2:172.21.15.133:6808/2671624067 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94146695285280] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x55a03c536f70 2024-02-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.645+0000 7f47a3f4b800 20 remove_watcher() i=4 2024-02-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.645+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94146695289264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c543c20 con 0x7f479c0141d0 2024-02-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.646+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94146695289264] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.646+0000 7f47a3f4b800 20 remove_watcher() i=5 2024-02-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.646+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94146695275424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c547140 con 0x7f479c0141d0 2024-02-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.647+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94146695275424] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.647+0000 7f47a3f4b800 20 remove_watcher() i=6 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.647+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94146695287536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a03c544a20 con 0x7f479c0141d0 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.648+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 <== osd.0 v2:172.21.15.52:6800/431200118 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94146695287536] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4794052040 con 0x7f479c0141d0 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.648+0000 7f47a3f4b800 20 remove_watcher() i=7 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.648+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f479c0141d0 msgr2=0x7f479c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.648+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f479c0141d0 0x7f479c015940 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.648+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a03c536f70 msgr2=0x55a03c5393f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.648+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a03c536f70 0x55a03c5393f0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.648+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f478c087040 msgr2=0x7f478c08f730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.648+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f478c087040 0x7f478c08f730 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.648+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a03c53cfe0 msgr2=0x55a03c53f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.648+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a03c53cfe0 0x55a03c53f3d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f466c0367e0 msgr2=0x7f466c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f466c0367e0 0x7f466c038ca0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f479c00b010 tx=0x7f479c020000 comp rx=0 tx=0).stop 2024-02-15T22:56:46.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 msgr2=0x55a03c52b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a1a51640 1 -- 172.21.15.133:0/3844431718 reap_dead start 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c52b550 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f478c006900 tx=0x7f478c08d7c0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 shutdown_connections 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/3844431718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c524570 0x55a03c52b550 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 >> 172.21.15.133:0/3844431718 conn(0x55a03c5208d0 msgr2=0x55a03c51df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 shutdown_connections 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/3844431718 wait complete. 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/745952213 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f467c036790 msgr2=0x7f467c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/745952213 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f467c036790 0x7f467c038c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55a03c507540 tx=0x7f479c005840 comp rx=0 tx=0).stop 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/745952213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c517380 msgr2=0x55a03c5177a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/745952213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c517380 0x55a03c5177a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f478c044940 tx=0x7f478c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/745952213 shutdown_connections 2024-02-15T22:56:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/745952213 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f467c036790 0x7f467c038c50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/745952213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c517380 0x55a03c5177a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/745952213 >> 172.21.15.133:0/745952213 conn(0x55a03c50b420 msgr2=0x55a03c50b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/745952213 shutdown_connections 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/745952213 wait complete. 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a03c40a4b0 msgr2=0x55a03c506600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a03c40a4b0 0x55a03c506600 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4688036790 msgr2=0x7f4688038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.649+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4688036790 0x7f4688038c50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f478c054000 tx=0x7f478c04e000 comp rx=0 tx=0).stop 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.650+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 msgr2=0x55a03c4ff870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.650+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c4ff870 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4794004000 tx=0x7f4794000bc0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.650+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 shutdown_connections 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.650+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a03c40a4b0 0x55a03c506600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.650+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4688036790 0x7f4688038c50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.650+0000 7f47a3f4b800 1 --2- 172.21.15.133:0/1690508029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a03c406020 0x55a03c4ff870 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.650+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 >> 172.21.15.133:0/1690508029 conn(0x55a03c4015c0 msgr2=0x55a03c379ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.650+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 shutdown_connections 2024-02-15T22:56:46.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.650+0000 7f47a3f4b800 1 -- 172.21.15.133:0/1690508029 wait complete. 2024-02-15T22:56:46.660 INFO:teuthology.orchestra.run.smithi133.stdout:[] 2024-02-15T22:56:46.660 DEBUG:tasks.util.rgw: json result: [] 2024-02-15T22:56:46.660 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-15T22:56:46.660 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-15T22:56:46.660 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-15T22:56:46.742 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:46.743 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.741+0000 7fb480b1f800 1 Processor -- start 2024-02-15T22:56:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.741+0000 7fb480b1f800 1 -- start start 2024-02-15T22:56:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.741+0000 7fb480b1f800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5616ed8a68b0 0x5616ed8a6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.741+0000 7fb480b1f800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5616ed7f2bb0 con 0x5616ed8a7210 2024-02-15T22:56:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.741+0000 7fb480b1f800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5616ed7aa450 con 0x5616ed8a68b0 2024-02-15T22:56:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.741+0000 7fb47c7f3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5616ed8a68b0 0x5616ed8a6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.741+0000 7fb47c7f3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5616ed8a68b0 0x5616ed8a6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53950/0 (socket says 172.21.15.133:53950) 2024-02-15T22:56:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.741+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1786950064 learned_addr learned my addr 172.21.15.133:0/1786950064 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.741+0000 7fb47bff2640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5616ed8a7210 0x5616ed8a76c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:56506/0 (socket says 172.21.15.133:56506) 2024-02-15T22:56:46.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.742+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1786950064 >> v1:172.21.15.52:6789/0 conn(0x5616ed8a7210 legacy=0x5616ed8a76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.742+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1786950064 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ed81b2f0 con 0x5616ed8a68b0 2024-02-15T22:56:46.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.743+0000 7fb47c7f3640 1 --2- 172.21.15.133:0/1786950064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed8a6cd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb46c005fd0 tx=0x7fb46c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fa8adbf77e8a25 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.744+0000 7fb47b7f1640 1 -- 172.21.15.133:0/1786950064 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46c052540 con 0x5616ed8a68b0 2024-02-15T22:56:46.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.744+0000 7fb47b7f1640 1 -- 172.21.15.133:0/1786950064 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c0526a0 con 0x5616ed8a68b0 2024-02-15T22:56:46.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.744+0000 7fb47b7f1640 1 -- 172.21.15.133:0/1786950064 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46c0529c0 con 0x5616ed8a68b0 2024-02-15T22:56:46.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.744+0000 7fb480b1f800 1 -- 172.21.15.133:0/1786950064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 msgr2=0x5616ed8a6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.744+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1786950064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed8a6cd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb46c005fd0 tx=0x7fb46c01cc50 comp rx=0 tx=0).stop 2024-02-15T22:56:46.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.744+0000 7fb480b1f800 1 -- 172.21.15.133:0/1786950064 shutdown_connections 2024-02-15T22:56:46.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.744+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1786950064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed8a6cd0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.744+0000 7fb480b1f800 1 -- 172.21.15.133:0/1786950064 >> 172.21.15.133:0/1786950064 conn(0x5616ed8a24d0 msgr2=0x5616ed8a48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.744+0000 7fb480b1f800 1 -- 172.21.15.133:0/1786950064 shutdown_connections 2024-02-15T22:56:46.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.744+0000 7fb480b1f800 1 -- 172.21.15.133:0/1786950064 wait complete. 2024-02-15T22:56:46.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.756+0000 7fb480b1f800 1 Processor -- start 2024-02-15T22:56:46.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.756+0000 7fb480b1f800 1 -- start start 2024-02-15T22:56:46.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.756+0000 7fb480b1f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed99a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.756+0000 7fb480b1f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ed7a7980 con 0x5616ed8a68b0 2024-02-15T22:56:46.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.756+0000 7fb47c7f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed99a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.756+0000 7fb47c7f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed99a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53964/0 (socket says 172.21.15.133:53964) 2024-02-15T22:56:46.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.756+0000 7fb47c7f3640 1 -- 172.21.15.133:0/3362783287 learned_addr learned my addr 172.21.15.133:0/3362783287 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.757+0000 7fb47c7f3640 1 -- 172.21.15.133:0/3362783287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c00a1c0 con 0x5616ed8a68b0 2024-02-15T22:56:46.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.757+0000 7fb47c7f3640 1 --2- 172.21.15.133:0/3362783287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed99a150 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb46c007000 tx=0x7fb46c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805b8913f19d6cb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.757+0000 7fb36a60c640 1 -- 172.21.15.133:0/3362783287 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46c061070 con 0x5616ed8a68b0 2024-02-15T22:56:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.757+0000 7fb36a60c640 1 -- 172.21.15.133:0/3362783287 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c052940 con 0x5616ed8a68b0 2024-02-15T22:56:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.757+0000 7fb36a60c640 1 -- 172.21.15.133:0/3362783287 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46c052c00 con 0x5616ed8a68b0 2024-02-15T22:56:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.758+0000 7fb480b1f800 1 -- 172.21.15.133:0/3362783287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 msgr2=0x5616ed99a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.758+0000 7fb480b1f800 1 --2- 172.21.15.133:0/3362783287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed99a150 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb46c007000 tx=0x7fb46c04c000 comp rx=0 tx=0).stop 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.758+0000 7fb480b1f800 1 -- 172.21.15.133:0/3362783287 shutdown_connections 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.758+0000 7fb480b1f800 1 --2- 172.21.15.133:0/3362783287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed99a150 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.758+0000 7fb480b1f800 1 -- 172.21.15.133:0/3362783287 >> 172.21.15.133:0/3362783287 conn(0x5616ed8a24d0 msgr2=0x5616ed995a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.758+0000 7fb480b1f800 1 -- 172.21.15.133:0/3362783287 shutdown_connections 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.758+0000 7fb480b1f800 1 -- 172.21.15.133:0/3362783287 wait complete. 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.758+0000 7fb480b1f800 1 Processor -- start 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.758+0000 7fb480b1f800 1 -- start start 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.758+0000 7fb480b1f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed9a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.758+0000 7fb480b1f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ed7a3160 con 0x5616ed8a68b0 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.759+0000 7fb47c7f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed9a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.759+0000 7fb47c7f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed9a17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53966/0 (socket says 172.21.15.133:53966) 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.759+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1051525401 learned_addr learned my addr 172.21.15.133:0/1051525401 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.759+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1051525401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ed81b2f0 con 0x5616ed8a68b0 2024-02-15T22:56:46.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.759+0000 7fb47c7f3640 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed9a17c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb46c05f040 tx=0x7fb46c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.759+0000 7fb368e09640 1 -- 172.21.15.133:0/1051525401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46c061040 con 0x5616ed8a68b0 2024-02-15T22:56:46.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.759+0000 7fb368e09640 1 -- 172.21.15.133:0/1051525401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c05d860 con 0x5616ed8a68b0 2024-02-15T22:56:46.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.759+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616ed9a1d00 con 0x5616ed8a68b0 2024-02-15T22:56:46.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.759+0000 7fb368e09640 1 -- 172.21.15.133:0/1051525401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46c05db40 con 0x5616ed8a68b0 2024-02-15T22:56:46.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.759+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616ed9a2240 con 0x5616ed8a68b0 2024-02-15T22:56:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.760+0000 7fb368e09640 1 -- 172.21.15.133:0/1051525401 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb46c05dcf0 con 0x5616ed8a68b0 2024-02-15T22:56:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.760+0000 7fb368e09640 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb364036790 0x7fb364038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.760+0000 7fb368e09640 1 -- 172.21.15.133:0/1051525401 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fb46c08dff0 con 0x5616ed8a68b0 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.760+0000 7fb47bff2640 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb364036790 0x7fb364038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.761+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616ed8a7210 0x5616ed9a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.761+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9a8b30 con 0x5616ed8a7210 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.761+0000 7fb47cff4640 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616ed8a7210 0x5616ed9a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.761+0000 7fb47bff2640 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb364036790 0x7fb364038c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb464000f60 tx=0x7fb464001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.761+0000 7fb47cff4640 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616ed8a7210 0x5616ed9a85f0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.761+0000 7fb47cff4640 1 -- 172.21.15.133:0/1051525401 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4740083e0 con 0x5616ed8a7210 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.761+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9a5b90 con 0x5616ed8a7210 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.761+0000 7fb47cff4640 1 -- 172.21.15.133:0/1051525401 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb4740083e0 con 0x5616ed8a7210 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.762+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9aa830 con 0x5616ed8a7210 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.762+0000 7fb47cff4640 1 -- 172.21.15.133:0/1051525401 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb4740083e0 con 0x5616ed8a7210 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.762+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9a9a80 con 0x5616ed8a7210 2024-02-15T22:56:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.762+0000 7fb47cff4640 1 -- 172.21.15.133:0/1051525401 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb4740083e0 con 0x5616ed8a7210 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.762+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9a9e90 con 0x5616ed8a7210 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.762+0000 7fb47cff4640 1 -- 172.21.15.133:0/1051525401 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb474012040 con 0x5616ed8a7210 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.763+0000 7fb480b1f800 1 Processor -- start 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.763+0000 7fb480b1f800 1 -- start start 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.763+0000 7fb480b1f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9b9270 0x5616ed9b9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.763+0000 7fb480b1f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ed745e80 con 0x5616ed9b9270 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.763+0000 7fb47bff2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9b9270 0x5616ed9b9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.763+0000 7fb47bff2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9b9270 0x5616ed9b9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53982/0 (socket says 172.21.15.133:53982) 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.763+0000 7fb47bff2640 1 -- 172.21.15.133:0/278376716 learned_addr learned my addr 172.21.15.133:0/278376716 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.763+0000 7fb47bff2640 1 -- 172.21.15.133:0/278376716 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ed9b9bd0 con 0x5616ed9b9270 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.764+0000 7fb47bff2640 1 --2- 172.21.15.133:0/278376716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9b9270 0x5616ed9b9690 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb464001ed0 tx=0x7fb46400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.764+0000 7fb361ffb640 1 -- 172.21.15.133:0/278376716 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46400bec0 con 0x5616ed9b9270 2024-02-15T22:56:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.764+0000 7fb361ffb640 1 -- 172.21.15.133:0/278376716 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46400d520 con 0x5616ed9b9270 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.764+0000 7fb480b1f800 1 -- 172.21.15.133:0/278376716 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616ed9ba640 con 0x5616ed9b9270 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.764+0000 7fb361ffb640 1 -- 172.21.15.133:0/278376716 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46400d7c0 con 0x5616ed9b9270 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.764+0000 7fb480b1f800 1 -- 172.21.15.133:0/278376716 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616ed9bab00 con 0x5616ed9b9270 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.765+0000 7fb361ffb640 1 -- 172.21.15.133:0/278376716 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb46401a070 con 0x5616ed9b9270 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.765+0000 7fb361ffb640 1 --2- 172.21.15.133:0/278376716 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb3540367e0 0x7fb354038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.765+0000 7fb361ffb640 1 -- 172.21.15.133:0/278376716 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fb464017050 con 0x5616ed9b9270 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.765+0000 7fb47cff4640 1 --2- 172.21.15.133:0/278376716 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb3540367e0 0x7fb354038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.765+0000 7fb480b1f800 1 Processor -- start 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.765+0000 7fb47cff4640 1 --2- 172.21.15.133:0/278376716 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb3540367e0 0x7fb354038ca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5616ed9a94c0 tx=0x7fb474000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.765+0000 7fb480b1f800 1 -- start start 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.765+0000 7fb480b1f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.765+0000 7fb480b1f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ed71b5d0 con 0x5616ed9c64f0 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.765+0000 7fb47bff2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb47bff2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53988/0 (socket says 172.21.15.133:53988) 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb47bff2640 1 -- 172.21.15.133:0/1446469010 learned_addr learned my addr 172.21.15.133:0/1446469010 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb47bff2640 1 -- 172.21.15.133:0/1446469010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ed9c6ee0 con 0x5616ed9c64f0 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb47bff2640 1 --2- 172.21.15.133:0/1446469010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9c6910 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb464027030 tx=0x7fb464024560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3efca6437e9d55 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb35b7fe640 1 -- 172.21.15.133:0/1446469010 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46404d2e0 con 0x5616ed9c64f0 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb35b7fe640 1 -- 172.21.15.133:0/1446469010 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46404bae0 con 0x5616ed9c64f0 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb35b7fe640 1 -- 172.21.15.133:0/1446469010 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46404bd80 con 0x5616ed9c64f0 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb480b1f800 1 -- 172.21.15.133:0/1446469010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 msgr2=0x5616ed9c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1446469010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9c6910 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb464027030 tx=0x7fb464024560 comp rx=0 tx=0).stop 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb480b1f800 1 -- 172.21.15.133:0/1446469010 shutdown_connections 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1446469010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9c6910 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.766+0000 7fb480b1f800 1 -- 172.21.15.133:0/1446469010 >> 172.21.15.133:0/1446469010 conn(0x5616ed9c2850 msgr2=0x5616ed9c08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.767+0000 7fb480b1f800 1 -- 172.21.15.133:0/1446469010 shutdown_connections 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.767+0000 7fb480b1f800 1 -- 172.21.15.133:0/1446469010 wait complete. 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.767+0000 7fb480b1f800 1 Processor -- start 2024-02-15T22:56:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.767+0000 7fb480b1f800 1 -- start start 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.767+0000 7fb480b1f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.767+0000 7fb480b1f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ed9cda60 con 0x5616ed9c64f0 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.767+0000 7fb47bff2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.767+0000 7fb47bff2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:53992/0 (socket says 172.21.15.133:53992) 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.767+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 learned_addr learned my addr 172.21.15.133:0/1696785933 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.767+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ed9bab00 con 0x5616ed9c64f0 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.768+0000 7fb47bff2640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9cd520 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb46401e040 tx=0x7fb46404b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.768+0000 7fb359ffb640 1 -- 172.21.15.133:0/1696785933 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46404d2e0 con 0x5616ed9c64f0 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.768+0000 7fb359ffb640 1 -- 172.21.15.133:0/1696785933 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46404a5c0 con 0x5616ed9c64f0 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.768+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616ed9cdc60 con 0x5616ed9c64f0 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.768+0000 7fb359ffb640 1 -- 172.21.15.133:0/1696785933 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46401a320 con 0x5616ed9c64f0 2024-02-15T22:56:46.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.768+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616ed9ce120 con 0x5616ed9c64f0 2024-02-15T22:56:46.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.768+0000 7fb359ffb640 1 -- 172.21.15.133:0/1696785933 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb46401a4a0 con 0x5616ed9c64f0 2024-02-15T22:56:46.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.769+0000 7fb359ffb640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb34c036790 0x7fb34c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.769+0000 7fb359ffb640 1 -- 172.21.15.133:0/1696785933 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fb46404edd0 con 0x5616ed9c64f0 2024-02-15T22:56:46.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.769+0000 7fb47cff4640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb34c036790 0x7fb34c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.769+0000 7fb47cff4640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb34c036790 0x7fb34c038c50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5616ed9a9580 tx=0x7fb47400c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.769+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.769+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616ed9d90c0 0x5616ed9db580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.769+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9dbcd0 con 0x5616ed9d90c0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.769+0000 7fb47c7f3640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616ed9d90c0 0x5616ed9db580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb47c7f3640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616ed9d90c0 0x5616ed9db580 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb46c04f070 con 0x5616ed9d90c0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb480b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb480b1f800 20 realm 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9dc0a0 con 0x5616ed9d90c0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb46c04f070 con 0x5616ed9d90c0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb480b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb480b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9dc920 con 0x5616ed9d90c0 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb46c04f070 con 0x5616ed9d90c0 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb480b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9dcc80 con 0x5616ed9d90c0 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.770+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb46c04f070 con 0x5616ed9d90c0 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb480b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9dd480 con 0x5616ed9d90c0 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb46c04f070 con 0x5616ed9d90c0 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb480b1f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb480b1f800 20 searching for the correct realm 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5616ed9df3a0 0x5616ed9e1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9df3a0 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb47bff2640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5616ed9df3a0 0x5616ed9e1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb47bff2640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5616ed9df3a0 0x5616ed9e1820 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb47bff2640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb464027060 0x7fb464046020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.771+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb464027060 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.772+0000 7fb47cff4640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb464027060 0x7fb464046020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.772+0000 7fb47cff4640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb464027060 0x7fb464046020 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.772+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47402c040 con 0x7fb464027060 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.772+0000 7fb47cff4640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb474027940 0x7fb4740333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.772+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb474027940 2024-02-15T22:56:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.772+0000 7fb47c7f3640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb474027940 0x7fb4740333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.773+0000 7fb47c7f3640 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb474027940 0x7fb4740333c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.773+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c04f070 con 0x7fb474027940 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.773+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9d90c0 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.773+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c04f070 con 0x5616ed9d90c0 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.773+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9d90c0 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.773+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c088040 con 0x5616ed9d90c0 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.773+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb474027940 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.774+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c088040 con 0x7fb474027940 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.774+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb474027940 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.774+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c088040 con 0x7fb474027940 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.774+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb464027060 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.774+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47402c040 con 0x7fb464027060 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.774+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9df3a0 2024-02-15T22:56:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.774+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.774+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9d90c0 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.775+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c088040 con 0x5616ed9d90c0 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.775+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb474027940 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.775+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c088040 con 0x7fb474027940 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.775+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9d90c0 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.775+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c088040 con 0x5616ed9d90c0 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.775+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb464027060 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.775+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb47402c040 con 0x7fb464027060 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.775+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9df3a0 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.776+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.776+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9df3a0 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.776+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.776+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb474027940 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.776+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c088040 con 0x7fb474027940 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.776+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9df3a0 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.776+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.776+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9df3a0 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.776+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.776+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9d90c0 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.777+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c088040 con 0x5616ed9d90c0 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.777+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9d90c0 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.777+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb46c088040 con 0x5616ed9d90c0 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.777+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb474027940 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.777+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c088040 con 0x7fb474027940 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.777+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9df3a0 2024-02-15T22:56:46.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.777+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.777+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb464027060 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.778+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47402c040 con 0x7fb464027060 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.778+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9d90c0 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.778+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb46c088040 con 0x5616ed9d90c0 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.778+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb474027940 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.778+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c088040 con 0x7fb474027940 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.778+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9df3a0 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.778+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.778+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb474027940 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.779+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.779+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb464027060 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.779+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47402c040 con 0x7fb464027060 2024-02-15T22:56:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.779+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9df3a0 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.779+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.779+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb474027940 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.779+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.779+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x5616ed9d90c0 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e1ef0 con 0x7fb464027060 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47402c040 con 0x7fb464027060 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb480b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb480b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb480b1f800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb480b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb480b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb480b1f800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9de9b0 con 0x5616ed9d90c0 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb480b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.780+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9de1d0 con 0x5616ed9d90c0 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e2330 con 0x5616ed9d90c0 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 20 zone default found 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 4 Realm: () 2024-02-15T22:56:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 20 zonegroup default 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e2690 con 0x7fb474027940 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.781+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e4420 con 0x5616ed9df3a0 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.782+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.782+0000 7fb480b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.782+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.782+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e4780 con 0x5616ed9df3a0 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.782+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.782+0000 7fb480b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.782+0000 7fb480b1f800 20 started sync module instance, tier type = 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.782+0000 7fb480b1f800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.782+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e3d00 con 0x7fb464027060 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.783+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.783+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94656475838560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e40b0 con 0x7fb464027060 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.783+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e54e0 con 0x5616ed9d90c0 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.784+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.784+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94656475844944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e5b50 con 0x5616ed9d90c0 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.784+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e6600 con 0x5616ed9df3a0 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.784+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94656475838560] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.785+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.785+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94656475848960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e69e0 con 0x5616ed9df3a0 2024-02-15T22:56:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.785+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e73d0 con 0x7fb464027060 2024-02-15T22:56:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.785+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94656475844944] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.786+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94656475848960] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.786+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.786+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94656475843488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e55b0 con 0x7fb464027060 2024-02-15T22:56:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.786+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e7d90 con 0x5616ed9d90c0 2024-02-15T22:56:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.787+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94656475843488] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.788+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.788+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94656475852464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e7d90 con 0x5616ed9d90c0 2024-02-15T22:56:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.788+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e8700 con 0x7fb474027940 2024-02-15T22:56:46.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.789+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94656475852464] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.789+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.789+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94656475857984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e7d90 con 0x7fb474027940 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.789+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e9130 con 0x7fb474027940 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.790+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94656475857984] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.790+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.790+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94656475855088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e92d0 con 0x7fb474027940 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.790+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e9ad0 con 0x7fb474027940 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.791+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.791+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94656475855088] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.791+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94656475862192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e9f10 con 0x7fb474027940 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.791+0000 7fb480b1f800 20 add_watcher() i=0 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.791+0000 7fb480b1f800 20 add_watcher() i=1 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.791+0000 7fb480b1f800 20 add_watcher() i=2 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.791+0000 7fb480b1f800 20 add_watcher() i=3 2024-02-15T22:56:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.791+0000 7fb480b1f800 20 add_watcher() i=4 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.791+0000 7fb480b1f800 20 add_watcher() i=5 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.791+0000 7fb480b1f800 20 add_watcher() i=6 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.792+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94656475862192] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.792+0000 7fb480b1f800 20 add_watcher() i=7 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.792+0000 7fb480b1f800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.792+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9ed320 con 0x5616ed9d90c0 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.792+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.792+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94656475863472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9ea790 con 0x5616ed9d90c0 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.793+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94656475863472] v32'173 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.793+0000 7fb3327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.793+0000 7fb480b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.793+0000 7fb480b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.793+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f5940 con 0x5616ed9d90c0 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.794+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.794+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f5fd0 con 0x7fb474027940 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.795+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'24 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.795+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f63f0 con 0x5616ed9df3a0 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.796+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.796+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f6dc0 con 0x5616ed9d90c0 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.797+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'174 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.797+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f6e50 con 0x7fb464027060 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.798+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'59 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.798+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f7380 con 0x5616ed9df3a0 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.799+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'39 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.799+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f7d50 con 0x5616ed9d90c0 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.800+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.800+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f7d50 con 0x7fb474027940 2024-02-15T22:56:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.801+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'39 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.801+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f7d50 con 0x7fb464027060 2024-02-15T22:56:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.803+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.803+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f4a70 con 0x5616ed9df3a0 2024-02-15T22:56:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.803+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.803+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f86f0 con 0x7fb464027060 2024-02-15T22:56:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.804+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'60 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.804+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f8b90 con 0x7fb474027940 2024-02-15T22:56:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.805+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.805+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f8b90 con 0x7fb464027060 2024-02-15T22:56:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.806+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.806+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f8b90 con 0x7fb474027940 2024-02-15T22:56:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.807+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'45 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.807+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f8b90 con 0x5616ed9d90c0 2024-02-15T22:56:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.808+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'175 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.808+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f8b90 con 0x5616ed9df3a0 2024-02-15T22:56:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.810+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'53 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.810+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f8b90 con 0x7fb464027060 2024-02-15T22:56:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.811+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'61 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.811+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f8c20 con 0x5616ed9df3a0 2024-02-15T22:56:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.811+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.811+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f8c20 con 0x5616ed9d90c0 2024-02-15T22:56:46.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.813+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.813+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f8c20 con 0x5616ed9d90c0 2024-02-15T22:56:46.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.814+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'176 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.814+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f8b90 con 0x5616ed9df3a0 2024-02-15T22:56:46.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.815+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'54 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.815+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f8b90 con 0x7fb464027060 2024-02-15T22:56:46.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.816+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'33 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.816+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f9120 con 0x5616ed9df3a0 2024-02-15T22:56:46.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.817+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.817+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f9120 con 0x5616ed9df3a0 2024-02-15T22:56:46.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.818+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.818+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f9120 con 0x5616ed9df3a0 2024-02-15T22:56:46.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.818+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'21 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.818+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f9120 con 0x5616ed9df3a0 2024-02-15T22:56:46.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.819+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'40 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.819+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f9120 con 0x7fb474027940 2024-02-15T22:56:46.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.821+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.821+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f9120 con 0x5616ed9df3a0 2024-02-15T22:56:46.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.822+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.822+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f9120 con 0x7fb474027940 2024-02-15T22:56:46.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.823+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'40 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.823+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f9120 con 0x5616ed9df3a0 2024-02-15T22:56:46.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.824+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'55 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.824+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f9120 con 0x7fb474027940 2024-02-15T22:56:46.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.825+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'46 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.825+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f9120 con 0x7fb464027060 2024-02-15T22:56:46.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.826+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'30 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.826+0000 7fb3317e2640 20 reqs_thread_entry: start 2024-02-15T22:56:46.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.826+0000 7fb480b1f800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:46.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.826+0000 7fb480b1f800 20 Filter name: none 2024-02-15T22:56:46.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.826+0000 7fb2a2ffd640 20 reqs_thread_entry: start 2024-02-15T22:56:46.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.826+0000 7fb480b1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:46.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.826+0000 7fb480b1f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:46.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.826+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f1970 con 0x5616ed9d90c0 2024-02-15T22:56:46.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.827+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.827+0000 7fb480b1f800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:46.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.827+0000 7fb480b1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:46.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.827+0000 7fb480b1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:46.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.827+0000 7fb480b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:46.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.827+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f1930 con 0x7fb464027060 2024-02-15T22:56:46.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.828+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.831 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-15T22:56:46.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.828+0000 7fb3327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:46.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.829+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94656475863472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f1900 con 0x5616ed9d90c0 2024-02-15T22:56:46.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.829+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94656475863472] v32'177 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.830+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94656475838560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f1900 con 0x7fb464027060 2024-02-15T22:56:46.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.830+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94656475838560] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.830+0000 7fb480b1f800 20 remove_watcher() i=0 2024-02-15T22:56:46.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.830+0000 7fb480b1f800 2 removed watcher, disabling cache 2024-02-15T22:56:46.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.830+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94656475844944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f1900 con 0x5616ed9d90c0 2024-02-15T22:56:46.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.832+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94656475844944] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.832+0000 7fb480b1f800 20 remove_watcher() i=1 2024-02-15T22:56:46.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.832+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94656475848960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f1900 con 0x5616ed9df3a0 2024-02-15T22:56:46.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.833+0000 7fb47bff2640 1 -- 172.21.15.133:0/1696785933 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94656475848960] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46401bb80 con 0x5616ed9df3a0 2024-02-15T22:56:46.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.833+0000 7fb480b1f800 20 remove_watcher() i=2 2024-02-15T22:56:46.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.833+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94656475843488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f1900 con 0x7fb464027060 2024-02-15T22:56:46.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.834+0000 7fb47cff4640 1 -- 172.21.15.133:0/1696785933 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94656475843488] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47403f040 con 0x7fb464027060 2024-02-15T22:56:46.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.834+0000 7fb480b1f800 20 remove_watcher() i=3 2024-02-15T22:56:46.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.834+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94656475852464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9f1900 con 0x5616ed9d90c0 2024-02-15T22:56:46.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.835+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94656475852464] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x5616ed9d90c0 2024-02-15T22:56:46.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.835+0000 7fb480b1f800 20 remove_watcher() i=4 2024-02-15T22:56:46.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.835+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94656475857984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e6eb0 con 0x7fb474027940 2024-02-15T22:56:46.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.836+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94656475857984] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.836+0000 7fb480b1f800 20 remove_watcher() i=5 2024-02-15T22:56:46.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.836+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94656475855088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e8440 con 0x7fb474027940 2024-02-15T22:56:46.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.837+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94656475855088] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.837+0000 7fb480b1f800 20 remove_watcher() i=6 2024-02-15T22:56:46.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.837+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94656475862192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5616ed9e78f0 con 0x7fb474027940 2024-02-15T22:56:46.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94656475862192] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46c097040 con 0x7fb474027940 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 20 remove_watcher() i=7 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb474027940 msgr2=0x7fb4740333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb474027940 0x7fb4740333c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616ed9d90c0 msgr2=0x5616ed9db580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616ed9d90c0 0x5616ed9db580 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb464027060 msgr2=0x7fb464046020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb464027060 0x7fb464046020 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5616ed9df3a0 msgr2=0x5616ed9e1820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5616ed9df3a0 0x5616ed9e1820 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb34c036790 msgr2=0x7fb34c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb34c036790 0x7fb34c038c50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5616ed9a9580 tx=0x7fb47400c040 comp rx=0 tx=0).stop 2024-02-15T22:56:46.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 msgr2=0x5616ed9cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb47c7f3640 1 -- 172.21.15.133:0/1696785933 reap_dead start 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9cd520 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb46401e040 tx=0x7fb46404b930 comp rx=0 tx=0).stop 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 shutdown_connections 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1696785933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9c64f0 0x5616ed9cd520 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 >> 172.21.15.133:0/1696785933 conn(0x5616ed9c2850 msgr2=0x5616ed9bfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 shutdown_connections 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/1696785933 wait complete. 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/278376716 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb3540367e0 msgr2=0x7fb354038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 --2- 172.21.15.133:0/278376716 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb3540367e0 0x7fb354038ca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5616ed9a94c0 tx=0x7fb474000f90 comp rx=0 tx=0).stop 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/278376716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9b9270 msgr2=0x5616ed9b9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 --2- 172.21.15.133:0/278376716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9b9270 0x5616ed9b9690 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb464001ed0 tx=0x7fb46400ea00 comp rx=0 tx=0).stop 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/278376716 shutdown_connections 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 --2- 172.21.15.133:0/278376716 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb3540367e0 0x7fb354038ca0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 --2- 172.21.15.133:0/278376716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed9b9270 0x5616ed9b9690 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/278376716 >> 172.21.15.133:0/278376716 conn(0x5616ed9ad310 msgr2=0x5616ed9ad710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/278376716 shutdown_connections 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.838+0000 7fb480b1f800 1 -- 172.21.15.133:0/278376716 wait complete. 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616ed8a7210 msgr2=0x5616ed9a85f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616ed8a7210 0x5616ed9a85f0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb364036790 msgr2=0x7fb364038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb364036790 0x7fb364038c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb464000f60 tx=0x7fb464001370 comp rx=0 tx=0).stop 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 msgr2=0x5616ed9a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed9a17c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb46c05f040 tx=0x7fb46c003330 comp rx=0 tx=0).stop 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 shutdown_connections 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5616ed8a7210 0x5616ed9a85f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb364036790 0x7fb364038c50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 --2- 172.21.15.133:0/1051525401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ed8a68b0 0x5616ed9a17c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 >> 172.21.15.133:0/1051525401 conn(0x5616ed8a24d0 msgr2=0x5616ed9942d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 shutdown_connections 2024-02-15T22:56:46.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.839+0000 7fb480b1f800 1 -- 172.21.15.133:0/1051525401 wait complete. 2024-02-15T22:56:46.849 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-15T22:56:46.858 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-02-15T22:56:46.861 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:46.889 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:46.899 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:46.944 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-15T22:56:46.948 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:46.949 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-15T22:56:46.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-15T22:56:46.949 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-15T22:56:46.992 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:46.992 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:46.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.990+0000 7fb03920f800 1 Processor -- start 2024-02-15T22:56:46.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.990+0000 7fb03920f800 1 -- start start 2024-02-15T22:56:46.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.990+0000 7fb03920f800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b502d423f0 0x55b502d4aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:46.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.990+0000 7fb03920f800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b502c8cba0 con 0x55b502d408b0 2024-02-15T22:56:46.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.990+0000 7fb03920f800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b502c44450 con 0x55b502d423f0 2024-02-15T22:56:46.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.991+0000 7fb02c0e3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b502d423f0 0x55b502d4aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:46.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.991+0000 7fb02c0e3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b502d423f0 0x55b502d4aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54002/0 (socket says 172.21.15.133:54002) 2024-02-15T22:56:46.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.991+0000 7fb02c0e3640 1 -- 172.21.15.133:0/2969057702 learned_addr learned my addr 172.21.15.133:0/2969057702 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:46.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.991+0000 7fb0348e4640 1 --1- 172.21.15.133:0/2969057702 >> v1:172.21.15.52:6789/0 conn(0x55b502d408b0 0x55b502d40cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:56512/0 (socket says 172.21.15.133:56512) 2024-02-15T22:56:46.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.991+0000 7fb02c0e3640 1 -- 172.21.15.133:0/2969057702 >> v1:172.21.15.52:6789/0 conn(0x55b502d408b0 legacy=0x55b502d40cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.991+0000 7fb02ffff640 1 -- 172.21.15.133:0/2969057702 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335779850 0 0) 0x55b502c8cba0 con 0x55b502d408b0 2024-02-15T22:56:46.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.991+0000 7fb02c0e3640 1 -- 172.21.15.133:0/2969057702 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b502cb51a0 con 0x55b502d423f0 2024-02-15T22:56:46.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.993+0000 7fb02c0e3640 1 --2- 172.21.15.133:0/2969057702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d423f0 0x55b502d4aef0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00a520 tx=0x7fb01c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ff8c9af4d3b923 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:46.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.993+0000 7fb02ffff640 1 -- 172.21.15.133:0/2969057702 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb01c052570 con 0x55b502d423f0 2024-02-15T22:56:46.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.993+0000 7fb02ffff640 1 -- 172.21.15.133:0/2969057702 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c0526d0 con 0x55b502d423f0 2024-02-15T22:56:46.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.993+0000 7fb02ffff640 1 -- 172.21.15.133:0/2969057702 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb01c052990 con 0x55b502d423f0 2024-02-15T22:56:46.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.994+0000 7fb03920f800 1 -- 172.21.15.133:0/2969057702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d423f0 msgr2=0x55b502d4aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:46.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.994+0000 7fb03920f800 1 --2- 172.21.15.133:0/2969057702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d423f0 0x55b502d4aef0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00a520 tx=0x7fb01c01cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.994+0000 7fb03920f800 1 -- 172.21.15.133:0/2969057702 shutdown_connections 2024-02-15T22:56:46.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.994+0000 7fb03920f800 1 --2- 172.21.15.133:0/2969057702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d423f0 0x55b502d4aef0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:46.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.994+0000 7fb03920f800 1 -- 172.21.15.133:0/2969057702 >> 172.21.15.133:0/2969057702 conn(0x55b502d3c4f0 msgr2=0x55b502d3e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:46.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.994+0000 7fb03920f800 1 -- 172.21.15.133:0/2969057702 shutdown_connections 2024-02-15T22:56:46.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:46.994+0000 7fb03920f800 1 -- 172.21.15.133:0/2969057702 wait complete. 2024-02-15T22:56:47.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.005+0000 7fb03920f800 1 Processor -- start 2024-02-15T22:56:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.005+0000 7fb03920f800 1 -- start start 2024-02-15T22:56:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.005+0000 7fb03920f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.005+0000 7fb03920f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b502c41980 con 0x55b502d408b0 2024-02-15T22:56:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.006+0000 7fb0348e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.006+0000 7fb0348e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54014/0 (socket says 172.21.15.133:54014) 2024-02-15T22:56:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.006+0000 7fb0348e4640 1 -- 172.21.15.133:0/29123888 learned_addr learned my addr 172.21.15.133:0/29123888 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.006+0000 7fb0348e4640 1 -- 172.21.15.133:0/29123888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c005de0 con 0x55b502d408b0 2024-02-15T22:56:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.006+0000 7fb0348e4640 1 --2- 172.21.15.133:0/29123888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e341d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb02400b210 tx=0x7fb02400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a91daae711130e8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.006+0000 7faf22e0d640 1 -- 172.21.15.133:0/29123888 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb024014070 con 0x55b502d408b0 2024-02-15T22:56:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.006+0000 7faf22e0d640 1 -- 172.21.15.133:0/29123888 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02400d500 con 0x55b502d408b0 2024-02-15T22:56:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.006+0000 7faf22e0d640 1 -- 172.21.15.133:0/29123888 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb02400d800 con 0x55b502d408b0 2024-02-15T22:56:47.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.007+0000 7fb03920f800 1 -- 172.21.15.133:0/29123888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 msgr2=0x55b502e341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.007+0000 7fb03920f800 1 --2- 172.21.15.133:0/29123888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e341d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb02400b210 tx=0x7fb02400b6d0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.007+0000 7fb03920f800 1 -- 172.21.15.133:0/29123888 shutdown_connections 2024-02-15T22:56:47.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.007+0000 7fb03920f800 1 --2- 172.21.15.133:0/29123888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e341d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.007+0000 7fb03920f800 1 -- 172.21.15.133:0/29123888 >> 172.21.15.133:0/29123888 conn(0x55b502d3c4f0 msgr2=0x55b502e2faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.007+0000 7fb03920f800 1 -- 172.21.15.133:0/29123888 shutdown_connections 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.007+0000 7fb03920f800 1 -- 172.21.15.133:0/29123888 wait complete. 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.007+0000 7fb03920f800 1 Processor -- start 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.007+0000 7fb03920f800 1 -- start start 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.007+0000 7fb03920f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e3b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.007+0000 7fb03920f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b502c3d160 con 0x55b502d408b0 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.008+0000 7fb0348e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e3b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.008+0000 7fb0348e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e3b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54022/0 (socket says 172.21.15.133:54022) 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.008+0000 7fb0348e4640 1 -- 172.21.15.133:0/423779170 learned_addr learned my addr 172.21.15.133:0/423779170 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.008+0000 7fb0348e4640 1 -- 172.21.15.133:0/423779170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb024001b70 con 0x55b502d408b0 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.008+0000 7fb0348e4640 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e3b890 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb02400b210 tx=0x7fb024000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.008+0000 7faf2160a640 1 -- 172.21.15.133:0/423779170 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb02400f950 con 0x55b502d408b0 2024-02-15T22:56:47.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.008+0000 7faf2160a640 1 -- 172.21.15.133:0/423779170 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb024020070 con 0x55b502d408b0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.008+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b502e3bdd0 con 0x55b502d408b0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.008+0000 7faf2160a640 1 -- 172.21.15.133:0/423779170 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb02400fc20 con 0x55b502d408b0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.008+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b502e3c2b0 con 0x55b502d408b0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.009+0000 7faf2160a640 1 -- 172.21.15.133:0/423779170 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb02400d040 con 0x55b502d408b0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.009+0000 7faf2160a640 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf1c0367e0 0x7faf1c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.009+0000 7faf2160a640 1 -- 172.21.15.133:0/423779170 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fb02400a040 con 0x55b502d408b0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.009+0000 7fb02c0e3640 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf1c0367e0 0x7faf1c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.009+0000 7fb03920f800 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b502d423f0 0x55b502e42570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.009+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e42b40 con 0x55b502d423f0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.009+0000 7fb0350e5640 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b502d423f0 0x55b502e42570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.010+0000 7fb02c0e3640 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf1c0367e0 0x7faf1c038ca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb01c054000 tx=0x7fb01c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.010+0000 7fb0350e5640 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b502d423f0 0x55b502e42570 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.010+0000 7fb0350e5640 1 -- 172.21.15.133:0/423779170 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb03000a4a0 con 0x55b502d423f0 2024-02-15T22:56:47.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.010+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e3fca0 con 0x55b502d423f0 2024-02-15T22:56:47.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.010+0000 7fb0350e5640 1 -- 172.21.15.133:0/423779170 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb03000a4a0 con 0x55b502d423f0 2024-02-15T22:56:47.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.010+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e448a0 con 0x55b502d423f0 2024-02-15T22:56:47.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.011+0000 7fb0350e5640 1 -- 172.21.15.133:0/423779170 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb03000a4a0 con 0x55b502d423f0 2024-02-15T22:56:47.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.011+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e43bb0 con 0x55b502d423f0 2024-02-15T22:56:47.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.011+0000 7fb0350e5640 1 -- 172.21.15.133:0/423779170 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb03000a4a0 con 0x55b502d423f0 2024-02-15T22:56:47.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.011+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e43fc0 con 0x55b502d423f0 2024-02-15T22:56:47.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.011+0000 7fb0350e5640 1 -- 172.21.15.133:0/423779170 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb03000a4a0 con 0x55b502d423f0 2024-02-15T22:56:47.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.012+0000 7fb03920f800 1 Processor -- start 2024-02-15T22:56:47.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.012+0000 7fb03920f800 1 -- start start 2024-02-15T22:56:47.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.012+0000 7fb03920f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e53310 0x55b502e53730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.012+0000 7fb03920f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b502bdfe80 con 0x55b502e53310 2024-02-15T22:56:47.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.012+0000 7fb02c0e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e53310 0x55b502e53730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.012+0000 7fb02c0e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e53310 0x55b502e53730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54024/0 (socket says 172.21.15.133:54024) 2024-02-15T22:56:47.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.012+0000 7fb02c0e3640 1 -- 172.21.15.133:0/279335601 learned_addr learned my addr 172.21.15.133:0/279335601 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.012+0000 7fb02c0e3640 1 -- 172.21.15.133:0/279335601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b502e53c70 con 0x55b502e53310 2024-02-15T22:56:47.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.012+0000 7fb02c0e3640 1 --2- 172.21.15.133:0/279335601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e53310 0x55b502e53730 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb01c044830 tx=0x7fb01c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.013+0000 7faf1a7fc640 1 -- 172.21.15.133:0/279335601 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb01c05db80 con 0x55b502e53310 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.013+0000 7faf1a7fc640 1 -- 172.21.15.133:0/279335601 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c05dd00 con 0x55b502e53310 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.013+0000 7fb03920f800 1 -- 172.21.15.133:0/279335601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b502e53e60 con 0x55b502e53310 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.013+0000 7faf1a7fc640 1 -- 172.21.15.133:0/279335601 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb01c069400 con 0x55b502e53310 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.013+0000 7fb03920f800 1 -- 172.21.15.133:0/279335601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b502e549b0 con 0x55b502e53310 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.013+0000 7faf1a7fc640 1 -- 172.21.15.133:0/279335601 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb01c059040 con 0x55b502e53310 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.013+0000 7faf1a7fc640 1 --2- 172.21.15.133:0/279335601 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf0c0367e0 0x7faf0c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.014+0000 7faf1a7fc640 1 -- 172.21.15.133:0/279335601 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fb01c08f510 con 0x55b502e53310 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.014+0000 7fb0350e5640 1 --2- 172.21.15.133:0/279335601 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf0c0367e0 0x7faf0c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.014+0000 7fb03920f800 1 Processor -- start 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.014+0000 7fb03920f800 1 -- start start 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.014+0000 7fb0350e5640 1 --2- 172.21.15.133:0/279335601 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf0c0367e0 0x7faf0c038ca0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55b502e435f0 tx=0x7fb030005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.014+0000 7fb03920f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e60930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.014+0000 7fb03920f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b502bb55d0 con 0x55b502e60510 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.014+0000 7fb02c0e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e60930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.014+0000 7fb02c0e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e60930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54040/0 (socket says 172.21.15.133:54040) 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.014+0000 7fb02c0e3640 1 -- 172.21.15.133:0/82770299 learned_addr learned my addr 172.21.15.133:0/82770299 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.014+0000 7fb02c0e3640 1 -- 172.21.15.133:0/82770299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b502e60f00 con 0x55b502e60510 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7fb02c0e3640 1 --2- 172.21.15.133:0/82770299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e60930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb01c05cfd0 tx=0x7fb01c08f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b6e5a408629c8a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7faf0bfff640 1 -- 172.21.15.133:0/82770299 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb01c050340 con 0x55b502e60510 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7faf0bfff640 1 -- 172.21.15.133:0/82770299 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c072580 con 0x55b502e60510 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7faf0bfff640 1 -- 172.21.15.133:0/82770299 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb01c0064b0 con 0x55b502e60510 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7fb03920f800 1 -- 172.21.15.133:0/82770299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 msgr2=0x55b502e60930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7fb03920f800 1 --2- 172.21.15.133:0/82770299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e60930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb01c05cfd0 tx=0x7fb01c08f420 comp rx=0 tx=0).stop 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7fb03920f800 1 -- 172.21.15.133:0/82770299 shutdown_connections 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7fb03920f800 1 --2- 172.21.15.133:0/82770299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e60930 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7fb03920f800 1 -- 172.21.15.133:0/82770299 >> 172.21.15.133:0/82770299 conn(0x55b502e5c830 msgr2=0x55b502e5a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7fb03920f800 1 -- 172.21.15.133:0/82770299 shutdown_connections 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7fb03920f800 1 -- 172.21.15.133:0/82770299 wait complete. 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.015+0000 7fb03920f800 1 Processor -- start 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.016+0000 7fb03920f800 1 -- start start 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.016+0000 7fb03920f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.016+0000 7fb03920f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b502e67ae0 con 0x55b502e60510 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.016+0000 7fb02c0e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.016+0000 7fb02c0e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e675a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54042/0 (socket says 172.21.15.133:54042) 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.016+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 learned_addr learned my addr 172.21.15.133:0/1478475741 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.016+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b502e549b0 con 0x55b502e60510 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.016+0000 7fb02c0e3640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e675a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb01c069fb0 tx=0x7fb01c08d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.017+0000 7faf0a7fc640 1 -- 172.21.15.133:0/1478475741 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb01c08c130 con 0x55b502e60510 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.017+0000 7faf0a7fc640 1 -- 172.21.15.133:0/1478475741 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c08c290 con 0x55b502e60510 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.017+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b502e67ce0 con 0x55b502e60510 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.017+0000 7faf0a7fc640 1 -- 172.21.15.133:0/1478475741 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb01c08c550 con 0x55b502e60510 2024-02-15T22:56:47.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.017+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b502e67ce0 con 0x55b502e60510 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.017+0000 7faf0a7fc640 1 -- 172.21.15.133:0/1478475741 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb01c006980 con 0x55b502e60510 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.018+0000 7faf0a7fc640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf00036740 0x7faf00038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.018+0000 7faf0a7fc640 1 -- 172.21.15.133:0/1478475741 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fb01c09ac00 con 0x55b502e60510 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.018+0000 7fb0350e5640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf00036740 0x7faf00038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.018+0000 7fb0350e5640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf00036740 0x7faf00038c00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb03000b010 tx=0x7fb030020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.018+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.018+0000 7fb03920f800 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b502e72f00 0x55b502e753c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.018+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e75b10 con 0x55b502e72f00 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.018+0000 7fb0348e4640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b502e72f00 0x55b502e753c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb0348e4640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b502e72f00 0x55b502e753c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 20 realm 2024-02-15T22:56:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e75ee0 con 0x55b502e72f00 2024-02-15T22:56:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e76760 con 0x55b502e72f00 2024-02-15T22:56:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e76ac0 con 0x55b502e72f00 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.019+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e772c0 con 0x55b502e72f00 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.020+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.020+0000 7fb03920f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.020+0000 7fb03920f800 20 searching for the correct realm 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.020+0000 7fb03920f800 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55b502e791b0 0x55b502e7b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.020+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e791b0 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.020+0000 7fb02c0e3640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55b502e791b0 0x55b502e7b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.020+0000 7fb02c0e3640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55b502e791b0 0x55b502e7b670 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.021+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb01c096070 con 0x55b502e791b0 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.021+0000 7fb02c0e3640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb01c04bbe0 0x7fb01c04b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.021+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb01c04bbe0 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.021+0000 7fb0350e5640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb01c04bbe0 0x7fb01c04b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.021+0000 7fb0350e5640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb01c04bbe0 0x7fb01c04b480 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.021+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb03000a4a0 con 0x7fb01c04bbe0 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.021+0000 7fb0350e5640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb0300141d0 0x7fb030015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.021+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb0300141d0 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.021+0000 7fb0348e4640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb0300141d0 0x7fb030015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.022+0000 7fb0348e4640 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb0300141d0 0x7fb030015940 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.022+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.022+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e72f00 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.022+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.022+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e72f00 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.023+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.023+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb0300141d0 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.023+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.023+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb0300141d0 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.023+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.023+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb01c04bbe0 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.023+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb03000a4a0 con 0x7fb01c04bbe0 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.023+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e791b0 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.024+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.024+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e72f00 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.024+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.024+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb0300141d0 2024-02-15T22:56:47.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.024+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.024+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e72f00 2024-02-15T22:56:47.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.024+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.024+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb01c04bbe0 2024-02-15T22:56:47.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.025+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.025+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e791b0 2024-02-15T22:56:47.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.025+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.025+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e791b0 2024-02-15T22:56:47.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.025+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.025+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb0300141d0 2024-02-15T22:56:47.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.025+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.025+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e791b0 2024-02-15T22:56:47.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.025+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.026+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e791b0 2024-02-15T22:56:47.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.026+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.026+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e72f00 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.026+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.026+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e72f00 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.026+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.026+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb0300141d0 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.027+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.027+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e791b0 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.027+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.027+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb01c04bbe0 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.027+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.027+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e72f00 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.027+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.027+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb0300141d0 2024-02-15T22:56:47.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.028+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.028+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e791b0 2024-02-15T22:56:47.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.028+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.028+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb0300141d0 2024-02-15T22:56:47.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.028+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.028+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb01c04bbe0 2024-02-15T22:56:47.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.028+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.028+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e791b0 2024-02-15T22:56:47.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb0300141d0 2024-02-15T22:56:47.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x55b502e72f00 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7bd40 con 0x7fb01c04bbe0 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb03920f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb03920f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb03920f800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb03920f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb03920f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb03920f800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.029+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e787c0 con 0x55b502e72f00 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e77fe0 con 0x55b502e72f00 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7c180 con 0x55b502e72f00 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 20 zone default found 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 4 Realm: () 2024-02-15T22:56:47.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 20 zonegroup default 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7c180 con 0x7fb0300141d0 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.030+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7e000 con 0x55b502e791b0 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.031+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.031+0000 7fb03920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.031+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.031+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7e360 con 0x55b502e791b0 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.031+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.031+0000 7fb03920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.031+0000 7fb03920f800 20 started sync module instance, tier type = 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.031+0000 7fb03920f800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.031+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7d5d0 con 0x7fb01c04bbe0 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.032+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.032+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94235926190784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7d5d0 con 0x7fb01c04bbe0 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.032+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7edc0 con 0x55b502e72f00 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.033+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94235926190784] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.034+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.034+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94235926194352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7d5d0 con 0x55b502e72f00 2024-02-15T22:56:47.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.034+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7f8b0 con 0x55b502e791b0 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.034+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94235926194352] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.035+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.035+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94235926188336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7d550 con 0x55b502e791b0 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.035+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e80620 con 0x7fb01c04bbe0 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.036+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94235926188336] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.036+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.036+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94235926199392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e80a00 con 0x7fb01c04bbe0 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.036+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e814a0 con 0x55b502e72f00 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.037+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.037+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94235926204288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e814a0 con 0x55b502e72f00 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.038+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e82440 con 0x7fb0300141d0 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.038+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94235926199392] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.039+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.039+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94235926204288] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.039+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94235926208320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e82400 con 0x7fb0300141d0 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.039+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e81800 con 0x7fb0300141d0 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.040+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94235926208320] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.040+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.040+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94235926200448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e82960 con 0x7fb0300141d0 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.040+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e832d0 con 0x7fb0300141d0 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.041+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94235926200448] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.041+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.041+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94235926206416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e832d0 con 0x7fb0300141d0 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.041+0000 7fb03920f800 20 add_watcher() i=0 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.041+0000 7fb03920f800 20 add_watcher() i=1 2024-02-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.041+0000 7fb03920f800 20 add_watcher() i=2 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.041+0000 7fb03920f800 20 add_watcher() i=3 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.041+0000 7fb03920f800 20 add_watcher() i=4 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.041+0000 7fb03920f800 20 add_watcher() i=5 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.041+0000 7fb03920f800 20 add_watcher() i=6 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.042+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94235926206416] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.042+0000 7fb03920f800 20 add_watcher() i=7 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.042+0000 7fb03920f800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.042+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e832d0 con 0x55b502e72f00 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.042+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.042+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94235926214288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e83f50 con 0x55b502e72f00 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.043+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94235926214288] v32'178 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.043+0000 7faeeafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.044+0000 7fb03920f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.044+0000 7fb03920f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.044+0000 7fb03920f800 5 note: GC not initialized 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.044+0000 7faee9fe3640 20 reqs_thread_entry: start 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.044+0000 7fb03920f800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.044+0000 7fb03920f800 20 Filter name: none 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.044+0000 7fae5b7fe640 20 reqs_thread_entry: start 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.044+0000 7fb03920f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.044+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.044+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502eb8c00 con 0x7fb01c04bbe0 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 : miss 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 8.7 8:e4120b70:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502eba710 con 0x7fb0300141d0 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 info.flags=0x17 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 to cache LRU end 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 20 get_obj_state: octx=0x7fb02401aef0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55b502ebcd68 s->prefetch_data=0 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.045+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 3.2e 3:75b7bb57:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502ebdc60 con 0x7fb01c04bbe0 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.046+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(64 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 262+0+864 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.046+0000 7fb03920f800 10 manifest: total_size = 5 2024-02-15T22:56:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.046+0000 7fb03920f800 20 get_obj_state: setting s->obj_tag to _A0hcYMyWjveUO-vzAYj0QDo0n7otZRf 2024-02-15T22:56:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.046+0000 7faeeafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.046+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94235926214288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502ebdc60 con 0x55b502e72f00 2024-02-15T22:56:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.047+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94235926214288] v32'179 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.047+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94235926190784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502ebdc60 con 0x7fb01c04bbe0 2024-02-15T22:56:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.048+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94235926190784] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.048+0000 7fb03920f800 20 remove_watcher() i=0 2024-02-15T22:56:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.048+0000 7fb03920f800 2 removed watcher, disabling cache 2024-02-15T22:56:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.048+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94235926194352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502ebdc60 con 0x55b502e72f00 2024-02-15T22:56:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.050+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94235926194352] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.050+0000 7fb03920f800 20 remove_watcher() i=1 2024-02-15T22:56:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.050+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94235926188336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502ebdc60 con 0x55b502e791b0 2024-02-15T22:56:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.051+0000 7fb02c0e3640 1 -- 172.21.15.133:0/1478475741 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94235926188336] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb01c0ab040 con 0x55b502e791b0 2024-02-15T22:56:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.051+0000 7fb03920f800 20 remove_watcher() i=2 2024-02-15T22:56:47.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.051+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94235926199392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502ea2870 con 0x7fb01c04bbe0 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.052+0000 7fb0350e5640 1 -- 172.21.15.133:0/1478475741 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94235926199392] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb03003a040 con 0x7fb01c04bbe0 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.052+0000 7fb03920f800 20 remove_watcher() i=3 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.052+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94235926204288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7e8b0 con 0x55b502e72f00 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.053+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94235926204288] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x55b502e72f00 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.053+0000 7fb03920f800 20 remove_watcher() i=4 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.053+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94235926208320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7d130 con 0x7fb0300141d0 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.054+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94235926208320] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.054+0000 7fb03920f800 20 remove_watcher() i=5 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.054+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94235926200448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7fc60 con 0x7fb0300141d0 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.055+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94235926200448] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.055+0000 7fb03920f800 20 remove_watcher() i=6 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.055+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94235926206416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b502e7e8b0 con 0x7fb0300141d0 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94235926206416] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb024016070 con 0x7fb0300141d0 2024-02-15T22:56:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 20 remove_watcher() i=7 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb0300141d0 msgr2=0x7fb030015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb0300141d0 0x7fb030015940 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b502e72f00 msgr2=0x55b502e753c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b502e72f00 0x55b502e753c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb01c04bbe0 msgr2=0x7fb01c04b480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fb01c04bbe0 0x7fb01c04b480 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55b502e791b0 msgr2=0x55b502e7b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55b502e791b0 0x55b502e7b670 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf00036740 msgr2=0x7faf00038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf00036740 0x7faf00038c00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb03000b010 tx=0x7fb030020000 comp rx=0 tx=0).stop 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 msgr2=0x55b502e675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb0348e4640 1 -- 172.21.15.133:0/1478475741 reap_dead start 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.056+0000 7fb03920f800 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e675a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb01c069fb0 tx=0x7fb01c08d880 comp rx=0 tx=0).stop 2024-02-15T22:56:47.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 shutdown_connections 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 --2- 172.21.15.133:0/1478475741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e60510 0x55b502e675a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 >> 172.21.15.133:0/1478475741 conn(0x55b502e5c830 msgr2=0x55b502e59e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 shutdown_connections 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/1478475741 wait complete. 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/279335601 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf0c0367e0 msgr2=0x7faf0c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 --2- 172.21.15.133:0/279335601 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf0c0367e0 0x7faf0c038ca0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55b502e435f0 tx=0x7fb030005840 comp rx=0 tx=0).stop 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/279335601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e53310 msgr2=0x55b502e53730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 --2- 172.21.15.133:0/279335601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e53310 0x55b502e53730 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb01c044830 tx=0x7fb01c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/279335601 shutdown_connections 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 --2- 172.21.15.133:0/279335601 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf0c0367e0 0x7faf0c038ca0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 --2- 172.21.15.133:0/279335601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502e53310 0x55b502e53730 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/279335601 >> 172.21.15.133:0/279335601 conn(0x55b502e473b0 msgr2=0x55b502e477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/279335601 shutdown_connections 2024-02-15T22:56:47.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/279335601 wait complete. 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b502d423f0 msgr2=0x55b502e42570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b502d423f0 0x55b502e42570 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf1c0367e0 msgr2=0x7faf1c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf1c0367e0 0x7faf1c038ca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb01c054000 tx=0x7fb01c04e000 comp rx=0 tx=0).stop 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 msgr2=0x55b502e3b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e3b890 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb02400b210 tx=0x7fb024000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 shutdown_connections 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55b502d423f0 0x55b502e42570 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faf1c0367e0 0x7faf1c038ca0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 --2- 172.21.15.133:0/423779170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b502d408b0 0x55b502e3b890 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 >> 172.21.15.133:0/423779170 conn(0x55b502d3c4f0 msgr2=0x55b502e2e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.057+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 shutdown_connections 2024-02-15T22:56:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.058+0000 7fb03920f800 1 -- 172.21.15.133:0/423779170 wait complete. 2024-02-15T22:56:47.072 INFO:teuthology.orchestra.run.smithi133.stdout:fooFoofooFooFULL_CONTROL 2024-02-15T22:56:47.073 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-02-15T22:56:47.075 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-02-15T22:56:47.079 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:47.079 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-15T22:56:47.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-15T22:56:47.079 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-15T22:56:47.123 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:47.123 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:47.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.121+0000 7f56e4939800 1 Processor -- start 2024-02-15T22:56:47.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.121+0000 7f56e4939800 1 -- start start 2024-02-15T22:56:47.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.121+0000 7f56e4939800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562f57f892a0 0x562f57f8b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.121+0000 7f56e4939800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562f57ecfba0 con 0x562f57ef8120 2024-02-15T22:56:47.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.121+0000 7f56e4939800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x562f57e87450 con 0x562f57f892a0 2024-02-15T22:56:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.121+0000 7f56dfecf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562f57f892a0 0x562f57f8b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.121+0000 7f56dfecf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562f57f892a0 0x562f57f8b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54048/0 (socket says 172.21.15.133:54048) 2024-02-15T22:56:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.121+0000 7f56dfecf640 1 -- 172.21.15.133:0/339123567 learned_addr learned my addr 172.21.15.133:0/339123567 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.121+0000 7f56e06d0640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x562f57ef8120 0x562f57f87b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:56526/0 (socket says 172.21.15.133:56526) 2024-02-15T22:56:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.122+0000 7f56dfecf640 1 -- 172.21.15.133:0/339123567 >> v1:172.21.15.52:6789/0 conn(0x562f57ef8120 legacy=0x562f57f87b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.122+0000 7f56df6ce640 1 -- 172.21.15.133:0/339123567 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647006648 0 0) 0x562f57ecfba0 con 0x562f57ef8120 2024-02-15T22:56:47.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.122+0000 7f56dfecf640 1 -- 172.21.15.133:0/339123567 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f57f8ce70 con 0x562f57f892a0 2024-02-15T22:56:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.123+0000 7f56dfecf640 1 --2- 172.21.15.133:0/339123567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57f892a0 0x562f57f8b760 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f56d400a520 tx=0x7f56d401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968007fa0519a22f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.124+0000 7f56df6ce640 1 -- 172.21.15.133:0/339123567 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d4052570 con 0x562f57f892a0 2024-02-15T22:56:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.124+0000 7f56df6ce640 1 -- 172.21.15.133:0/339123567 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d40526d0 con 0x562f57f892a0 2024-02-15T22:56:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.124+0000 7f56df6ce640 1 -- 172.21.15.133:0/339123567 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d4052990 con 0x562f57f892a0 2024-02-15T22:56:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.124+0000 7f56e4939800 1 -- 172.21.15.133:0/339123567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57f892a0 msgr2=0x562f57f8b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.124+0000 7f56e4939800 1 --2- 172.21.15.133:0/339123567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57f892a0 0x562f57f8b760 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f56d400a520 tx=0x7f56d401cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.124+0000 7f56e4939800 1 -- 172.21.15.133:0/339123567 shutdown_connections 2024-02-15T22:56:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.124+0000 7f56e4939800 1 --2- 172.21.15.133:0/339123567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57f892a0 0x562f57f8b760 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.124+0000 7f56e4939800 1 -- 172.21.15.133:0/339123567 >> 172.21.15.133:0/339123567 conn(0x562f57f7f4f0 msgr2=0x562f57f81910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.124+0000 7f56e4939800 1 -- 172.21.15.133:0/339123567 shutdown_connections 2024-02-15T22:56:47.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.124+0000 7f56e4939800 1 -- 172.21.15.133:0/339123567 wait complete. 2024-02-15T22:56:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.136+0000 7f56e4939800 1 Processor -- start 2024-02-15T22:56:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.136+0000 7f56e4939800 1 -- start start 2024-02-15T22:56:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.136+0000 7f56e4939800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f57f85480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.136+0000 7f56e4939800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f57e84980 con 0x562f57ef8120 2024-02-15T22:56:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.136+0000 7f56e06d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f57f85480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.136+0000 7f56e06d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f57f85480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54062/0 (socket says 172.21.15.133:54062) 2024-02-15T22:56:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.136+0000 7f56e06d0640 1 -- 172.21.15.133:0/658238180 learned_addr learned my addr 172.21.15.133:0/658238180 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.137+0000 7f56e06d0640 1 -- 172.21.15.133:0/658238180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4005de0 con 0x562f57ef8120 2024-02-15T22:56:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.137+0000 7f56e06d0640 1 --2- 172.21.15.133:0/658238180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f57f85480 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b210 tx=0x7f56d000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2db44c8879a22b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.137+0000 7f55ce60c640 1 -- 172.21.15.133:0/658238180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d0014070 con 0x562f57ef8120 2024-02-15T22:56:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.137+0000 7f55ce60c640 1 -- 172.21.15.133:0/658238180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000d500 con 0x562f57ef8120 2024-02-15T22:56:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.137+0000 7f55ce60c640 1 -- 172.21.15.133:0/658238180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d000d800 con 0x562f57ef8120 2024-02-15T22:56:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e4939800 1 -- 172.21.15.133:0/658238180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 msgr2=0x562f57f85480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e4939800 1 --2- 172.21.15.133:0/658238180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f57f85480 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b210 tx=0x7f56d000b6d0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e4939800 1 -- 172.21.15.133:0/658238180 shutdown_connections 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e4939800 1 --2- 172.21.15.133:0/658238180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f57f85480 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e4939800 1 -- 172.21.15.133:0/658238180 >> 172.21.15.133:0/658238180 conn(0x562f57f7f4f0 msgr2=0x562f58070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e4939800 1 -- 172.21.15.133:0/658238180 shutdown_connections 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e4939800 1 -- 172.21.15.133:0/658238180 wait complete. 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e4939800 1 Processor -- start 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e4939800 1 -- start start 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e4939800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f5807e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e4939800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f57e80160 con 0x562f57ef8120 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e06d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f5807e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e06d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f5807e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54064/0 (socket says 172.21.15.133:54064) 2024-02-15T22:56:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.138+0000 7f56e06d0640 1 -- 172.21.15.133:0/2844056387 learned_addr learned my addr 172.21.15.133:0/2844056387 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.139+0000 7f56e06d0640 1 -- 172.21.15.133:0/2844056387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0001b70 con 0x562f57ef8120 2024-02-15T22:56:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.139+0000 7f56e06d0640 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f5807e790 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b210 tx=0x7f56d0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.139+0000 7f55cce09640 1 -- 172.21.15.133:0/2844056387 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d000f950 con 0x562f57ef8120 2024-02-15T22:56:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.139+0000 7f55cce09640 1 -- 172.21.15.133:0/2844056387 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d0020070 con 0x562f57ef8120 2024-02-15T22:56:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.139+0000 7f55cce09640 1 -- 172.21.15.133:0/2844056387 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d000fc20 con 0x562f57ef8120 2024-02-15T22:56:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.139+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562f5807ecd0 con 0x562f57ef8120 2024-02-15T22:56:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.139+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f5807f1b0 con 0x562f57ef8120 2024-02-15T22:56:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.140+0000 7f55cce09640 1 -- 172.21.15.133:0/2844056387 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f56d000d040 con 0x562f57ef8120 2024-02-15T22:56:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.140+0000 7f55cce09640 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55c8036790 0x7f55c8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.140+0000 7f55cce09640 1 -- 172.21.15.133:0/2844056387 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f56d000a040 con 0x562f57ef8120 2024-02-15T22:56:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.140+0000 7f56dfecf640 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55c8036790 0x7f55c8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.140+0000 7f56e4939800 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562f57f892a0 0x562f58085470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.140+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f58085a40 con 0x562f57f892a0 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.140+0000 7f56e0ed1640 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562f57f892a0 0x562f58085470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.140+0000 7f56dfecf640 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55c8036790 0x7f55c8038c50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f56d4054000 tx=0x7f56d404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.140+0000 7f56e0ed1640 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562f57f892a0 0x562f58085470 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.141+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2844056387 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f56d800a4a0 con 0x562f57f892a0 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.141+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f58082ba0 con 0x562f57f892a0 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.141+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2844056387 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f56d800a4a0 con 0x562f57f892a0 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.141+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580877a0 con 0x562f57f892a0 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.141+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2844056387 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f56d800a4a0 con 0x562f57f892a0 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.141+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f58086ab0 con 0x562f57f892a0 2024-02-15T22:56:47.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.142+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2844056387 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f56d800a4a0 con 0x562f57f892a0 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.142+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f58086ec0 con 0x562f57f892a0 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.142+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2844056387 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f56d800a4a0 con 0x562f57f892a0 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.142+0000 7f56e4939800 1 Processor -- start 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.142+0000 7f56e4939800 1 -- start start 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.142+0000 7f56e4939800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580961a0 0x562f580965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.142+0000 7f56e4939800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f57e22e80 con 0x562f580961a0 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.143+0000 7f56dfecf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580961a0 0x562f580965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.143+0000 7f56dfecf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580961a0 0x562f580965c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54074/0 (socket says 172.21.15.133:54074) 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.143+0000 7f56dfecf640 1 -- 172.21.15.133:0/180225189 learned_addr learned my addr 172.21.15.133:0/180225189 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.143+0000 7f56dfecf640 1 -- 172.21.15.133:0/180225189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f58096b00 con 0x562f580961a0 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.143+0000 7f56dfecf640 1 --2- 172.21.15.133:0/180225189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580961a0 0x562f580965c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f56d4044940 tx=0x7f56d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.143+0000 7f55c5ffb640 1 -- 172.21.15.133:0/180225189 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d405f2e0 con 0x562f580961a0 2024-02-15T22:56:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.143+0000 7f55c5ffb640 1 -- 172.21.15.133:0/180225189 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d4064040 con 0x562f580961a0 2024-02-15T22:56:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.143+0000 7f55c5ffb640 1 -- 172.21.15.133:0/180225189 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d405fa60 con 0x562f580961a0 2024-02-15T22:56:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.143+0000 7f56e4939800 1 -- 172.21.15.133:0/180225189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562f58096cf0 con 0x562f580961a0 2024-02-15T22:56:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.143+0000 7f56e4939800 1 -- 172.21.15.133:0/180225189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f58097840 con 0x562f580961a0 2024-02-15T22:56:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.144+0000 7f55c5ffb640 1 -- 172.21.15.133:0/180225189 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f56d4059040 con 0x562f580961a0 2024-02-15T22:56:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.144+0000 7f55c5ffb640 1 --2- 172.21.15.133:0/180225189 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55b80367e0 0x7f55b8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.144+0000 7f55c5ffb640 1 -- 172.21.15.133:0/180225189 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f56d408f240 con 0x562f580961a0 2024-02-15T22:56:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.144+0000 7f56e0ed1640 1 --2- 172.21.15.133:0/180225189 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55b80367e0 0x7f55b8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.144+0000 7f56e4939800 1 Processor -- start 2024-02-15T22:56:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f56e4939800 1 -- start start 2024-02-15T22:56:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f56e0ed1640 1 --2- 172.21.15.133:0/180225189 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55b80367e0 0x7f55b8038ca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x562f580864f0 tx=0x7f56d8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f56e4939800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580a3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f56e4939800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f57df85d0 con 0x562f580a3330 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f56dfecf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f56dfecf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580a3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54076/0 (socket says 172.21.15.133:54076) 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f56dfecf640 1 -- 172.21.15.133:0/2532176508 learned_addr learned my addr 172.21.15.133:0/2532176508 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f56dfecf640 1 -- 172.21.15.133:0/2532176508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f580a3d20 con 0x562f580a3330 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f56dfecf640 1 --2- 172.21.15.133:0/2532176508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580a3750 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f56d408d620 tx=0x7f56d405ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d615d7e510242e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f55b77fe640 1 -- 172.21.15.133:0/2532176508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d408c070 con 0x562f580a3330 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f55b77fe640 1 -- 172.21.15.133:0/2532176508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d405be20 con 0x562f580a3330 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.145+0000 7f55b77fe640 1 -- 172.21.15.133:0/2532176508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d405c3e0 con 0x562f580a3330 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.146+0000 7f56e4939800 1 -- 172.21.15.133:0/2532176508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 msgr2=0x562f580a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.146+0000 7f56e4939800 1 --2- 172.21.15.133:0/2532176508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580a3750 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f56d408d620 tx=0x7f56d405ff90 comp rx=0 tx=0).stop 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.146+0000 7f56e4939800 1 -- 172.21.15.133:0/2532176508 shutdown_connections 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.146+0000 7f56e4939800 1 --2- 172.21.15.133:0/2532176508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580a3750 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.146+0000 7f56e4939800 1 -- 172.21.15.133:0/2532176508 >> 172.21.15.133:0/2532176508 conn(0x562f5809f690 msgr2=0x562f5809d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.146+0000 7f56e4939800 1 -- 172.21.15.133:0/2532176508 shutdown_connections 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.146+0000 7f56e4939800 1 -- 172.21.15.133:0/2532176508 wait complete. 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.146+0000 7f56e4939800 1 Processor -- start 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.146+0000 7f56e4939800 1 -- start start 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.146+0000 7f56e4939800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.146+0000 7f56e4939800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f580aa900 con 0x562f580a3330 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.147+0000 7f56dfecf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.147+0000 7f56dfecf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580aa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54084/0 (socket says 172.21.15.133:54084) 2024-02-15T22:56:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.147+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 learned_addr learned my addr 172.21.15.133:0/2314521279 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.147+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f58097840 con 0x562f580a3330 2024-02-15T22:56:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.147+0000 7f56dfecf640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580aa3c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f56d405ffd0 tx=0x7f56d408d5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.147+0000 7f55b5ffb640 1 -- 172.21.15.133:0/2314521279 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d4067390 con 0x562f580a3330 2024-02-15T22:56:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.147+0000 7f55b5ffb640 1 -- 172.21.15.133:0/2314521279 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d40674f0 con 0x562f580a3330 2024-02-15T22:56:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.147+0000 7f55b5ffb640 1 -- 172.21.15.133:0/2314521279 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d4000ed0 con 0x562f580a3330 2024-02-15T22:56:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.147+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562f580aab00 con 0x562f580a3330 2024-02-15T22:56:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.147+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f580aab00 con 0x562f580a3330 2024-02-15T22:56:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.148+0000 7f55b5ffb640 1 -- 172.21.15.133:0/2314521279 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f56d408da30 con 0x562f580a3330 2024-02-15T22:56:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.148+0000 7f55b5ffb640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55a80367e0 0x7f55a8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.148+0000 7f55b5ffb640 1 -- 172.21.15.133:0/2314521279 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f56d4099bb0 con 0x562f580a3330 2024-02-15T22:56:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.148+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.148+0000 7f56e4939800 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562f580b5de0 0x562f580b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580b89f0 con 0x562f580b5de0 2024-02-15T22:56:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e06d0640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562f580b5de0 0x562f580b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e06d0640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562f580b5de0 0x562f580b82a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 20 realm 2024-02-15T22:56:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580b8dc0 con 0x562f580b5de0 2024-02-15T22:56:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580b9640 con 0x562f580b5de0 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.149+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580b99a0 con 0x562f580b5de0 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.150+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.150+0000 7f56e4939800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.150+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.150+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580ba1a0 con 0x562f580b5de0 2024-02-15T22:56:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.150+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.150+0000 7f56e4939800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.150+0000 7f56e4939800 20 searching for the correct realm 2024-02-15T22:56:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.150+0000 7f56e4939800 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562f580bc090 0x562f580be550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.150+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580bc090 2024-02-15T22:56:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.150+0000 7f56dfecf640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562f580bc090 0x562f580be550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.150+0000 7f56dfecf640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562f580bc090 0x562f580be550 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.151+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.151+0000 7f56dfecf640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f56d4098020 0x7f56d4086820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.151+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d4098020 2024-02-15T22:56:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.151+0000 7f56e0ed1640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f56d4098020 0x7f56d4086820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.151+0000 7f56e0ed1640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f56d4098020 0x7f56d4086820 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.151+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.151+0000 7f56e0ed1640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f56d80141d0 0x7f56d8027970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.151+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d80141d0 2024-02-15T22:56:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.152+0000 7f56e06d0640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f56d80141d0 0x7f56d8027970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.152+0000 7f56e06d0640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f56d80141d0 0x7f56d8027970 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.152+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.152+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580b5de0 2024-02-15T22:56:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.152+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.152+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580b5de0 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.153+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.153+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d80141d0 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.153+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.153+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d80141d0 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.153+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.153+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d4098020 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.153+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.153+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580bc090 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.154+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.154+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580b5de0 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.154+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.154+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d80141d0 2024-02-15T22:56:47.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.154+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.154+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580b5de0 2024-02-15T22:56:47.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.154+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.154+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d4098020 2024-02-15T22:56:47.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.155+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.155+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580bc090 2024-02-15T22:56:47.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.155+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.155+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580bc090 2024-02-15T22:56:47.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.155+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.155+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d80141d0 2024-02-15T22:56:47.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.155+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.155+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580bc090 2024-02-15T22:56:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.156+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.156+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580bc090 2024-02-15T22:56:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.156+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.156+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580b5de0 2024-02-15T22:56:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.156+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.156+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580b5de0 2024-02-15T22:56:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.156+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.156+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d80141d0 2024-02-15T22:56:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.157+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.157+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580bc090 2024-02-15T22:56:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.157+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.157+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d4098020 2024-02-15T22:56:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.157+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.157+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580b5de0 2024-02-15T22:56:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.157+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.157+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d80141d0 2024-02-15T22:56:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.158+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.158+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x562f580bc090 2024-02-15T22:56:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.158+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.158+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d80141d0 2024-02-15T22:56:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.158+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.158+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bec20 con 0x7f56d4098020 2024-02-15T22:56:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.158+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.158+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f56d8036040 con 0x562f580bc090 2024-02-15T22:56:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e0ed1640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55a80367e0 0x7f55a8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f56d8036040 con 0x7f56d80141d0 2024-02-15T22:56:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e0ed1640 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55a80367e0 0x7f55a8038ca0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f56d000f640 tx=0x7f56d803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f56d8036040 con 0x562f580b5de0 2024-02-15T22:56:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f56d8036040 con 0x7f56d4098020 2024-02-15T22:56:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e4939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e4939800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e4939800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e4939800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e4939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e4939800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.159+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580ba530 con 0x562f580b5de0 2024-02-15T22:56:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580ba8e0 con 0x562f580b5de0 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580ba8e0 con 0x562f580b5de0 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 20 zone default found 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 4 Realm: () 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:47.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:47.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 20 zonegroup default 2024-02-15T22:56:47.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.160+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bb6b0 con 0x7f56d80141d0 2024-02-15T22:56:47.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56e4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580badf0 con 0x562f580bc090 2024-02-15T22:56:47.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56e4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c0a40 con 0x562f580bc090 2024-02-15T22:56:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56e4939800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56e4939800 20 started sync module instance, tier type = 2024-02-15T22:56:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56e4939800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.161+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c0320 con 0x7f56d4098020 2024-02-15T22:56:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.162+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.162+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94761340632704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c02a0 con 0x7f56d4098020 2024-02-15T22:56:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.162+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c1770 con 0x562f580b5de0 2024-02-15T22:56:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.163+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94761340632704] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.163+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.163+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94761340636720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c16f0 con 0x562f580b5de0 2024-02-15T22:56:47.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.163+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c2060 con 0x562f580bc090 2024-02-15T22:56:47.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.164+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94761340636720] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.164+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.164+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94761340637776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c1670 con 0x562f580bc090 2024-02-15T22:56:47.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.164+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c2ec0 con 0x7f56d4098020 2024-02-15T22:56:47.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.165+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94761340637776] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.166+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.166+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94761340643872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c32e0 con 0x7f56d4098020 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.166+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c3c50 con 0x562f580b5de0 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.167+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.167+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94761340647344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c3c10 con 0x562f580b5de0 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.167+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c4bd0 con 0x7f56d80141d0 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.167+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94761340643872] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.168+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.168+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94761340651248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c4bd0 con 0x7f56d80141d0 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.168+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94761340647344] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.168+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c55d0 con 0x7f56d80141d0 2024-02-15T22:56:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.169+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94761340651248] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.169+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.169+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94761340649600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c50f0 con 0x7f56d80141d0 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.169+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c5a60 con 0x7f56d80141d0 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.170+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94761340649600] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.170+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.170+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94761340644928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c5a60 con 0x7f56d80141d0 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.170+0000 7f56e4939800 20 add_watcher() i=0 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.170+0000 7f56e4939800 20 add_watcher() i=1 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.170+0000 7f56e4939800 20 add_watcher() i=2 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.170+0000 7f56e4939800 20 add_watcher() i=3 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.170+0000 7f56e4939800 20 add_watcher() i=4 2024-02-15T22:56:47.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.170+0000 7f56e4939800 20 add_watcher() i=5 2024-02-15T22:56:47.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.170+0000 7f56e4939800 20 add_watcher() i=6 2024-02-15T22:56:47.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.171+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94761340644928] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.171+0000 7f56e4939800 20 add_watcher() i=7 2024-02-15T22:56:47.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.171+0000 7f56e4939800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:47.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.171+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c92f0 con 0x562f580b5de0 2024-02-15T22:56:47.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.171+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.171+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94761340657184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c66e0 con 0x562f580b5de0 2024-02-15T22:56:47.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.172+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94761340657184] v32'180 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.172+0000 7f5596fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.172+0000 7f56e4939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.172+0000 7f56e4939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.172+0000 7f56e4939800 5 note: GC not initialized 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f5595fdb640 20 reqs_thread_entry: start 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e4939800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e4939800 20 Filter name: none 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f55077fe640 20 reqs_thread_entry: start 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e4939800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580fb420 con 0x7f56d4098020 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e4939800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e4939800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e4939800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e4939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 : miss 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e4939800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.173+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 8.7 8:e4120b70:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580fcf10 con 0x7f56d80141d0 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e4939800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e4939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 info.flags=0x17 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e4939800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 to cache LRU end 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e4939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e4939800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:47.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e4939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e4939800 20 get_obj_state: octx=0x7f56d001aef0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x562f580ff568 s->prefetch_data=0 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 3.2e 3:75b7bb57:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f58100420 con 0x7f56d4098020 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(64 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e4939800 10 manifest: total_size = 5 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.174+0000 7f56e4939800 20 get_obj_state: setting s->obj_tag to _RFnFU9xvsYeMtUQl2ULXZY2NMQSVOMb 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.175+0000 7f5596fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.175+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94761340657184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f58100420 con 0x562f580b5de0 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.176+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94761340657184] v32'181 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.176+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94761340632704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f58100420 con 0x7f56d4098020 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.177+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94761340632704] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.177+0000 7f56e4939800 20 remove_watcher() i=0 2024-02-15T22:56:47.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.177+0000 7f56e4939800 2 removed watcher, disabling cache 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.177+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94761340636720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f58100420 con 0x562f580b5de0 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.178+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94761340636720] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.178+0000 7f56e4939800 20 remove_watcher() i=1 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.178+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94761340637776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f58100420 con 0x562f580bc090 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.179+0000 7f56dfecf640 1 -- 172.21.15.133:0/2314521279 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94761340637776] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d4095070 con 0x562f580bc090 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.179+0000 7f56e4939800 20 remove_watcher() i=2 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.179+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94761340643872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580e5050 con 0x7f56d4098020 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.180+0000 7f56e0ed1640 1 -- 172.21.15.133:0/2314521279 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94761340643872] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d800a4a0 con 0x7f56d4098020 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.180+0000 7f56e4939800 20 remove_watcher() i=3 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.180+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94761340647344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bfe80 con 0x562f580b5de0 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.181+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94761340647344] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x562f580b5de0 2024-02-15T22:56:47.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.181+0000 7f56e4939800 20 remove_watcher() i=4 2024-02-15T22:56:47.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.181+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94761340651248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c2a20 con 0x7f56d80141d0 2024-02-15T22:56:47.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.182+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94761340651248] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.182+0000 7f56e4939800 20 remove_watcher() i=5 2024-02-15T22:56:47.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.182+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94761340649600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580c37b0 con 0x7f56d80141d0 2024-02-15T22:56:47.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.183+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94761340649600] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.183+0000 7f56e4939800 20 remove_watcher() i=6 2024-02-15T22:56:47.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.183+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94761340644928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562f580bfe80 con 0x7f56d80141d0 2024-02-15T22:56:47.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94761340644928] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f56d0016070 con 0x7f56d80141d0 2024-02-15T22:56:47.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 20 remove_watcher() i=7 2024-02-15T22:56:47.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f56d80141d0 msgr2=0x7f56d8027970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f56d80141d0 0x7f56d8027970 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562f580b5de0 msgr2=0x562f580b82a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562f580b5de0 0x562f580b82a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f56d4098020 msgr2=0x7f56d4086820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f56d4098020 0x7f56d4086820 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562f580bc090 msgr2=0x562f580be550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562f580bc090 0x562f580be550 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55a80367e0 msgr2=0x7f55a8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55a80367e0 0x7f55a8038ca0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f56d000f640 tx=0x7f56d803c040 comp rx=0 tx=0).stop 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 msgr2=0x562f580aa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580aa3c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f56d405ffd0 tx=0x7f56d408d5b0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e06d0640 1 -- 172.21.15.133:0/2314521279 reap_dead start 2024-02-15T22:56:47.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 shutdown_connections 2024-02-15T22:56:47.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 --2- 172.21.15.133:0/2314521279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580a3330 0x562f580aa3c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 >> 172.21.15.133:0/2314521279 conn(0x562f5809f690 msgr2=0x562f5809ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 shutdown_connections 2024-02-15T22:56:47.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.184+0000 7f56e4939800 1 -- 172.21.15.133:0/2314521279 wait complete. 2024-02-15T22:56:47.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/180225189 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55b80367e0 msgr2=0x7f55b8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 --2- 172.21.15.133:0/180225189 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55b80367e0 0x7f55b8038ca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x562f580864f0 tx=0x7f56d8005840 comp rx=0 tx=0).stop 2024-02-15T22:56:47.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/180225189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580961a0 msgr2=0x562f580965c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 --2- 172.21.15.133:0/180225189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580961a0 0x562f580965c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f56d4044940 tx=0x7f56d4002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/180225189 shutdown_connections 2024-02-15T22:56:47.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 --2- 172.21.15.133:0/180225189 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55b80367e0 0x7f55b8038ca0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 --2- 172.21.15.133:0/180225189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f580961a0 0x562f580965c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/180225189 >> 172.21.15.133:0/180225189 conn(0x562f5808a240 msgr2=0x562f5808a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/180225189 shutdown_connections 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/180225189 wait complete. 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562f57f892a0 msgr2=0x562f58085470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562f57f892a0 0x562f58085470 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55c8036790 msgr2=0x7f55c8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55c8036790 0x7f55c8038c50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f56d4054000 tx=0x7f56d404e000 comp rx=0 tx=0).stop 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 msgr2=0x562f5807e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f5807e790 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b210 tx=0x7f56d0000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 shutdown_connections 2024-02-15T22:56:47.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562f57f892a0 0x562f58085470 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f55c8036790 0x7f55c8038c50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 --2- 172.21.15.133:0/2844056387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562f57ef8120 0x562f5807e790 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 >> 172.21.15.133:0/2844056387 conn(0x562f57f7f4f0 msgr2=0x562f57f83ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 shutdown_connections 2024-02-15T22:56:47.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.185+0000 7f56e4939800 1 -- 172.21.15.133:0/2844056387 wait complete. 2024-02-15T22:56:47.210 INFO:teuthology.orchestra.run.smithi133.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-15T22:56:47.210 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-15T22:56:47.212 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-02-15T22:56:47.225 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:47.280 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-15T22:56:47.280 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-15T22:56:47.281 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-15T22:56:47.281 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-15T22:56:47.281 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-15T22:56:47.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-15T22:56:47.281 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-02-15T22:56:47.324 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:47.324 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.322+0000 7f5df8299800 1 Processor -- start 2024-02-15T22:56:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.322+0000 7f5df8299800 1 -- start start 2024-02-15T22:56:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.323+0000 7f5df8299800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55cc0ea12e90 0x55cc0ea132b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.323+0000 7f5df8299800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cc0e95eba0 con 0x55cc0ea140f0 2024-02-15T22:56:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.323+0000 7f5df8299800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cc0e916450 con 0x55cc0ea12e90 2024-02-15T22:56:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.323+0000 7f5df5d98640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55cc0ea12e90 0x55cc0ea132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.323+0000 7f5df5d98640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55cc0ea12e90 0x55cc0ea132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54100/0 (socket says 172.21.15.133:54100) 2024-02-15T22:56:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.323+0000 7f5ded597640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55cc0ea140f0 0x55cc0ea14570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:56534/0 (socket says 172.21.15.133:56534) 2024-02-15T22:56:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.323+0000 7f5df5d98640 1 -- 172.21.15.133:0/1858302408 learned_addr learned my addr 172.21.15.133:0/1858302408 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.323+0000 7f5df5d98640 1 -- 172.21.15.133:0/1858302408 >> v1:172.21.15.52:6789/0 conn(0x55cc0ea140f0 legacy=0x55cc0ea14570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.323+0000 7f5df5d98640 1 -- 172.21.15.133:0/1858302408 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc0ea13980 con 0x55cc0ea12e90 2024-02-15T22:56:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.325+0000 7f5df5d98640 1 --2- 172.21.15.133:0/1858302408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0ea132b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5de800a520 tx=0x7f5de801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d47ced695c0d76 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.325+0000 7f5df5597640 1 -- 172.21.15.133:0/1858302408 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de8052570 con 0x55cc0ea12e90 2024-02-15T22:56:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.325+0000 7f5df5597640 1 -- 172.21.15.133:0/1858302408 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de80526d0 con 0x55cc0ea12e90 2024-02-15T22:56:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.325+0000 7f5df5597640 1 -- 172.21.15.133:0/1858302408 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de8052990 con 0x55cc0ea12e90 2024-02-15T22:56:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.326+0000 7f5df8299800 1 -- 172.21.15.133:0/1858302408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 msgr2=0x55cc0ea132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.326+0000 7f5df8299800 1 --2- 172.21.15.133:0/1858302408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0ea132b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5de800a520 tx=0x7f5de801cee0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.326+0000 7f5df8299800 1 -- 172.21.15.133:0/1858302408 shutdown_connections 2024-02-15T22:56:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.326+0000 7f5df8299800 1 --2- 172.21.15.133:0/1858302408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0ea132b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.326+0000 7f5df8299800 1 -- 172.21.15.133:0/1858302408 >> 172.21.15.133:0/1858302408 conn(0x55cc0ea0e4f0 msgr2=0x55cc0ea10910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.326+0000 7f5df8299800 1 -- 172.21.15.133:0/1858302408 shutdown_connections 2024-02-15T22:56:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.326+0000 7f5df8299800 1 -- 172.21.15.133:0/1858302408 wait complete. 2024-02-15T22:56:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.337+0000 7f5df8299800 1 Processor -- start 2024-02-15T22:56:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.337+0000 7f5df8299800 1 -- start start 2024-02-15T22:56:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.337+0000 7f5df8299800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0e986f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.337+0000 7f5df8299800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0e913980 con 0x55cc0ea12e90 2024-02-15T22:56:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.338+0000 7f5df5d98640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0e986f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.338+0000 7f5df5d98640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0e986f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54102/0 (socket says 172.21.15.133:54102) 2024-02-15T22:56:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.338+0000 7f5df5d98640 1 -- 172.21.15.133:0/981767445 learned_addr learned my addr 172.21.15.133:0/981767445 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.338+0000 7f5df5d98640 1 -- 172.21.15.133:0/981767445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8005de0 con 0x55cc0ea12e90 2024-02-15T22:56:47.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.338+0000 7f5df5d98640 1 --2- 172.21.15.133:0/981767445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0e986f50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5de8055040 tx=0x7f5de804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38380cb4eeb60ef server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.338+0000 7f5ce3e07640 1 -- 172.21.15.133:0/981767445 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de8052840 con 0x55cc0ea12e90 2024-02-15T22:56:47.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.338+0000 7f5ce3e07640 1 -- 172.21.15.133:0/981767445 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de80529c0 con 0x55cc0ea12e90 2024-02-15T22:56:47.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.338+0000 7f5ce3e07640 1 -- 172.21.15.133:0/981767445 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de8052ca0 con 0x55cc0ea12e90 2024-02-15T22:56:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.339+0000 7f5df8299800 1 -- 172.21.15.133:0/981767445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 msgr2=0x55cc0e986f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.339+0000 7f5df8299800 1 --2- 172.21.15.133:0/981767445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0e986f50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5de8055040 tx=0x7f5de804c000 comp rx=0 tx=0).stop 2024-02-15T22:56:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.339+0000 7f5df8299800 1 -- 172.21.15.133:0/981767445 shutdown_connections 2024-02-15T22:56:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.339+0000 7f5df8299800 1 --2- 172.21.15.133:0/981767445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0e986f50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.339+0000 7f5df8299800 1 -- 172.21.15.133:0/981767445 >> 172.21.15.133:0/981767445 conn(0x55cc0ea0e4f0 msgr2=0x55cc0eafebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.339+0000 7f5df8299800 1 -- 172.21.15.133:0/981767445 shutdown_connections 2024-02-15T22:56:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.339+0000 7f5df8299800 1 -- 172.21.15.133:0/981767445 wait complete. 2024-02-15T22:56:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.339+0000 7f5df8299800 1 Processor -- start 2024-02-15T22:56:47.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.340+0000 7f5df8299800 1 -- start start 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.340+0000 7f5df8299800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0eb04a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.340+0000 7f5df8299800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0e90f160 con 0x55cc0ea12e90 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.340+0000 7f5df5d98640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0eb04a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.340+0000 7f5df5d98640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0eb04a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54116/0 (socket says 172.21.15.133:54116) 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.340+0000 7f5df5d98640 1 -- 172.21.15.133:0/2814454081 learned_addr learned my addr 172.21.15.133:0/2814454081 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.340+0000 7f5df5d98640 1 -- 172.21.15.133:0/2814454081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de804e070 con 0x55cc0ea12e90 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.340+0000 7f5df5d98640 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0eb04a20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5de801ceb0 tx=0x7f5de8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.340+0000 7f5ce2604640 1 -- 172.21.15.133:0/2814454081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de806c070 con 0x55cc0ea12e90 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.341+0000 7f5ce2604640 1 -- 172.21.15.133:0/2814454081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de805d480 con 0x55cc0ea12e90 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.341+0000 7f5ce2604640 1 -- 172.21.15.133:0/2814454081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de805d760 con 0x55cc0ea12e90 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.341+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc0eb03110 con 0x55cc0ea12e90 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.341+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc0eb03650 con 0x55cc0ea12e90 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.341+0000 7f5ce2604640 1 -- 172.21.15.133:0/2814454081 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5de8059040 con 0x55cc0ea12e90 2024-02-15T22:56:47.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.341+0000 7f5ce2604640 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cdc036790 0x7f5cdc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.342+0000 7f5ce2604640 1 -- 172.21.15.133:0/2814454081 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f5de808d420 con 0x55cc0ea12e90 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.342+0000 7f5ded597640 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cdc036790 0x7f5cdc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.342+0000 7f5df8299800 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cc0ea140f0 0x55cc0eb14d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.342+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb03d30 con 0x55cc0ea140f0 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.342+0000 7f5df6599640 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cc0ea140f0 0x55cc0eb14d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.342+0000 7f5ded597640 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cdc036790 0x7f5cdc038c50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5de0000f60 tx=0x7f5de0001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.342+0000 7f5df6599640 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cc0ea140f0 0x55cc0eb14d30 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.342+0000 7f5df6599640 1 -- 172.21.15.133:0/2814454081 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5df000a4a0 con 0x55cc0ea140f0 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.342+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb15270 con 0x55cc0ea140f0 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.343+0000 7f5df6599640 1 -- 172.21.15.133:0/2814454081 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5df000a4a0 con 0x55cc0ea140f0 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.343+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb16b20 con 0x55cc0ea140f0 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.343+0000 7f5df6599640 1 -- 172.21.15.133:0/2814454081 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f5df000a4a0 con 0x55cc0ea140f0 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.343+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb15d20 con 0x55cc0ea140f0 2024-02-15T22:56:47.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.343+0000 7f5df6599640 1 -- 172.21.15.133:0/2814454081 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5df000a4a0 con 0x55cc0ea140f0 2024-02-15T22:56:47.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.343+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb16130 con 0x55cc0ea140f0 2024-02-15T22:56:47.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.344+0000 7f5df6599640 1 -- 172.21.15.133:0/2814454081 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5df000a4a0 con 0x55cc0ea140f0 2024-02-15T22:56:47.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.344+0000 7f5df8299800 1 Processor -- start 2024-02-15T22:56:47.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.344+0000 7f5df8299800 1 -- start start 2024-02-15T22:56:47.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.344+0000 7f5df8299800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb25510 0x55cc0eb25930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.344+0000 7f5df8299800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0e8b1e80 con 0x55cc0eb25510 2024-02-15T22:56:47.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.344+0000 7f5ded597640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb25510 0x55cc0eb25930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.344+0000 7f5ded597640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb25510 0x55cc0eb25930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54132/0 (socket says 172.21.15.133:54132) 2024-02-15T22:56:47.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.344+0000 7f5ded597640 1 -- 172.21.15.133:0/3926469588 learned_addr learned my addr 172.21.15.133:0/3926469588 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.345+0000 7f5ded597640 1 -- 172.21.15.133:0/3926469588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc0eb25e70 con 0x55cc0eb25510 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.345+0000 7f5ded597640 1 --2- 172.21.15.133:0/3926469588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb25510 0x55cc0eb25930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5de0001ed0 tx=0x7f5de000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.345+0000 7f5cdb7fe640 1 -- 172.21.15.133:0/3926469588 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de000bec0 con 0x55cc0eb25510 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.345+0000 7f5cdb7fe640 1 -- 172.21.15.133:0/3926469588 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de000d520 con 0x55cc0eb25510 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.345+0000 7f5cdb7fe640 1 -- 172.21.15.133:0/3926469588 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de000d7c0 con 0x55cc0eb25510 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.345+0000 7f5df8299800 1 -- 172.21.15.133:0/3926469588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc0eb268e0 con 0x55cc0eb25510 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.345+0000 7f5df8299800 1 -- 172.21.15.133:0/3926469588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc0eb26da0 con 0x55cc0eb25510 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.346+0000 7f5cdb7fe640 1 -- 172.21.15.133:0/3926469588 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5de001a070 con 0x55cc0eb25510 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.346+0000 7f5cdb7fe640 1 --2- 172.21.15.133:0/3926469588 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cd00367e0 0x7f5cd0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.346+0000 7f5cdb7fe640 1 -- 172.21.15.133:0/3926469588 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f5de0017050 con 0x55cc0eb25510 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.346+0000 7f5df6599640 1 --2- 172.21.15.133:0/3926469588 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cd00367e0 0x7f5cd0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.346+0000 7f5df8299800 1 Processor -- start 2024-02-15T22:56:47.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.346+0000 7f5df6599640 1 --2- 172.21.15.133:0/3926469588 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cd00367e0 0x7f5cd0038ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55cc0eb15760 tx=0x7f5df0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.346+0000 7f5df8299800 1 -- start start 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.346+0000 7f5df8299800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb32bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.346+0000 7f5df8299800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0e8875d0 con 0x55cc0eb32790 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.347+0000 7f5ded597640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb32bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.347+0000 7f5ded597640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb32bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54136/0 (socket says 172.21.15.133:54136) 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.347+0000 7f5ded597640 1 -- 172.21.15.133:0/1974654951 learned_addr learned my addr 172.21.15.133:0/1974654951 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.347+0000 7f5ded597640 1 -- 172.21.15.133:0/1974654951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc0eb33180 con 0x55cc0eb32790 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.347+0000 7f5ded597640 1 --2- 172.21.15.133:0/1974654951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb32bb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5de0027030 tx=0x7f5de0024560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5056577767b8c80c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.347+0000 7f5cd97fa640 1 -- 172.21.15.133:0/1974654951 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de004d2e0 con 0x55cc0eb32790 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.347+0000 7f5cd97fa640 1 -- 172.21.15.133:0/1974654951 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de004bae0 con 0x55cc0eb32790 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.347+0000 7f5cd97fa640 1 -- 172.21.15.133:0/1974654951 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de004bd80 con 0x55cc0eb32790 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.348+0000 7f5df8299800 1 -- 172.21.15.133:0/1974654951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 msgr2=0x55cc0eb32bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.348+0000 7f5df8299800 1 --2- 172.21.15.133:0/1974654951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb32bb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5de0027030 tx=0x7f5de0024560 comp rx=0 tx=0).stop 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.348+0000 7f5df8299800 1 -- 172.21.15.133:0/1974654951 shutdown_connections 2024-02-15T22:56:47.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.348+0000 7f5df8299800 1 --2- 172.21.15.133:0/1974654951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb32bb0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.348+0000 7f5df8299800 1 -- 172.21.15.133:0/1974654951 >> 172.21.15.133:0/1974654951 conn(0x55cc0eb2eaf0 msgr2=0x55cc0eb2cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.348+0000 7f5df8299800 1 -- 172.21.15.133:0/1974654951 shutdown_connections 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.348+0000 7f5df8299800 1 -- 172.21.15.133:0/1974654951 wait complete. 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.348+0000 7f5df8299800 1 Processor -- start 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.348+0000 7f5df8299800 1 -- start start 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.348+0000 7f5df8299800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb39750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.348+0000 7f5df8299800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0eb39c90 con 0x55cc0eb32790 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.349+0000 7f5ded597640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb39750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.349+0000 7f5ded597640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb39750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54148/0 (socket says 172.21.15.133:54148) 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.349+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 learned_addr learned my addr 172.21.15.133:0/1543540872 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.349+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc0eb26da0 con 0x55cc0eb32790 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.349+0000 7f5ded597640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb39750 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5de001e040 tx=0x7f5de004b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.349+0000 7f5cc77fe640 1 -- 172.21.15.133:0/1543540872 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de004d2e0 con 0x55cc0eb32790 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.349+0000 7f5cc77fe640 1 -- 172.21.15.133:0/1543540872 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de004a5c0 con 0x55cc0eb32790 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.349+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc0eb39e90 con 0x55cc0eb32790 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.349+0000 7f5cc77fe640 1 -- 172.21.15.133:0/1543540872 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de001a320 con 0x55cc0eb32790 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.349+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc0eb3a350 con 0x55cc0eb32790 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.350+0000 7f5cc77fe640 1 -- 172.21.15.133:0/1543540872 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5de001a4a0 con 0x55cc0eb32790 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.350+0000 7f5cc77fe640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cc0036790 0x7f5cc0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.350+0000 7f5cc77fe640 1 -- 172.21.15.133:0/1543540872 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f5de004ee10 con 0x55cc0eb32790 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.350+0000 7f5df6599640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cc0036790 0x7f5cc0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.351+0000 7f5df6599640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cc0036790 0x7f5cc0038c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5df000b010 tx=0x7f5df0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.351+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.351+0000 7f5df8299800 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cc0eb45350 0x55cc0eb47810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.351+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb47f60 con 0x55cc0eb45350 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.351+0000 7f5df5d98640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cc0eb45350 0x55cc0eb47810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.351+0000 7f5df5d98640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cc0eb45350 0x55cc0eb47810 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.351+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.351+0000 7f5df8299800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.351+0000 7f5df8299800 20 realm 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.351+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.351+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb48330 con 0x55cc0eb45350 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb48bb0 con 0x55cc0eb45350 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb48f10 con 0x55cc0eb45350 2024-02-15T22:56:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb49710 con 0x55cc0eb45350 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 20 searching for the correct realm 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55cc0eb4b630 0x55cc0eb4dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb4b630 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.352+0000 7f5ded597640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55cc0eb4b630 0x55cc0eb4dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.353+0000 7f5ded597640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55cc0eb4b630 0x55cc0eb4dab0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.353+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.353+0000 7f5ded597640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5de0027060 0x7f5de0046020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.353+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5de0027060 2024-02-15T22:56:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.353+0000 7f5df6599640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5de0027060 0x7f5de0046020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.353+0000 7f5df6599640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5de0027060 0x7f5de0046020 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.354+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df000a4a0 con 0x7f5de0027060 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.354+0000 7f5df6599640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5df00141d0 0x7f5df0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.354+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5df00141d0 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.354+0000 7f5df5d98640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5df00141d0 0x7f5df0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.354+0000 7f5df5d98640 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5df00141d0 0x7f5df0015940 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.355+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.355+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb45350 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.355+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.355+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb45350 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.355+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.355+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5df00141d0 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.355+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.355+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5df00141d0 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.356+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.356+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5de0027060 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.356+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df000a4a0 con 0x7f5de0027060 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.356+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb4b630 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.356+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.356+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb45350 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.356+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.356+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5df00141d0 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.357+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.357+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb45350 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.357+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.357+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5de0027060 2024-02-15T22:56:47.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.357+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.357+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb4b630 2024-02-15T22:56:47.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.357+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.357+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb4b630 2024-02-15T22:56:47.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.358+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.358+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5df00141d0 2024-02-15T22:56:47.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.358+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.358+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb4b630 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.358+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.358+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb4b630 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.358+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.358+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb45350 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.358+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.359+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb45350 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.359+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.359+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5df00141d0 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.359+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.359+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb4b630 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.359+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.359+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5de0027060 2024-02-15T22:56:47.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.359+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.359+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb45350 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.360+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.360+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5df00141d0 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.360+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.360+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb4b630 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.360+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.360+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5df00141d0 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.361+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.361+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5de0027060 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.361+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.361+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb4b630 2024-02-15T22:56:47.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.361+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.361+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5df00141d0 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.361+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x55cc0eb45350 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e180 con 0x7f5de0027060 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:47.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4ac10 con 0x55cc0eb45350 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4a460 con 0x55cc0eb45350 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.362+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb49bf0 con 0x55cc0eb45350 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 20 zone default found 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 4 Realm: () 2024-02-15T22:56:47.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 20 zonegroup default 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4e5c0 con 0x7f5df00141d0 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb50440 con 0x55cc0eb4b630 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.363+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb507a0 con 0x55cc0eb4b630 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.364+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.364+0000 7f5df8299800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.364+0000 7f5df8299800 20 started sync module instance, tier type = 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.364+0000 7f5df8299800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.364+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4fa10 con 0x7f5de0027060 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.365+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.365+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94334908431856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4fa10 con 0x7f5de0027060 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.365+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb51190 con 0x55cc0eb45350 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.366+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94334908431856] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.366+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.366+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94334908435568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4fa10 con 0x55cc0eb45350 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.366+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb51c80 con 0x55cc0eb4b630 2024-02-15T22:56:47.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.367+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94334908435568] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.367+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.367+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94334908429680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb4f990 con 0x55cc0eb4b630 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.367+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb52ae0 con 0x7f5de0027060 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.368+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.368+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94334908429680] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.368+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94334908442656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb53280 con 0x7f5de0027060 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.368+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb52030 con 0x55cc0eb45350 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.369+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.369+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94334908446768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb52030 con 0x55cc0eb45350 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.369+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb54740 con 0x7f5df00141d0 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.369+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94334908442656] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.370+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94334908446768] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.370+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.370+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94334908447824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb54260 con 0x7f5df00141d0 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.370+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb54fc0 con 0x7f5df00141d0 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.371+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.371+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94334908450832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb550d0 con 0x7f5df00141d0 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.371+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb55b00 con 0x7f5df00141d0 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.371+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94334908447824] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.372+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.372+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94334908450832] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.372+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94334908454432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb55b00 con 0x7f5df00141d0 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.372+0000 7f5df8299800 20 add_watcher() i=0 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.372+0000 7f5df8299800 20 add_watcher() i=1 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.372+0000 7f5df8299800 20 add_watcher() i=2 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.372+0000 7f5df8299800 20 add_watcher() i=3 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.372+0000 7f5df8299800 20 add_watcher() i=4 2024-02-15T22:56:47.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.372+0000 7f5df8299800 20 add_watcher() i=5 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.372+0000 7f5df8299800 20 add_watcher() i=6 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.373+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94334908454432] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.373+0000 7f5df8299800 20 add_watcher() i=7 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.373+0000 7f5df8299800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.373+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb58b30 con 0x55cc0eb45350 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.373+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.373+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94334908443872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb56010 con 0x55cc0eb45350 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.374+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94334908443872] v32'182 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.374+0000 7f5c9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.375+0000 7f5df8299800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.375+0000 7f5df8299800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.375+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb61490 con 0x55cc0eb45350 2024-02-15T22:56:47.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.376+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.376+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb61a80 con 0x7f5df00141d0 2024-02-15T22:56:47.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.377+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'25 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.377+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb61fb0 con 0x55cc0eb4b630 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.378+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.378+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb62980 con 0x55cc0eb45350 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.379+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'183 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.379+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb5d360 con 0x7f5de0027060 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.380+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'62 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.380+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb5d360 con 0x55cc0eb4b630 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.381+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'41 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.381+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb63b60 con 0x55cc0eb45350 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.382+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.382+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb63b60 con 0x7f5df00141d0 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.383+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'41 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.383+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb63b60 con 0x7f5de0027060 2024-02-15T22:56:47.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.384+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.384+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64090 con 0x55cc0eb4b630 2024-02-15T22:56:47.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.385+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.385+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb643f0 con 0x7f5de0027060 2024-02-15T22:56:47.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.385+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'63 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.386+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64920 con 0x7f5df00141d0 2024-02-15T22:56:47.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.386+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.387+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64920 con 0x7f5de0027060 2024-02-15T22:56:47.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.387+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.387+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb63a60 con 0x7f5df00141d0 2024-02-15T22:56:47.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.388+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'47 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.388+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb63a60 con 0x55cc0eb45350 2024-02-15T22:56:47.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.390+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'184 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.390+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb63a60 con 0x55cc0eb4b630 2024-02-15T22:56:47.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.390+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'56 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.390+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x7f5de0027060 2024-02-15T22:56:47.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.391+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'64 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.391+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x55cc0eb4b630 2024-02-15T22:56:47.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.392+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.392+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x55cc0eb45350 2024-02-15T22:56:47.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.393+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.393+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x55cc0eb45350 2024-02-15T22:56:47.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.394+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'185 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.394+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x55cc0eb4b630 2024-02-15T22:56:47.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.395+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'57 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.395+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x7f5de0027060 2024-02-15T22:56:47.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.396+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'34 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.396+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x55cc0eb4b630 2024-02-15T22:56:47.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.397+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.397+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x55cc0eb4b630 2024-02-15T22:56:47.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.398+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.398+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x55cc0eb4b630 2024-02-15T22:56:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.399+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'22 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.399+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x55cc0eb4b630 2024-02-15T22:56:47.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.400+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'42 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.400+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x7f5df00141d0 2024-02-15T22:56:47.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.401+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.401+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x55cc0eb4b630 2024-02-15T22:56:47.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.402+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.402+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x7f5df00141d0 2024-02-15T22:56:47.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.403+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'42 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.403+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x55cc0eb4b630 2024-02-15T22:56:47.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.404+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'58 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.404+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x7f5df00141d0 2024-02-15T22:56:47.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.405+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'48 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.405+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb64dc0 con 0x7f5de0027060 2024-02-15T22:56:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'31 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5c9e7fc640 20 reqs_thread_entry: start 2024-02-15T22:56:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df8299800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df8299800 20 Filter name: none 2024-02-15T22:56:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5c17fff640 20 reqs_thread_entry: start 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df8299800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb58490 con 0x7f5de0027060 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df8299800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df8299800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df8299800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df8299800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 : miss 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.406+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:95 8.7 8:e4120b70:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb905d0 con 0x7f5df00141d0 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.407+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(95 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.407+0000 7f5df8299800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:56:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.407+0000 7f5df8299800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 info.flags=0x17 2024-02-15T22:56:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.407+0000 7f5df8299800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 to cache LRU end 2024-02-15T22:56:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.407+0000 7f5df8299800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.407+0000 7f5df8299800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:56:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.407+0000 7f5df8299800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 2024-02-15T22:56:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.407+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:96 4.1a 4:5ac491a5:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d7b0 con 0x7f5de0027060 2024-02-15T22:56:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.407+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(96 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.407+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:97 4.3e 4:7d03ce80:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d7b0 con 0x7f5de0027060 2024-02-15T22:56:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.408+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(97 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.408+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:98 4.27 4:e4b9647f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d7f0 con 0x55cc0eb45350 2024-02-15T22:56:47.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.408+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(98 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2 [call out=426b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.408+0000 7f5df8299800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-02-15T22:56:47.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.408+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:99 4.3e 4:7efeb46f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d7f0 con 0x7f5de0027060 2024-02-15T22:56:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.408+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 21 ==== osd_op_reply(99 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.3 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.408+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:100 4.35 4:aedb77fa:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d7f0 con 0x55cc0eb45350 2024-02-15T22:56:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.409+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(100 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.409+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:101 4.2c 4:37797b6d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d7f0 con 0x55cc0eb45350 2024-02-15T22:56:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.409+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(101 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.409+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 4.21 4:856cc43d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d7f0 con 0x7f5df00141d0 2024-02-15T22:56:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.410+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(102 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.410+0000 7f5df8299800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-02-15T22:56:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.410+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:103 4.15 4:a9e708d4:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d7f0 con 0x55cc0eb4b630 2024-02-15T22:56:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.410+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(103 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.410+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:104 4.9 4:91d8d04d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d7f0 con 0x55cc0eb45350 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.410+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(104 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8 [call out=426b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.410+0000 7f5df8299800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.410+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:105 4.3 4:c334e41a:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d830 con 0x55cc0eb45350 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.411+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(105 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.411+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:106 4.a 4:5118be22:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d830 con 0x7f5de0027060 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.411+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 22 ==== osd_op_reply(106 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10 [call out=697b] v0'0 uv15 ondisk = 0) v8 ==== 195+0+697 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.411+0000 7f5df8299800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.411+0000 7f5df8299800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.411+0000 7f5df8299800 20 get_obj_state: octx=0x7f5df0029040 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55cc0ec0cd78 s->prefetch_data=0 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.411+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:107 3.29 3:947911ea:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb90fa0 con 0x7f5df00141d0 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.411+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(107 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.412+0000 7f5df8299800 10 manifest: total_size = 6 2024-02-15T22:56:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.412+0000 7f5df8299800 20 get_obj_state: setting s->obj_tag to b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.16740893102675665630 2024-02-15T22:56:47.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.412+0000 7f5df8299800 20 get_obj_state: octx=0x7f5df0029040 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55cc0ec0cd78 s->prefetch_data=0 2024-02-15T22:56:47.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.412+0000 7f5df8299800 20 prepare_atomic_modification: state is not atomic. state=0x55cc0ec0cd78 2024-02-15T22:56:47.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.412+0000 7f5df8299800 20 bucket index object: :.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2 2024-02-15T22:56:47.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.412+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:108 4.27 4:e4b9647f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb95870 con 0x55cc0eb45350 2024-02-15T22:56:47.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.413+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(108 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2 [stat,call,call] v32'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.413+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:109 3.29 3:947911ea:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb93850 con 0x7f5df00141d0 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.414+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(109 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_9c8454ddf7aa50116496bac348d7550d [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.414+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:110 4.27 4:e4b9647f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb95e10 con 0x55cc0eb45350 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.414+0000 7f5df8299800 20 get_obj_state: octx=0x7f5df0029040 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55cc0ec0cd78 s->prefetch_data=0 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.414+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:111 3.26 3:673d5089:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb95df0 con 0x7f5de0027060 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.414+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 23 ==== osd_op_reply(111 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.414+0000 7f5df8299800 10 manifest: total_size = 3 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.414+0000 7f5df8299800 20 get_obj_state: setting s->obj_tag to b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.1819441347484697396 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.414+0000 7f5df8299800 20 get_obj_state: octx=0x7f5df0029040 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55cc0ec0cd78 s->prefetch_data=0 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.414+0000 7f5df8299800 20 prepare_atomic_modification: state is not atomic. state=0x55cc0ec0cd78 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.414+0000 7f5df8299800 20 bucket index object: :.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.414+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:112 4.21 4:856cc43d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9aa40 con 0x7f5df00141d0 2024-02-15T22:56:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.415+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(110 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2 [stat,call,call] v32'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.415+0000 7f5cd97fa640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.415+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(112 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6 [stat,call,call] v32'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.415+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:113 3.26 3:673d5089:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb93850 con 0x7f5de0027060 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.416+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 24 ==== osd_op_reply(113 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.416+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:114 4.21 4:856cc43d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb96a00 con 0x7f5df00141d0 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.416+0000 7f5df8299800 20 get_obj_state: octx=0x7f5df0029040 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55cc0ec0cd78 s->prefetch_data=0 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.417+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:115 3.19 3:99e7e9e6:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb97120 con 0x55cc0eb45350 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.417+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 36 ==== osd_op_reply(115 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.417+0000 7f5df8299800 10 manifest: total_size = 4 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.417+0000 7f5df8299800 20 get_obj_state: setting s->obj_tag to b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.15797706402499337114 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.417+0000 7f5df8299800 20 get_obj_state: octx=0x7f5df0029040 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55cc0ec0cd78 s->prefetch_data=0 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.417+0000 7f5df8299800 20 prepare_atomic_modification: state is not atomic. state=0x55cc0ec0cd78 2024-02-15T22:56:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.417+0000 7f5df8299800 20 bucket index object: :.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8 2024-02-15T22:56:47.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.417+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:116 4.9 4:91d8d04d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9a150 con 0x55cc0eb45350 2024-02-15T22:56:47.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.418+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(114 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6 [stat,call,call] v32'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.418+0000 7f5cd8ff9640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-02-15T22:56:47.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.418+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 37 ==== osd_op_reply(116 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8 [stat,call,call] v32'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.418+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:117 3.19 3:99e7e9e6:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9ab90 con 0x55cc0eb45350 2024-02-15T22:56:47.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.419+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 38 ==== osd_op_reply(117 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.419+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:118 4.9 4:91d8d04d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9ab90 con 0x55cc0eb45350 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.419+0000 7f5df8299800 20 get_obj_state: octx=0x7f5df0029040 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55cc0ec0cd78 s->prefetch_data=0 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.419+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:119 3.9 3:91c4e170:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9ab90 con 0x55cc0eb4b630 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.419+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 27 ==== osd_op_reply(119 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.419+0000 7f5df8299800 10 manifest: total_size = 5 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.419+0000 7f5df8299800 20 get_obj_state: setting s->obj_tag to b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.8604901333880018201 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.419+0000 7f5df8299800 20 get_obj_state: octx=0x7f5df0029040 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55cc0ec0cd78 s->prefetch_data=0 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.419+0000 7f5df8299800 20 prepare_atomic_modification: state is not atomic. state=0x55cc0ec0cd78 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.419+0000 7f5df8299800 20 bucket index object: :.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.419+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:120 4.a 4:5118be22:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9ab90 con 0x7f5de0027060 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.420+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 39 ==== osd_op_reply(118 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8 [stat,call,call] v32'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.420+0000 7f5cd97fa640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-02-15T22:56:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.420+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 25 ==== osd_op_reply(120 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10 [stat,call,call] v32'16 uv16 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.420+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:121 3.9 3:91c4e170:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9a6f0 con 0x55cc0eb4b630 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.421+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 28 ==== osd_op_reply(121 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.421+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:122 4.a 4:5118be22:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9ab90 con 0x7f5de0027060 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.421+0000 7f5df8299800 20 get_obj_state: octx=0x7f5df0029040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55cc0ec0cd78 s->prefetch_data=0 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.421+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:123 3.2e 3:75b7bb57:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb92840 con 0x7f5de0027060 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.422+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 26 ==== osd_op_reply(123 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.422+0000 7f5df8299800 10 manifest: total_size = 5 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.422+0000 7f5df8299800 20 get_obj_state: setting s->obj_tag to _RFnFU9xvsYeMtUQl2ULXZY2NMQSVOMb 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.422+0000 7f5df8299800 20 get_obj_state: octx=0x7f5df0029040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55cc0ec0cd78 s->prefetch_data=0 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.422+0000 7f5df8299800 20 prepare_atomic_modification: state is not atomic. state=0x55cc0ec0cd78 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.422+0000 7f5df8299800 20 bucket index object: :.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.422+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:124 4.a 4:5118be22:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9c430 con 0x7f5de0027060 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.422+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 27 ==== osd_op_reply(122 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10 [stat,call,call] v32'17 uv17 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.422+0000 7f5cd8ff9640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-02-15T22:56:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.423+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 28 ==== osd_op_reply(124 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10 [stat,call,call] v32'18 uv18 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.423+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:125 3.2e 3:75b7bb57:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9bf90 con 0x7f5de0027060 2024-02-15T22:56:47.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 29 ==== osd_op_reply(125 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:126 4.a 4:5118be22:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9c430 con 0x7f5de0027060 2024-02-15T22:56:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 20 list_objects_ordered: starting attempt 1 2024-02-15T22:56:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-15T22:56:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:127 4.1a 4:5ac491a5:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9c430 con 0x7f5de0027060 2024-02-15T22:56:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:128 4.3e 4:7d03ce80:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0d030 con 0x7f5de0027060 2024-02-15T22:56:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:129 4.27 4:e4b9647f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9c430 con 0x55cc0eb45350 2024-02-15T22:56:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:130 4.3e 4:7efeb46f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba19d0 con 0x7f5de0027060 2024-02-15T22:56:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:131 4.35 4:aedb77fa:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9c430 con 0x55cc0eb45350 2024-02-15T22:56:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:132 4.2c 4:37797b6d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba6bb0 con 0x55cc0eb45350 2024-02-15T22:56:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:133 4.21 4:856cc43d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba9880 con 0x7f5df00141d0 2024-02-15T22:56:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:134 4.15 4:a9e708d4:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba19d0 con 0x55cc0eb4b630 2024-02-15T22:56:47.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:135 4.9 4:91d8d04d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ebae5e0 con 0x55cc0eb45350 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:136 4.3 4:c334e41a:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba19d0 con 0x55cc0eb45350 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:137 4.a 4:5118be22:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ebb37f0 con 0x7f5de0027060 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 30 ==== osd_op_reply(127 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 31 ==== osd_op_reply(128 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.424+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 30 ==== osd_op_reply(133 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 32 ==== osd_op_reply(130 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.3 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 29 ==== osd_op_reply(134 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 40 ==== osd_op_reply(129 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 41 ==== osd_op_reply(132 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 33 ==== osd_op_reply(126 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10 [stat,call,call] v32'19 uv19 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5cd8ff9640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 42 ==== osd_op_reply(136 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 43 ==== osd_op_reply(135 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 44 ==== osd_op_reply(131 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 34 ==== osd_op_reply(137 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10 [call out=124b] v0'0 uv19 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5])"; uploads.size()=0; is_truncated=0 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:138 4.1a 4:5ac491a5:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ebb37f0 con 0x7f5de0027060 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:139 4.3e 4:7d03ce80:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba6630 con 0x7f5de0027060 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:140 4.27 4:e4b9647f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba92e0 con 0x55cc0eb45350 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:141 4.3e 4:7efeb46f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ebb37f0 con 0x7f5de0027060 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:142 4.35 4:aedb77fa:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba6630 con 0x55cc0eb45350 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:143 4.2c 4:37797b6d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ebb37f0 con 0x55cc0eb45350 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:144 4.21 4:856cc43d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba6630 con 0x7f5df00141d0 2024-02-15T22:56:47.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:145 4.15 4:a9e708d4:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ebb37f0 con 0x55cc0eb4b630 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.425+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:146 4.9 4:91d8d04d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba6630 con 0x55cc0eb45350 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 30 ==== osd_op_reply(145 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:147 4.3 4:c334e41a:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ebb37f0 con 0x55cc0eb45350 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:148 4.a 4:5118be22:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ebae470 con 0x7f5de0027060 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 35 ==== osd_op_reply(138 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 45 ==== osd_op_reply(140 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 36 ==== osd_op_reply(139 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 46 ==== osd_op_reply(143 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 37 ==== osd_op_reply(141 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.3 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 47 ==== osd_op_reply(142 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 31 ==== osd_op_reply(144 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 48 ==== osd_op_reply(146 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 49 ==== osd_op_reply(147 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 38 ==== osd_op_reply(148 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10 [call out=124b] v0'0 uv19 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.426+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba96d0 con 0x7f5de0027060 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.427+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 39 ==== osd_op_reply(149 foo.buckets [call] v32'37 uv37 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.427+0000 7f5df8299800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.427+0000 7f5df8299800 10 removing default.rgw.meta+root+myfoo from cache 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.427+0000 7f5df8299800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.427+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:150 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94334909205392 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba96d0 con 0x7f5df00141d0 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.427+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 32 ==== watch-notify(notify (1) cookie 94334908450832 notify 137438953493 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x55cc0eb03650 con 0x7f5df00141d0 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.427+0000 7f5cd97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94334908450832 notifier 4642 bl.length()=149 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.427+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 33 ==== osd_op_reply(150 notify.6 [notify cookie 94334909205392 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.427+0000 7f5cd97fa640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f5cb8003d50 con 0x7f5df00141d0 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.428+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 34 ==== osd_op_reply(151 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.428+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 35 ==== watch-notify(notify_complete (2) cookie 94334909205392 notify 137438953493 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55cc0eb03110 con 0x7f5df00141d0 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.428+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:152 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba96d0 con 0x7f5de0027060 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.429+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 40 ==== osd_op_reply(152 myfoo [call,call,delete] v32'38 uv38 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.429+0000 7f5df8299800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 from cache 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.429+0000 7f5df8299800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5, ofs0, ns] 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.429+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:153 7.d 7:b4812045:::notify.4:head [notify cookie 94334909205392 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba96d0 con 0x55cc0eb45350 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.429+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 50 ==== watch-notify(notify (1) cookie 94334908446768 notify 137438953499 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x55cc0eb03110 con 0x55cc0eb45350 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.429+0000 7f5cd8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94334908446768 notifier 4642 bl.length()=206 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.429+0000 7f5cd8ff9640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:154 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f5c200032b0 con 0x55cc0eb45350 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.429+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 51 ==== osd_op_reply(153 notify.4 [notify cookie 94334909205392 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.429+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 52 ==== osd_op_reply(154 notify.4 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.429+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 53 ==== watch-notify(notify_complete (2) cookie 94334909205392 notify 137438953499 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5de804e070 con 0x55cc0eb45350 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.429+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:155 8.7 8:e4120b70:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba96d0 con 0x7f5df00141d0 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.430+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 36 ==== osd_op_reply(155 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 [call,call,delete] v32'3 uv3 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.431+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:156 4.1a 4:5ac491a5:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba96d0 con 0x7f5de0027060 2024-02-15T22:56:47.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.431+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:157 4.3e 4:7d03ce80:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0b610 con 0x7f5de0027060 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.431+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:158 4.27 4:e4b9647f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9b420 con 0x55cc0eb45350 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.431+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:159 4.3e 4:7efeb46f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9bcf0 con 0x7f5de0027060 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.431+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:160 4.35 4:aedb77fa:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba96d0 con 0x55cc0eb45350 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.431+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:161 4.2c 4:37797b6d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0b610 con 0x55cc0eb45350 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.431+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:162 4.21 4:856cc43d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9bcf0 con 0x7f5df00141d0 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.431+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:163 4.15 4:a9e708d4:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9b420 con 0x55cc0eb4b630 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.431+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:164 4.9 4:91d8d04d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9c0a0 con 0x55cc0eb45350 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.431+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:165 4.3 4:c334e41a:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba8c20 con 0x55cc0eb45350 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.431+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:166 4.a 4:5118be22:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eba96d0 con 0x7f5de0027060 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.432+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 41 ==== osd_op_reply(156 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.0 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.432+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 54 ==== osd_op_reply(158 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.2 [delete] v32'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.432+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 31 ==== osd_op_reply(163 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.7 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.433+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 42 ==== osd_op_reply(166 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.10 [delete] v32'20 uv20 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.433+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 55 ==== osd_op_reply(160 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.4 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.433+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 56 ==== osd_op_reply(161 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.5 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.434+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 57 ==== osd_op_reply(164 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.8 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.434+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 58 ==== osd_op_reply(165 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.9 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 43 ==== osd_op_reply(157 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.1 [delete] v32'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 37 ==== osd_op_reply(162 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.6 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 44 ==== osd_op_reply(159 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5.3 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df8299800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 : miss 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df8299800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:167 6.19 6:98e0d86b:::pubsub..bucket.myfoo%2fb92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb9b420 con 0x55cc0eb45350 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 59 ==== osd_op_reply(167 pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df8299800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df8299800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 info.flags=0x0 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df8299800 10 adding default.rgw.log++pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 to cache LRU end 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df8299800 10 removing default.rgw.log++pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 from cache 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df8299800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5, ofs0, ns] 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:168 7.e 7:7759931f:::notify.3:head [notify cookie 94334908743568 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0b610 con 0x7f5de0027060 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 45 ==== watch-notify(notify (1) cookie 94334908442656 notify 137438953489 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7f5df0042930 con 0x7f5de0027060 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5cd97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94334908442656 notifier 4642 bl.length()=203 2024-02-15T22:56:47.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 46 ==== osd_op_reply(168 notify.3 [notify cookie 94334908743568 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5cd97fa640 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f5cb8003d50 con 0x7f5de0027060 2024-02-15T22:56:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 47 ==== osd_op_reply(169 notify.3 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.435+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 48 ==== watch-notify(notify_complete (2) cookie 94334908743568 notify 137438953489 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5df0042b90 con 0x7f5de0027060 2024-02-15T22:56:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.436+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:170 6.19 6:98e0d86b:::pubsub..bucket.myfoo%2fb92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0cb90 con 0x55cc0eb45350 2024-02-15T22:56:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.436+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 60 ==== osd_op_reply(170 pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5 [delete] v32'31 uv27 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.436+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:171 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0ec0b610 con 0x7f5de0027060 2024-02-15T22:56:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.437+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 49 ==== osd_op_reply(171 foo.buckets [call] v32'39 uv39 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.438+0000 7f5c9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.438+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:172 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94334908443872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb5f5e0 con 0x55cc0eb45350 2024-02-15T22:56:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.439+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 61 ==== osd_op_reply(172 data_loggenerations_metadata [watch unwatch cookie 94334908443872] v32'186 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.439+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:173 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94334908431856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb5f5e0 con 0x7f5de0027060 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.440+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 50 ==== osd_op_reply(173 notify.0 [watch unwatch cookie 94334908431856] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.440+0000 7f5df8299800 20 remove_watcher() i=0 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.440+0000 7f5df8299800 2 removed watcher, disabling cache 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.440+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:174 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94334908435568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb5f5e0 con 0x55cc0eb45350 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.441+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 62 ==== osd_op_reply(174 notify.1 [watch unwatch cookie 94334908435568] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.441+0000 7f5df8299800 20 remove_watcher() i=1 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.442+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:175 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94334908429680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb5f5e0 con 0x55cc0eb4b630 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.442+0000 7f5ded597640 1 -- 172.21.15.133:0/1543540872 <== osd.3 v2:172.21.15.133:6816/1065500544 32 ==== osd_op_reply(175 notify.2 [watch unwatch cookie 94334908429680] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de001bb80 con 0x55cc0eb4b630 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.442+0000 7f5df8299800 20 remove_watcher() i=2 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.442+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:176 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94334908442656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb5f5e0 con 0x7f5de0027060 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.443+0000 7f5df6599640 1 -- 172.21.15.133:0/1543540872 <== osd.2 v2:172.21.15.133:6800/2073628168 51 ==== osd_op_reply(176 notify.3 [watch unwatch cookie 94334908442656] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df003a040 con 0x7f5de0027060 2024-02-15T22:56:47.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.443+0000 7f5df8299800 20 remove_watcher() i=3 2024-02-15T22:56:47.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.443+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:177 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94334908446768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb5f5e0 con 0x55cc0eb45350 2024-02-15T22:56:47.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.444+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.1 v2:172.21.15.133:6808/2671624067 63 ==== osd_op_reply(177 notify.4 [watch unwatch cookie 94334908446768] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x55cc0eb45350 2024-02-15T22:56:47.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.444+0000 7f5df8299800 20 remove_watcher() i=4 2024-02-15T22:56:47.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.444+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:178 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94334908447824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb5f5e0 con 0x7f5df00141d0 2024-02-15T22:56:47.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.445+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 38 ==== osd_op_reply(178 notify.5 [watch unwatch cookie 94334908447824] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.445+0000 7f5df8299800 20 remove_watcher() i=5 2024-02-15T22:56:47.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.445+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94334908450832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb5f5e0 con 0x7f5df00141d0 2024-02-15T22:56:47.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.446+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 39 ==== osd_op_reply(179 notify.6 [watch unwatch cookie 94334908450832] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.446+0000 7f5df8299800 20 remove_watcher() i=6 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.446+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:180 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94334908454432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc0eb5f5e0 con 0x7f5df00141d0 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.447+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 <== osd.0 v2:172.21.15.52:6800/431200118 40 ==== osd_op_reply(180 notify.7 [watch unwatch cookie 94334908454432] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8080040 con 0x7f5df00141d0 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 20 remove_watcher() i=7 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5df00141d0 msgr2=0x7f5df0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5df00141d0 0x7f5df0015940 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cc0eb45350 msgr2=0x55cc0eb47810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cc0eb45350 0x55cc0eb47810 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5de0027060 msgr2=0x7f5de0046020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5de0027060 0x7f5de0046020 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55cc0eb4b630 msgr2=0x55cc0eb4dab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55cc0eb4b630 0x55cc0eb4dab0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cc0036790 msgr2=0x7f5cc0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cc0036790 0x7f5cc0038c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5df000b010 tx=0x7f5df0020000 comp rx=0 tx=0).stop 2024-02-15T22:56:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 msgr2=0x55cc0eb39750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df5d98640 1 -- 172.21.15.133:0/1543540872 reap_dead start 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb39750 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5de001e040 tx=0x7f5de004b930 comp rx=0 tx=0).stop 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 shutdown_connections 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 --2- 172.21.15.133:0/1543540872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb32790 0x55cc0eb39750 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 >> 172.21.15.133:0/1543540872 conn(0x55cc0eb2eaf0 msgr2=0x55cc0eb2c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 shutdown_connections 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/1543540872 wait complete. 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/3926469588 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cd00367e0 msgr2=0x7f5cd0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 --2- 172.21.15.133:0/3926469588 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cd00367e0 0x7f5cd0038ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55cc0eb15760 tx=0x7f5df0005840 comp rx=0 tx=0).stop 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/3926469588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb25510 msgr2=0x55cc0eb25930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 --2- 172.21.15.133:0/3926469588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb25510 0x55cc0eb25930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5de0001ed0 tx=0x7f5de000ea00 comp rx=0 tx=0).stop 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/3926469588 shutdown_connections 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 --2- 172.21.15.133:0/3926469588 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cd00367e0 0x7f5cd0038ca0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 --2- 172.21.15.133:0/3926469588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0eb25510 0x55cc0eb25930 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/3926469588 >> 172.21.15.133:0/3926469588 conn(0x55cc0eb195b0 msgr2=0x55cc0eb199b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/3926469588 shutdown_connections 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.448+0000 7f5df8299800 1 -- 172.21.15.133:0/3926469588 wait complete. 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cc0ea140f0 msgr2=0x55cc0eb14d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cc0ea140f0 0x55cc0eb14d30 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cdc036790 msgr2=0x7f5cdc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cdc036790 0x7f5cdc038c50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5de0000f60 tx=0x7f5de0001370 comp rx=0 tx=0).stop 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 msgr2=0x55cc0eb04a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0eb04a20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5de801ceb0 tx=0x7f5de8002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 shutdown_connections 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55cc0ea140f0 0x55cc0eb14d30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5cdc036790 0x7f5cdc038c50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 --2- 172.21.15.133:0/2814454081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc0ea12e90 0x55cc0eb04a20 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 >> 172.21.15.133:0/2814454081 conn(0x55cc0ea0e4f0 msgr2=0x55cc0eafd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 shutdown_connections 2024-02-15T22:56:47.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.449+0000 7f5df8299800 1 -- 172.21.15.133:0/2814454081 wait complete. 2024-02-15T22:56:47.459 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-15T22:56:47.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-15T22:56:47.460 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-02-15T22:56:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:47.544 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:47.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.542+0000 7f21d0522800 1 Processor -- start 2024-02-15T22:56:47.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.542+0000 7f21d0522800 1 -- start start 2024-02-15T22:56:47.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.542+0000 7f21d0522800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556d6ca32a20 0x556d6ca34e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.542+0000 7f21d0522800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556d6c97cba0 con 0x556d6ca35350 2024-02-15T22:56:47.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.542+0000 7f21d0522800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x556d6c934450 con 0x556d6ca32a20 2024-02-15T22:56:47.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.542+0000 7f21cc2be640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556d6ca32a20 0x556d6ca34e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.542+0000 7f21cc2be640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556d6ca32a20 0x556d6ca34e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54152/0 (socket says 172.21.15.133:54152) 2024-02-15T22:56:47.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.542+0000 7f21cc2be640 1 -- 172.21.15.133:0/2842987046 learned_addr learned my addr 172.21.15.133:0/2842987046 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.542+0000 7f21cbabd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x556d6ca35350 0x556d6ca37740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:56548/0 (socket says 172.21.15.133:56548) 2024-02-15T22:56:47.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.543+0000 7f21cc2be640 1 -- 172.21.15.133:0/2842987046 >> v1:172.21.15.52:6789/0 conn(0x556d6ca35350 legacy=0x556d6ca37740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.543+0000 7f21cc2be640 1 -- 172.21.15.133:0/2842987046 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6ca39e70 con 0x556d6ca32a20 2024-02-15T22:56:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.544+0000 7f21cc2be640 1 --2- 172.21.15.133:0/2842987046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6ca34e10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f21c4005fd0 tx=0x7f21c401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa41c319dddb6f59 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.545+0000 7f21cb2bc640 1 -- 172.21.15.133:0/2842987046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21c4052540 con 0x556d6ca32a20 2024-02-15T22:56:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.545+0000 7f21cb2bc640 1 -- 172.21.15.133:0/2842987046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40526a0 con 0x556d6ca32a20 2024-02-15T22:56:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.545+0000 7f21cb2bc640 1 -- 172.21.15.133:0/2842987046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21c40529c0 con 0x556d6ca32a20 2024-02-15T22:56:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.545+0000 7f21d0522800 1 -- 172.21.15.133:0/2842987046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 msgr2=0x556d6ca34e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.545+0000 7f21d0522800 1 --2- 172.21.15.133:0/2842987046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6ca34e10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f21c4005fd0 tx=0x7f21c401cc50 comp rx=0 tx=0).stop 2024-02-15T22:56:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.545+0000 7f21d0522800 1 -- 172.21.15.133:0/2842987046 shutdown_connections 2024-02-15T22:56:47.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.545+0000 7f21d0522800 1 --2- 172.21.15.133:0/2842987046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6ca34e10 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.545+0000 7f21d0522800 1 -- 172.21.15.133:0/2842987046 >> 172.21.15.133:0/2842987046 conn(0x556d6ca2c4f0 msgr2=0x556d6ca2e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.545+0000 7f21d0522800 1 -- 172.21.15.133:0/2842987046 shutdown_connections 2024-02-15T22:56:47.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.545+0000 7f21d0522800 1 -- 172.21.15.133:0/2842987046 wait complete. 2024-02-15T22:56:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.557+0000 7f21d0522800 1 Processor -- start 2024-02-15T22:56:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.557+0000 7f21d0522800 1 -- start start 2024-02-15T22:56:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.557+0000 7f21d0522800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb21f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.557+0000 7f21d0522800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6c931980 con 0x556d6ca32a20 2024-02-15T22:56:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.557+0000 7f21cc2be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb21f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.557+0000 7f21cc2be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb21f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54168/0 (socket says 172.21.15.133:54168) 2024-02-15T22:56:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.557+0000 7f21cc2be640 1 -- 172.21.15.133:0/3230878622 learned_addr learned my addr 172.21.15.133:0/3230878622 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.557+0000 7f21cc2be640 1 -- 172.21.15.133:0/3230878622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c400a1c0 con 0x556d6ca32a20 2024-02-15T22:56:47.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.558+0000 7f21cc2be640 1 --2- 172.21.15.133:0/3230878622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb21f80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f21c4007000 tx=0x7f21c404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce867bc8043a8425 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.558+0000 7f20ba60c640 1 -- 172.21.15.133:0/3230878622 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21c4061070 con 0x556d6ca32a20 2024-02-15T22:56:47.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.558+0000 7f20ba60c640 1 -- 172.21.15.133:0/3230878622 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c4052940 con 0x556d6ca32a20 2024-02-15T22:56:47.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.558+0000 7f20ba60c640 1 -- 172.21.15.133:0/3230878622 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21c4052c00 con 0x556d6ca32a20 2024-02-15T22:56:47.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.558+0000 7f21d0522800 1 -- 172.21.15.133:0/3230878622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 msgr2=0x556d6cb21f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.558+0000 7f21d0522800 1 --2- 172.21.15.133:0/3230878622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb21f80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f21c4007000 tx=0x7f21c404c000 comp rx=0 tx=0).stop 2024-02-15T22:56:47.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21d0522800 1 -- 172.21.15.133:0/3230878622 shutdown_connections 2024-02-15T22:56:47.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21d0522800 1 --2- 172.21.15.133:0/3230878622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb21f80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21d0522800 1 -- 172.21.15.133:0/3230878622 >> 172.21.15.133:0/3230878622 conn(0x556d6ca2c4f0 msgr2=0x556d6cb1d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21d0522800 1 -- 172.21.15.133:0/3230878622 shutdown_connections 2024-02-15T22:56:47.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21d0522800 1 -- 172.21.15.133:0/3230878622 wait complete. 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21d0522800 1 Processor -- start 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21d0522800 1 -- start start 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21d0522800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb29610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21d0522800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6c92d160 con 0x556d6ca32a20 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21cc2be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb29610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21cc2be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb29610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54172/0 (socket says 172.21.15.133:54172) 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21cc2be640 1 -- 172.21.15.133:0/1847088729 learned_addr learned my addr 172.21.15.133:0/1847088729 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.559+0000 7f21cc2be640 1 -- 172.21.15.133:0/1847088729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6ca39e70 con 0x556d6ca32a20 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.560+0000 7f21cc2be640 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb29610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f21c405f040 tx=0x7f21c4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.560+0000 7f20b8e09640 1 -- 172.21.15.133:0/1847088729 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21c4061040 con 0x556d6ca32a20 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.560+0000 7f20b8e09640 1 -- 172.21.15.133:0/1847088729 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c405d860 con 0x556d6ca32a20 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.560+0000 7f20b8e09640 1 -- 172.21.15.133:0/1847088729 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21c405db40 con 0x556d6ca32a20 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.560+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d6cb29b50 con 0x556d6ca32a20 2024-02-15T22:56:47.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.560+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d6cb2a090 con 0x556d6ca32a20 2024-02-15T22:56:47.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.561+0000 7f20b8e09640 1 -- 172.21.15.133:0/1847088729 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f21c405dca0 con 0x556d6ca32a20 2024-02-15T22:56:47.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.561+0000 7f20b8e09640 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 0x7f20b4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.561+0000 7f20b8e09640 1 -- 172.21.15.133:0/1847088729 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f21c408def0 con 0x556d6ca32a20 2024-02-15T22:56:47.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.561+0000 7f21cbabd640 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 0x7f20b4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.561+0000 7f21d0522800 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556d6ca35350 0x556d6cb30440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.561+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb30980 con 0x556d6ca35350 2024-02-15T22:56:47.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.561+0000 7f21ccabf640 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556d6ca35350 0x556d6cb30440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.561+0000 7f21cbabd640 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 0x7f20b4038ca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f21b4000f60 tx=0x7f21b4001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.561+0000 7f21ccabf640 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556d6ca35350 0x556d6cb30440 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.562+0000 7f21ccabf640 1 -- 172.21.15.133:0/1847088729 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21bc0083e0 con 0x556d6ca35350 2024-02-15T22:56:47.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.562+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb2d9e0 con 0x556d6ca35350 2024-02-15T22:56:47.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.562+0000 7f21ccabf640 1 -- 172.21.15.133:0/1847088729 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f21bc0083e0 con 0x556d6ca35350 2024-02-15T22:56:47.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.562+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb326b0 con 0x556d6ca35350 2024-02-15T22:56:47.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.562+0000 7f21ccabf640 1 -- 172.21.15.133:0/1847088729 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f21bc0083e0 con 0x556d6ca35350 2024-02-15T22:56:47.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.562+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb319c0 con 0x556d6ca35350 2024-02-15T22:56:47.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.562+0000 7f21ccabf640 1 -- 172.21.15.133:0/1847088729 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f21bc0083e0 con 0x556d6ca35350 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.562+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb31dd0 con 0x556d6ca35350 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.563+0000 7f21ccabf640 1 -- 172.21.15.133:0/1847088729 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f21bc012040 con 0x556d6ca35350 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.563+0000 7f21d0522800 1 Processor -- start 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.563+0000 7f21d0522800 1 -- start start 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.563+0000 7f21d0522800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6cb410e0 0x556d6cb41500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.563+0000 7f21d0522800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6c8cfe80 con 0x556d6cb410e0 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.563+0000 7f21cbabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6cb410e0 0x556d6cb41500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.563+0000 7f21cbabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6cb410e0 0x556d6cb41500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54174/0 (socket says 172.21.15.133:54174) 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.563+0000 7f21cbabd640 1 -- 172.21.15.133:0/3576048794 learned_addr learned my addr 172.21.15.133:0/3576048794 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.564+0000 7f21cbabd640 1 -- 172.21.15.133:0/3576048794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6cb41a40 con 0x556d6cb410e0 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.564+0000 7f21cbabd640 1 --2- 172.21.15.133:0/3576048794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6cb410e0 0x556d6cb41500 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f21b4001ed0 tx=0x7f21b400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.564+0000 7f20b1ffb640 1 -- 172.21.15.133:0/3576048794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21b400bec0 con 0x556d6cb410e0 2024-02-15T22:56:47.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.564+0000 7f20b1ffb640 1 -- 172.21.15.133:0/3576048794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b400d520 con 0x556d6cb410e0 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.564+0000 7f21d0522800 1 -- 172.21.15.133:0/3576048794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d6cb424b0 con 0x556d6cb410e0 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.564+0000 7f20b1ffb640 1 -- 172.21.15.133:0/3576048794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21b400d7c0 con 0x556d6cb410e0 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.564+0000 7f21d0522800 1 -- 172.21.15.133:0/3576048794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d6cb42970 con 0x556d6cb410e0 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.565+0000 7f20b1ffb640 1 -- 172.21.15.133:0/3576048794 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f21b401a070 con 0x556d6cb410e0 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.565+0000 7f20b1ffb640 1 --2- 172.21.15.133:0/3576048794 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20a40367d0 0x7f20a4038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.565+0000 7f20b1ffb640 1 -- 172.21.15.133:0/3576048794 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f21b4017050 con 0x556d6cb410e0 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.565+0000 7f21ccabf640 1 --2- 172.21.15.133:0/3576048794 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20a40367d0 0x7f20a4038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.565+0000 7f21d0522800 1 Processor -- start 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.565+0000 7f21d0522800 1 -- start start 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.565+0000 7f21ccabf640 1 --2- 172.21.15.133:0/3576048794 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20a40367d0 0x7f20a4038c90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x556d6cb31400 tx=0x7f21bc000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.565+0000 7f21d0522800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6ca32430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.565+0000 7f21d0522800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6c8a55d0 con 0x556d6ca32010 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.566+0000 7f21cbabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6ca32430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.566+0000 7f21cbabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6ca32430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54176/0 (socket says 172.21.15.133:54176) 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.566+0000 7f21cbabd640 1 -- 172.21.15.133:0/4230671238 learned_addr learned my addr 172.21.15.133:0/4230671238 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.566+0000 7f21cbabd640 1 -- 172.21.15.133:0/4230671238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6ca30810 con 0x556d6ca32010 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.566+0000 7f21cbabd640 1 --2- 172.21.15.133:0/4230671238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6ca32430 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f21b4027030 tx=0x7f21b4024560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc65d3ec912059b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.566+0000 7f20ab7fe640 1 -- 172.21.15.133:0/4230671238 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21b404d2e0 con 0x556d6ca32010 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.566+0000 7f20ab7fe640 1 -- 172.21.15.133:0/4230671238 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b404bae0 con 0x556d6ca32010 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.566+0000 7f20ab7fe640 1 -- 172.21.15.133:0/4230671238 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21b404bd80 con 0x556d6ca32010 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21d0522800 1 -- 172.21.15.133:0/4230671238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 msgr2=0x556d6ca32430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21d0522800 1 --2- 172.21.15.133:0/4230671238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6ca32430 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f21b4027030 tx=0x7f21b4024560 comp rx=0 tx=0).stop 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21d0522800 1 -- 172.21.15.133:0/4230671238 shutdown_connections 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21d0522800 1 --2- 172.21.15.133:0/4230671238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6ca32430 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21d0522800 1 -- 172.21.15.133:0/4230671238 >> 172.21.15.133:0/4230671238 conn(0x556d6cb4a660 msgr2=0x556d6cb486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21d0522800 1 -- 172.21.15.133:0/4230671238 shutdown_connections 2024-02-15T22:56:47.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21d0522800 1 -- 172.21.15.133:0/4230671238 wait complete. 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21d0522800 1 Processor -- start 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21d0522800 1 -- start start 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21d0522800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6cb57510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21d0522800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6cb57a50 con 0x556d6ca32010 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21cbabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6cb57510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21cbabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6cb57510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54180/0 (socket says 172.21.15.133:54180) 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.567+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 learned_addr learned my addr 172.21.15.133:0/3389999560 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.568+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6cb42970 con 0x556d6ca32010 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.568+0000 7f21cbabd640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6cb57510 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f21b4025750 tx=0x7f21b404b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.568+0000 7f20a9ffb640 1 -- 172.21.15.133:0/3389999560 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21b404d2e0 con 0x556d6ca32010 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.568+0000 7f20a9ffb640 1 -- 172.21.15.133:0/3389999560 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b404a4c0 con 0x556d6ca32010 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.568+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d6cb57c50 con 0x556d6ca32010 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.568+0000 7f20a9ffb640 1 -- 172.21.15.133:0/3389999560 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21b401a320 con 0x556d6ca32010 2024-02-15T22:56:47.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.568+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d6cb58110 con 0x556d6ca32010 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.569+0000 7f20a9ffb640 1 -- 172.21.15.133:0/3389999560 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f21b401a4a0 con 0x556d6ca32010 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.569+0000 7f20a9ffb640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f209c0367e0 0x7f209c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.569+0000 7f20a9ffb640 1 -- 172.21.15.133:0/3389999560 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f21b404ed40 con 0x556d6ca32010 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.569+0000 7f21ccabf640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f209c0367e0 0x7f209c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.569+0000 7f21ccabf640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f209c0367e0 0x7f209c038ca0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x556d6cb314c0 tx=0x7f21bc00c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.569+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.569+0000 7f21d0522800 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556d6cb63120 0x556d6cb655e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.569+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb65d30 con 0x556d6cb63120 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.569+0000 7f21cc2be640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556d6cb63120 0x556d6cb655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21cc2be640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556d6cb63120 0x556d6cb655e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21c404f070 con 0x556d6cb63120 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21d0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21d0522800 20 realm 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb66100 con 0x556d6cb63120 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21c404f070 con 0x556d6cb63120 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21d0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21d0522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb66980 con 0x556d6cb63120 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21c404f070 con 0x556d6cb63120 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21d0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.570+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb66ce0 con 0x556d6cb63120 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.571+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f21c404f070 con 0x556d6cb63120 2024-02-15T22:56:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.571+0000 7f21d0522800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.571+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.571+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb674e0 con 0x556d6cb63120 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.571+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f21c404f070 con 0x556d6cb63120 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.571+0000 7f21d0522800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.571+0000 7f21d0522800 20 searching for the correct realm 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.571+0000 7f21d0522800 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556d6cb69400 0x556d6cb6b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.571+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb69400 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.571+0000 7f21cbabd640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556d6cb69400 0x556d6cb6b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.571+0000 7f21cbabd640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556d6cb69400 0x556d6cb6b8c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.572+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.572+0000 7f21cbabd640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f21b4027060 0x7f21b4027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.572+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21b4027060 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.572+0000 7f21ccabf640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f21b4027060 0x7f21b4027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.572+0000 7f21ccabf640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f21b4027060 0x7f21b4027440 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.572+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21bc02c040 con 0x7f21b4027060 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.572+0000 7f21ccabf640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21bc027940 0x7f21bc0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.572+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21bc027940 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.573+0000 7f21cc2be640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21bc027940 0x7f21bc0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.573+0000 7f21cc2be640 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21bc027940 0x7f21bc0333c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.573+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.573+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb63120 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.573+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.573+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb63120 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.574+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.574+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21bc027940 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.574+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.574+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21bc027940 2024-02-15T22:56:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.574+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.574+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21b4027060 2024-02-15T22:56:47.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.574+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21bc02c040 con 0x7f21b4027060 2024-02-15T22:56:47.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.574+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb69400 2024-02-15T22:56:47.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.575+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.575+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb63120 2024-02-15T22:56:47.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.575+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.575+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21bc027940 2024-02-15T22:56:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.575+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.575+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb63120 2024-02-15T22:56:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.575+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.575+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21b4027060 2024-02-15T22:56:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.576+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f21bc02c040 con 0x7f21b4027060 2024-02-15T22:56:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.576+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb69400 2024-02-15T22:56:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.576+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.576+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb69400 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.576+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.576+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21bc027940 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.576+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.576+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb69400 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.577+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.577+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb69400 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.577+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.577+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb63120 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.577+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.577+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb63120 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.577+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.577+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21bc027940 2024-02-15T22:56:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.578+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.578+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb69400 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.578+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.578+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21b4027060 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.578+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21bc02c040 con 0x7f21b4027060 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.578+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb63120 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.578+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.578+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21bc027940 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.579+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.579+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb69400 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.579+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.579+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21bc027940 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.579+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.580+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21b4027060 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.580+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21bc02c040 con 0x7f21b4027060 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.580+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb69400 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.580+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.580+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21bc027940 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.580+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.580+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x556d6cb63120 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6bf90 con 0x7f21b4027060 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21bc02c040 con 0x7f21b4027060 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21d0522800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21d0522800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21d0522800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21d0522800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:47.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21d0522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21d0522800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb689e0 con 0x556d6cb63120 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21d0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.581+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb68230 con 0x556d6cb63120 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb679c0 con 0x556d6cb63120 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 20 zone default found 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 4 Realm: () 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 20 zonegroup default 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6c3d0 con 0x7f21bc027940 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.582+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6e250 con 0x556d6cb69400 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.583+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.583+0000 7f21d0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.583+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.583+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6e5b0 con 0x556d6cb69400 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.583+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.583+0000 7f21d0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.583+0000 7f21d0522800 20 started sync module instance, tier type = 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.583+0000 7f21d0522800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.583+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6d820 con 0x7f21b4027060 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.584+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21bc03f040 con 0x7f21b4027060 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.584+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93928463719376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6d820 con 0x7f21b4027060 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.584+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6ef80 con 0x556d6cb63120 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.585+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93928463719376] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21bc03f040 con 0x7f21b4027060 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.585+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.585+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93928463723136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6d820 con 0x556d6cb63120 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.585+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6fa20 con 0x556d6cb69400 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.586+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.586+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93928463725824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb70270 con 0x556d6cb69400 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.586+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb70cd0 con 0x7f21b4027060 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.586+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93928463723136] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.587+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93928463725824] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.587+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21bc03f040 con 0x7f21b4027060 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.587+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93928463728080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6d380 con 0x7f21b4027060 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.587+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb71590 con 0x556d6cb63120 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.588+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.588+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93928463732912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb71550 con 0x556d6cb63120 2024-02-15T22:56:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.589+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb724f0 con 0x7f21bc027940 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.589+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93928463728080] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21bc03f040 con 0x7f21b4027060 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.589+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93928463732912] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.589+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.589+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93928463736880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb71730 con 0x7f21bc027940 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.590+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb72d70 con 0x7f21bc027940 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.591+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93928463736880] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.591+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.591+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93928463730672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb724f0 con 0x7f21bc027940 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.591+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb73380 con 0x7f21bc027940 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.592+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93928463730672] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.592+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.592+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93928463739088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb73380 con 0x7f21bc027940 2024-02-15T22:56:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.592+0000 7f21d0522800 20 add_watcher() i=0 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.592+0000 7f21d0522800 20 add_watcher() i=1 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.592+0000 7f21d0522800 20 add_watcher() i=2 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.592+0000 7f21d0522800 20 add_watcher() i=3 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.592+0000 7f21d0522800 20 add_watcher() i=4 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.592+0000 7f21d0522800 20 add_watcher() i=5 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.592+0000 7f21d0522800 20 add_watcher() i=6 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.593+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93928463739088] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.593+0000 7f21d0522800 20 add_watcher() i=7 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.593+0000 7f21d0522800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.593+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb73380 con 0x556d6cb63120 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.593+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.593+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93928463742784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb74000 con 0x556d6cb63120 2024-02-15T22:56:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.594+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93928463742784] v32'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.594+0000 7f20827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.594+0000 7f21d0522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.594+0000 7f21d0522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.594+0000 7f21d0522800 5 note: GC not initialized 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f20817e2640 20 reqs_thread_entry: start 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f21d0522800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f21d0522800 20 Filter name: none 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f1ff2ffd640 20 reqs_thread_entry: start 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f21d0522800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f21d0522800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cba87e0 con 0x556d6cb63120 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f21d0522800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:47.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f21d0522800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:47.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f21d0522800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:47.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.595+0000 7f21d0522800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:47.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.596+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~370 in=370b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cbae5b0 con 0x556d6cb63120 2024-02-15T22:56:47.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~370] v32'14 uv14 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f21d0522800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:47.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f21d0522800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:47.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f21d0522800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:47.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93928463982768 in=558b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cbab1a0 con 0x556d6cb63120 2024-02-15T22:56:47.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 93928463732912 notify 137438953500 ret 0) v3 ==== 588+0+0 (crc 0 0 0) 0x556d6cb2a090 con 0x556d6cb63120 2024-02-15T22:56:47.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f20ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 93928463732912 notifier 4649 bl.length()=546 2024-02-15T22:56:47.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f20ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:47.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f20ab7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:47.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f20ab7fe640 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2090003e90 con 0x556d6cb63120 2024-02-15T22:56:47.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(64 notify.4 [notify cookie 93928463982768 out=8b] v0'0 uv180 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.597+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== watch-notify(notify_complete (2) cookie 93928463982768 notify 137438953500 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556d6cb29b50 con 0x556d6cb63120 2024-02-15T22:56:47.611 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:47.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.598+0000 7f20827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.598+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93928463742784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb76370 con 0x556d6cb63120 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.599+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93928463742784] v32'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.599+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93928463719376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb73740 con 0x7f21b4027060 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.600+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93928463719376] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21bc03f040 con 0x7f21b4027060 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.600+0000 7f21d0522800 20 remove_watcher() i=0 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.600+0000 7f21d0522800 2 removed watcher, disabling cache 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.600+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93928463723136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb73740 con 0x556d6cb63120 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.601+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93928463723136] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.601+0000 7f21d0522800 20 remove_watcher() i=1 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.601+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93928463725824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6ea80 con 0x556d6cb69400 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.602+0000 7f21cbabd640 1 -- 172.21.15.133:0/3389999560 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93928463725824] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21b403cce0 con 0x556d6cb69400 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.602+0000 7f21d0522800 20 remove_watcher() i=2 2024-02-15T22:56:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.602+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93928463728080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb73740 con 0x7f21b4027060 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.603+0000 7f21ccabf640 1 -- 172.21.15.133:0/3389999560 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93928463728080] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21bc03f040 con 0x7f21b4027060 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.603+0000 7f21d0522800 20 remove_watcher() i=3 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.603+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93928463732912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6f500 con 0x556d6cb63120 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.604+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93928463732912] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x556d6cb63120 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.604+0000 7f21d0522800 20 remove_watcher() i=4 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.604+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93928463736880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb73740 con 0x7f21bc027940 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.605+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93928463736880] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.605+0000 7f21d0522800 20 remove_watcher() i=5 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.605+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93928463730672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb710b0 con 0x7f21bc027940 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.606+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93928463730672] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.606+0000 7f21d0522800 20 remove_watcher() i=6 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.606+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93928463739088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d6cb6f500 con 0x7f21bc027940 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93928463739088] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21c4085040 con 0x7f21bc027940 2024-02-15T22:56:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 20 remove_watcher() i=7 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21bc027940 msgr2=0x7f21bc0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f21bc027940 0x7f21bc0333c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556d6cb63120 msgr2=0x556d6cb655e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556d6cb63120 0x556d6cb655e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f21b4027060 msgr2=0x7f21b4027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f21b4027060 0x7f21b4027440 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556d6cb69400 msgr2=0x556d6cb6b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x556d6cb69400 0x556d6cb6b8c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f209c0367e0 msgr2=0x7f209c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f209c0367e0 0x7f209c038ca0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x556d6cb314c0 tx=0x7f21bc00c040 comp rx=0 tx=0).stop 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 msgr2=0x556d6cb57510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21d0522800 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6cb57510 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f21b4025750 tx=0x7f21b404b930 comp rx=0 tx=0).stop 2024-02-15T22:56:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.607+0000 7f21cc2be640 1 -- 172.21.15.133:0/3389999560 reap_dead start 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 shutdown_connections 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 --2- 172.21.15.133:0/3389999560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32010 0x556d6cb57510 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 >> 172.21.15.133:0/3389999560 conn(0x556d6cb4a660 msgr2=0x556d6cb47cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 shutdown_connections 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/3389999560 wait complete. 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/3576048794 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20a40367d0 msgr2=0x7f20a4038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 --2- 172.21.15.133:0/3576048794 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20a40367d0 0x7f20a4038c90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x556d6cb31400 tx=0x7f21bc000f90 comp rx=0 tx=0).stop 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/3576048794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6cb410e0 msgr2=0x556d6cb41500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 --2- 172.21.15.133:0/3576048794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6cb410e0 0x556d6cb41500 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f21b4001ed0 tx=0x7f21b400ea00 comp rx=0 tx=0).stop 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/3576048794 shutdown_connections 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 --2- 172.21.15.133:0/3576048794 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20a40367d0 0x7f20a4038c90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 --2- 172.21.15.133:0/3576048794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6cb410e0 0x556d6cb41500 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/3576048794 >> 172.21.15.133:0/3576048794 conn(0x556d6cb35180 msgr2=0x556d6cb35580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/3576048794 shutdown_connections 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/3576048794 wait complete. 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556d6ca35350 msgr2=0x556d6cb30440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556d6ca35350 0x556d6cb30440 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 msgr2=0x7f20b4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 0x7f20b4038ca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f21b4000f60 tx=0x7f21b4001370 comp rx=0 tx=0).stop 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 msgr2=0x556d6cb29610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb29610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f21c405f040 tx=0x7f21c4003330 comp rx=0 tx=0).stop 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 shutdown_connections 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556d6ca35350 0x556d6cb30440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b40367e0 0x7f20b4038ca0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 --2- 172.21.15.133:0/1847088729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d6ca32a20 0x556d6cb29610 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.608+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 >> 172.21.15.133:0/1847088729 conn(0x556d6ca2c4f0 msgr2=0x556d6cb1c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.609+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 shutdown_connections 2024-02-15T22:56:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.609+0000 7f21d0522800 1 -- 172.21.15.133:0/1847088729 wait complete. 2024-02-15T22:56:47.622 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:47.623 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-15T22:56:47.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-15T22:56:47.623 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-02-15T22:56:47.667 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:47.667 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.665+0000 7fe1b9813800 1 Processor -- start 2024-02-15T22:56:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.665+0000 7fe1b9813800 1 -- start start 2024-02-15T22:56:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.666+0000 7fe1b9813800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564012bc9aa0 0x564012bcbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.666+0000 7fe1b9813800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564012b13ba0 con 0x564012bcc3d0 2024-02-15T22:56:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.666+0000 7fe1b9813800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x564012acb450 con 0x564012bc9aa0 2024-02-15T22:56:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.666+0000 7fe1b7312640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564012bc9aa0 0x564012bcbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.666+0000 7fe1b7312640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564012bc9aa0 0x564012bcbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54196/0 (socket says 172.21.15.133:54196) 2024-02-15T22:56:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.666+0000 7fe1b7312640 1 -- 172.21.15.133:0/2916542364 learned_addr learned my addr 172.21.15.133:0/2916542364 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.666+0000 7fe1b6b11640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x564012bcc3d0 0x564012bce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:56556/0 (socket says 172.21.15.133:56556) 2024-02-15T22:56:47.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.666+0000 7fe1b6310640 1 -- 172.21.15.133:0/2916542364 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293943938 0 0) 0x564012b13ba0 con 0x564012bcc3d0 2024-02-15T22:56:47.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.666+0000 7fe1b6310640 1 -- 172.21.15.133:0/2916542364 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a0001e10 con 0x564012bcc3d0 2024-02-15T22:56:47.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.666+0000 7fe1b7312640 1 -- 172.21.15.133:0/2916542364 >> v1:172.21.15.52:6789/0 conn(0x564012bcc3d0 legacy=0x564012bce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.666+0000 7fe1b7312640 1 -- 172.21.15.133:0/2916542364 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564012bd0ef0 con 0x564012bc9aa0 2024-02-15T22:56:47.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.668+0000 7fe1b7312640 1 --2- 172.21.15.133:0/2916542364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012bcbe90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800a520 tx=0x7fe1a801ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2774c4ac2865897d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.668+0000 7fe1b6310640 1 -- 172.21.15.133:0/2916542364 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1a8052570 con 0x564012bc9aa0 2024-02-15T22:56:47.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.669+0000 7fe1b6310640 1 -- 172.21.15.133:0/2916542364 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a80526d0 con 0x564012bc9aa0 2024-02-15T22:56:47.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.669+0000 7fe1b6310640 1 -- 172.21.15.133:0/2916542364 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1a8052990 con 0x564012bc9aa0 2024-02-15T22:56:47.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.669+0000 7fe1b9813800 1 -- 172.21.15.133:0/2916542364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 msgr2=0x564012bcbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.669+0000 7fe1b9813800 1 --2- 172.21.15.133:0/2916542364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012bcbe90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800a520 tx=0x7fe1a801ce00 comp rx=0 tx=0).stop 2024-02-15T22:56:47.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.669+0000 7fe1b9813800 1 -- 172.21.15.133:0/2916542364 shutdown_connections 2024-02-15T22:56:47.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.669+0000 7fe1b9813800 1 --2- 172.21.15.133:0/2916542364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012bcbe90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.669+0000 7fe1b9813800 1 -- 172.21.15.133:0/2916542364 >> 172.21.15.133:0/2916542364 conn(0x564012bc34f0 msgr2=0x564012bc5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.669+0000 7fe1b9813800 1 -- 172.21.15.133:0/2916542364 shutdown_connections 2024-02-15T22:56:47.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.669+0000 7fe1b9813800 1 -- 172.21.15.133:0/2916542364 wait complete. 2024-02-15T22:56:47.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.681+0000 7fe1b9813800 1 Processor -- start 2024-02-15T22:56:47.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.681+0000 7fe1b9813800 1 -- start start 2024-02-15T22:56:47.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.681+0000 7fe1b9813800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012bc93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.681+0000 7fe1b9813800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564012ac8980 con 0x564012bc9aa0 2024-02-15T22:56:47.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.681+0000 7fe1b7312640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012bc93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.681+0000 7fe1b7312640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012bc93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54206/0 (socket says 172.21.15.133:54206) 2024-02-15T22:56:47.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.681+0000 7fe1b7312640 1 -- 172.21.15.133:0/2961096305 learned_addr learned my addr 172.21.15.133:0/2961096305 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.681+0000 7fe1b7312640 1 -- 172.21.15.133:0/2961096305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a8005de0 con 0x564012bc9aa0 2024-02-15T22:56:47.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.682+0000 7fe1b7312640 1 --2- 172.21.15.133:0/2961096305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012bc93e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8000c00 tx=0x7fe1a804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d366a1112019ab3f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.682+0000 7fe0a560a640 1 -- 172.21.15.133:0/2961096305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1a8052840 con 0x564012bc9aa0 2024-02-15T22:56:47.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.682+0000 7fe0a560a640 1 -- 172.21.15.133:0/2961096305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a80529a0 con 0x564012bc9aa0 2024-02-15T22:56:47.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.682+0000 7fe0a560a640 1 -- 172.21.15.133:0/2961096305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1a8052c60 con 0x564012bc9aa0 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.682+0000 7fe1b9813800 1 -- 172.21.15.133:0/2961096305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 msgr2=0x564012bc93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.682+0000 7fe1b9813800 1 --2- 172.21.15.133:0/2961096305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012bc93e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8000c00 tx=0x7fe1a804c000 comp rx=0 tx=0).stop 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.682+0000 7fe1b9813800 1 -- 172.21.15.133:0/2961096305 shutdown_connections 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.682+0000 7fe1b9813800 1 --2- 172.21.15.133:0/2961096305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012bc93e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.682+0000 7fe1b9813800 1 -- 172.21.15.133:0/2961096305 >> 172.21.15.133:0/2961096305 conn(0x564012bc34f0 msgr2=0x564012cb4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.682+0000 7fe1b9813800 1 -- 172.21.15.133:0/2961096305 shutdown_connections 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.682+0000 7fe1b9813800 1 -- 172.21.15.133:0/2961096305 wait complete. 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.683+0000 7fe1b9813800 1 Processor -- start 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.683+0000 7fe1b9813800 1 -- start start 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.683+0000 7fe1b9813800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012cc2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.683+0000 7fe1b9813800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564012ac4160 con 0x564012bc9aa0 2024-02-15T22:56:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.683+0000 7fe1b7312640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012cc2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.683+0000 7fe1b7312640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012cc2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54210/0 (socket says 172.21.15.133:54210) 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.683+0000 7fe1b7312640 1 -- 172.21.15.133:0/549686120 learned_addr learned my addr 172.21.15.133:0/549686120 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.683+0000 7fe1b7312640 1 -- 172.21.15.133:0/549686120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564012bd0ef0 con 0x564012bc9aa0 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.683+0000 7fe1b7312640 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012cc2610 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe1a801cdd0 tx=0x7fe1a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.684+0000 7fe0a3e07640 1 -- 172.21.15.133:0/549686120 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1a806c070 con 0x564012bc9aa0 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.684+0000 7fe0a3e07640 1 -- 172.21.15.133:0/549686120 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a8052e60 con 0x564012bc9aa0 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.684+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564012cc2b50 con 0x564012bc9aa0 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.684+0000 7fe0a3e07640 1 -- 172.21.15.133:0/549686120 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1a805d7e0 con 0x564012bc9aa0 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.684+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564012cc3090 con 0x564012bc9aa0 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.684+0000 7fe0a3e07640 1 -- 172.21.15.133:0/549686120 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe1a8059040 con 0x564012bc9aa0 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.685+0000 7fe0a3e07640 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe09c0367e0 0x7fe09c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.685+0000 7fe0a3e07640 1 -- 172.21.15.133:0/549686120 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fe1a808d740 con 0x564012bc9aa0 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.685+0000 7fe1b6b11640 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe09c0367e0 0x7fe09c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.685+0000 7fe1b9813800 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564012bcc3d0 0x564012cc9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.685+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012cc9980 con 0x564012bcc3d0 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.685+0000 7fe1b7b13640 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564012bcc3d0 0x564012cc9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.685+0000 7fe1b6b11640 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe09c0367e0 0x7fe09c038ca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac000f60 tx=0x7fe1ac001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.685+0000 7fe1b7b13640 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564012bcc3d0 0x564012cc9440 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.686+0000 7fe1b7b13640 1 -- 172.21.15.133:0/549686120 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1b000a4a0 con 0x564012bcc3d0 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.686+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012cc69c0 con 0x564012bcc3d0 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.686+0000 7fe1b7b13640 1 -- 172.21.15.133:0/549686120 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe1b000a4a0 con 0x564012bcc3d0 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.686+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012cc9e40 con 0x564012bcc3d0 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.686+0000 7fe1b7b13640 1 -- 172.21.15.133:0/549686120 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe1b000a4a0 con 0x564012bcc3d0 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.686+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012ccab10 con 0x564012bcc3d0 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.686+0000 7fe1b7b13640 1 -- 172.21.15.133:0/549686120 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe1b000a4a0 con 0x564012bcc3d0 2024-02-15T22:56:47.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.686+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012ccaf20 con 0x564012bcc3d0 2024-02-15T22:56:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.687+0000 7fe1b7b13640 1 -- 172.21.15.133:0/549686120 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe1b000a4a0 con 0x564012bcc3d0 2024-02-15T22:56:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.687+0000 7fe1b9813800 1 Processor -- start 2024-02-15T22:56:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.687+0000 7fe1b9813800 1 -- start start 2024-02-15T22:56:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.687+0000 7fe1b9813800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012cda0e0 0x564012cda500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.687+0000 7fe1b9813800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564012a66e80 con 0x564012cda0e0 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.687+0000 7fe1b6b11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012cda0e0 0x564012cda500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.687+0000 7fe1b6b11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012cda0e0 0x564012cda500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54218/0 (socket says 172.21.15.133:54218) 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.687+0000 7fe1b6b11640 1 -- 172.21.15.133:0/1139625907 learned_addr learned my addr 172.21.15.133:0/1139625907 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.688+0000 7fe1b6b11640 1 -- 172.21.15.133:0/1139625907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564012cdaa40 con 0x564012cda0e0 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.688+0000 7fe1b6b11640 1 --2- 172.21.15.133:0/1139625907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012cda0e0 0x564012cda500 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac001ed0 tx=0x7fe1ac00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.688+0000 7fe0a1602640 1 -- 172.21.15.133:0/1139625907 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1ac01b380 con 0x564012cda0e0 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.688+0000 7fe0a1602640 1 -- 172.21.15.133:0/1139625907 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac01b500 con 0x564012cda0e0 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.688+0000 7fe1b9813800 1 -- 172.21.15.133:0/1139625907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564012cdb4b0 con 0x564012cda0e0 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.688+0000 7fe0a1602640 1 -- 172.21.15.133:0/1139625907 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1ac01b6b0 con 0x564012cda0e0 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.688+0000 7fe1b9813800 1 -- 172.21.15.133:0/1139625907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564012cdb970 con 0x564012cda0e0 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.689+0000 7fe0a1602640 1 -- 172.21.15.133:0/1139625907 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe1ac01a070 con 0x564012cda0e0 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.689+0000 7fe0a1602640 1 --2- 172.21.15.133:0/1139625907 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe0900367e0 0x7fe090038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.689+0000 7fe0a1602640 1 -- 172.21.15.133:0/1139625907 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fe1ac017050 con 0x564012cda0e0 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.689+0000 7fe1b7b13640 1 --2- 172.21.15.133:0/1139625907 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe0900367e0 0x7fe090038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.689+0000 7fe1b9813800 1 Processor -- start 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.689+0000 7fe1b9813800 1 -- start start 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.689+0000 7fe1b7b13640 1 --2- 172.21.15.133:0/1139625907 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe0900367e0 0x7fe090038ca0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x564012cca550 tx=0x7fe1b0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.690+0000 7fe1b9813800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012ce7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.690+0000 7fe1b9813800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564012a3c5d0 con 0x564012ce7300 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.690+0000 7fe1b6b11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012ce7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.690+0000 7fe1b6b11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012ce7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54228/0 (socket says 172.21.15.133:54228) 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.690+0000 7fe1b6b11640 1 -- 172.21.15.133:0/1852237649 learned_addr learned my addr 172.21.15.133:0/1852237649 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.690+0000 7fe1b6b11640 1 -- 172.21.15.133:0/1852237649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564012ce7cf0 con 0x564012ce7300 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.690+0000 7fe1b6b11640 1 --2- 172.21.15.133:0/1852237649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012ce7720 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac04b9f0 tx=0x7fe1ac01a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587e6098bff79899 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.690+0000 7fe09affd640 1 -- 172.21.15.133:0/1852237649 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1ac0264e0 con 0x564012ce7300 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.690+0000 7fe09affd640 1 -- 172.21.15.133:0/1852237649 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac01bb90 con 0x564012ce7300 2024-02-15T22:56:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.690+0000 7fe09affd640 1 -- 172.21.15.133:0/1852237649 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1ac00d310 con 0x564012ce7300 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b9813800 1 -- 172.21.15.133:0/1852237649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 msgr2=0x564012ce7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b9813800 1 --2- 172.21.15.133:0/1852237649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012ce7720 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac04b9f0 tx=0x7fe1ac01a740 comp rx=0 tx=0).stop 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b9813800 1 -- 172.21.15.133:0/1852237649 shutdown_connections 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b9813800 1 --2- 172.21.15.133:0/1852237649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012ce7720 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b9813800 1 -- 172.21.15.133:0/1852237649 >> 172.21.15.133:0/1852237649 conn(0x564012ce3660 msgr2=0x564012ce16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b9813800 1 -- 172.21.15.133:0/1852237649 shutdown_connections 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b9813800 1 -- 172.21.15.133:0/1852237649 wait complete. 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b9813800 1 Processor -- start 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b9813800 1 -- start start 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b9813800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012cee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b9813800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564012cee7f0 con 0x564012ce7300 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b6b11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012cee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b6b11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012cee2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54244/0 (socket says 172.21.15.133:54244) 2024-02-15T22:56:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.691+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 learned_addr learned my addr 172.21.15.133:0/473168038 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.692+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564012cdb970 con 0x564012ce7300 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.692+0000 7fe1b6b11640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012cee2b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac04b9f0 tx=0x7fe1ac04b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.692+0000 7fe0997fa640 1 -- 172.21.15.133:0/473168038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1ac04d2e0 con 0x564012ce7300 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.692+0000 7fe0997fa640 1 -- 172.21.15.133:0/473168038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac04bb30 con 0x564012ce7300 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.692+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564012cee9f0 con 0x564012ce7300 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.692+0000 7fe0997fa640 1 -- 172.21.15.133:0/473168038 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1ac04bdd0 con 0x564012ce7300 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.692+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564012cee9f0 con 0x564012ce7300 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.693+0000 7fe0997fa640 1 -- 172.21.15.133:0/473168038 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe1ac00d6a0 con 0x564012ce7300 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.693+0000 7fe0997fa640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe0800367e0 0x7fe080038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.693+0000 7fe0997fa640 1 -- 172.21.15.133:0/473168038 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fe1ac032bf0 con 0x564012ce7300 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.693+0000 7fe1b7b13640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe0800367e0 0x7fe080038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.693+0000 7fe1b7b13640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe0800367e0 0x7fe080038ca0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b010 tx=0x7fe1b0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.693+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.693+0000 7fe1b9813800 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564012cf9d00 0x564012cfc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.693+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012cfc910 con 0x564012cf9d00 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.693+0000 7fe1b7312640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564012cf9d00 0x564012cfc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b7312640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564012cf9d00 0x564012cfc1c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b9813800 20 realm 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012cfcce0 con 0x564012cf9d00 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b9813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012cfd560 con 0x564012cf9d00 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.694+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012cfd8c0 con 0x564012cf9d00 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.695+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.695+0000 7fe1b9813800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.695+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.695+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012cfe0c0 con 0x564012cf9d00 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.695+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.695+0000 7fe1b9813800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.695+0000 7fe1b9813800 20 searching for the correct realm 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.695+0000 7fe1b9813800 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564012cfffe0 0x564012d02480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.695+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cfffe0 2024-02-15T22:56:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.695+0000 7fe1b6b11640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564012cfffe0 0x564012d02480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.695+0000 7fe1b6b11640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564012cfffe0 0x564012d02480 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.696+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.696+0000 7fe1b6b11640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe1ac027060 0x7fe1ac0256a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.696+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1ac027060 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.696+0000 7fe1b7b13640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe1ac027060 0x7fe1ac0256a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.696+0000 7fe1b7b13640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe1ac027060 0x7fe1ac0256a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.696+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b000a4a0 con 0x7fe1ac027060 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.696+0000 7fe1b7b13640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe1b00141d0 0x7fe1b0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.696+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1b00141d0 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.697+0000 7fe1b7312640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe1b00141d0 0x7fe1b0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.697+0000 7fe1b7312640 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe1b00141d0 0x7fe1b0015940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.697+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x7fe1b00141d0 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.697+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cf9d00 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.698+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.698+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cf9d00 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.698+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.698+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1b00141d0 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.698+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x7fe1b00141d0 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.698+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1b00141d0 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.698+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x7fe1b00141d0 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.698+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1ac027060 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.698+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b000a4a0 con 0x7fe1ac027060 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.698+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cfffe0 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.699+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.699+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cf9d00 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.699+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.699+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1b00141d0 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.699+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x7fe1b00141d0 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.699+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cf9d00 2024-02-15T22:56:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.699+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.699+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1ac027060 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.700+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe1b003a040 con 0x7fe1ac027060 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.700+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cfffe0 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.700+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.700+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cfffe0 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.700+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.700+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1b00141d0 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.700+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x7fe1b00141d0 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.700+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cfffe0 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.701+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.701+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cfffe0 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.701+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.701+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cf9d00 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.701+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.701+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cf9d00 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.701+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.701+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1b00141d0 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.702+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x7fe1b00141d0 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.702+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cfffe0 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.702+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.702+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1ac027060 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.702+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b003a040 con 0x7fe1ac027060 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.702+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cf9d00 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.702+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe1a80797d0 con 0x564012cf9d00 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.702+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1b00141d0 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.703+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x7fe1b00141d0 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.703+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cfffe0 2024-02-15T22:56:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.703+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.703+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1b00141d0 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.703+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a80797d0 con 0x7fe1b00141d0 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.703+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1ac027060 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.703+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b003a040 con 0x7fe1ac027060 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.703+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cfffe0 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.704+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.704+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1b00141d0 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.704+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1a8093040 con 0x7fe1b00141d0 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.704+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x564012cf9d00 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.704+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.704+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02b50 con 0x7fe1ac027060 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b003a040 con 0x7fe1ac027060 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012cff5f0 con 0x564012cf9d00 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012cfee10 con 0x564012cf9d00 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d02f90 con 0x564012cf9d00 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 zone default found 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 4 Realm: () 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 zonegroup default 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.705+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d032f0 con 0x7fe1b00141d0 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x7fe1b00141d0 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d05170 con 0x564012cfffe0 2024-02-15T22:56:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d054d0 con 0x564012cfffe0 2024-02-15T22:56:47.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b9813800 20 started sync module instance, tier type = 2024-02-15T22:56:47.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.706+0000 7fe1b9813800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:47.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.707+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d04740 con 0x7fe1ac027060 2024-02-15T22:56:47.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.708+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b003a040 con 0x7fe1ac027060 2024-02-15T22:56:47.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.708+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94833193536288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d043d0 con 0x7fe1ac027060 2024-02-15T22:56:47.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.708+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d062e0 con 0x564012cf9d00 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.709+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.709+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94833193541664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d06aa0 con 0x564012cf9d00 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.709+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d07550 con 0x564012cfffe0 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.709+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94833193536288] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b003a040 con 0x7fe1ac027060 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.710+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94833193541664] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.710+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.710+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94833193545808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d06500 con 0x564012cfffe0 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.710+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d07f40 con 0x7fe1ac027060 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.711+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94833193545808] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.711+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b003a040 con 0x7fe1ac027060 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.711+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94833193548448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d08360 con 0x7fe1ac027060 2024-02-15T22:56:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.711+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d08be0 con 0x564012cf9d00 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.712+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.712+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94833193550688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d087e0 con 0x564012cf9d00 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.712+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d09b80 con 0x7fe1b00141d0 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.712+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94833193548448] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b003a040 con 0x7fe1ac027060 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.713+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94833193550688] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.713+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x7fe1b00141d0 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.713+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94833193555584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d09b40 con 0x7fe1b00141d0 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.713+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d090b0 con 0x7fe1b00141d0 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.714+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x7fe1b00141d0 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.714+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94833193556800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d0a460 con 0x7fe1b00141d0 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.714+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d0af30 con 0x7fe1b00141d0 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.714+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94833193555584] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x7fe1b00141d0 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.715+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x7fe1b00141d0 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.715+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94833193556800] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x7fe1b00141d0 2024-02-15T22:56:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.715+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94833193560592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d0aef0 con 0x7fe1b00141d0 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.715+0000 7fe1b9813800 20 add_watcher() i=0 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.715+0000 7fe1b9813800 20 add_watcher() i=1 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.715+0000 7fe1b9813800 20 add_watcher() i=2 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.715+0000 7fe1b9813800 20 add_watcher() i=3 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.715+0000 7fe1b9813800 20 add_watcher() i=4 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.715+0000 7fe1b9813800 20 add_watcher() i=5 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.715+0000 7fe1b9813800 20 add_watcher() i=6 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.716+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94833193560592] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x7fe1b00141d0 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.716+0000 7fe1b9813800 20 add_watcher() i=7 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.716+0000 7fe1b9813800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.716+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d0df20 con 0x564012cf9d00 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.716+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.717+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94833193549504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d0b390 con 0x564012cf9d00 2024-02-15T22:56:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.717+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94833193549504] v32'189 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.718+0000 7fe06dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.718+0000 7fe1b9813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.718+0000 7fe1b9813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.718+0000 7fe1b9813800 5 note: GC not initialized 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.718+0000 7fe06cfe1640 20 reqs_thread_entry: start 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.718+0000 7fe1b9813800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.718+0000 7fe1b9813800 20 Filter name: none 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.718+0000 7fdfe67fc640 20 reqs_thread_entry: start 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.718+0000 7fe1b9813800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.718+0000 7fe1b9813800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.718+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d3fe90 con 0x564012cf9d00 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.719+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~370 out=370b,getxattrs out=75b] v0'0 uv14 ondisk = 0) v8 ==== 231+0+493 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.719+0000 7fe1b9813800 20 rados_obj.operate() r=0 bl.length=370 2024-02-15T22:56:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.719+0000 7fe1b9813800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.719+0000 7fe1b9813800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.719+0000 7fe1b9813800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.719+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d45cc0 con 0x564012cf9d00 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v32'15 uv15 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe1b9813800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe1b9813800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe1b9813800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94833193801696 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d42850 con 0x564012cf9d00 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== watch-notify(notify (1) cookie 94833193550688 notify 137438953501 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x564012cc3090 con 0x564012cf9d00 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe09affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94833193550688 notifier 4656 bl.length()=534 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe09affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe09affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(64 notify.4 [notify cookie 94833193801696 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe09affd640 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe07c003e90 con 0x564012cf9d00 2024-02-15T22:56:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.720+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== watch-notify(notify_complete (2) cookie 94833193801696 notify 137438953501 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564012cc2b50 con 0x564012cf9d00 2024-02-15T22:56:47.735 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:56:47.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.721+0000 7fe06dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.721+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94833193549504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d0d9a0 con 0x564012cf9d00 2024-02-15T22:56:47.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.722+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94833193549504] v32'190 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.722+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94833193536288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d07ec0 con 0x7fe1ac027060 2024-02-15T22:56:47.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.723+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94833193536288] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b003a040 con 0x7fe1ac027060 2024-02-15T22:56:47.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.723+0000 7fe1b9813800 20 remove_watcher() i=0 2024-02-15T22:56:47.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.723+0000 7fe1b9813800 2 removed watcher, disabling cache 2024-02-15T22:56:47.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.723+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94833193541664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d07ec0 con 0x564012cf9d00 2024-02-15T22:56:47.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.725+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94833193541664] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.725+0000 7fe1b9813800 20 remove_watcher() i=1 2024-02-15T22:56:47.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.725+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94833193545808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d06020 con 0x564012cfffe0 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.726+0000 7fe1b6b11640 1 -- 172.21.15.133:0/473168038 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94833193545808] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1ac032db0 con 0x564012cfffe0 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.726+0000 7fe1b9813800 20 remove_watcher() i=2 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.726+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94833193548448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d07050 con 0x7fe1ac027060 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.726+0000 7fe1b7b13640 1 -- 172.21.15.133:0/473168038 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94833193548448] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b003a040 con 0x7fe1ac027060 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.726+0000 7fe1b9813800 20 remove_watcher() i=3 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.726+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94833193550688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d07f40 con 0x564012cf9d00 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.727+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94833193550688] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x564012cf9d00 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.727+0000 7fe1b9813800 20 remove_watcher() i=4 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.727+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94833193555584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d07f40 con 0x7fe1b00141d0 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.728+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94833193555584] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x7fe1b00141d0 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.728+0000 7fe1b9813800 20 remove_watcher() i=5 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.728+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94833193556800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d07f40 con 0x7fe1b00141d0 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.729+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94833193556800] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x7fe1b00141d0 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.730+0000 7fe1b9813800 20 remove_watcher() i=6 2024-02-15T22:56:47.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.730+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94833193560592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564012d09680 con 0x7fe1b00141d0 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.730+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94833193560592] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1a8093040 con 0x7fe1b00141d0 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.730+0000 7fe1b9813800 20 remove_watcher() i=7 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe1b00141d0 msgr2=0x7fe1b0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fe1b00141d0 0x7fe1b0015940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564012cf9d00 msgr2=0x564012cfc1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564012cf9d00 0x564012cfc1c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe1ac027060 msgr2=0x7fe1ac0256a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe1ac027060 0x7fe1ac0256a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564012cfffe0 msgr2=0x564012d02480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564012cfffe0 0x564012d02480 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe0800367e0 msgr2=0x7fe080038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe0800367e0 0x7fe080038ca0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b010 tx=0x7fe1b0020000 comp rx=0 tx=0).stop 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b7312640 1 -- 172.21.15.133:0/473168038 reap_dead start 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 msgr2=0x564012cee2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012cee2b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac04b9f0 tx=0x7fe1ac04b980 comp rx=0 tx=0).stop 2024-02-15T22:56:47.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 shutdown_connections 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 --2- 172.21.15.133:0/473168038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012ce7300 0x564012cee2b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 >> 172.21.15.133:0/473168038 conn(0x564012ce3660 msgr2=0x564012ce0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 shutdown_connections 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/473168038 wait complete. 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/1139625907 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe0900367e0 msgr2=0x7fe090038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 --2- 172.21.15.133:0/1139625907 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe0900367e0 0x7fe090038ca0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x564012cca550 tx=0x7fe1b0005840 comp rx=0 tx=0).stop 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/1139625907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012cda0e0 msgr2=0x564012cda500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 --2- 172.21.15.133:0/1139625907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012cda0e0 0x564012cda500 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac001ed0 tx=0x7fe1ac00ea00 comp rx=0 tx=0).stop 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/1139625907 shutdown_connections 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 --2- 172.21.15.133:0/1139625907 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe0900367e0 0x7fe090038ca0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 --2- 172.21.15.133:0/1139625907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012cda0e0 0x564012cda500 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/1139625907 >> 172.21.15.133:0/1139625907 conn(0x564012cce180 msgr2=0x564012cce580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/1139625907 shutdown_connections 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/1139625907 wait complete. 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.731+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564012bcc3d0 msgr2=0x564012cc9440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564012bcc3d0 0x564012cc9440 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe09c0367e0 msgr2=0x7fe09c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe09c0367e0 0x7fe09c038ca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac000f60 tx=0x7fe1ac001390 comp rx=0 tx=0).stop 2024-02-15T22:56:47.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 msgr2=0x564012cc2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012cc2610 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe1a801cdd0 tx=0x7fe1a8002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 shutdown_connections 2024-02-15T22:56:47.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564012bcc3d0 0x564012cc9440 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe09c0367e0 0x7fe09c038ca0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 --2- 172.21.15.133:0/549686120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564012bc9aa0 0x564012cc2610 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 >> 172.21.15.133:0/549686120 conn(0x564012bc34f0 msgr2=0x564012bc7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 shutdown_connections 2024-02-15T22:56:47.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.732+0000 7fe1b9813800 1 -- 172.21.15.133:0/549686120 wait complete. 2024-02-15T22:56:47.745 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:56:47.755 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:47.755 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-15T22:56:47.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-15T22:56:47.755 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-15T22:56:47.797 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:56:47.797 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:56:47.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.795+0000 7f11f933e800 1 Processor -- start 2024-02-15T22:56:47.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.795+0000 7f11f933e800 1 -- start start 2024-02-15T22:56:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.795+0000 7f11f933e800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5559ac4863d0 0x5559ac48eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.795+0000 7f11f933e800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5559ac3d0bb0 con 0x5559ac484890 2024-02-15T22:56:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.795+0000 7f11f933e800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5559ac388450 con 0x5559ac4863d0 2024-02-15T22:56:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.796+0000 7f11ec843640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5559ac4863d0 0x5559ac48eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.796+0000 7f11f5044640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5559ac484890 0x5559ac484cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:56562/0 (socket says 172.21.15.133:56562) 2024-02-15T22:56:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.796+0000 7f11ec843640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5559ac4863d0 0x5559ac48eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54246/0 (socket says 172.21.15.133:54246) 2024-02-15T22:56:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.796+0000 7f11f5044640 1 -- 172.21.15.133:0/3200578810 learned_addr learned my addr 172.21.15.133:0/3200578810 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:56:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.796+0000 7f11ec843640 1 -- 172.21.15.133:0/3200578810 >> v1:172.21.15.52:6789/0 conn(0x5559ac484890 legacy=0x5559ac484cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.796+0000 7f11ec843640 1 -- 172.21.15.133:0/3200578810 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ac3f9180 con 0x5559ac4863d0 2024-02-15T22:56:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.798+0000 7f11ec843640 1 --2- 172.21.15.133:0/3200578810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac4863d0 0x5559ac48eed0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f11e000a470 tx=0x7f11e001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1ae1024ae9c224 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.798+0000 7f11f4843640 1 -- 172.21.15.133:0/3200578810 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e004ad40 con 0x5559ac4863d0 2024-02-15T22:56:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.798+0000 7f11f4843640 1 -- 172.21.15.133:0/3200578810 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0052440 con 0x5559ac4863d0 2024-02-15T22:56:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.798+0000 7f11f4843640 1 -- 172.21.15.133:0/3200578810 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e004aea0 con 0x5559ac4863d0 2024-02-15T22:56:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.798+0000 7f11f933e800 1 -- 172.21.15.133:0/3200578810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac4863d0 msgr2=0x5559ac48eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.798+0000 7f11f933e800 1 --2- 172.21.15.133:0/3200578810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac4863d0 0x5559ac48eed0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f11e000a470 tx=0x7f11e001cd60 comp rx=0 tx=0).stop 2024-02-15T22:56:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.798+0000 7f11f933e800 1 -- 172.21.15.133:0/3200578810 shutdown_connections 2024-02-15T22:56:47.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.798+0000 7f11f933e800 1 --2- 172.21.15.133:0/3200578810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac4863d0 0x5559ac48eed0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.798+0000 7f11f933e800 1 -- 172.21.15.133:0/3200578810 >> 172.21.15.133:0/3200578810 conn(0x5559ac4804d0 msgr2=0x5559ac4828f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.798+0000 7f11f933e800 1 -- 172.21.15.133:0/3200578810 shutdown_connections 2024-02-15T22:56:47.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.798+0000 7f11f933e800 1 -- 172.21.15.133:0/3200578810 wait complete. 2024-02-15T22:56:47.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.810+0000 7f11f933e800 1 Processor -- start 2024-02-15T22:56:47.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.810+0000 7f11f933e800 1 -- start start 2024-02-15T22:56:47.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.810+0000 7f11f933e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac5782e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.810+0000 7f11f933e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ac385980 con 0x5559ac484890 2024-02-15T22:56:47.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.810+0000 7f11f5044640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac5782e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.810+0000 7f11f5044640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac5782e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54258/0 (socket says 172.21.15.133:54258) 2024-02-15T22:56:47.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.810+0000 7f11f5044640 1 -- 172.21.15.133:0/3974908222 learned_addr learned my addr 172.21.15.133:0/3974908222 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.811+0000 7f11f5044640 1 -- 172.21.15.133:0/3974908222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e0005d20 con 0x5559ac484890 2024-02-15T22:56:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.811+0000 7f11f5044640 1 --2- 172.21.15.133:0/3974908222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac5782e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f11e8001c50 tx=0x7f11e800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a78bec410aea40 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.811+0000 7f10e3606640 1 -- 172.21.15.133:0/3974908222 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e800e470 con 0x5559ac484890 2024-02-15T22:56:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.811+0000 7f10e3606640 1 -- 172.21.15.133:0/3974908222 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e800e5d0 con 0x5559ac484890 2024-02-15T22:56:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.811+0000 7f10e3606640 1 -- 172.21.15.133:0/3974908222 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e800e8d0 con 0x5559ac484890 2024-02-15T22:56:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.812+0000 7f11f933e800 1 -- 172.21.15.133:0/3974908222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 msgr2=0x5559ac5782e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.812+0000 7f11f933e800 1 --2- 172.21.15.133:0/3974908222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac5782e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f11e8001c50 tx=0x7f11e800b6c0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.812+0000 7f11f933e800 1 -- 172.21.15.133:0/3974908222 shutdown_connections 2024-02-15T22:56:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.812+0000 7f11f933e800 1 --2- 172.21.15.133:0/3974908222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac5782e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.812+0000 7f11f933e800 1 -- 172.21.15.133:0/3974908222 >> 172.21.15.133:0/3974908222 conn(0x5559ac4804d0 msgr2=0x5559ac573c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.812+0000 7f11f933e800 1 -- 172.21.15.133:0/3974908222 shutdown_connections 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.812+0000 7f11f933e800 1 -- 172.21.15.133:0/3974908222 wait complete. 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.812+0000 7f11f933e800 1 Processor -- start 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.812+0000 7f11f933e800 1 -- start start 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.812+0000 7f11f933e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac57f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.812+0000 7f11f933e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ac381160 con 0x5559ac484890 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.813+0000 7f11f5044640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac57f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.813+0000 7f11f5044640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac57f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54264/0 (socket says 172.21.15.133:54264) 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.813+0000 7f11f5044640 1 -- 172.21.15.133:0/3249530810 learned_addr learned my addr 172.21.15.133:0/3249530810 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.813+0000 7f11f5044640 1 -- 172.21.15.133:0/3249530810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ac3d0bb0 con 0x5559ac484890 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.813+0000 7f11f5044640 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac57f970 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f11e8000c00 tx=0x7f11e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.813+0000 7f10e1e03640 1 -- 172.21.15.133:0/3249530810 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e801f070 con 0x5559ac484890 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.813+0000 7f10e1e03640 1 -- 172.21.15.133:0/3249530810 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8018770 con 0x5559ac484890 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.813+0000 7f10e1e03640 1 -- 172.21.15.133:0/3249530810 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e8018a30 con 0x5559ac484890 2024-02-15T22:56:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.813+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5559ac57feb0 con 0x5559ac484890 2024-02-15T22:56:47.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.813+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559ac580390 con 0x5559ac484890 2024-02-15T22:56:47.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.814+0000 7f10e1e03640 1 -- 172.21.15.133:0/3249530810 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f11e8018c20 con 0x5559ac484890 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.814+0000 7f10e1e03640 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10dc036790 0x7f10dc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.814+0000 7f10e1e03640 1 -- 172.21.15.133:0/3249530810 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f11e804c250 con 0x5559ac484890 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.814+0000 7f11ec843640 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10dc036790 0x7f10dc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.814+0000 7f11f933e800 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5559ac4863d0 0x5559ac586670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.814+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac586c40 con 0x5559ac4863d0 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.815+0000 7f11f5845640 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5559ac4863d0 0x5559ac586670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.815+0000 7f11ec843640 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10dc036790 0x7f10dc038c50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f11e0054000 tx=0x7f11e004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.815+0000 7f11f5845640 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5559ac4863d0 0x5559ac586670 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.815+0000 7f11f5845640 1 -- 172.21.15.133:0/3249530810 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11f000a4a0 con 0x5559ac4863d0 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.815+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac583d60 con 0x5559ac4863d0 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.815+0000 7f11f5845640 1 -- 172.21.15.133:0/3249530810 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f11f000a4a0 con 0x5559ac4863d0 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.815+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac588970 con 0x5559ac4863d0 2024-02-15T22:56:47.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.816+0000 7f11f5845640 1 -- 172.21.15.133:0/3249530810 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f11f000a4a0 con 0x5559ac4863d0 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.816+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac587b70 con 0x5559ac4863d0 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.816+0000 7f11f5845640 1 -- 172.21.15.133:0/3249530810 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f11f000a4a0 con 0x5559ac4863d0 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.816+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac587f80 con 0x5559ac4863d0 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.816+0000 7f11f5845640 1 -- 172.21.15.133:0/3249530810 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f11f000a4a0 con 0x5559ac4863d0 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.816+0000 7f11f933e800 1 Processor -- start 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.817+0000 7f11f933e800 1 -- start start 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.817+0000 7f11f933e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5973f0 0x5559ac597810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.817+0000 7f11f933e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ac323e80 con 0x5559ac5973f0 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.817+0000 7f11ec843640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5973f0 0x5559ac597810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.817+0000 7f11ec843640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5973f0 0x5559ac597810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54274/0 (socket says 172.21.15.133:54274) 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.817+0000 7f11ec843640 1 -- 172.21.15.133:0/775410726 learned_addr learned my addr 172.21.15.133:0/775410726 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.817+0000 7f11ec843640 1 -- 172.21.15.133:0/775410726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ac597d50 con 0x5559ac5973f0 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.817+0000 7f11ec843640 1 --2- 172.21.15.133:0/775410726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5973f0 0x5559ac597810 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f11e001d490 tx=0x7f11e0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.817+0000 7f10daffd640 1 -- 172.21.15.133:0/775410726 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e005c540 con 0x5559ac5973f0 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.817+0000 7f10daffd640 1 -- 172.21.15.133:0/775410726 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0063040 con 0x5559ac5973f0 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.817+0000 7f11f933e800 1 -- 172.21.15.133:0/775410726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5559ac597f40 con 0x5559ac5973f0 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.818+0000 7f10daffd640 1 -- 172.21.15.133:0/775410726 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e005c810 con 0x5559ac5973f0 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.818+0000 7f11f933e800 1 -- 172.21.15.133:0/775410726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559ac598af0 con 0x5559ac5973f0 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.818+0000 7f10daffd640 1 -- 172.21.15.133:0/775410726 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f11e005c970 con 0x5559ac5973f0 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.818+0000 7f10daffd640 1 --2- 172.21.15.133:0/775410726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10d00367e0 0x7f10d0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.818+0000 7f10daffd640 1 -- 172.21.15.133:0/775410726 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f11e008e5b0 con 0x5559ac5973f0 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.819+0000 7f11f5845640 1 --2- 172.21.15.133:0/775410726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10d00367e0 0x7f10d0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.819+0000 7f11f933e800 1 Processor -- start 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.819+0000 7f11f933e800 1 -- start start 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.819+0000 7f11f5845640 1 --2- 172.21.15.133:0/775410726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10d00367e0 0x7f10d0038ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5559ac5875b0 tx=0x7f11f0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.819+0000 7f11f933e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5a4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.819+0000 7f11f933e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ac2f95d0 con 0x5559ac5a4510 2024-02-15T22:56:47.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.819+0000 7f11ec843640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.819+0000 7f11ec843640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5a4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54288/0 (socket says 172.21.15.133:54288) 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.819+0000 7f11ec843640 1 -- 172.21.15.133:0/3644514493 learned_addr learned my addr 172.21.15.133:0/3644514493 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.819+0000 7f11ec843640 1 -- 172.21.15.133:0/3644514493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ac5a4f00 con 0x5559ac5a4510 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.820+0000 7f11ec843640 1 --2- 172.21.15.133:0/3644514493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5a4930 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f11e008ca80 tx=0x7f11e005bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d531a094083f8c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.820+0000 7f10d8ff9640 1 -- 172.21.15.133:0/3644514493 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e006f490 con 0x5559ac5a4510 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.820+0000 7f10d8ff9640 1 -- 172.21.15.133:0/3644514493 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e005b370 con 0x5559ac5a4510 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.820+0000 7f10d8ff9640 1 -- 172.21.15.133:0/3644514493 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e008e070 con 0x5559ac5a4510 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.820+0000 7f11f933e800 1 -- 172.21.15.133:0/3644514493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 msgr2=0x5559ac5a4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.820+0000 7f11f933e800 1 --2- 172.21.15.133:0/3644514493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5a4930 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f11e008ca80 tx=0x7f11e005bd50 comp rx=0 tx=0).stop 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.820+0000 7f11f933e800 1 -- 172.21.15.133:0/3644514493 shutdown_connections 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.820+0000 7f11f933e800 1 --2- 172.21.15.133:0/3644514493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5a4930 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.820+0000 7f11f933e800 1 -- 172.21.15.133:0/3644514493 >> 172.21.15.133:0/3644514493 conn(0x5559ac5a0870 msgr2=0x5559ac59e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.820+0000 7f11f933e800 1 -- 172.21.15.133:0/3644514493 shutdown_connections 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.820+0000 7f11f933e800 1 -- 172.21.15.133:0/3644514493 wait complete. 2024-02-15T22:56:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.821+0000 7f11f933e800 1 Processor -- start 2024-02-15T22:56:47.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.821+0000 7f11f933e800 1 -- start start 2024-02-15T22:56:47.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.821+0000 7f11f933e800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.821+0000 7f11f933e800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ac5aba00 con 0x5559ac5a4510 2024-02-15T22:56:47.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.821+0000 7f11ec843640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.821+0000 7f11ec843640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5ab4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:54302/0 (socket says 172.21.15.133:54302) 2024-02-15T22:56:47.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.821+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 learned_addr learned my addr 172.21.15.133:0/609419205 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:56:47.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.821+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ac598af0 con 0x5559ac5a4510 2024-02-15T22:56:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.822+0000 7f11ec843640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5ab4c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f11e0067700 tx=0x7f11e008c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.822+0000 7f10c6ffd640 1 -- 172.21.15.133:0/609419205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e0070a70 con 0x5559ac5a4510 2024-02-15T22:56:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.822+0000 7f10c6ffd640 1 -- 172.21.15.133:0/609419205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0070bd0 con 0x5559ac5a4510 2024-02-15T22:56:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.822+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5559ac5abc00 con 0x5559ac5a4510 2024-02-15T22:56:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.822+0000 7f10c6ffd640 1 -- 172.21.15.133:0/609419205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e0070e70 con 0x5559ac5a4510 2024-02-15T22:56:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.822+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559ac5ac060 con 0x5559ac5a4510 2024-02-15T22:56:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.822+0000 7f10c6ffd640 1 -- 172.21.15.133:0/609419205 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f11e008b1b0 con 0x5559ac5a4510 2024-02-15T22:56:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.823+0000 7f10c6ffd640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10c0036790 0x7f10c0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.823+0000 7f10c6ffd640 1 -- 172.21.15.133:0/609419205 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f11e0099bf0 con 0x5559ac5a4510 2024-02-15T22:56:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.823+0000 7f11f5845640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10c0036790 0x7f10c0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.823+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.823+0000 7f11f933e800 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5559ac5b7090 0x5559ac5b9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.823+0000 7f11f5845640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10c0036790 0x7f10c0038c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f11f000b010 tx=0x7f11f0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.823+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5b9ca0 con 0x5559ac5b7090 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.823+0000 7f11f5044640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5559ac5b7090 0x5559ac5b9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.823+0000 7f11f5044640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5559ac5b7090 0x5559ac5b9550 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11e8014070 con 0x5559ac5b7090 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 20 realm 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5ba070 con 0x5559ac5b7090 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11e8014070 con 0x5559ac5b7090 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5ba8f0 con 0x5559ac5b7090 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11e8014070 con 0x5559ac5b7090 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bac50 con 0x5559ac5b7090 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f11e8014070 con 0x5559ac5b7090 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.824+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bb450 con 0x5559ac5b7090 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.825+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f11e8014070 con 0x5559ac5b7090 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.825+0000 7f11f933e800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.825+0000 7f11f933e800 20 searching for the correct realm 2024-02-15T22:56:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.825+0000 7f11f933e800 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5559ac5bd370 0x5559ac5bf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.825+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5bd370 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.825+0000 7f11ec843640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5559ac5bd370 0x5559ac5bf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.825+0000 7f11ec843640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5559ac5bd370 0x5559ac5bf7f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.825+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.825+0000 7f11ec843640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f11e0098060 0x7f11e007f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.825+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11e0098060 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.825+0000 7f11f5845640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f11e0098060 0x7f11e007f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.826+0000 7f11f5845640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f11e0098060 0x7f11e007f400 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.826+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11f000a4a0 con 0x7f11e0098060 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.826+0000 7f11f5845640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f11f00141d0 0x7f11f0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.826+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11f00141d0 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.826+0000 7f11f5044640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f11f00141d0 0x7f11f0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.827+0000 7f11f5044640 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f11f00141d0 0x7f11f0015940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.827+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e8014070 con 0x7f11f00141d0 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.827+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5b7090 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.827+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e8035040 con 0x5559ac5b7090 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.827+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5b7090 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.827+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e8035040 con 0x5559ac5b7090 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.827+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11f00141d0 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.828+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e8035040 con 0x7f11f00141d0 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.828+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11f00141d0 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.828+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e8035040 con 0x7f11f00141d0 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.828+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11e0098060 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.828+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11f000a4a0 con 0x7f11e0098060 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.828+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5bd370 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.828+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.828+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5b7090 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.828+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e8035040 con 0x5559ac5b7090 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.828+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11f00141d0 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.829+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e8035040 con 0x7f11f00141d0 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.829+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5b7090 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.829+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e8035040 con 0x5559ac5b7090 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.829+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11e0098060 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.829+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.829+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5bd370 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.829+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.829+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5bd370 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.830+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.830+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11f00141d0 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.830+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e8035040 con 0x7f11f00141d0 2024-02-15T22:56:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.830+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5bd370 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.830+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.830+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5bd370 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.830+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.830+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5b7090 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.831+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e8035040 con 0x5559ac5b7090 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.831+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5b7090 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.831+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f11e8035040 con 0x5559ac5b7090 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.831+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11f00141d0 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.831+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.831+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5bd370 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.831+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.831+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11e0098060 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.832+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.832+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5b7090 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.832+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.832+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11f00141d0 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.832+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.832+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5bd370 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.832+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.832+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11f00141d0 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.833+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.833+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11e0098060 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.833+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.833+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5bd370 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.833+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.833+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11f00141d0 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.833+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.833+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x5559ac5b7090 2024-02-15T22:56:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bfec0 con 0x7f11e0098060 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bc980 con 0x5559ac5b7090 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5bc1a0 con 0x5559ac5b7090 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.834+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c0300 con 0x5559ac5b7090 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 20 zone default found 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 4 Realm: () 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 20 zonegroup default 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c0660 con 0x7f11f00141d0 2024-02-15T22:56:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c23f0 con 0x5559ac5bd370 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.835+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c2750 con 0x5559ac5bd370 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.836+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.836+0000 7f11f933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.836+0000 7f11f933e800 20 started sync module instance, tier type = 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.836+0000 7f11f933e800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.836+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c1cd0 con 0x7f11e0098060 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.837+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.837+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93843632166960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c2080 con 0x7f11e0098060 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.837+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c3490 con 0x5559ac5b7090 2024-02-15T22:56:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.838+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93843632166960] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.838+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.838+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93843632172128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c3620 con 0x5559ac5b7090 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.838+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c40f0 con 0x5559ac5bd370 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.839+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93843632172128] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.839+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.839+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93843632176080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c44a0 con 0x5559ac5bd370 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.839+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c4e80 con 0x7f11e0098060 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.840+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93843632176080] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.840+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.840+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93843632173184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c5260 con 0x7f11e0098060 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.840+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c5ca0 con 0x5559ac5b7090 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.841+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.841+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93843632183216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c5ca0 con 0x5559ac5b7090 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.841+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c6c40 con 0x7f11f00141d0 2024-02-15T22:56:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.841+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93843632173184] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.842+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93843632183216] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.842+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.842+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93843632187200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c5e80 con 0x7f11f00141d0 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.842+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c7490 con 0x7f11f00141d0 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.843+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93843632187200] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.843+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.843+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93843632179616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c5e80 con 0x7f11f00141d0 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.843+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c7aa0 con 0x7f11f00141d0 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.844+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93843632179616] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.845+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.845+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93843632189248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c7aa0 con 0x7f11f00141d0 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.845+0000 7f11f933e800 20 add_watcher() i=0 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.845+0000 7f11f933e800 20 add_watcher() i=1 2024-02-15T22:56:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.845+0000 7f11f933e800 20 add_watcher() i=2 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.845+0000 7f11f933e800 20 add_watcher() i=3 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.845+0000 7f11f933e800 20 add_watcher() i=4 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.845+0000 7f11f933e800 20 add_watcher() i=5 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.845+0000 7f11f933e800 20 add_watcher() i=6 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.846+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93843632189248] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.846+0000 7f11f933e800 20 add_watcher() i=7 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.846+0000 7f11f933e800 2 all 8 watchers are set, enabling cache 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.846+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c7a70 con 0x5559ac5b7090 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.846+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.846+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93843632193168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c8750 con 0x5559ac5b7090 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.847+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93843632193168] v32'191 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.847+0000 7f10ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.847+0000 7f11f933e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.847+0000 7f11f933e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:56:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.847+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d38d0 con 0x5559ac5b7090 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.848+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.848+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d3ee0 con 0x7f11f00141d0 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.850+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'26 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.850+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d4320 con 0x5559ac5bd370 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.851+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.851+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d4cf0 con 0x5559ac5b7090 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.852+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'192 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.852+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5cf7d0 con 0x7f11e0098060 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.853+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'65 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.853+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5cf7d0 con 0x5559ac5bd370 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.854+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'43 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.854+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d5ed0 con 0x5559ac5b7090 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.855+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.855+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d5ed0 con 0x7f11f00141d0 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.856+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'43 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.856+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d5ed0 con 0x7f11e0098060 2024-02-15T22:56:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.857+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.857+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d6400 con 0x5559ac5bd370 2024-02-15T22:56:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.858+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.858+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d5e60 con 0x7f11e0098060 2024-02-15T22:56:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.859+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'66 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.859+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d6fa0 con 0x7f11f00141d0 2024-02-15T22:56:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.860+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.860+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d6fa0 con 0x7f11e0098060 2024-02-15T22:56:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.861+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.861+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7360 con 0x7f11f00141d0 2024-02-15T22:56:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.862+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'49 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.862+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7360 con 0x5559ac5b7090 2024-02-15T22:56:47.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.863+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'193 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.863+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7360 con 0x5559ac5bd370 2024-02-15T22:56:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.864+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'59 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.864+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x7f11e0098060 2024-02-15T22:56:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.865+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'67 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.865+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x5559ac5bd370 2024-02-15T22:56:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.866+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.866+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x5559ac5b7090 2024-02-15T22:56:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.867+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.867+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x5559ac5b7090 2024-02-15T22:56:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.868+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'194 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.868+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x5559ac5bd370 2024-02-15T22:56:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.869+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'60 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.869+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x7f11e0098060 2024-02-15T22:56:47.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.870+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'35 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.870+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x5559ac5bd370 2024-02-15T22:56:47.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.871+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.871+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x5559ac5bd370 2024-02-15T22:56:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.872+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.872+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x5559ac5bd370 2024-02-15T22:56:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.873+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'23 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.873+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x5559ac5bd370 2024-02-15T22:56:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.874+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'44 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.874+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x7f11f00141d0 2024-02-15T22:56:47.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.875+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.875+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x5559ac5bd370 2024-02-15T22:56:47.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.876+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.876+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x7f11f00141d0 2024-02-15T22:56:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.877+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'44 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.877+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x5559ac5bd370 2024-02-15T22:56:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.878+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'61 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.878+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x7f11f00141d0 2024-02-15T22:56:47.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.879+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'50 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.879+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d7800 con 0x7f11e0098060 2024-02-15T22:56:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.880+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'32 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.880+0000 7f10aa7e4640 20 reqs_thread_entry: start 2024-02-15T22:56:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.880+0000 7f11f933e800 20 init_complete bucket index max shards: 11 2024-02-15T22:56:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.880+0000 7f11f933e800 20 Filter name: none 2024-02-15T22:56:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.880+0000 7f101bfff640 20 reqs_thread_entry: start 2024-02-15T22:56:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.880+0000 7f11f933e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:56:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.880+0000 7f11f933e800 20 rados->read ofs=0 len=0 2024-02-15T22:56:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.880+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5d3070 con 0x5559ac5b7090 2024-02-15T22:56:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.881+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.881+0000 7f11f933e800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:56:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.881+0000 7f11f933e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:56:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.881+0000 7f11f933e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:56:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.881+0000 7f11f933e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:56:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.881+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac6037a0 con 0x7f11e0098060 2024-02-15T22:56:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.881+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-15T22:56:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.882+0000 7f10ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:56:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.882+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93843632193168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5ca7c0 con 0x5559ac5b7090 2024-02-15T22:56:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.883+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93843632193168] v32'195 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.883+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93843632166960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c7e90 con 0x7f11e0098060 2024-02-15T22:56:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.884+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93843632166960] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.884+0000 7f11f933e800 20 remove_watcher() i=0 2024-02-15T22:56:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.884+0000 7f11f933e800 2 removed watcher, disabling cache 2024-02-15T22:56:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.884+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93843632172128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c7e90 con 0x5559ac5b7090 2024-02-15T22:56:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.885+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93843632172128] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.885+0000 7f11f933e800 20 remove_watcher() i=1 2024-02-15T22:56:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.885+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93843632176080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c2c60 con 0x5559ac5bd370 2024-02-15T22:56:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.886+0000 7f11ec843640 1 -- 172.21.15.133:0/609419205 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93843632176080] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e0086070 con 0x5559ac5bd370 2024-02-15T22:56:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.886+0000 7f11f933e800 20 remove_watcher() i=2 2024-02-15T22:56:47.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.886+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93843632173184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c7e90 con 0x7f11e0098060 2024-02-15T22:56:47.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.887+0000 7f11f5845640 1 -- 172.21.15.133:0/609419205 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93843632173184] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11f003a040 con 0x7f11e0098060 2024-02-15T22:56:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.887+0000 7f11f933e800 20 remove_watcher() i=3 2024-02-15T22:56:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.887+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93843632183216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c3100 con 0x5559ac5b7090 2024-02-15T22:56:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.888+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93843632183216] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x5559ac5b7090 2024-02-15T22:56:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.888+0000 7f11f933e800 20 remove_watcher() i=4 2024-02-15T22:56:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.888+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93843632187200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c3100 con 0x7f11f00141d0 2024-02-15T22:56:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.889+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93843632187200] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.889+0000 7f11f933e800 20 remove_watcher() i=5 2024-02-15T22:56:47.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.889+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93843632179616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c3100 con 0x7f11f00141d0 2024-02-15T22:56:47.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.890+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93843632179616] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.890+0000 7f11f933e800 20 remove_watcher() i=6 2024-02-15T22:56:47.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.890+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93843632189248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5559ac5c3100 con 0x7f11f00141d0 2024-02-15T22:56:47.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93843632189248] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11e803f040 con 0x7f11f00141d0 2024-02-15T22:56:47.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 20 remove_watcher() i=7 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f11f00141d0 msgr2=0x7f11f0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f11f00141d0 0x7f11f0015940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5559ac5b7090 msgr2=0x5559ac5b9550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5559ac5b7090 0x5559ac5b9550 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f11e0098060 msgr2=0x7f11e007f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f11e0098060 0x7f11e007f400 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5559ac5bd370 msgr2=0x5559ac5bf7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5559ac5bd370 0x5559ac5bf7f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10c0036790 msgr2=0x7f10c0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10c0036790 0x7f10c0038c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f11f000b010 tx=0x7f11f0020000 comp rx=0 tx=0).stop 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 msgr2=0x5559ac5ab4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f5044640 1 -- 172.21.15.133:0/609419205 reap_dead start 2024-02-15T22:56:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5ab4c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f11e0067700 tx=0x7f11e008c9e0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 shutdown_connections 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 --2- 172.21.15.133:0/609419205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5a4510 0x5559ac5ab4c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 >> 172.21.15.133:0/609419205 conn(0x5559ac5a0870 msgr2=0x5559ac59ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 shutdown_connections 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.891+0000 7f11f933e800 1 -- 172.21.15.133:0/609419205 wait complete. 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/775410726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10d00367e0 msgr2=0x7f10d0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 --2- 172.21.15.133:0/775410726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10d00367e0 0x7f10d0038ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5559ac5875b0 tx=0x7f11f0005840 comp rx=0 tx=0).stop 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/775410726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5973f0 msgr2=0x5559ac597810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 --2- 172.21.15.133:0/775410726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5973f0 0x5559ac597810 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f11e001d490 tx=0x7f11e0002fb0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/775410726 shutdown_connections 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 --2- 172.21.15.133:0/775410726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10d00367e0 0x7f10d0038ca0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 --2- 172.21.15.133:0/775410726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac5973f0 0x5559ac597810 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/775410726 >> 172.21.15.133:0/775410726 conn(0x5559ac58b490 msgr2=0x5559ac58b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/775410726 shutdown_connections 2024-02-15T22:56:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/775410726 wait complete. 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5559ac4863d0 msgr2=0x5559ac586670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5559ac4863d0 0x5559ac586670 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10dc036790 msgr2=0x7f10dc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10dc036790 0x7f10dc038c50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f11e0054000 tx=0x7f11e004e000 comp rx=0 tx=0).stop 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 msgr2=0x5559ac57f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac57f970 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f11e8000c00 tx=0x7f11e8000ed0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 shutdown_connections 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5559ac4863d0 0x5559ac586670 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f10dc036790 0x7f10dc038c50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 --2- 172.21.15.133:0/3249530810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559ac484890 0x5559ac57f970 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 >> 172.21.15.133:0/3249530810 conn(0x5559ac4804d0 msgr2=0x5559ac5724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 shutdown_connections 2024-02-15T22:56:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:56:47.892+0000 7f11f933e800 1 -- 172.21.15.133:0/3249530810 wait complete. 2024-02-15T22:56:47.902 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-15T22:56:47.917 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:56:47.960 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-15T22:57:22.961 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-02-15T22:57:22.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-02-15T22:57:22.962 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-02-15T22:57:23.012 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:23.012 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:23.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.010+0000 7f502212a800 1 Processor -- start 2024-02-15T22:57:23.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.010+0000 7f502212a800 1 -- start start 2024-02-15T22:57:23.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.011+0000 7f502212a800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a9f9e37e70 0x55a9f9e38290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.011+0000 7f502212a800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a9f9d83bb0 con 0x55a9f9e390d0 2024-02-15T22:57:23.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.011+0000 7f502212a800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a9f9d3b450 con 0x55a9f9e37e70 2024-02-15T22:57:23.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.011+0000 7f501deef640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a9f9e37e70 0x55a9f9e38290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.011+0000 7f501d6ee640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55a9f9e390d0 0x55a9f9e39550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:55884/0 (socket says 172.21.15.133:55884) 2024-02-15T22:57:23.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.011+0000 7f501deef640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a9f9e37e70 0x55a9f9e38290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36106/0 (socket says 172.21.15.133:36106) 2024-02-15T22:57:23.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.011+0000 7f501d6ee640 1 -- 172.21.15.133:0/1419694896 learned_addr learned my addr 172.21.15.133:0/1419694896 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:23.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.011+0000 7f501deef640 1 -- 172.21.15.133:0/1419694896 >> v1:172.21.15.52:6789/0 conn(0x55a9f9e390d0 legacy=0x55a9f9e39550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.011+0000 7f501deef640 1 -- 172.21.15.133:0/1419694896 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9f9e38960 con 0x55a9f9e37e70 2024-02-15T22:57:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.013+0000 7f501deef640 1 --2- 172.21.15.133:0/1419694896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9e38290 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f501000a470 tx=0x7f501001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e916081c26886d51 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.014+0000 7f501ceed640 1 -- 172.21.15.133:0/1419694896 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5010052570 con 0x55a9f9e37e70 2024-02-15T22:57:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.014+0000 7f501ceed640 1 -- 172.21.15.133:0/1419694896 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50100526d0 con 0x55a9f9e37e70 2024-02-15T22:57:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.014+0000 7f501ceed640 1 -- 172.21.15.133:0/1419694896 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5010052990 con 0x55a9f9e37e70 2024-02-15T22:57:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.014+0000 7f502212a800 1 -- 172.21.15.133:0/1419694896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 msgr2=0x55a9f9e38290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.014+0000 7f502212a800 1 --2- 172.21.15.133:0/1419694896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9e38290 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f501000a470 tx=0x7f501001cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.014+0000 7f502212a800 1 -- 172.21.15.133:0/1419694896 shutdown_connections 2024-02-15T22:57:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.014+0000 7f502212a800 1 --2- 172.21.15.133:0/1419694896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9e38290 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.014+0000 7f502212a800 1 -- 172.21.15.133:0/1419694896 >> 172.21.15.133:0/1419694896 conn(0x55a9f9e334d0 msgr2=0x55a9f9e358f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.014+0000 7f502212a800 1 -- 172.21.15.133:0/1419694896 shutdown_connections 2024-02-15T22:57:23.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.014+0000 7f502212a800 1 -- 172.21.15.133:0/1419694896 wait complete. 2024-02-15T22:57:23.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.028+0000 7f502212a800 1 Processor -- start 2024-02-15T22:57:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.028+0000 7f502212a800 1 -- start start 2024-02-15T22:57:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.028+0000 7f502212a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9dabf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.028+0000 7f502212a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f9d38980 con 0x55a9f9e37e70 2024-02-15T22:57:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.028+0000 7f501deef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9dabf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.028+0000 7f501deef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9dabf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36120/0 (socket says 172.21.15.133:36120) 2024-02-15T22:57:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.028+0000 7f501deef640 1 -- 172.21.15.133:0/2767594706 learned_addr learned my addr 172.21.15.133:0/2767594706 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.029+0000 7f501deef640 1 -- 172.21.15.133:0/2767594706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5010005d20 con 0x55a9f9e37e70 2024-02-15T22:57:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.029+0000 7f501deef640 1 --2- 172.21.15.133:0/2767594706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9dabf30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5010055040 tx=0x7f501004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f52e5e979b77bf server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.029+0000 7f4f0be07640 1 -- 172.21.15.133:0/2767594706 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f501000a180 con 0x55a9f9e37e70 2024-02-15T22:57:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.029+0000 7f4f0be07640 1 -- 172.21.15.133:0/2767594706 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501000a2e0 con 0x55a9f9e37e70 2024-02-15T22:57:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.029+0000 7f4f0be07640 1 -- 172.21.15.133:0/2767594706 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50100529b0 con 0x55a9f9e37e70 2024-02-15T22:57:23.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.030+0000 7f502212a800 1 -- 172.21.15.133:0/2767594706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 msgr2=0x55a9f9dabf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.030+0000 7f502212a800 1 --2- 172.21.15.133:0/2767594706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9dabf30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5010055040 tx=0x7f501004c000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.030+0000 7f502212a800 1 -- 172.21.15.133:0/2767594706 shutdown_connections 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.030+0000 7f502212a800 1 --2- 172.21.15.133:0/2767594706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9dabf30 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.030+0000 7f502212a800 1 -- 172.21.15.133:0/2767594706 >> 172.21.15.133:0/2767594706 conn(0x55a9f9e334d0 msgr2=0x55a9f9f23c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.030+0000 7f502212a800 1 -- 172.21.15.133:0/2767594706 shutdown_connections 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.030+0000 7f502212a800 1 -- 172.21.15.133:0/2767594706 wait complete. 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.030+0000 7f502212a800 1 Processor -- start 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.030+0000 7f502212a800 1 -- start start 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.031+0000 7f502212a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9f30a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.031+0000 7f502212a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f9d34160 con 0x55a9f9e37e70 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.031+0000 7f501deef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9f30a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.031+0000 7f501deef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9f30a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36122/0 (socket says 172.21.15.133:36122) 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.031+0000 7f501deef640 1 -- 172.21.15.133:0/45500069 learned_addr learned my addr 172.21.15.133:0/45500069 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.031+0000 7f501deef640 1 -- 172.21.15.133:0/45500069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501004e070 con 0x55a9f9e37e70 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.031+0000 7f501deef640 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9f30a30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f501000a470 tx=0x7f5010002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.031+0000 7f4f0a604640 1 -- 172.21.15.133:0/45500069 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f501006a070 con 0x55a9f9e37e70 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.031+0000 7f4f0a604640 1 -- 172.21.15.133:0/45500069 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5010052cc0 con 0x55a9f9e37e70 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.031+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a9f9f30f70 con 0x55a9f9e37e70 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.031+0000 7f4f0a604640 1 -- 172.21.15.133:0/45500069 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f501005d420 con 0x55a9f9e37e70 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.032+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9f9f31450 con 0x55a9f9e37e70 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.032+0000 7f4f0a604640 1 -- 172.21.15.133:0/45500069 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f501005d580 con 0x55a9f9e37e70 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.032+0000 7f4f0a604640 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4f040367e0 0x7f4f04038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.033+0000 7f4f0a604640 1 -- 172.21.15.133:0/45500069 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f501008d6e0 con 0x55a9f9e37e70 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.033+0000 7f501d6ee640 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4f040367e0 0x7f4f04038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.033+0000 7f502212a800 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a9f9e390d0 0x55a9f9f376f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.033+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f37c30 con 0x55a9f9e390d0 2024-02-15T22:57:23.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.033+0000 7f501e6f0640 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a9f9e390d0 0x55a9f9f376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.033+0000 7f501d6ee640 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4f040367e0 0x7f4f04038ca0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5014000f60 tx=0x7f50140012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.033+0000 7f501e6f0640 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a9f9e390d0 0x55a9f9f376f0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.033+0000 7f501e6f0640 1 -- 172.21.15.133:0/45500069 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f501800a4a0 con 0x55a9f9e390d0 2024-02-15T22:57:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.033+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f38020 con 0x55a9f9e390d0 2024-02-15T22:57:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.034+0000 7f501e6f0640 1 -- 172.21.15.133:0/45500069 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f501800a4a0 con 0x55a9f9e390d0 2024-02-15T22:57:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.034+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f398d0 con 0x55a9f9e390d0 2024-02-15T22:57:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.034+0000 7f501e6f0640 1 -- 172.21.15.133:0/45500069 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f501800a4a0 con 0x55a9f9e390d0 2024-02-15T22:57:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.034+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f38ad0 con 0x55a9f9e390d0 2024-02-15T22:57:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.034+0000 7f501e6f0640 1 -- 172.21.15.133:0/45500069 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f501800a4a0 con 0x55a9f9e390d0 2024-02-15T22:57:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.034+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f38ee0 con 0x55a9f9e390d0 2024-02-15T22:57:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.035+0000 7f501e6f0640 1 -- 172.21.15.133:0/45500069 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f501800a4a0 con 0x55a9f9e390d0 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.035+0000 7f502212a800 1 Processor -- start 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.035+0000 7f502212a800 1 -- start start 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.035+0000 7f502212a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f482a0 0x55a9f9f486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.035+0000 7f502212a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f9cd6e80 con 0x55a9f9f482a0 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.036+0000 7f501d6ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f482a0 0x55a9f9f486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.036+0000 7f501d6ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f482a0 0x55a9f9f486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36132/0 (socket says 172.21.15.133:36132) 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.036+0000 7f501d6ee640 1 -- 172.21.15.133:0/1017417751 learned_addr learned my addr 172.21.15.133:0/1017417751 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.036+0000 7f501d6ee640 1 -- 172.21.15.133:0/1017417751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9f9f48c00 con 0x55a9f9f482a0 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.036+0000 7f501d6ee640 1 --2- 172.21.15.133:0/1017417751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f482a0 0x55a9f9f486c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5014001ed0 tx=0x7f501400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.036+0000 7f4f037fe640 1 -- 172.21.15.133:0/1017417751 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5014020070 con 0x55a9f9f482a0 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.037+0000 7f4f037fe640 1 -- 172.21.15.133:0/1017417751 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501401b550 con 0x55a9f9f482a0 2024-02-15T22:57:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.037+0000 7f502212a800 1 -- 172.21.15.133:0/1017417751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a9f9f49670 con 0x55a9f9f482a0 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.037+0000 7f4f037fe640 1 -- 172.21.15.133:0/1017417751 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5014013040 con 0x55a9f9f482a0 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.037+0000 7f502212a800 1 -- 172.21.15.133:0/1017417751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9f9f49b30 con 0x55a9f9f482a0 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.038+0000 7f4f037fe640 1 -- 172.21.15.133:0/1017417751 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f501401b7f0 con 0x55a9f9f482a0 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.038+0000 7f4f037fe640 1 --2- 172.21.15.133:0/1017417751 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ef80367e0 0x7f4ef8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.038+0000 7f4f037fe640 1 -- 172.21.15.133:0/1017417751 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f501404e2b0 con 0x55a9f9f482a0 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.038+0000 7f501e6f0640 1 --2- 172.21.15.133:0/1017417751 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ef80367e0 0x7f4ef8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.038+0000 7f502212a800 1 Processor -- start 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.038+0000 7f502212a800 1 -- start start 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.038+0000 7f501e6f0640 1 --2- 172.21.15.133:0/1017417751 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ef80367e0 0x7f4ef8038ca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55a9f9f38510 tx=0x7f5018005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.038+0000 7f502212a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f29b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.038+0000 7f502212a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f9cac5d0 con 0x55a9f9f29700 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.039+0000 7f501d6ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f29b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.039+0000 7f501d6ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f29b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36148/0 (socket says 172.21.15.133:36148) 2024-02-15T22:57:23.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.039+0000 7f501d6ee640 1 -- 172.21.15.133:0/2662112097 learned_addr learned my addr 172.21.15.133:0/2662112097 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.039+0000 7f501d6ee640 1 -- 172.21.15.133:0/2662112097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9f9f27f00 con 0x55a9f9f29700 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.039+0000 7f501d6ee640 1 --2- 172.21.15.133:0/2662112097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f29b20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f501404c750 tx=0x7f501404e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6a80108a527b3d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.039+0000 7f4f017fa640 1 -- 172.21.15.133:0/2662112097 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5014025410 con 0x55a9f9f29700 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.039+0000 7f4f017fa640 1 -- 172.21.15.133:0/2662112097 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5014040e90 con 0x55a9f9f29700 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.039+0000 7f4f017fa640 1 -- 172.21.15.133:0/2662112097 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5014025590 con 0x55a9f9f29700 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.040+0000 7f502212a800 1 -- 172.21.15.133:0/2662112097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 msgr2=0x55a9f9f29b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.040+0000 7f502212a800 1 --2- 172.21.15.133:0/2662112097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f29b20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f501404c750 tx=0x7f501404e050 comp rx=0 tx=0).stop 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.040+0000 7f502212a800 1 -- 172.21.15.133:0/2662112097 shutdown_connections 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.040+0000 7f502212a800 1 --2- 172.21.15.133:0/2662112097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f29b20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.040+0000 7f502212a800 1 -- 172.21.15.133:0/2662112097 >> 172.21.15.133:0/2662112097 conn(0x55a9f9f51900 msgr2=0x55a9f9f4f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.040+0000 7f502212a800 1 -- 172.21.15.133:0/2662112097 shutdown_connections 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.040+0000 7f502212a800 1 -- 172.21.15.133:0/2662112097 wait complete. 2024-02-15T22:57:23.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.040+0000 7f502212a800 1 Processor -- start 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.040+0000 7f502212a800 1 -- start start 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.040+0000 7f502212a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f5e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.040+0000 7f502212a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f9f5ed10 con 0x55a9f9f29700 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.041+0000 7f501d6ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f5e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.041+0000 7f501d6ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f5e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36150/0 (socket says 172.21.15.133:36150) 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.041+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 learned_addr learned my addr 172.21.15.133:0/1086980165 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.041+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9f9f49b30 con 0x55a9f9f29700 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.041+0000 7f501d6ee640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f5e7d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f501401afd0 tx=0x7f501404c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.041+0000 7f4eef7fe640 1 -- 172.21.15.133:0/1086980165 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5014025410 con 0x55a9f9f29700 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.041+0000 7f4eef7fe640 1 -- 172.21.15.133:0/1086980165 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5014025570 con 0x55a9f9f29700 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.041+0000 7f4eef7fe640 1 -- 172.21.15.133:0/1086980165 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f501401bc80 con 0x55a9f9f29700 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.041+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a9f9f5ef10 con 0x55a9f9f29700 2024-02-15T22:57:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.042+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9f9f5ef10 con 0x55a9f9f29700 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.042+0000 7f4eef7fe640 1 -- 172.21.15.133:0/1086980165 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f501400cc60 con 0x55a9f9f29700 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.043+0000 7f4eef7fe640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ee80367e0 0x7f4ee8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.043+0000 7f502212a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.043+0000 7f4eef7fe640 1 -- 172.21.15.133:0/1086980165 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f5014039c00 con 0x55a9f9f29700 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.043+0000 7f501e6f0640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ee80367e0 0x7f4ee8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.043+0000 7f502212a800 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a9f9f6a210 0x55a9f9f6c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.043+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f6cdd0 con 0x55a9f9f6a210 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.043+0000 7f501deef640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a9f9f6a210 0x55a9f9f6c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.043+0000 7f501e6f0640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ee80367e0 0x7f4ee8038ca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f501800b010 tx=0x7f5018020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.043+0000 7f501deef640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a9f9f6a210 0x55a9f9f6c680 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5010059040 con 0x55a9f9f6a210 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 20 realm 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f6d1a0 con 0x55a9f9f6a210 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5010059040 con 0x55a9f9f6a210 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f6da20 con 0x55a9f9f6a210 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5010059040 con 0x55a9f9f6a210 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f6dd80 con 0x55a9f9f6a210 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5010059040 con 0x55a9f9f6a210 2024-02-15T22:57:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.044+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f6d680 con 0x55a9f9f6a210 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.045+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f501007e380 con 0x55a9f9f6a210 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.045+0000 7f502212a800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.045+0000 7f502212a800 20 searching for the correct realm 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.045+0000 7f502212a800 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a9f9f70100 0x55a9f9f724f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.045+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f70100 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.045+0000 7f501d6ee640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a9f9f70100 0x55a9f9f724f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.045+0000 7f501d6ee640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a9f9f70100 0x55a9f9f724f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.045+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.045+0000 7f501d6ee640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5014038070 0x7f5014024370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.045+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f5014038070 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.046+0000 7f501e6f0640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5014038070 0x7f5014024370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.046+0000 7f501e6f0640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5014038070 0x7f5014024370 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.046+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501800a4a0 con 0x7f5014038070 2024-02-15T22:57:23.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.046+0000 7f501e6f0640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f50180141d0 0x7f5018015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.046+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f50180141d0 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.046+0000 7f501deef640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f50180141d0 0x7f5018015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.047+0000 7f501deef640 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f50180141d0 0x7f5018015940 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.047+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x7f50180141d0 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.047+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f6a210 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.048+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x55a9f9f6a210 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.048+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f6a210 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.048+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x55a9f9f6a210 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.048+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f50180141d0 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.048+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x7f50180141d0 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.048+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f50180141d0 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.048+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x7f50180141d0 2024-02-15T22:57:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.048+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f5014038070 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.049+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501800a4a0 con 0x7f5014038070 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.049+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f70100 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.049+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.049+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f6a210 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.049+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x55a9f9f6a210 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.049+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f50180141d0 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.049+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x7f50180141d0 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.050+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f6a210 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.050+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x55a9f9f6a210 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.050+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f5014038070 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.050+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.050+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f70100 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.050+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.050+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f70100 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.050+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.051+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f50180141d0 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.051+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x7f50180141d0 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.051+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f70100 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.051+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.051+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f70100 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.051+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.051+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f6a210 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.052+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x55a9f9f6a210 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.052+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f6a210 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.052+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f501007e380 con 0x55a9f9f6a210 2024-02-15T22:57:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.052+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f50180141d0 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.052+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x7f50180141d0 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.052+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f70100 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.052+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.053+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f5014038070 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.053+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.053+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f6a210 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.053+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f501007e380 con 0x55a9f9f6a210 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.053+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f50180141d0 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.054+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501007e380 con 0x7f50180141d0 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.054+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f70100 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.054+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.054+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f50180141d0 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.054+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.054+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f5014038070 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.054+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.054+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f70100 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.055+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.055+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f50180141d0 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.055+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.055+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x55a9f9f6a210 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.055+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.055+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f72ba0 con 0x7f5014038070 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f6eba0 con 0x55a9f9f6a210 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f6e820 con 0x55a9f9f6a210 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f6f530 con 0x55a9f9f6a210 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 zone default found 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 4 Realm: () 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 zonegroup default 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.056+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f73010 con 0x7f50180141d0 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f502212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f502212a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f74e90 con 0x55a9f9f70100 2024-02-15T22:57:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f502212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f502212a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f751f0 con 0x55a9f9f70100 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f502212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f502212a800 20 started sync module instance, tier type = 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f502212a800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.057+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f74460 con 0x7f5014038070 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.059+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.059+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94188531566880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f75550 con 0x7f5014038070 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.059+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f75d50 con 0x55a9f9f6a210 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.060+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94188531566880] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.060+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.060+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94188531570000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f75e10 con 0x55a9f9f6a210 2024-02-15T22:57:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.060+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f76780 con 0x55a9f9f70100 2024-02-15T22:57:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.061+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94188531570000] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.061+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.061+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94188531571056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f75d90 con 0x55a9f9f70100 2024-02-15T22:57:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.062+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f775e0 con 0x7f5014038070 2024-02-15T22:57:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.063+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.063+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94188531571056] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.063+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94188531577632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f77d60 con 0x7f5014038070 2024-02-15T22:57:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.063+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f78310 con 0x55a9f9f6a210 2024-02-15T22:57:23.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.064+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94188531577632] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.064+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.064+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94188531575600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f78310 con 0x55a9f9f6a210 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.064+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f78d10 con 0x7f50180141d0 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.065+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.065+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94188531583024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f78c90 con 0x7f50180141d0 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.065+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f79c40 con 0x7f50180141d0 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.065+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94188531575600] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.066+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.066+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94188531583024] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.067+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94188531586816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f777c0 con 0x7f50180141d0 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.067+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f7a210 con 0x7f50180141d0 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.068+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.068+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94188531586816] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.068+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94188531588464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f7a630 con 0x7f50180141d0 2024-02-15T22:57:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.068+0000 7f502212a800 20 add_watcher() i=0 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.068+0000 7f502212a800 20 add_watcher() i=1 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.068+0000 7f502212a800 20 add_watcher() i=2 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.068+0000 7f502212a800 20 add_watcher() i=3 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.068+0000 7f502212a800 20 add_watcher() i=4 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.068+0000 7f502212a800 20 add_watcher() i=5 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.068+0000 7f502212a800 20 add_watcher() i=6 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.069+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94188531588464] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.069+0000 7f502212a800 20 add_watcher() i=7 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.069+0000 7f502212a800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.069+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f7d660 con 0x55a9f9f6a210 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.069+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.069+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94188531589520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f7aac0 con 0x55a9f9f6a210 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.070+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94188531589520] v32'196 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.070+0000 7f4ecf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.070+0000 7f502212a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.070+0000 7f502212a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.070+0000 7f502212a800 5 note: GC not initialized 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.071+0000 7f4ece7fc640 20 reqs_thread_entry: start 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.071+0000 7f502212a800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.071+0000 7f502212a800 20 Filter name: none 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.071+0000 7f4e3ffff640 20 reqs_thread_entry: start 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.071+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fafa70 con 0x55a9f9f6a210 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.071+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.071+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fafa70 con 0x7f5014038070 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.071+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.071+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fafa70 con 0x55a9f9f6a210 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.072+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.072+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fafa70 con 0x55a9f9f70100 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.072+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.072+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fafef0 con 0x55a9f9f70100 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.072+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.072+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb02e0 con 0x55a9f9f70100 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.072+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.072+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb06b0 con 0x55a9f9f6a210 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.073+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.073+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb06b0 con 0x55a9f9f6a210 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.073+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.073+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb06b0 con 0x55a9f9f70100 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.073+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.073+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb06b0 con 0x55a9f9f70100 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.073+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.073+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb0660 con 0x7f50180141d0 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.074+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.074+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f60 con 0x55a9f9f6a210 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.074+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.074+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f60 con 0x7f5014038070 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.074+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.075+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f60 con 0x55a9f9f70100 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.075+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.075+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f60 con 0x7f50180141d0 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.075+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.075+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x7f50180141d0 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.075+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.075+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x55a9f9f70100 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.075+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.076+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x7f50180141d0 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.076+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.076+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x55a9f9f6a210 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.076+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.076+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x55a9f9f70100 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.076+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.076+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x7f50180141d0 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.077+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.077+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x7f5014038070 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.077+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.077+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x7f50180141d0 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.077+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.077+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x55a9f9f6a210 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.077+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.077+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x55a9f9f6a210 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.078+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.078+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x55a9f9f70100 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.078+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.078+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x55a9f9f6a210 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.078+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.078+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x55a9f9f6a210 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.078+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.078+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x55a9f9f70100 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.079+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.079+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x55a9f9f70100 2024-02-15T22:57:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.079+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.079+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x55a9f9f70100 2024-02-15T22:57:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.079+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.079+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb1f10 con 0x7f50180141d0 2024-02-15T22:57:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.079+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.080+0000 7f4ecf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.080+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94188531589520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f7ca40 con 0x55a9f9f6a210 2024-02-15T22:57:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.081+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94188531589520] v32'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.081+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94188531566880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9f7a190 con 0x7f5014038070 2024-02-15T22:57:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.082+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94188531566880] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.082+0000 7f502212a800 20 remove_watcher() i=0 2024-02-15T22:57:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.082+0000 7f502212a800 2 removed watcher, disabling cache 2024-02-15T22:57:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.082+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94188531570000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb0660 con 0x55a9f9f6a210 2024-02-15T22:57:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.084+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94188531570000] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.084+0000 7f502212a800 20 remove_watcher() i=1 2024-02-15T22:57:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.084+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94188531571056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb0660 con 0x55a9f9f70100 2024-02-15T22:57:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.085+0000 7f501d6ee640 1 -- 172.21.15.133:0/1086980165 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94188531571056] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5014022070 con 0x55a9f9f70100 2024-02-15T22:57:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.085+0000 7f502212a800 20 remove_watcher() i=2 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.085+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94188531577632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb0660 con 0x7f5014038070 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.086+0000 7f501e6f0640 1 -- 172.21.15.133:0/1086980165 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94188531577632] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501803a040 con 0x7f5014038070 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.086+0000 7f502212a800 20 remove_watcher() i=3 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.086+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94188531575600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb0660 con 0x55a9f9f6a210 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.087+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94188531575600] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x55a9f9f6a210 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.087+0000 7f502212a800 20 remove_watcher() i=4 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.087+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94188531583024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb0660 con 0x7f50180141d0 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.088+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94188531583024] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.088+0000 7f502212a800 20 remove_watcher() i=5 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.088+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94188531586816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb0660 con 0x7f50180141d0 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.089+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94188531586816] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.089+0000 7f502212a800 20 remove_watcher() i=6 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.089+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94188531588464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a9f9fb0660 con 0x7f50180141d0 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.090+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94188531588464] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f501009d040 con 0x7f50180141d0 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.090+0000 7f502212a800 20 remove_watcher() i=7 2024-02-15T22:57:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.090+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f50180141d0 msgr2=0x7f5018015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.090+0000 7f502212a800 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f50180141d0 0x7f5018015940 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.090+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a9f9f6a210 msgr2=0x55a9f9f6c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.090+0000 7f502212a800 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a9f9f6a210 0x55a9f9f6c680 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.090+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5014038070 msgr2=0x7f5014024370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.090+0000 7f502212a800 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5014038070 0x7f5014024370 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.090+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a9f9f70100 msgr2=0x55a9f9f724f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.090+0000 7f502212a800 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55a9f9f70100 0x55a9f9f724f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ee80367e0 msgr2=0x7f4ee8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ee80367e0 0x7f4ee8038ca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f501800b010 tx=0x7f5018020000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 msgr2=0x55a9f9f5e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f5e7d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f501401afd0 tx=0x7f501404c6e0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f501deef640 1 -- 172.21.15.133:0/1086980165 reap_dead start 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 shutdown_connections 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 --2- 172.21.15.133:0/1086980165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f29700 0x55a9f9f5e7d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 >> 172.21.15.133:0/1086980165 conn(0x55a9f9f51900 msgr2=0x55a9f9f4ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 shutdown_connections 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1086980165 wait complete. 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1017417751 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ef80367e0 msgr2=0x7f4ef8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 --2- 172.21.15.133:0/1017417751 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ef80367e0 0x7f4ef8038ca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55a9f9f38510 tx=0x7f5018005840 comp rx=0 tx=0).stop 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1017417751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f482a0 msgr2=0x55a9f9f486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 --2- 172.21.15.133:0/1017417751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f482a0 0x55a9f9f486c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5014001ed0 tx=0x7f501400d7a0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1017417751 shutdown_connections 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 --2- 172.21.15.133:0/1017417751 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4ef80367e0 0x7f4ef8038ca0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 --2- 172.21.15.133:0/1017417751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9f482a0 0x55a9f9f486c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1017417751 >> 172.21.15.133:0/1017417751 conn(0x55a9f9f3c340 msgr2=0x55a9f9f3c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1017417751 shutdown_connections 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.091+0000 7f502212a800 1 -- 172.21.15.133:0/1017417751 wait complete. 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a9f9e390d0 msgr2=0x55a9f9f376f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a9f9e390d0 0x55a9f9f376f0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4f040367e0 msgr2=0x7f4f04038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4f040367e0 0x7f4f04038ca0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5014000f60 tx=0x7f50140012b0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 msgr2=0x55a9f9f30a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9f30a30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f501000a470 tx=0x7f5010002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 shutdown_connections 2024-02-15T22:57:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55a9f9e390d0 0x55a9f9f376f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4f040367e0 0x7f4f04038ca0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 --2- 172.21.15.133:0/45500069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9f9e37e70 0x55a9f9f30a30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 >> 172.21.15.133:0/45500069 conn(0x55a9f9e334d0 msgr2=0x55a9f9f22490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 shutdown_connections 2024-02-15T22:57:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.092+0000 7f502212a800 1 -- 172.21.15.133:0/45500069 wait complete. 2024-02-15T22:57:23.102 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-02-15T22:57:23.102 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-02-15T22:57:23.103 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-15T22:57:23.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-15T22:57:23.103 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-15T22:57:23.144 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:23.144 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:23.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.142+0000 7fa55d93a800 1 Processor -- start 2024-02-15T22:57:23.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.142+0000 7fa55d93a800 1 -- start start 2024-02-15T22:57:23.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.142+0000 7fa55d93a800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560d2aa35500 0x560d2aa378f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.142+0000 7fa55d93a800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560d2a97bba0 con 0x560d2aa319f0 2024-02-15T22:57:23.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.142+0000 7fa55d93a800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x560d2a933450 con 0x560d2aa35500 2024-02-15T22:57:23.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.143+0000 7fa558e04640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560d2aa35500 0x560d2aa378f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.143+0000 7fa558e04640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560d2aa35500 0x560d2aa378f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36152/0 (socket says 172.21.15.133:36152) 2024-02-15T22:57:23.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.143+0000 7fa559605640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x560d2aa319f0 0x560d2aa33de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:55888/0 (socket says 172.21.15.133:55888) 2024-02-15T22:57:23.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.143+0000 7fa558e04640 1 -- 172.21.15.133:0/3759053583 learned_addr learned my addr 172.21.15.133:0/3759053583 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.143+0000 7fa558e04640 1 -- 172.21.15.133:0/3759053583 >> v1:172.21.15.52:6789/0 conn(0x560d2aa319f0 legacy=0x560d2aa33de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.143+0000 7fa558e04640 1 -- 172.21.15.133:0/3759053583 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d2aa38e40 con 0x560d2aa35500 2024-02-15T22:57:23.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.145+0000 7fa558e04640 1 --2- 172.21.15.133:0/3759053583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa35500 0x560d2aa378f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa55000a520 tx=0x7fa55001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b458bca78bd8dd server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.145+0000 7fa54bfff640 1 -- 172.21.15.133:0/3759053583 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa550052570 con 0x560d2aa35500 2024-02-15T22:57:23.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.145+0000 7fa54bfff640 1 -- 172.21.15.133:0/3759053583 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5500526d0 con 0x560d2aa35500 2024-02-15T22:57:23.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.145+0000 7fa54bfff640 1 -- 172.21.15.133:0/3759053583 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa550052990 con 0x560d2aa35500 2024-02-15T22:57:23.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.145+0000 7fa55d93a800 1 -- 172.21.15.133:0/3759053583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa35500 msgr2=0x560d2aa378f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.145+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3759053583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa35500 0x560d2aa378f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa55000a520 tx=0x7fa55001cee0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.145+0000 7fa55d93a800 1 -- 172.21.15.133:0/3759053583 shutdown_connections 2024-02-15T22:57:23.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.145+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3759053583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa35500 0x560d2aa378f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.145+0000 7fa55d93a800 1 -- 172.21.15.133:0/3759053583 >> 172.21.15.133:0/3759053583 conn(0x560d2aa2b4c0 msgr2=0x560d2aa2d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.145+0000 7fa55d93a800 1 -- 172.21.15.133:0/3759053583 shutdown_connections 2024-02-15T22:57:23.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.145+0000 7fa55d93a800 1 -- 172.21.15.133:0/3759053583 wait complete. 2024-02-15T22:57:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.157+0000 7fa55d93a800 1 Processor -- start 2024-02-15T22:57:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.157+0000 7fa55d93a800 1 -- start start 2024-02-15T22:57:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.157+0000 7fa55d93a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab20f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.157+0000 7fa55d93a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d2a930980 con 0x560d2aa319f0 2024-02-15T22:57:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.157+0000 7fa559605640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab20f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.157+0000 7fa559605640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab20f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36154/0 (socket says 172.21.15.133:36154) 2024-02-15T22:57:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.157+0000 7fa559605640 1 -- 172.21.15.133:0/2523413244 learned_addr learned my addr 172.21.15.133:0/2523413244 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.158+0000 7fa559605640 1 -- 172.21.15.133:0/2523413244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550005de0 con 0x560d2aa319f0 2024-02-15T22:57:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.158+0000 7fa559605640 1 --2- 172.21.15.133:0/2523413244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab20f70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa54c001c80 tx=0x7fa54c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23695fd1287e4d09 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.158+0000 7fa447606640 1 -- 172.21.15.133:0/2523413244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c014070 con 0x560d2aa319f0 2024-02-15T22:57:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.158+0000 7fa447606640 1 -- 172.21.15.133:0/2523413244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c00f450 con 0x560d2aa319f0 2024-02-15T22:57:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.158+0000 7fa447606640 1 -- 172.21.15.133:0/2523413244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c00f790 con 0x560d2aa319f0 2024-02-15T22:57:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.159+0000 7fa55d93a800 1 -- 172.21.15.133:0/2523413244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 msgr2=0x560d2ab20f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.159+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2523413244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab20f70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa54c001c80 tx=0x7fa54c00b600 comp rx=0 tx=0).stop 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.159+0000 7fa55d93a800 1 -- 172.21.15.133:0/2523413244 shutdown_connections 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.159+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2523413244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab20f70 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.159+0000 7fa55d93a800 1 -- 172.21.15.133:0/2523413244 >> 172.21.15.133:0/2523413244 conn(0x560d2aa2b4c0 msgr2=0x560d2ab1c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.159+0000 7fa55d93a800 1 -- 172.21.15.133:0/2523413244 shutdown_connections 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.159+0000 7fa55d93a800 1 -- 172.21.15.133:0/2523413244 wait complete. 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.159+0000 7fa55d93a800 1 Processor -- start 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.159+0000 7fa55d93a800 1 -- start start 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.159+0000 7fa55d93a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab28650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.159+0000 7fa55d93a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d2a92c160 con 0x560d2aa319f0 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.160+0000 7fa559605640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab28650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.160+0000 7fa559605640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab28650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36156/0 (socket says 172.21.15.133:36156) 2024-02-15T22:57:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.160+0000 7fa559605640 1 -- 172.21.15.133:0/3667431289 learned_addr learned my addr 172.21.15.133:0/3667431289 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.160+0000 7fa559605640 1 -- 172.21.15.133:0/3667431289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d2a97bba0 con 0x560d2aa319f0 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.160+0000 7fa559605640 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab28650 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa54c004000 tx=0x7fa54c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.160+0000 7fa445e03640 1 -- 172.21.15.133:0/3667431289 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c014070 con 0x560d2aa319f0 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.160+0000 7fa445e03640 1 -- 172.21.15.133:0/3667431289 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c020070 con 0x560d2aa319f0 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.160+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d2ab28b90 con 0x560d2aa319f0 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.160+0000 7fa445e03640 1 -- 172.21.15.133:0/3667431289 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c0198e0 con 0x560d2aa319f0 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.160+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d2ab29070 con 0x560d2aa319f0 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.161+0000 7fa445e03640 1 -- 172.21.15.133:0/3667431289 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa54c019a40 con 0x560d2aa319f0 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.161+0000 7fa445e03640 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa440036790 0x7fa440038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.161+0000 7fa445e03640 1 -- 172.21.15.133:0/3667431289 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fa54c008030 con 0x560d2aa319f0 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.162+0000 7fa558e04640 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa440036790 0x7fa440038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.162+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560d2aa35500 0x560d2ab2f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.162+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab2f960 con 0x560d2aa35500 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.162+0000 7fa559e06640 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560d2aa35500 0x560d2ab2f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.162+0000 7fa558e04640 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa440036790 0x7fa440038c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa550054000 tx=0x7fa55004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.162+0000 7fa559e06640 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560d2aa35500 0x560d2ab2f390 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.162+0000 7fa559e06640 1 -- 172.21.15.133:0/3667431289 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa55400a4a0 con 0x560d2aa35500 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.162+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab2c9f0 con 0x560d2aa35500 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.163+0000 7fa559e06640 1 -- 172.21.15.133:0/3667431289 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa55400a4a0 con 0x560d2aa35500 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.163+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab31690 con 0x560d2aa35500 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.163+0000 7fa559e06640 1 -- 172.21.15.133:0/3667431289 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa55400a4a0 con 0x560d2aa35500 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.163+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab30890 con 0x560d2aa35500 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.163+0000 7fa559e06640 1 -- 172.21.15.133:0/3667431289 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa55400a4a0 con 0x560d2aa35500 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.163+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab30ca0 con 0x560d2aa35500 2024-02-15T22:57:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.163+0000 7fa559e06640 1 -- 172.21.15.133:0/3667431289 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa55400a4a0 con 0x560d2aa35500 2024-02-15T22:57:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.164+0000 7fa55d93a800 1 Processor -- start 2024-02-15T22:57:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.164+0000 7fa55d93a800 1 -- start start 2024-02-15T22:57:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.164+0000 7fa55d93a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab40110 0x560d2ab40530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.164+0000 7fa55d93a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d2a8cee80 con 0x560d2ab40110 2024-02-15T22:57:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.164+0000 7fa558e04640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab40110 0x560d2ab40530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.164+0000 7fa558e04640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab40110 0x560d2ab40530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36168/0 (socket says 172.21.15.133:36168) 2024-02-15T22:57:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.164+0000 7fa558e04640 1 -- 172.21.15.133:0/3191536625 learned_addr learned my addr 172.21.15.133:0/3191536625 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.164+0000 7fa558e04640 1 -- 172.21.15.133:0/3191536625 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d2ab40a70 con 0x560d2ab40110 2024-02-15T22:57:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.165+0000 7fa558e04640 1 --2- 172.21.15.133:0/3191536625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab40110 0x560d2ab40530 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa550044940 tx=0x7fa550002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.165+0000 7fa43effd640 1 -- 172.21.15.133:0/3191536625 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa55005dc30 con 0x560d2ab40110 2024-02-15T22:57:23.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.165+0000 7fa43effd640 1 -- 172.21.15.133:0/3191536625 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa550064040 con 0x560d2ab40110 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.165+0000 7fa55d93a800 1 -- 172.21.15.133:0/3191536625 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d2ab40c60 con 0x560d2ab40110 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.165+0000 7fa43effd640 1 -- 172.21.15.133:0/3191536625 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5500683f0 con 0x560d2ab40110 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.165+0000 7fa55d93a800 1 -- 172.21.15.133:0/3191536625 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d2ab417b0 con 0x560d2ab40110 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.166+0000 7fa43effd640 1 -- 172.21.15.133:0/3191536625 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa550059040 con 0x560d2ab40110 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.166+0000 7fa43effd640 1 --2- 172.21.15.133:0/3191536625 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa430036790 0x7fa430038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.166+0000 7fa43effd640 1 -- 172.21.15.133:0/3191536625 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fa55008f480 con 0x560d2ab40110 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.166+0000 7fa559e06640 1 --2- 172.21.15.133:0/3191536625 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa430036790 0x7fa430038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.166+0000 7fa55d93a800 1 Processor -- start 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.166+0000 7fa559e06640 1 --2- 172.21.15.133:0/3191536625 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa430036790 0x7fa430038c50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x560d2ab302d0 tx=0x7fa554005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.166+0000 7fa55d93a800 1 -- start start 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.167+0000 7fa55d93a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab4d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.167+0000 7fa55d93a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d2a8a45d0 con 0x560d2ab4d300 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.167+0000 7fa558e04640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab4d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.167+0000 7fa558e04640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab4d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36180/0 (socket says 172.21.15.133:36180) 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.167+0000 7fa558e04640 1 -- 172.21.15.133:0/2784732263 learned_addr learned my addr 172.21.15.133:0/2784732263 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.167+0000 7fa558e04640 1 -- 172.21.15.133:0/2784732263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d2ab4dcf0 con 0x560d2ab4d300 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.167+0000 7fa558e04640 1 --2- 172.21.15.133:0/2784732263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab4d720 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa55008d890 tx=0x7fa5500068b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13087cf9586821cc server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.167+0000 7fa43cff9640 1 -- 172.21.15.133:0/2784732263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa550050340 con 0x560d2ab4d300 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.167+0000 7fa43cff9640 1 -- 172.21.15.133:0/2784732263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55008f070 con 0x560d2ab4d300 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.167+0000 7fa43cff9640 1 -- 172.21.15.133:0/2784732263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa55008c130 con 0x560d2ab4d300 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.168+0000 7fa55d93a800 1 -- 172.21.15.133:0/2784732263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 msgr2=0x560d2ab4d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.168+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2784732263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab4d720 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa55008d890 tx=0x7fa5500068b0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.168+0000 7fa55d93a800 1 -- 172.21.15.133:0/2784732263 shutdown_connections 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.168+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2784732263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab4d720 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.168+0000 7fa55d93a800 1 -- 172.21.15.133:0/2784732263 >> 172.21.15.133:0/2784732263 conn(0x560d2ab49660 msgr2=0x560d2ab476c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.168+0000 7fa55d93a800 1 -- 172.21.15.133:0/2784732263 shutdown_connections 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.168+0000 7fa55d93a800 1 -- 172.21.15.133:0/2784732263 wait complete. 2024-02-15T22:57:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.168+0000 7fa55d93a800 1 Processor -- start 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.168+0000 7fa55d93a800 1 -- start start 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.168+0000 7fa55d93a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.168+0000 7fa55d93a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d2ab54810 con 0x560d2ab4d300 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.169+0000 7fa558e04640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.169+0000 7fa558e04640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36186/0 (socket says 172.21.15.133:36186) 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.169+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 learned_addr learned my addr 172.21.15.133:0/2646358998 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.169+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d2ab417b0 con 0x560d2ab4d300 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.169+0000 7fa558e04640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab542d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa5500717b0 tx=0x7fa55008d7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.169+0000 7fa42effd640 1 -- 172.21.15.133:0/2646358998 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa55008c4b0 con 0x560d2ab4d300 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.169+0000 7fa42effd640 1 -- 172.21.15.133:0/2646358998 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa550067510 con 0x560d2ab4d300 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.169+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d2ab417b0 con 0x560d2ab4d300 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.169+0000 7fa42effd640 1 -- 172.21.15.133:0/2646358998 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5500677b0 con 0x560d2ab4d300 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.169+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d2ab417b0 con 0x560d2ab4d300 2024-02-15T22:57:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.170+0000 7fa42effd640 1 -- 172.21.15.133:0/2646358998 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa5500069c0 con 0x560d2ab4d300 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.170+0000 7fa55d93a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.170+0000 7fa42effd640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa424036740 0x7fa424038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.170+0000 7fa42effd640 1 -- 172.21.15.133:0/2646358998 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fa550099bb0 con 0x560d2ab4d300 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.170+0000 7fa559e06640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa424036740 0x7fa424038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.170+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560d2ab5fbb0 0x560d2ab62070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.170+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab627c0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa559605640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560d2ab5fbb0 0x560d2ab62070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa559e06640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa424036740 0x7fa424038c00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa55400b010 tx=0x7fa554020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa559605640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560d2ab5fbb0 0x560d2ab62070 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa54c016070 con 0x560d2ab5fbb0 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa55d93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa55d93a800 20 realm 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa55d93a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab62b90 con 0x560d2ab5fbb0 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa54c016070 con 0x560d2ab5fbb0 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa55d93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa55d93a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa55d93a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab633e0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa54c016070 con 0x560d2ab5fbb0 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa55d93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa55d93a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.171+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab63740 con 0x560d2ab5fbb0 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.172+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa54c043040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.172+0000 7fa55d93a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.172+0000 7fa55d93a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.172+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab63080 con 0x560d2ab5fbb0 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.172+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa54c043040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.172+0000 7fa55d93a800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.172+0000 7fa55d93a800 20 searching for the correct realm 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.172+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560d2ab65b00 0x560d2ab67ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.172+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab65b00 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.172+0000 7fa558e04640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560d2ab65b00 0x560d2ab67ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.172+0000 7fa558e04640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560d2ab65b00 0x560d2ab67ef0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.173+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.173+0000 7fa558e04640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa550098020 0x7fa55007c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.173+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa550098020 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.173+0000 7fa559e06640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa550098020 0x7fa55007c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.173+0000 7fa559e06640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa550098020 0x7fa55007c890 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.173+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55400a4a0 con 0x7fa550098020 2024-02-15T22:57:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.173+0000 7fa559e06640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa5540141d0 0x7fa554015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.173+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa5540141d0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.174+0000 7fa559605640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa5540141d0 0x7fa554015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.174+0000 7fa559605640 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa5540141d0 0x7fa554015940 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.174+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c043040 con 0x7fa5540141d0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.174+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab5fbb0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.174+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c043040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.174+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab5fbb0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.175+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c043040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.175+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa5540141d0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.175+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c043040 con 0x7fa5540141d0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.175+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa5540141d0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.175+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c043040 con 0x7fa5540141d0 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.175+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa550098020 2024-02-15T22:57:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.175+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55400a4a0 con 0x7fa550098020 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.175+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab65b00 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.176+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.176+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab5fbb0 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.176+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c043040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.176+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa5540141d0 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.176+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c043040 con 0x7fa5540141d0 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.176+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab5fbb0 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.176+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c043040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.176+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa550098020 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.177+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.177+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab65b00 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.177+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.177+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab65b00 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.177+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.177+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa5540141d0 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.177+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c043040 con 0x7fa5540141d0 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.177+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab65b00 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.178+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.178+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab65b00 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.178+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.178+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab5fbb0 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.178+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c043040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.178+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab5fbb0 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.178+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa54c043040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.178+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa5540141d0 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.179+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c043040 con 0x7fa5540141d0 2024-02-15T22:57:23.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.179+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab65b00 2024-02-15T22:57:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.179+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.179+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa550098020 2024-02-15T22:57:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.179+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.179+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab5fbb0 2024-02-15T22:57:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.179+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa54c043040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.179+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa5540141d0 2024-02-15T22:57:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.180+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.180+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab65b00 2024-02-15T22:57:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.180+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.180+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa5540141d0 2024-02-15T22:57:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.181+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.181+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa550098020 2024-02-15T22:57:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.181+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.181+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab65b00 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.181+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.181+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa5540141d0 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x560d2ab5fbb0 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab68520 con 0x7fa550098020 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa55d93a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa55d93a800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa55d93a800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa55d93a800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa55d93a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa55d93a800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa55d93a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab645e0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa55d93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa55d93a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.182+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab64260 con 0x560d2ab5fbb0 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab64eb0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:23.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 20 zone default found 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 4 Realm: () 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 20 zonegroup default 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab64eb0 con 0x7fa5540141d0 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.183+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6a370 con 0x560d2ab65b00 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.184+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.184+0000 7fa55d93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.184+0000 7fa55d93a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.184+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6a6d0 con 0x560d2ab65b00 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.184+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.184+0000 7fa55d93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.184+0000 7fa55d93a800 20 started sync module instance, tier type = 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.184+0000 7fa55d93a800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.184+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab69c50 con 0x7fa550098020 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.185+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.185+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94614551173040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6a000 con 0x7fa550098020 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.185+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6b430 con 0x560d2ab5fbb0 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.186+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94614551173040] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.186+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.186+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94614551178240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6b640 con 0x560d2ab5fbb0 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.186+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6c110 con 0x560d2ab65b00 2024-02-15T22:57:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.188+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94614551178240] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.188+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.188+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94614551182320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6c4c0 con 0x560d2ab65b00 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.188+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6cea0 con 0x7fa550098020 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.189+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.189+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94614551185856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6d760 con 0x7fa550098020 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.189+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6e200 con 0x560d2ab5fbb0 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.189+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94614551182320] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.190+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94614551185856] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.190+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.190+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94614551190752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6e1c0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.190+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6ea50 con 0x7fa5540141d0 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.191+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94614551190752] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.191+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.191+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94614551179424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6e1c0 con 0x7fa5540141d0 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.191+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6f0b0 con 0x7fa5540141d0 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.192+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94614551179424] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.193+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.193+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94614551194544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6f070 con 0x7fa5540141d0 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.193+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6faa0 con 0x7fa5540141d0 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.194+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94614551194544] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.194+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.194+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94614551197088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6fa60 con 0x7fa5540141d0 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.194+0000 7fa55d93a800 20 add_watcher() i=0 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.194+0000 7fa55d93a800 20 add_watcher() i=1 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.194+0000 7fa55d93a800 20 add_watcher() i=2 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.194+0000 7fa55d93a800 20 add_watcher() i=3 2024-02-15T22:57:23.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.194+0000 7fa55d93a800 20 add_watcher() i=4 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.194+0000 7fa55d93a800 20 add_watcher() i=5 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.194+0000 7fa55d93a800 20 add_watcher() i=6 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.195+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94614551197088] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.195+0000 7fa55d93a800 20 add_watcher() i=7 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.195+0000 7fa55d93a800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.195+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab72fe0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.195+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.195+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94614551192896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab70350 con 0x560d2ab5fbb0 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.196+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94614551192896] v32'198 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.196+0000 7fa40f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.196+0000 7fa55d93a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.196+0000 7fa55d93a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.196+0000 7fa55d93a800 5 note: GC not initialized 2024-02-15T22:57:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.197+0000 7fa40e7e4640 20 reqs_thread_entry: start 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.197+0000 7fa55d93a800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.197+0000 7fa55d93a800 20 Filter name: none 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.197+0000 7fa37ffff640 20 reqs_thread_entry: start 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.197+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba5570 con 0x560d2ab5fbb0 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.197+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.197+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba5570 con 0x7fa550098020 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.197+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.197+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba5570 con 0x560d2ab5fbb0 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.198+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.198+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba5570 con 0x560d2ab65b00 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.198+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.198+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba5980 con 0x560d2ab65b00 2024-02-15T22:57:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.198+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.198+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba5d70 con 0x560d2ab65b00 2024-02-15T22:57:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.198+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.198+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba6140 con 0x560d2ab5fbb0 2024-02-15T22:57:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.199+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.199+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba6140 con 0x560d2ab5fbb0 2024-02-15T22:57:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.199+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.199+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba6140 con 0x560d2ab65b00 2024-02-15T22:57:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.199+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.199+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba6140 con 0x560d2ab65b00 2024-02-15T22:57:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.199+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.199+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba60f0 con 0x7fa5540141d0 2024-02-15T22:57:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.200+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.200+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba7a30 con 0x560d2ab5fbb0 2024-02-15T22:57:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.200+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.200+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba7a30 con 0x7fa550098020 2024-02-15T22:57:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.201+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.201+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba7a30 con 0x560d2ab65b00 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.201+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.201+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba7a30 con 0x7fa5540141d0 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.201+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.201+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x7fa5540141d0 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.201+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.202+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x560d2ab65b00 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.202+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.202+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x7fa5540141d0 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.202+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.202+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.202+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.202+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x560d2ab65b00 2024-02-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.203+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.203+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x7fa5540141d0 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.203+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.203+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x7fa550098020 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.203+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.203+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x7fa5540141d0 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.203+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.203+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.204+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.204+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.204+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.204+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x560d2ab65b00 2024-02-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.204+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.204+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.204+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.204+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.204+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.204+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x560d2ab65b00 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.205+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.205+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x560d2ab65b00 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.205+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.205+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x560d2ab65b00 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.205+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.205+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2aba79e0 con 0x7fa5540141d0 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.206+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.207+0000 7fa40f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.207+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94614551192896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab71fc0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.208+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94614551192896] v32'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.208+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94614551173040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6e540 con 0x7fa550098020 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.209+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94614551173040] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.209+0000 7fa55d93a800 20 remove_watcher() i=0 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.209+0000 7fa55d93a800 2 removed watcher, disabling cache 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.209+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94614551178240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab697b0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.210+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94614551178240] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.210+0000 7fa55d93a800 20 remove_watcher() i=1 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.210+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94614551182320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab697b0 con 0x560d2ab65b00 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.211+0000 7fa558e04640 1 -- 172.21.15.133:0/2646358998 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94614551182320] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550095070 con 0x560d2ab65b00 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.211+0000 7fa55d93a800 20 remove_watcher() i=2 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.211+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94614551185856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6bbf0 con 0x7fa550098020 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.212+0000 7fa559e06640 1 -- 172.21.15.133:0/2646358998 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94614551185856] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa55403a040 con 0x7fa550098020 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.212+0000 7fa55d93a800 20 remove_watcher() i=3 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.212+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94614551190752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab697b0 con 0x560d2ab5fbb0 2024-02-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.213+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94614551190752] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x560d2ab5fbb0 2024-02-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.213+0000 7fa55d93a800 20 remove_watcher() i=4 2024-02-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.213+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94614551179424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab6bbf0 con 0x7fa5540141d0 2024-02-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.214+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94614551179424] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.214+0000 7fa55d93a800 20 remove_watcher() i=5 2024-02-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.214+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94614551194544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab697b0 con 0x7fa5540141d0 2024-02-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.215+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94614551194544] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.216+0000 7fa55d93a800 20 remove_watcher() i=6 2024-02-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.216+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94614551197088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d2ab697b0 con 0x7fa5540141d0 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94614551197088] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c054040 con 0x7fa5540141d0 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 20 remove_watcher() i=7 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa5540141d0 msgr2=0x7fa554015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa5540141d0 0x7fa554015940 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560d2ab5fbb0 msgr2=0x560d2ab62070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560d2ab5fbb0 0x560d2ab62070 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa550098020 msgr2=0x7fa55007c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa550098020 0x7fa55007c890 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560d2ab65b00 msgr2=0x560d2ab67ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560d2ab65b00 0x560d2ab67ef0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa424036740 msgr2=0x7fa424038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa424036740 0x7fa424038c00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa55400b010 tx=0x7fa554020000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 msgr2=0x560d2ab542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa559605640 1 -- 172.21.15.133:0/2646358998 reap_dead start 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab542d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa5500717b0 tx=0x7fa55008d7f0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 shutdown_connections 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 --2- 172.21.15.133:0/2646358998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab4d300 0x560d2ab542d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 >> 172.21.15.133:0/2646358998 conn(0x560d2ab49660 msgr2=0x560d2ab46cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 shutdown_connections 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/2646358998 wait complete. 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/3191536625 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa430036790 msgr2=0x7fa430038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3191536625 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa430036790 0x7fa430038c50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x560d2ab302d0 tx=0x7fa554005840 comp rx=0 tx=0).stop 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/3191536625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab40110 msgr2=0x560d2ab40530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3191536625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab40110 0x560d2ab40530 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa550044940 tx=0x7fa550002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/3191536625 shutdown_connections 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3191536625 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa430036790 0x7fa430038c50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3191536625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2ab40110 0x560d2ab40530 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/3191536625 >> 172.21.15.133:0/3191536625 conn(0x560d2ab341b0 msgr2=0x560d2ab345b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/3191536625 shutdown_connections 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.217+0000 7fa55d93a800 1 -- 172.21.15.133:0/3191536625 wait complete. 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560d2aa35500 msgr2=0x560d2ab2f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560d2aa35500 0x560d2ab2f390 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa440036790 msgr2=0x7fa440038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa440036790 0x7fa440038c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa550054000 tx=0x7fa55004e000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 msgr2=0x560d2ab28650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab28650 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa54c004000 tx=0x7fa54c000bc0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 shutdown_connections 2024-02-15T22:57:23.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560d2aa35500 0x560d2ab2f390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa440036790 0x7fa440038c50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 --2- 172.21.15.133:0/3667431289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560d2aa319f0 0x560d2ab28650 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 >> 172.21.15.133:0/3667431289 conn(0x560d2aa2b4c0 msgr2=0x560d2ab1b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 shutdown_connections 2024-02-15T22:57:23.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.218+0000 7fa55d93a800 1 -- 172.21.15.133:0/3667431289 wait complete. 2024-02-15T22:57:23.231 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-02-15T22:57:23.231 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-02-15T22:57:23.231 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-15T22:57:23.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-15T22:57:23.232 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-15T22:57:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.314+0000 7f90057ad800 1 Processor -- start 2024-02-15T22:57:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.314+0000 7f90057ad800 1 -- start start 2024-02-15T22:57:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.314+0000 7f90057ad800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5588e265d510 0x5588e265f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.314+0000 7f90057ad800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5588e25a3bb0 con 0x5588e2659a00 2024-02-15T22:57:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.314+0000 7f90057ad800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5588e255b450 con 0x5588e265d510 2024-02-15T22:57:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.314+0000 7f9002aab640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5588e265d510 0x5588e265f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.314+0000 7f9002aab640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5588e265d510 0x5588e265f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36196/0 (socket says 172.21.15.133:36196) 2024-02-15T22:57:23.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.314+0000 7f9002aab640 1 -- 172.21.15.133:0/2672619660 learned_addr learned my addr 172.21.15.133:0/2672619660 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.314+0000 7f90032ac640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5588e2659a00 0x5588e265bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:55900/0 (socket says 172.21.15.133:55900) 2024-02-15T22:57:23.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.315+0000 7f9002aab640 1 -- 172.21.15.133:0/2672619660 >> v1:172.21.15.52:6789/0 conn(0x5588e2659a00 legacy=0x5588e265bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.315+0000 7f9002aab640 1 -- 172.21.15.133:0/2672619660 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588e2660e50 con 0x5588e265d510 2024-02-15T22:57:23.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.316+0000 7f9002aab640 1 --2- 172.21.15.133:0/2672619660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e265d510 0x5588e265f900 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800a520 tx=0x7f8ff801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5fb015d6c4e789 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.317+0000 7f90022aa640 1 -- 172.21.15.133:0/2672619660 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff8052570 con 0x5588e265d510 2024-02-15T22:57:23.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.317+0000 7f90022aa640 1 -- 172.21.15.133:0/2672619660 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff80526d0 con 0x5588e265d510 2024-02-15T22:57:23.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.317+0000 7f90022aa640 1 -- 172.21.15.133:0/2672619660 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff8052990 con 0x5588e265d510 2024-02-15T22:57:23.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.317+0000 7f90057ad800 1 -- 172.21.15.133:0/2672619660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e265d510 msgr2=0x5588e265f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.317+0000 7f90057ad800 1 --2- 172.21.15.133:0/2672619660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e265d510 0x5588e265f900 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800a520 tx=0x7f8ff801cee0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.317+0000 7f90057ad800 1 -- 172.21.15.133:0/2672619660 shutdown_connections 2024-02-15T22:57:23.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.317+0000 7f90057ad800 1 --2- 172.21.15.133:0/2672619660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e265d510 0x5588e265f900 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.317+0000 7f90057ad800 1 -- 172.21.15.133:0/2672619660 >> 172.21.15.133:0/2672619660 conn(0x5588e26534d0 msgr2=0x5588e26558f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.317+0000 7f90057ad800 1 -- 172.21.15.133:0/2672619660 shutdown_connections 2024-02-15T22:57:23.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.317+0000 7f90057ad800 1 -- 172.21.15.133:0/2672619660 wait complete. 2024-02-15T22:57:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.329+0000 7f90057ad800 1 Processor -- start 2024-02-15T22:57:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.329+0000 7f90057ad800 1 -- start start 2024-02-15T22:57:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.329+0000 7f90057ad800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e2748ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.329+0000 7f90057ad800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e2558980 con 0x5588e2659a00 2024-02-15T22:57:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.329+0000 7f90032ac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e2748ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.329+0000 7f90032ac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e2748ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36202/0 (socket says 172.21.15.133:36202) 2024-02-15T22:57:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.329+0000 7f90032ac640 1 -- 172.21.15.133:0/2168621132 learned_addr learned my addr 172.21.15.133:0/2168621132 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.329+0000 7f90032ac640 1 -- 172.21.15.133:0/2168621132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8005de0 con 0x5588e2659a00 2024-02-15T22:57:23.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.330+0000 7f90032ac640 1 --2- 172.21.15.133:0/2168621132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e2748ff0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4001d00 tx=0x7f8ff400b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be45b3cc2b2a6efa server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.330+0000 7f8ef160a640 1 -- 172.21.15.133:0/2168621132 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff4014070 con 0x5588e2659a00 2024-02-15T22:57:23.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.330+0000 7f8ef160a640 1 -- 172.21.15.133:0/2168621132 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff400f450 con 0x5588e2659a00 2024-02-15T22:57:23.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.330+0000 7f8ef160a640 1 -- 172.21.15.133:0/2168621132 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff400f730 con 0x5588e2659a00 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.330+0000 7f90057ad800 1 -- 172.21.15.133:0/2168621132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 msgr2=0x5588e2748ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.330+0000 7f90057ad800 1 --2- 172.21.15.133:0/2168621132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e2748ff0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4001d00 tx=0x7f8ff400b600 comp rx=0 tx=0).stop 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.330+0000 7f90057ad800 1 -- 172.21.15.133:0/2168621132 shutdown_connections 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.330+0000 7f90057ad800 1 --2- 172.21.15.133:0/2168621132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e2748ff0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.330+0000 7f90057ad800 1 -- 172.21.15.133:0/2168621132 >> 172.21.15.133:0/2168621132 conn(0x5588e26534d0 msgr2=0x5588e2744910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.331+0000 7f90057ad800 1 -- 172.21.15.133:0/2168621132 shutdown_connections 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.331+0000 7f90057ad800 1 -- 172.21.15.133:0/2168621132 wait complete. 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.331+0000 7f90057ad800 1 Processor -- start 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.331+0000 7f90057ad800 1 -- start start 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.331+0000 7f90057ad800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e27506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.331+0000 7f90057ad800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e2554160 con 0x5588e2659a00 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.331+0000 7f90032ac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e27506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.331+0000 7f90032ac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e27506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36210/0 (socket says 172.21.15.133:36210) 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.331+0000 7f90032ac640 1 -- 172.21.15.133:0/3404498545 learned_addr learned my addr 172.21.15.133:0/3404498545 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.331+0000 7f90032ac640 1 -- 172.21.15.133:0/3404498545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588e25a3bb0 con 0x5588e2659a00 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.332+0000 7f90032ac640 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e27506d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x5588e2749d80 tx=0x7f8ff4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.332+0000 7f8eefe07640 1 -- 172.21.15.133:0/3404498545 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff4014050 con 0x5588e2659a00 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.332+0000 7f8eefe07640 1 -- 172.21.15.133:0/3404498545 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff401b850 con 0x5588e2659a00 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.332+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588e2750c10 con 0x5588e2659a00 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.332+0000 7f8eefe07640 1 -- 172.21.15.133:0/3404498545 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff401baf0 con 0x5588e2659a00 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.332+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588e27510f0 con 0x5588e2659a00 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.333+0000 7f8eefe07640 1 -- 172.21.15.133:0/3404498545 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8ff4022020 con 0x5588e2659a00 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.333+0000 7f8eefe07640 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8ee80367e0 0x7f8ee8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.333+0000 7f8eefe07640 1 -- 172.21.15.133:0/3404498545 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f8ff4008030 con 0x5588e2659a00 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.333+0000 7f9002aab640 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8ee80367e0 0x7f8ee8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.333+0000 7f90057ad800 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5588e265d510 0x5588e2757410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.333+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27579e0 con 0x5588e265d510 2024-02-15T22:57:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.333+0000 7f9003aad640 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5588e265d510 0x5588e2757410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.333+0000 7f9002aab640 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8ee80367e0 0x7f8ee8038ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8054000 tx=0x7f8ff804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.333+0000 7f9003aad640 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5588e265d510 0x5588e2757410 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.334+0000 7f9003aad640 1 -- 172.21.15.133:0/3404498545 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ffc00a4a0 con 0x5588e265d510 2024-02-15T22:57:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.334+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2754a70 con 0x5588e265d510 2024-02-15T22:57:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.334+0000 7f9003aad640 1 -- 172.21.15.133:0/3404498545 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8ffc00a4a0 con 0x5588e265d510 2024-02-15T22:57:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.334+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2759710 con 0x5588e265d510 2024-02-15T22:57:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.334+0000 7f9003aad640 1 -- 172.21.15.133:0/3404498545 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8ffc00a4a0 con 0x5588e265d510 2024-02-15T22:57:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.334+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2758910 con 0x5588e265d510 2024-02-15T22:57:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.335+0000 7f9003aad640 1 -- 172.21.15.133:0/3404498545 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8ffc00a4a0 con 0x5588e265d510 2024-02-15T22:57:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.335+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2758d20 con 0x5588e265d510 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.335+0000 7f9003aad640 1 -- 172.21.15.133:0/3404498545 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8ffc00a4a0 con 0x5588e265d510 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.335+0000 7f90057ad800 1 Processor -- start 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.335+0000 7f90057ad800 1 -- start start 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.335+0000 7f90057ad800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2768190 0x5588e27685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.335+0000 7f90057ad800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e24f6e80 con 0x5588e2768190 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.336+0000 7f9002aab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2768190 0x5588e27685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.336+0000 7f9002aab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2768190 0x5588e27685b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36214/0 (socket says 172.21.15.133:36214) 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.336+0000 7f9002aab640 1 -- 172.21.15.133:0/968930900 learned_addr learned my addr 172.21.15.133:0/968930900 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.336+0000 7f9002aab640 1 -- 172.21.15.133:0/968930900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588e2768af0 con 0x5588e2768190 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.336+0000 7f9002aab640 1 --2- 172.21.15.133:0/968930900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2768190 0x5588e27685b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8000c00 tx=0x7f8ff8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.336+0000 7f8eed602640 1 -- 172.21.15.133:0/968930900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff805dcb0 con 0x5588e2768190 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.336+0000 7f8eed602640 1 -- 172.21.15.133:0/968930900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff805de10 con 0x5588e2768190 2024-02-15T22:57:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.336+0000 7f90057ad800 1 -- 172.21.15.133:0/968930900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588e2768ce0 con 0x5588e2768190 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.336+0000 7f8eed602640 1 -- 172.21.15.133:0/968930900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff8069530 con 0x5588e2768190 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.337+0000 7f90057ad800 1 -- 172.21.15.133:0/968930900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588e2769830 con 0x5588e2768190 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.337+0000 7f8eed602640 1 -- 172.21.15.133:0/968930900 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8ff8059040 con 0x5588e2768190 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.337+0000 7f8eed602640 1 --2- 172.21.15.133:0/968930900 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8edc0367e0 0x7f8edc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.337+0000 7f8eed602640 1 -- 172.21.15.133:0/968930900 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f8ff808f5a0 con 0x5588e2768190 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.338+0000 7f9003aad640 1 --2- 172.21.15.133:0/968930900 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8edc0367e0 0x7f8edc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.338+0000 7f90057ad800 1 Processor -- start 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.338+0000 7f90057ad800 1 -- start start 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.338+0000 7f9003aad640 1 --2- 172.21.15.133:0/968930900 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8edc0367e0 0x7f8edc038ca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5588e2758350 tx=0x7f8ffc005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.338+0000 7f90057ad800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e2775770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.338+0000 7f90057ad800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e24cc5d0 con 0x5588e2775350 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.338+0000 7f9002aab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e2775770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.338+0000 7f9002aab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e2775770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36230/0 (socket says 172.21.15.133:36230) 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.338+0000 7f9002aab640 1 -- 172.21.15.133:0/88866433 learned_addr learned my addr 172.21.15.133:0/88866433 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f9002aab640 1 -- 172.21.15.133:0/88866433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588e2775d40 con 0x5588e2775350 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f9002aab640 1 --2- 172.21.15.133:0/88866433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e2775770 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800a3f0 tx=0x7f8ff8006870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bb25196a1520e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f8ee6ffd640 1 -- 172.21.15.133:0/88866433 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff80727e0 con 0x5588e2775350 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f8ee6ffd640 1 -- 172.21.15.133:0/88866433 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff8073460 con 0x5588e2775350 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f8ee6ffd640 1 -- 172.21.15.133:0/88866433 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff8068360 con 0x5588e2775350 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f90057ad800 1 -- 172.21.15.133:0/88866433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 msgr2=0x5588e2775770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f90057ad800 1 --2- 172.21.15.133:0/88866433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e2775770 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800a3f0 tx=0x7f8ff8006870 comp rx=0 tx=0).stop 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f90057ad800 1 -- 172.21.15.133:0/88866433 shutdown_connections 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f90057ad800 1 --2- 172.21.15.133:0/88866433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e2775770 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f90057ad800 1 -- 172.21.15.133:0/88866433 >> 172.21.15.133:0/88866433 conn(0x5588e27716b0 msgr2=0x5588e276f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f90057ad800 1 -- 172.21.15.133:0/88866433 shutdown_connections 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.339+0000 7f90057ad800 1 -- 172.21.15.133:0/88866433 wait complete. 2024-02-15T22:57:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.340+0000 7f90057ad800 1 Processor -- start 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.340+0000 7f90057ad800 1 -- start start 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.340+0000 7f90057ad800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e277c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.340+0000 7f90057ad800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e277c8a0 con 0x5588e2775350 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.340+0000 7f9002aab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e277c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.340+0000 7f9002aab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e277c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:36238/0 (socket says 172.21.15.133:36238) 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.340+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 learned_addr learned my addr 172.21.15.133:0/3168217830 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.340+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588e2769830 con 0x5588e2775350 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.341+0000 7f9002aab640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e277c360 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80068b0 tx=0x7f8ff808d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.341+0000 7f8ee57fa640 1 -- 172.21.15.133:0/3168217830 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff808db80 con 0x5588e2775350 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.341+0000 7f8ee57fa640 1 -- 172.21.15.133:0/3168217830 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff8072cb0 con 0x5588e2775350 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.341+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588e277caa0 con 0x5588e2775350 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.341+0000 7f8ee57fa640 1 -- 172.21.15.133:0/3168217830 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff806a030 con 0x5588e2775350 2024-02-15T22:57:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.341+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588e277caa0 con 0x5588e2775350 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.342+0000 7f8ee57fa640 1 -- 172.21.15.133:0/3168217830 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8ff806a190 con 0x5588e2775350 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.342+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.342+0000 7f8ee57fa640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8ecc036790 0x7f8ecc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.342+0000 7f8ee57fa640 1 -- 172.21.15.133:0/3168217830 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f8ff80910d0 con 0x5588e2775350 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.342+0000 7f9003aad640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8ecc036790 0x7f8ecc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.342+0000 7f90057ad800 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5588e2787dc0 0x5588e278a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.342+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278a9b0 con 0x5588e2787dc0 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.342+0000 7f90032ac640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5588e2787dc0 0x5588e278a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.342+0000 7f9003aad640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8ecc036790 0x7f8ecc038c50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00b010 tx=0x7f8ffc020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.342+0000 7f90032ac640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5588e2787dc0 0x5588e278a260 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 20 realm 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278ad80 con 0x5588e2787dc0 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b600 con 0x5588e2787dc0 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b960 con 0x5588e2787dc0 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e2787dc0 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.343+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.344+0000 7f90057ad800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.344+0000 7f90057ad800 20 searching for the correct realm 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.344+0000 7f90057ad800 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5588e278dce0 0x5588e27900d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.344+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2790780 con 0x5588e278dce0 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.344+0000 7f9002aab640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5588e278dce0 0x5588e27900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.344+0000 7f9002aab640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5588e278dce0 0x5588e27900d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.344+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.344+0000 7f9002aab640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f8ff8087070 0x7f8ff80686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.344+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2790780 con 0x7f8ff8087070 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.344+0000 7f9003aad640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f8ff8087070 0x7f8ff80686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.345+0000 7f9003aad640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f8ff8087070 0x7f8ff80686f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.345+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ffc00a4a0 con 0x7f8ff8087070 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.345+0000 7f9003aad640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f8ffc0141d0 0x7f8ffc015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.345+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2790780 con 0x7f8ffc0141d0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.345+0000 7f90032ac640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f8ffc0141d0 0x7f8ffc015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.346+0000 7f90032ac640 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f8ffc0141d0 0x7f8ffc015940 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.346+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.346+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e2787dc0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.346+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.346+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e2787dc0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.346+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.346+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ffc0141d0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.347+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.347+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ffc0141d0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.347+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.347+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ff8087070 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.347+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ffc00a4a0 con 0x7f8ff8087070 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.347+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e278dce0 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.347+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.347+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e2787dc0 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.348+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.348+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ffc0141d0 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.348+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.348+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e2787dc0 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.348+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.348+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ff8087070 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.348+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8ffc03a040 con 0x7f8ff8087070 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.348+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e278dce0 2024-02-15T22:57:23.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.349+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.349+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e278dce0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.349+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.349+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ffc0141d0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.349+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.349+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e278dce0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.349+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.349+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e278dce0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.350+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.350+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e2787dc0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.350+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.350+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e2787dc0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.350+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.350+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ffc0141d0 2024-02-15T22:57:23.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.350+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.350+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e278dce0 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.351+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.351+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ff8087070 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.351+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ffc03a040 con 0x7f8ff8087070 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.351+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e2787dc0 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.351+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.351+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ffc0141d0 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.351+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.352+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e278dce0 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.352+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.352+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ffc0141d0 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.352+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.352+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ff8087070 2024-02-15T22:57:23.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.352+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ffc03a040 con 0x7f8ff8087070 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.352+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e278dce0 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.352+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ffc0141d0 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x5588e2787dc0 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278b260 con 0x7f8ff8087070 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ffc03a040 con 0x7f8ff8087070 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90057ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90057ad800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90057ad800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90057ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90057ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:23.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90057ad800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.353+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278c650 con 0x5588e2787dc0 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278ca00 con 0x5588e2787dc0 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278ca00 con 0x5588e2787dc0 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 20 zone default found 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 4 Realm: () 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 20 zonegroup default 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278d2d0 con 0x7f8ffc0141d0 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.354+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e278d2d0 con 0x5588e278dce0 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.355+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.355+0000 7f90057ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.355+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.355+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27925d0 con 0x5588e278dce0 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.355+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.355+0000 7f90057ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.355+0000 7f90057ad800 20 started sync module instance, tier type = 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.355+0000 7f90057ad800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.355+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2791eb0 con 0x7f8ff8087070 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.356+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ffc03a040 con 0x7f8ff8087070 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.356+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94046403500560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2792260 con 0x7f8ff8087070 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.356+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2793330 con 0x5588e2787dc0 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.357+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94046403500560] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ffc03a040 con 0x7f8ff8087070 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.357+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.357+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94046403504896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27934c0 con 0x5588e2787dc0 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.357+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2793f90 con 0x5588e278dce0 2024-02-15T22:57:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.358+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94046403504896] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.359+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.359+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94046403508848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2794340 con 0x5588e278dce0 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.359+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2794d30 con 0x7f8ff8087070 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.360+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ffc03a040 con 0x7f8ff8087070 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.360+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94046403512336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27955c0 con 0x7f8ff8087070 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.360+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2796070 con 0x5588e2787dc0 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.360+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94046403508848] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.361+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94046403512336] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ffc03a040 con 0x7f8ff8087070 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.361+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.361+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94046403517296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2796030 con 0x5588e2787dc0 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.361+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27968c0 con 0x7f8ffc0141d0 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.362+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.362+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94046403518512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27969b0 con 0x7f8ffc0141d0 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.362+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2797480 con 0x7f8ffc0141d0 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.362+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94046403517296] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.363+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94046403518512] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.363+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.363+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94046403519568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2797440 con 0x7f8ffc0141d0 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.363+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2797d00 con 0x7f8ffc0141d0 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.364+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.364+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94046403524704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2797440 con 0x7f8ffc0141d0 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.364+0000 7f90057ad800 20 add_watcher() i=0 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.364+0000 7f90057ad800 20 add_watcher() i=1 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.364+0000 7f90057ad800 20 add_watcher() i=2 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.364+0000 7f90057ad800 20 add_watcher() i=3 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.364+0000 7f90057ad800 20 add_watcher() i=4 2024-02-15T22:57:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.364+0000 7f90057ad800 20 add_watcher() i=5 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.364+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94046403519568] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.364+0000 7f90057ad800 20 add_watcher() i=6 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.365+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94046403524704] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.365+0000 7f90057ad800 20 add_watcher() i=7 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.365+0000 7f90057ad800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.365+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2797050 con 0x5588e2787dc0 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.366+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.366+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94046403525760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2798700 con 0x5588e2787dc0 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.367+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94046403525760] v32'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.367+0000 7f8eb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.367+0000 7f90057ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.367+0000 7f90057ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:23.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.367+0000 7f90057ad800 5 note: GC not initialized 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.367+0000 7f8eb8fe1640 20 reqs_thread_entry: start 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.367+0000 7f90057ad800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.367+0000 7f90057ad800 20 Filter name: none 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.367+0000 7f8e327fc640 20 reqs_thread_entry: start 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.367+0000 7f90057ad800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.367+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27cc9d0 con 0x5588e2787dc0 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.368+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.368+0000 7f90057ad800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.368+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27cc9d0 con 0x7f8ffc0141d0 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.368+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.369+0000 7f8eb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.369+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94046403525760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27cc9d0 con 0x5588e2787dc0 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.370+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94046403525760] v32'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.370+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94046403500560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27cc9d0 con 0x7f8ff8087070 2024-02-15T22:57:23.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.371+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94046403500560] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ffc03a040 con 0x7f8ff8087070 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.371+0000 7f90057ad800 20 remove_watcher() i=0 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.371+0000 7f90057ad800 2 removed watcher, disabling cache 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.371+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94046403504896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27cc9d0 con 0x5588e2787dc0 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.373+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94046403504896] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.373+0000 7f90057ad800 20 remove_watcher() i=1 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.373+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94046403508848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e27cc9d0 con 0x5588e278dce0 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.374+0000 7f9002aab640 1 -- 172.21.15.133:0/3168217830 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94046403508848] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff80a9040 con 0x5588e278dce0 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.374+0000 7f90057ad800 20 remove_watcher() i=2 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.374+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94046403512336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2791a10 con 0x7f8ff8087070 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.374+0000 7f9003aad640 1 -- 172.21.15.133:0/3168217830 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94046403512336] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ffc03a040 con 0x7f8ff8087070 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.375+0000 7f90057ad800 20 remove_watcher() i=3 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.375+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94046403517296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2792b00 con 0x5588e2787dc0 2024-02-15T22:57:23.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.376+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94046403517296] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x5588e2787dc0 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.376+0000 7f90057ad800 20 remove_watcher() i=4 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.376+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94046403518512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2791a10 con 0x7f8ffc0141d0 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.377+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94046403518512] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.377+0000 7f90057ad800 20 remove_watcher() i=5 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.377+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94046403519568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2792b00 con 0x7f8ffc0141d0 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.378+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94046403519568] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.378+0000 7f90057ad800 20 remove_watcher() i=6 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.378+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94046403524704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588e2791a10 con 0x7f8ffc0141d0 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94046403524704] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff4016070 con 0x7f8ffc0141d0 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 20 remove_watcher() i=7 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f8ffc0141d0 msgr2=0x7f8ffc015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f8ffc0141d0 0x7f8ffc015940 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5588e2787dc0 msgr2=0x5588e278a260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5588e2787dc0 0x5588e278a260 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f8ff8087070 msgr2=0x7f8ff80686f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f8ff8087070 0x7f8ff80686f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5588e278dce0 msgr2=0x5588e27900d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5588e278dce0 0x5588e27900d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8ecc036790 msgr2=0x7f8ecc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8ecc036790 0x7f8ecc038c50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00b010 tx=0x7f8ffc020000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 msgr2=0x5588e277c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90032ac640 1 -- 172.21.15.133:0/3168217830 reap_dead start 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.379+0000 7f90057ad800 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e277c360 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80068b0 tx=0x7f8ff808d910 comp rx=0 tx=0).stop 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 shutdown_connections 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 --2- 172.21.15.133:0/3168217830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2775350 0x5588e277c360 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 >> 172.21.15.133:0/3168217830 conn(0x5588e27716b0 msgr2=0x5588e276ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 shutdown_connections 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/3168217830 wait complete. 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/968930900 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8edc0367e0 msgr2=0x7f8edc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 --2- 172.21.15.133:0/968930900 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8edc0367e0 0x7f8edc038ca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5588e2758350 tx=0x7f8ffc005840 comp rx=0 tx=0).stop 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/968930900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2768190 msgr2=0x5588e27685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 --2- 172.21.15.133:0/968930900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2768190 0x5588e27685b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8000c00 tx=0x7f8ff8002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/968930900 shutdown_connections 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 --2- 172.21.15.133:0/968930900 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8edc0367e0 0x7f8edc038ca0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 --2- 172.21.15.133:0/968930900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2768190 0x5588e27685b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/968930900 >> 172.21.15.133:0/968930900 conn(0x5588e275c230 msgr2=0x5588e275c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/968930900 shutdown_connections 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/968930900 wait complete. 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5588e265d510 msgr2=0x5588e2757410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5588e265d510 0x5588e2757410 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8ee80367e0 msgr2=0x7f8ee8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8ee80367e0 0x7f8ee8038ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8054000 tx=0x7f8ff804e000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 msgr2=0x5588e27506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e27506d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x5588e2749d80 tx=0x7f8ff4000ed0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 shutdown_connections 2024-02-15T22:57:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5588e265d510 0x5588e2757410 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8ee80367e0 0x7f8ee8038ca0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 --2- 172.21.15.133:0/3404498545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588e2659a00 0x5588e27506d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 >> 172.21.15.133:0/3404498545 conn(0x5588e26534d0 msgr2=0x5588e2743190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 shutdown_connections 2024-02-15T22:57:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.380+0000 7f90057ad800 1 -- 172.21.15.133:0/3404498545 wait complete. 2024-02-15T22:57:23.392 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-02-15T22:57:23.393 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-02-15T22:57:23.393 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-15T22:57:23.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-15T22:57:23.393 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-02-15T22:57:23.437 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:23.438 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:23.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.436+0000 7f745d133800 1 Processor -- start 2024-02-15T22:57:23.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.436+0000 7f745d133800 1 -- start start 2024-02-15T22:57:23.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.436+0000 7f745d133800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5648f3f6c120 0x5648f3ffbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.436+0000 7f745d133800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5648f3f43ba0 con 0x5648f3ffc0c0 2024-02-15T22:57:23.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.436+0000 7f745d133800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5648f3efb450 con 0x5648f3f6c120 2024-02-15T22:57:23.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.436+0000 7f7458e67640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5648f3f6c120 0x5648f3ffbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.436+0000 7f7453fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5648f3ffc0c0 0x5648f3ffe580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45248/0 (socket says 172.21.15.133:45248) 2024-02-15T22:57:23.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.436+0000 7f7453fff640 1 -- 172.21.15.133:0/659830179 learned_addr learned my addr 172.21.15.133:0/659830179 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:23.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.437+0000 7f7458e67640 1 -- 172.21.15.133:0/659830179 >> v1:172.21.15.52:6789/0 conn(0x5648f3ffc0c0 legacy=0x5648f3ffe580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.437+0000 7f7458e67640 1 -- 172.21.15.133:0/659830179 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648f4000e70 con 0x5648f3f6c120 2024-02-15T22:57:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.438+0000 7f7458e67640 1 --2- 172.21.15.133:0/659830179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f3ffbb50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f744c00a470 tx=0x7f744c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cb0eda554e9044 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.439+0000 7f74537fe640 1 -- 172.21.15.133:0/659830179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f744c052570 con 0x5648f3f6c120 2024-02-15T22:57:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.439+0000 7f74537fe640 1 -- 172.21.15.133:0/659830179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c0526d0 con 0x5648f3f6c120 2024-02-15T22:57:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.439+0000 7f74537fe640 1 -- 172.21.15.133:0/659830179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f744c052990 con 0x5648f3f6c120 2024-02-15T22:57:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.439+0000 7f745d133800 1 -- 172.21.15.133:0/659830179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 msgr2=0x5648f3ffbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.439+0000 7f745d133800 1 --2- 172.21.15.133:0/659830179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f3ffbb50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f744c00a470 tx=0x7f744c01cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.439+0000 7f745d133800 1 -- 172.21.15.133:0/659830179 shutdown_connections 2024-02-15T22:57:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.439+0000 7f745d133800 1 --2- 172.21.15.133:0/659830179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f3ffbb50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.439+0000 7f745d133800 1 -- 172.21.15.133:0/659830179 >> 172.21.15.133:0/659830179 conn(0x5648f3ff34f0 msgr2=0x5648f3ff5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.439+0000 7f745d133800 1 -- 172.21.15.133:0/659830179 shutdown_connections 2024-02-15T22:57:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.439+0000 7f745d133800 1 -- 172.21.15.133:0/659830179 wait complete. 2024-02-15T22:57:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.451+0000 7f745d133800 1 Processor -- start 2024-02-15T22:57:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.451+0000 7f745d133800 1 -- start start 2024-02-15T22:57:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.451+0000 7f745d133800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40e9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.451+0000 7f745d133800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f3ef8980 con 0x5648f3f6c120 2024-02-15T22:57:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.451+0000 7f7458e67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.451+0000 7f7458e67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40e9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33268/0 (socket says 172.21.15.133:33268) 2024-02-15T22:57:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.451+0000 7f7458e67640 1 -- 172.21.15.133:0/3143206354 learned_addr learned my addr 172.21.15.133:0/3143206354 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.452+0000 7f7458e67640 1 -- 172.21.15.133:0/3143206354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c005d20 con 0x5648f3f6c120 2024-02-15T22:57:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.452+0000 7f7458e67640 1 --2- 172.21.15.133:0/3143206354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40e9080 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f744c055040 tx=0x7f744c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3421a67a49eb87af server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.452+0000 7f7346e05640 1 -- 172.21.15.133:0/3143206354 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f744c00a180 con 0x5648f3f6c120 2024-02-15T22:57:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.452+0000 7f7346e05640 1 -- 172.21.15.133:0/3143206354 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c00a2e0 con 0x5648f3f6c120 2024-02-15T22:57:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.452+0000 7f7346e05640 1 -- 172.21.15.133:0/3143206354 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f744c0529b0 con 0x5648f3f6c120 2024-02-15T22:57:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.453+0000 7f745d133800 1 -- 172.21.15.133:0/3143206354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 msgr2=0x5648f40e9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.453+0000 7f745d133800 1 --2- 172.21.15.133:0/3143206354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40e9080 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f744c055040 tx=0x7f744c04c000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.453+0000 7f745d133800 1 -- 172.21.15.133:0/3143206354 shutdown_connections 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.453+0000 7f745d133800 1 --2- 172.21.15.133:0/3143206354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40e9080 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.453+0000 7f745d133800 1 -- 172.21.15.133:0/3143206354 >> 172.21.15.133:0/3143206354 conn(0x5648f3ff34f0 msgr2=0x5648f40e49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.453+0000 7f745d133800 1 -- 172.21.15.133:0/3143206354 shutdown_connections 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.453+0000 7f745d133800 1 -- 172.21.15.133:0/3143206354 wait complete. 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.453+0000 7f745d133800 1 Processor -- start 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.453+0000 7f745d133800 1 -- start start 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.453+0000 7f745d133800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.453+0000 7f745d133800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f3ef4160 con 0x5648f3f6c120 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.454+0000 7f7458e67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.454+0000 7f7458e67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40f06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33278/0 (socket says 172.21.15.133:33278) 2024-02-15T22:57:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.454+0000 7f7458e67640 1 -- 172.21.15.133:0/3854310295 learned_addr learned my addr 172.21.15.133:0/3854310295 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.454+0000 7f7458e67640 1 -- 172.21.15.133:0/3854310295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648f4000e70 con 0x5648f3f6c120 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.454+0000 7f7458e67640 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40f06b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f744c00a470 tx=0x7f744c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.454+0000 7f7345602640 1 -- 172.21.15.133:0/3854310295 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f744c06a070 con 0x5648f3f6c120 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.454+0000 7f7345602640 1 -- 172.21.15.133:0/3854310295 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c05d420 con 0x5648f3f6c120 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.454+0000 7f7345602640 1 -- 172.21.15.133:0/3854310295 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f744c05d5d0 con 0x5648f3f6c120 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.454+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648f40f0bf0 con 0x5648f3f6c120 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.454+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648f40f10d0 con 0x5648f3f6c120 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.455+0000 7f7345602640 1 -- 172.21.15.133:0/3854310295 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f744c05d730 con 0x5648f3f6c120 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.455+0000 7f7345602640 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73400367e0 0x7f7340038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.455+0000 7f7345602640 1 -- 172.21.15.133:0/3854310295 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f744c08dad0 con 0x5648f3f6c120 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.455+0000 7f7453fff640 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73400367e0 0x7f7340038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.455+0000 7f745d133800 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5648f3ffc0c0 0x5648f40f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.455+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f40f7a10 con 0x5648f3ffc0c0 2024-02-15T22:57:23.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.456+0000 7f7459668640 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5648f3ffc0c0 0x5648f40f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.456+0000 7f7453fff640 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73400367e0 0x7f7340038ca0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7444000f60 tx=0x7f74440012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.456+0000 7f7459668640 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5648f3ffc0c0 0x5648f40f7440 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.456+0000 7f7459668640 1 -- 172.21.15.133:0/3854310295 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f745400a4a0 con 0x5648f3ffc0c0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.456+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f40f4aa0 con 0x5648f3ffc0c0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.456+0000 7f7459668640 1 -- 172.21.15.133:0/3854310295 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f745400a4a0 con 0x5648f3ffc0c0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.456+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f40f9740 con 0x5648f3ffc0c0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.457+0000 7f7459668640 1 -- 172.21.15.133:0/3854310295 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f745400a4a0 con 0x5648f3ffc0c0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.457+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f40f8940 con 0x5648f3ffc0c0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.457+0000 7f7459668640 1 -- 172.21.15.133:0/3854310295 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f745400a4a0 con 0x5648f3ffc0c0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.457+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f40f8d50 con 0x5648f3ffc0c0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.457+0000 7f7459668640 1 -- 172.21.15.133:0/3854310295 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f745400a4a0 con 0x5648f3ffc0c0 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.458+0000 7f745d133800 1 Processor -- start 2024-02-15T22:57:23.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.458+0000 7f745d133800 1 -- start start 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.458+0000 7f745d133800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3ff96e0 0x5648f3ff7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.458+0000 7f745d133800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f3e96e80 con 0x5648f3ff96e0 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.458+0000 7f7453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3ff96e0 0x5648f3ff7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.458+0000 7f7453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3ff96e0 0x5648f3ff7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33292/0 (socket says 172.21.15.133:33292) 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.458+0000 7f7453fff640 1 -- 172.21.15.133:0/2107647874 learned_addr learned my addr 172.21.15.133:0/2107647874 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.458+0000 7f7453fff640 1 -- 172.21.15.133:0/2107647874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648f3ff8090 con 0x5648f3ff96e0 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.459+0000 7f7453fff640 1 --2- 172.21.15.133:0/2107647874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3ff96e0 0x5648f3ff7b50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7444001ed0 tx=0x7f744400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.459+0000 7f733e7fc640 1 -- 172.21.15.133:0/2107647874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7444020070 con 0x5648f3ff96e0 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.459+0000 7f733e7fc640 1 -- 172.21.15.133:0/2107647874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744401b550 con 0x5648f3ff96e0 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.459+0000 7f745d133800 1 -- 172.21.15.133:0/2107647874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648f3ff82e0 con 0x5648f3ff96e0 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.459+0000 7f733e7fc640 1 -- 172.21.15.133:0/2107647874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7444013040 con 0x5648f3ff96e0 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.459+0000 7f745d133800 1 -- 172.21.15.133:0/2107647874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648f3ff87a0 con 0x5648f3ff96e0 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.460+0000 7f733e7fc640 1 -- 172.21.15.133:0/2107647874 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f744401b7f0 con 0x5648f3ff96e0 2024-02-15T22:57:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.460+0000 7f733e7fc640 1 --2- 172.21.15.133:0/2107647874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73300367e0 0x7f7330038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.460+0000 7f733e7fc640 1 -- 172.21.15.133:0/2107647874 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f744404e370 con 0x5648f3ff96e0 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.460+0000 7f7459668640 1 --2- 172.21.15.133:0/2107647874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73300367e0 0x7f7330038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.460+0000 7f745d133800 1 Processor -- start 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.460+0000 7f745d133800 1 -- start start 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.460+0000 7f7459668640 1 --2- 172.21.15.133:0/2107647874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73300367e0 0x7f7330038ca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5648f40f8380 tx=0x7f7454005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.460+0000 7f745d133800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 0x5648f4117a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.460+0000 7f745d133800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f3e6c5d0 con 0x5648f4117670 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.461+0000 7f7453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 0x5648f4117a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.461+0000 7f7453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 0x5648f4117a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33308/0 (socket says 172.21.15.133:33308) 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.461+0000 7f7453fff640 1 -- 172.21.15.133:0/3523227882 learned_addr learned my addr 172.21.15.133:0/3523227882 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.461+0000 7f7453fff640 1 -- 172.21.15.133:0/3523227882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648f4118060 con 0x5648f4117670 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.461+0000 7f7453fff640 1 --2- 172.21.15.133:0/3523227882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 0x5648f4117a90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f744404c750 tx=0x7f744404c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0cf5a071746b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.461+0000 7f732ffff640 1 -- 172.21.15.133:0/3523227882 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f744404b260 con 0x5648f4117670 2024-02-15T22:57:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.461+0000 7f732ffff640 1 -- 172.21.15.133:0/3523227882 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444040e90 con 0x5648f4117670 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.461+0000 7f732ffff640 1 -- 172.21.15.133:0/3523227882 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7444025930 con 0x5648f4117670 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f745d133800 1 -- 172.21.15.133:0/3523227882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 msgr2=0x5648f4117a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f745d133800 1 --2- 172.21.15.133:0/3523227882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 0x5648f4117a90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f744404c750 tx=0x7f744404c890 comp rx=0 tx=0).stop 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f745d133800 1 -- 172.21.15.133:0/3523227882 shutdown_connections 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f745d133800 1 --2- 172.21.15.133:0/3523227882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 0x5648f4117a90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f745d133800 1 -- 172.21.15.133:0/3523227882 >> 172.21.15.133:0/3523227882 conn(0x5648f4113990 msgr2=0x5648f41119f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f745d133800 1 -- 172.21.15.133:0/3523227882 shutdown_connections 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f745d133800 1 -- 172.21.15.133:0/3523227882 wait complete. 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f745d133800 1 Processor -- start 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f745d133800 1 -- start start 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f745d133800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 0x5648f411e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f745d133800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f411eb70 con 0x5648f4117670 2024-02-15T22:57:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f7453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 0x5648f411e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f7453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 0x5648f411e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33312/0 (socket says 172.21.15.133:33312) 2024-02-15T22:57:23.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.462+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 learned_addr learned my addr 172.21.15.133:0/1933362201 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.463+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648f3ff87a0 con 0x5648f4117670 2024-02-15T22:57:23.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.463+0000 7f7453fff640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 0x5648f411e630 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f744401afd0 tx=0x7f7444024e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.463+0000 7f732e7fc640 1 -- 172.21.15.133:0/1933362201 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7444025930 con 0x5648f4117670 2024-02-15T22:57:23.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.463+0000 7f732e7fc640 1 -- 172.21.15.133:0/1933362201 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444025a90 con 0x5648f4117670 2024-02-15T22:57:23.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.463+0000 7f732e7fc640 1 -- 172.21.15.133:0/1933362201 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f744401bc80 con 0x5648f4117670 2024-02-15T22:57:23.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.463+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648f411ed70 con 0x5648f4117670 2024-02-15T22:57:23.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.463+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648f411ed70 con 0x5648f4117670 2024-02-15T22:57:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.464+0000 7f732e7fc640 1 -- 172.21.15.133:0/1933362201 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f744400cc60 con 0x5648f4117670 2024-02-15T22:57:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.464+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.464+0000 7f732e7fc640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7324036790 0x7f7324038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.464+0000 7f732e7fc640 1 -- 172.21.15.133:0/1933362201 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f744404fda0 con 0x5648f4117670 2024-02-15T22:57:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.464+0000 7f7459668640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7324036790 0x7f7324038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.464+0000 7f745d133800 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5648f412a040 0x5648f412c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.464+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f412cc50 con 0x5648f412a040 2024-02-15T22:57:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.464+0000 7f7458e67640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5648f412a040 0x5648f412c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f7459668640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7324036790 0x7f7324038c50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f745400b010 tx=0x7f7454020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f7458e67640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5648f412a040 0x5648f412c500 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f744c059040 con 0x5648f412a040 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f745d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f745d133800 20 realm 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f412d020 con 0x5648f412a040 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f744c059040 con 0x5648f412a040 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f745d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f745d133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f412d870 con 0x5648f412a040 2024-02-15T22:57:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f744c059040 con 0x5648f412a040 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f745d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.465+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f412dbd0 con 0x5648f412a040 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.466+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f744c059040 con 0x5648f412a040 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.466+0000 7f745d133800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.466+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.466+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f412d510 con 0x5648f412a040 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.466+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.466+0000 7f745d133800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.466+0000 7f745d133800 20 searching for the correct realm 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.466+0000 7f745d133800 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5648f412ff90 0x5648f4132380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.466+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412ff90 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.466+0000 7f7453fff640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5648f412ff90 0x5648f4132380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.466+0000 7f7453fff640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5648f412ff90 0x5648f4132380 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.467+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.467+0000 7f7453fff640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f74440234d0 0x7f744403b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.467+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74440234d0 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.467+0000 7f7459668640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f74440234d0 0x7f744403b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.467+0000 7f7459668640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f74440234d0 0x7f744403b9a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.467+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f745400a4a0 con 0x7f74440234d0 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.467+0000 7f7459668640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f74540141d0 0x7f7454015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.467+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74540141d0 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.468+0000 7f7458e67640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f74540141d0 0x7f7454015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.468+0000 7f7458e67640 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f74540141d0 0x7f7454015940 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.468+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.468+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412a040 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.468+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.468+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412a040 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.469+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.469+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74540141d0 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.469+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.469+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74540141d0 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.469+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.469+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74440234d0 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.469+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f745400a4a0 con 0x7f74440234d0 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.469+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412ff90 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.470+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.470+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412a040 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.470+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.470+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74540141d0 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.470+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.470+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412a040 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.470+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.470+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74440234d0 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.471+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f745403a040 con 0x7f74440234d0 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.471+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412ff90 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.471+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.471+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412ff90 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.471+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.471+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74540141d0 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.472+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.472+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412ff90 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.472+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.472+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412ff90 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.472+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.472+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412a040 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.472+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.472+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412a040 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.472+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.472+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74540141d0 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.473+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.473+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412ff90 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.473+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.473+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74440234d0 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.473+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f745403a040 con 0x7f74440234d0 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.473+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412a040 2024-02-15T22:57:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.474+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.474+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74540141d0 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.474+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.474+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412ff90 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.474+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.474+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74540141d0 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.475+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.475+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74440234d0 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.475+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f745403a040 con 0x7f74440234d0 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.475+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412ff90 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.475+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.475+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74540141d0 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x5648f412a040 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132a00 con 0x7f74440234d0 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f745403a040 con 0x7f74440234d0 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f745d133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f745d133800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f745d133800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f745d133800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f745d133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f745d133800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f412ea70 con 0x5648f412a040 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f745d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.476+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f412e6f0 con 0x5648f412a040 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f412f400 con 0x5648f412a040 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 20 zone default found 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 4 Realm: () 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 20 zonegroup default 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4132e20 con 0x7f74540141d0 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.477+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4134bb0 con 0x5648f412ff90 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.478+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.478+0000 7f745d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.478+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.478+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4134f10 con 0x5648f412ff90 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.478+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.478+0000 7f745d133800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.478+0000 7f745d133800 20 started sync module instance, tier type = 2024-02-15T22:57:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.478+0000 7f745d133800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.478+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4134490 con 0x7f74440234d0 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.479+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f745403a040 con 0x7f74440234d0 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.479+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94871332536304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4134410 con 0x7f74440234d0 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.479+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4135c70 con 0x5648f412a040 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.480+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94871332536304] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f745403a040 con 0x7f74440234d0 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.480+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.480+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94871332541232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4135bf0 con 0x5648f412a040 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.480+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f41365a0 con 0x5648f412ff90 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.481+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.481+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94871332544704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4136e20 con 0x5648f412ff90 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.482+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f41378b0 con 0x7f74440234d0 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.482+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94871332541232] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.483+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f745403a040 con 0x7f74440234d0 2024-02-15T22:57:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.483+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94871332549584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4137c60 con 0x7f74440234d0 2024-02-15T22:57:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.483+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94871332544704] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.483+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4138670 con 0x5648f412a040 2024-02-15T22:57:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.483+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94871332549584] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f745403a040 con 0x7f74440234d0 2024-02-15T22:57:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.484+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.484+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94871332542288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4138190 con 0x5648f412a040 2024-02-15T22:57:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.484+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4138ef0 con 0x7f74540141d0 2024-02-15T22:57:23.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.485+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.485+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94871332542288] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.485+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94871332554560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4139000 con 0x7f74540141d0 2024-02-15T22:57:23.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.485+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4139580 con 0x7f74540141d0 2024-02-15T22:57:23.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.486+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94871332554560] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.486+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.486+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94871332546944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4139760 con 0x7f74540141d0 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.486+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4139f60 con 0x7f74540141d0 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.487+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94871332546944] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.487+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.487+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94871332558688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f413a020 con 0x7f74540141d0 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.487+0000 7f745d133800 20 add_watcher() i=0 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.487+0000 7f745d133800 20 add_watcher() i=1 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.487+0000 7f745d133800 20 add_watcher() i=2 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.487+0000 7f745d133800 20 add_watcher() i=3 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.487+0000 7f745d133800 20 add_watcher() i=4 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.487+0000 7f745d133800 20 add_watcher() i=5 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.487+0000 7f745d133800 20 add_watcher() i=6 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.488+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94871332558688] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.488+0000 7f745d133800 20 add_watcher() i=7 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.488+0000 7f745d133800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.488+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f413d480 con 0x5648f412a040 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.489+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.489+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94871332572800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f413a190 con 0x5648f412a040 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.490+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94871332572800] v32'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.490+0000 7f730efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.490+0000 7f745d133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.490+0000 7f745d133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.490+0000 7f745d133800 5 note: GC not initialized 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.490+0000 7f730dfe3640 20 reqs_thread_entry: start 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.490+0000 7f745d133800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.490+0000 7f745d133800 20 Filter name: none 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.490+0000 7f727f7fe640 20 reqs_thread_entry: start 2024-02-15T22:57:23.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.490+0000 7f745d133800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.490+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f416f010 con 0x5648f412a040 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.491+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.491+0000 7f745d133800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.491+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f416f010 con 0x7f74540141d0 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.492+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.492+0000 7f730efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.492+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94871332572800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f416f010 con 0x5648f412a040 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.493+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94871332572800] v32'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.493+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94871332536304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f416f010 con 0x7f74440234d0 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.494+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94871332536304] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f745403a040 con 0x7f74440234d0 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.494+0000 7f745d133800 20 remove_watcher() i=0 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.494+0000 7f745d133800 2 removed watcher, disabling cache 2024-02-15T22:57:23.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.494+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94871332541232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f416f010 con 0x5648f412a040 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.496+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94871332541232] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.496+0000 7f745d133800 20 remove_watcher() i=1 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.496+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94871332544704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f416f010 con 0x5648f412ff90 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.497+0000 7f7453fff640 1 -- 172.21.15.133:0/1933362201 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94871332544704] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7444034020 con 0x5648f412ff90 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.497+0000 7f745d133800 20 remove_watcher() i=2 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.497+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94871332549584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4135330 con 0x7f74440234d0 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.498+0000 7f7459668640 1 -- 172.21.15.133:0/1933362201 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94871332549584] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f745403a040 con 0x7f74440234d0 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.498+0000 7f745d133800 20 remove_watcher() i=3 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.498+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94871332542288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f41373d0 con 0x5648f412a040 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.499+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94871332542288] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x5648f412a040 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.499+0000 7f745d133800 20 remove_watcher() i=4 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.499+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94871332554560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f41357d0 con 0x7f74540141d0 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.500+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94871332554560] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.500+0000 7f745d133800 20 remove_watcher() i=5 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.500+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94871332546944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4133ff0 con 0x7f74540141d0 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.501+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94871332546944] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.501+0000 7f745d133800 20 remove_watcher() i=6 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.501+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94871332558688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5648f4133ff0 con 0x7f74540141d0 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.502+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94871332558688] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f744c07e040 con 0x7f74540141d0 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.502+0000 7f745d133800 20 remove_watcher() i=7 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.502+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f74540141d0 msgr2=0x7f7454015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.502+0000 7f745d133800 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f74540141d0 0x7f7454015940 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.502+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5648f412a040 msgr2=0x5648f412c500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.502+0000 7f745d133800 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5648f412a040 0x5648f412c500 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.502+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f74440234d0 msgr2=0x7f744403b9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.502+0000 7f745d133800 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f74440234d0 0x7f744403b9a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.502+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5648f412ff90 msgr2=0x5648f4132380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.502+0000 7f745d133800 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5648f412ff90 0x5648f4132380 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.502+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7324036790 msgr2=0x7f7324038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f7324036790 0x7f7324038c50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f745400b010 tx=0x7f7454020000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 msgr2=0x5648f411e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/1933362201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f4117670 0x5648f411e630 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f744401afd0 tx=0x7f7444024e90 comp rx=0 tx=0).stop 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 reap_dead start 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f7458e67640 1 -- 172.21.15.133:0/1933362201 reap_dead start 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 shutdown_connections 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 >> 172.21.15.133:0/1933362201 conn(0x5648f4113990 msgr2=0x5648f4110ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 shutdown_connections 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/1933362201 wait complete. 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/2107647874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73300367e0 msgr2=0x7f7330038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/2107647874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73300367e0 0x7f7330038ca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5648f40f8380 tx=0x7f7454005840 comp rx=0 tx=0).stop 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/2107647874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3ff96e0 msgr2=0x5648f3ff7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/2107647874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3ff96e0 0x5648f3ff7b50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7444001ed0 tx=0x7f744400d7a0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/2107647874 shutdown_connections 2024-02-15T22:57:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/2107647874 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73300367e0 0x7f7330038ca0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/2107647874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3ff96e0 0x5648f3ff7b50 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/2107647874 >> 172.21.15.133:0/2107647874 conn(0x5648f40fc1f0 msgr2=0x5648f40fc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/2107647874 shutdown_connections 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/2107647874 wait complete. 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5648f3ffc0c0 msgr2=0x5648f40f7440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5648f3ffc0c0 0x5648f40f7440 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73400367e0 msgr2=0x7f7340038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73400367e0 0x7f7340038ca0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7444000f60 tx=0x7f74440012b0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 msgr2=0x5648f40f06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40f06b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f744c00a470 tx=0x7f744c002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 shutdown_connections 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5648f3ffc0c0 0x5648f40f7440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f73400367e0 0x7f7340038ca0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 --2- 172.21.15.133:0/3854310295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648f3f6c120 0x5648f40f06b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.503+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 >> 172.21.15.133:0/3854310295 conn(0x5648f3ff34f0 msgr2=0x5648f40e3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.504+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 shutdown_connections 2024-02-15T22:57:23.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.504+0000 7f745d133800 1 -- 172.21.15.133:0/3854310295 wait complete. 2024-02-15T22:57:23.516 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-02-15T22:57:23.516 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-02-15T22:57:23.516 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-15T22:57:23.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-15T22:57:23.516 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-02-15T22:57:23.561 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:23.561 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.559+0000 7f45c6733800 1 Processor -- start 2024-02-15T22:57:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.559+0000 7f45c6733800 1 -- start start 2024-02-15T22:57:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.559+0000 7f45c6733800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5556a698c4d0 0x5556a698e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.559+0000 7f45c6733800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5556a68d2ba0 con 0x5556a6988040 2024-02-15T22:57:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.559+0000 7f45c6733800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5556a688a450 con 0x5556a698c4d0 2024-02-15T22:57:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.560+0000 7f45c1cf8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5556a698c4d0 0x5556a698e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.560+0000 7f45c1cf8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5556a698c4d0 0x5556a698e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33326/0 (socket says 172.21.15.133:33326) 2024-02-15T22:57:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.560+0000 7f45c1cf8640 1 -- 172.21.15.133:0/3444146604 learned_addr learned my addr 172.21.15.133:0/3444146604 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.560+0000 7f45c24f9640 1 --1- 172.21.15.133:0/3444146604 >> v1:172.21.15.52:6789/0 conn(0x5556a6988040 0x5556a6988460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45256/0 (socket says 172.21.15.133:45256) 2024-02-15T22:57:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.560+0000 7f45c1cf8640 1 -- 172.21.15.133:0/3444146604 >> v1:172.21.15.52:6789/0 conn(0x5556a6988040 legacy=0x5556a6988460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.560+0000 7f45c1cf8640 1 -- 172.21.15.133:0/3444146604 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556a698fef0 con 0x5556a698c4d0 2024-02-15T22:57:23.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.562+0000 7f45c1cf8640 1 --2- 172.21.15.133:0/3444146604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a698c4d0 0x5556a698e8c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00a520 tx=0x7f45ac01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d93b0fae07c0ef server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.562+0000 7f45c14f7640 1 -- 172.21.15.133:0/3444146604 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ac052570 con 0x5556a698c4d0 2024-02-15T22:57:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.562+0000 7f45c14f7640 1 -- 172.21.15.133:0/3444146604 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac0526d0 con 0x5556a698c4d0 2024-02-15T22:57:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.562+0000 7f45c14f7640 1 -- 172.21.15.133:0/3444146604 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ac052990 con 0x5556a698c4d0 2024-02-15T22:57:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.562+0000 7f45c6733800 1 -- 172.21.15.133:0/3444146604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a698c4d0 msgr2=0x5556a698e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.562+0000 7f45c6733800 1 --2- 172.21.15.133:0/3444146604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a698c4d0 0x5556a698e8c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00a520 tx=0x7f45ac01cee0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.562+0000 7f45c6733800 1 -- 172.21.15.133:0/3444146604 shutdown_connections 2024-02-15T22:57:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.562+0000 7f45c6733800 1 --2- 172.21.15.133:0/3444146604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a698c4d0 0x5556a698e8c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.562+0000 7f45c6733800 1 -- 172.21.15.133:0/3444146604 >> 172.21.15.133:0/3444146604 conn(0x5556a69835e0 msgr2=0x5556a6985a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.562+0000 7f45c6733800 1 -- 172.21.15.133:0/3444146604 shutdown_connections 2024-02-15T22:57:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.562+0000 7f45c6733800 1 -- 172.21.15.133:0/3444146604 wait complete. 2024-02-15T22:57:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.574+0000 7f45c6733800 1 Processor -- start 2024-02-15T22:57:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.574+0000 7f45c6733800 1 -- start start 2024-02-15T22:57:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.574+0000 7f45c6733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a68fd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.574+0000 7f45c6733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556a6887980 con 0x5556a6988040 2024-02-15T22:57:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.574+0000 7f45c24f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a68fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.574+0000 7f45c24f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a68fd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33336/0 (socket says 172.21.15.133:33336) 2024-02-15T22:57:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.574+0000 7f45c24f9640 1 -- 172.21.15.133:0/4013040463 learned_addr learned my addr 172.21.15.133:0/4013040463 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.575+0000 7f45c24f9640 1 -- 172.21.15.133:0/4013040463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac005de0 con 0x5556a6988040 2024-02-15T22:57:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.575+0000 7f45c24f9640 1 --2- 172.21.15.133:0/4013040463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a68fd070 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f45bc001d30 tx=0x7f45bc00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3c4a912198d3e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.575+0000 7f44b0608640 1 -- 172.21.15.133:0/4013040463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45bc014070 con 0x5556a6988040 2024-02-15T22:57:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.575+0000 7f44b0608640 1 -- 172.21.15.133:0/4013040463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00f450 con 0x5556a6988040 2024-02-15T22:57:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.575+0000 7f44b0608640 1 -- 172.21.15.133:0/4013040463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45bc00f730 con 0x5556a6988040 2024-02-15T22:57:23.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c6733800 1 -- 172.21.15.133:0/4013040463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 msgr2=0x5556a68fd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c6733800 1 --2- 172.21.15.133:0/4013040463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a68fd070 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f45bc001d30 tx=0x7f45bc00b600 comp rx=0 tx=0).stop 2024-02-15T22:57:23.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c6733800 1 -- 172.21.15.133:0/4013040463 shutdown_connections 2024-02-15T22:57:23.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c6733800 1 --2- 172.21.15.133:0/4013040463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a68fd070 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c6733800 1 -- 172.21.15.133:0/4013040463 >> 172.21.15.133:0/4013040463 conn(0x5556a69835e0 msgr2=0x5556a6a739b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c6733800 1 -- 172.21.15.133:0/4013040463 shutdown_connections 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c6733800 1 -- 172.21.15.133:0/4013040463 wait complete. 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c6733800 1 Processor -- start 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c6733800 1 -- start start 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c6733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a6a818f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c6733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556a6883160 con 0x5556a6988040 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c24f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a6a818f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c24f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a6a818f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33338/0 (socket says 172.21.15.133:33338) 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.576+0000 7f45c24f9640 1 -- 172.21.15.133:0/3635132526 learned_addr learned my addr 172.21.15.133:0/3635132526 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.577+0000 7f45c24f9640 1 -- 172.21.15.133:0/3635132526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556a68d2ba0 con 0x5556a6988040 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.577+0000 7f45c24f9640 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a6a818f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x5556a68fc6a0 tx=0x7f45bc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.577+0000 7f44aee05640 1 -- 172.21.15.133:0/3635132526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45bc014050 con 0x5556a6988040 2024-02-15T22:57:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.577+0000 7f44aee05640 1 -- 172.21.15.133:0/3635132526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc01b790 con 0x5556a6988040 2024-02-15T22:57:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.577+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5556a6a81e30 con 0x5556a6988040 2024-02-15T22:57:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.577+0000 7f44aee05640 1 -- 172.21.15.133:0/3635132526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45bc01ba70 con 0x5556a6988040 2024-02-15T22:57:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.577+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556a6a82310 con 0x5556a6988040 2024-02-15T22:57:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.578+0000 7f44aee05640 1 -- 172.21.15.133:0/3635132526 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f45bc022020 con 0x5556a6988040 2024-02-15T22:57:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.578+0000 7f44aee05640 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44a8036790 0x7f44a8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.578+0000 7f44aee05640 1 -- 172.21.15.133:0/3635132526 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f45bc008030 con 0x5556a6988040 2024-02-15T22:57:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.578+0000 7f45c1cf8640 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44a8036790 0x7f44a8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.578+0000 7f45c6733800 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5556a698c4d0 0x5556a6a88680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.578+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6a88c50 con 0x5556a698c4d0 2024-02-15T22:57:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.578+0000 7f45c2cfa640 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5556a698c4d0 0x5556a6a88680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.579+0000 7f45c1cf8640 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44a8036790 0x7f44a8038c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f45ac054000 tx=0x7f45ac04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.579+0000 7f45c2cfa640 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5556a698c4d0 0x5556a6a88680 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.579+0000 7f45c2cfa640 1 -- 172.21.15.133:0/3635132526 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f45b400a4a0 con 0x5556a698c4d0 2024-02-15T22:57:23.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.579+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6a85d00 con 0x5556a698c4d0 2024-02-15T22:57:23.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.579+0000 7f45c2cfa640 1 -- 172.21.15.133:0/3635132526 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f45b400a4a0 con 0x5556a698c4d0 2024-02-15T22:57:23.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.579+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6a89120 con 0x5556a698c4d0 2024-02-15T22:57:23.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.579+0000 7f45c2cfa640 1 -- 172.21.15.133:0/3635132526 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f45b400a4a0 con 0x5556a698c4d0 2024-02-15T22:57:23.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.579+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6a89e10 con 0x5556a698c4d0 2024-02-15T22:57:23.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.580+0000 7f45c2cfa640 1 -- 172.21.15.133:0/3635132526 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f45b400a4a0 con 0x5556a698c4d0 2024-02-15T22:57:23.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.580+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6a8a220 con 0x5556a698c4d0 2024-02-15T22:57:23.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.580+0000 7f45c2cfa640 1 -- 172.21.15.133:0/3635132526 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f45b400a4a0 con 0x5556a698c4d0 2024-02-15T22:57:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.580+0000 7f45c6733800 1 Processor -- start 2024-02-15T22:57:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.580+0000 7f45c6733800 1 -- start start 2024-02-15T22:57:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.581+0000 7f45c6733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6a99400 0x5556a6a99820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.581+0000 7f45c6733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556a6825e80 con 0x5556a6a99400 2024-02-15T22:57:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.581+0000 7f45c1cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6a99400 0x5556a6a99820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.581+0000 7f45c1cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6a99400 0x5556a6a99820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33340/0 (socket says 172.21.15.133:33340) 2024-02-15T22:57:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.581+0000 7f45c1cf8640 1 -- 172.21.15.133:0/2567950576 learned_addr learned my addr 172.21.15.133:0/2567950576 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.581+0000 7f45c1cf8640 1 -- 172.21.15.133:0/2567950576 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556a6a99d60 con 0x5556a6a99400 2024-02-15T22:57:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.581+0000 7f45c1cf8640 1 --2- 172.21.15.133:0/2567950576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6a99400 0x5556a6a99820 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f45ac000c00 tx=0x7f45ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.581+0000 7f44a7fff640 1 -- 172.21.15.133:0/2567950576 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ac05dcb0 con 0x5556a6a99400 2024-02-15T22:57:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.582+0000 7f44a7fff640 1 -- 172.21.15.133:0/2567950576 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac05de10 con 0x5556a6a99400 2024-02-15T22:57:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.582+0000 7f45c6733800 1 -- 172.21.15.133:0/2567950576 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5556a6a99f50 con 0x5556a6a99400 2024-02-15T22:57:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.582+0000 7f44a7fff640 1 -- 172.21.15.133:0/2567950576 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ac069530 con 0x5556a6a99400 2024-02-15T22:57:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.582+0000 7f45c6733800 1 -- 172.21.15.133:0/2567950576 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556a6a9aaa0 con 0x5556a6a99400 2024-02-15T22:57:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.582+0000 7f44a7fff640 1 -- 172.21.15.133:0/2567950576 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f45ac059040 con 0x5556a6a99400 2024-02-15T22:57:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.583+0000 7f44a7fff640 1 --2- 172.21.15.133:0/2567950576 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f449c0367e0 0x7f449c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.583+0000 7f44a7fff640 1 -- 172.21.15.133:0/2567950576 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f45ac08f5a0 con 0x5556a6a99400 2024-02-15T22:57:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.583+0000 7f45c2cfa640 1 --2- 172.21.15.133:0/2567950576 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f449c0367e0 0x7f449c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.583+0000 7f45c6733800 1 Processor -- start 2024-02-15T22:57:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.583+0000 7f45c6733800 1 -- start start 2024-02-15T22:57:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.583+0000 7f45c2cfa640 1 --2- 172.21.15.133:0/2567950576 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f449c0367e0 0x7f449c038ca0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5556a6a85c20 tx=0x7f45b4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.583+0000 7f45c6733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aa69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.583+0000 7f45c6733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556a67fb5d0 con 0x5556a6aa65c0 2024-02-15T22:57:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.583+0000 7f45c1cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aa69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.583+0000 7f45c1cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aa69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33352/0 (socket says 172.21.15.133:33352) 2024-02-15T22:57:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.583+0000 7f45c1cf8640 1 -- 172.21.15.133:0/1725176563 learned_addr learned my addr 172.21.15.133:0/1725176563 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f45c1cf8640 1 -- 172.21.15.133:0/1725176563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556a6aa6fb0 con 0x5556a6aa65c0 2024-02-15T22:57:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f45c1cf8640 1 --2- 172.21.15.133:0/1725176563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aa69e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00a3f0 tx=0x7f45ac006870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d020c12cec5543fc server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f44a5ffb640 1 -- 172.21.15.133:0/1725176563 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ac0727e0 con 0x5556a6aa65c0 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f44a5ffb640 1 -- 172.21.15.133:0/1725176563 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac073460 con 0x5556a6aa65c0 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f44a5ffb640 1 -- 172.21.15.133:0/1725176563 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ac068360 con 0x5556a6aa65c0 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f45c6733800 1 -- 172.21.15.133:0/1725176563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 msgr2=0x5556a6aa69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f45c6733800 1 --2- 172.21.15.133:0/1725176563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aa69e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00a3f0 tx=0x7f45ac006870 comp rx=0 tx=0).stop 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f45c6733800 1 -- 172.21.15.133:0/1725176563 shutdown_connections 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f45c6733800 1 --2- 172.21.15.133:0/1725176563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aa69e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f45c6733800 1 -- 172.21.15.133:0/1725176563 >> 172.21.15.133:0/1725176563 conn(0x5556a6aa2920 msgr2=0x5556a6aa0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f45c6733800 1 -- 172.21.15.133:0/1725176563 shutdown_connections 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.584+0000 7f45c6733800 1 -- 172.21.15.133:0/1725176563 wait complete. 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.585+0000 7f45c6733800 1 Processor -- start 2024-02-15T22:57:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.585+0000 7f45c6733800 1 -- start start 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.585+0000 7f45c6733800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.585+0000 7f45c6733800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556a6aadb10 con 0x5556a6aa65c0 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.585+0000 7f45c1cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.585+0000 7f45c1cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aad5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33360/0 (socket says 172.21.15.133:33360) 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.585+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 learned_addr learned my addr 172.21.15.133:0/992393161 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.585+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556a6a9aaa0 con 0x5556a6aa65c0 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.586+0000 7f45c1cf8640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aad5d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0068b0 tx=0x7f45ac08d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.586+0000 7f4493fff640 1 -- 172.21.15.133:0/992393161 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ac08db80 con 0x5556a6aa65c0 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.586+0000 7f4493fff640 1 -- 172.21.15.133:0/992393161 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac072cb0 con 0x5556a6aa65c0 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.586+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5556a6aadd10 con 0x5556a6aa65c0 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.586+0000 7f4493fff640 1 -- 172.21.15.133:0/992393161 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ac06a030 con 0x5556a6aa65c0 2024-02-15T22:57:23.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.586+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556a6aadd10 con 0x5556a6aa65c0 2024-02-15T22:57:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.587+0000 7f4493fff640 1 -- 172.21.15.133:0/992393161 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f45ac06a190 con 0x5556a6aa65c0 2024-02-15T22:57:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.587+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.587+0000 7f4493fff640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f448c036790 0x7f448c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.587+0000 7f4493fff640 1 -- 172.21.15.133:0/992393161 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f45ac0910d0 con 0x5556a6aa65c0 2024-02-15T22:57:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.587+0000 7f45c2cfa640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f448c036790 0x7f448c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.587+0000 7f45c6733800 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5556a6ab9040 0x5556a6abb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.587+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abbc20 con 0x5556a6ab9040 2024-02-15T22:57:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.587+0000 7f45c24f9640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5556a6ab9040 0x5556a6abb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.587+0000 7f45c2cfa640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f448c036790 0x7f448c038c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f45b400b010 tx=0x7f45b4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.587+0000 7f45c24f9640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5556a6ab9040 0x5556a6abb4d0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f45bc016070 con 0x5556a6ab9040 2024-02-15T22:57:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 20 realm 2024-02-15T22:57:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abbff0 con 0x5556a6ab9040 2024-02-15T22:57:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f45bc016070 con 0x5556a6ab9040 2024-02-15T22:57:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abc870 con 0x5556a6ab9040 2024-02-15T22:57:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f45bc016070 con 0x5556a6ab9040 2024-02-15T22:57:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abcbd0 con 0x5556a6ab9040 2024-02-15T22:57:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f45bc016070 con 0x5556a6ab9040 2024-02-15T22:57:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.588+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abc4d0 con 0x5556a6ab9040 2024-02-15T22:57:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.589+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f45bc016070 con 0x5556a6ab9040 2024-02-15T22:57:23.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.589+0000 7f45c6733800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.589+0000 7f45c6733800 20 searching for the correct realm 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.589+0000 7f45c6733800 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5556a6abede0 0x5556a6ac11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.589+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac1710 con 0x5556a6abede0 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.589+0000 7f45c1cf8640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5556a6abede0 0x5556a6ac11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.589+0000 7f45c1cf8640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5556a6abede0 0x5556a6ac11d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.589+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.590+0000 7f45c1cf8640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f45ac087070 0x7f45ac0686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.590+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac1710 con 0x7f45ac087070 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.590+0000 7f45c2cfa640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f45ac087070 0x7f45ac0686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.590+0000 7f45c2cfa640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f45ac087070 0x7f45ac0686f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.590+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45b400a4a0 con 0x7f45ac087070 2024-02-15T22:57:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.590+0000 7f45c2cfa640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f45b40141d0 0x7f45b4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.590+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac1710 con 0x7f45b40141d0 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.590+0000 7f45c24f9640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f45b40141d0 0x7f45b4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.591+0000 7f45c24f9640 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f45b40141d0 0x7f45b4015940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.591+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc016070 con 0x7f45b40141d0 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.591+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abcbd0 con 0x5556a6ab9040 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.592+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc016070 con 0x5556a6ab9040 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.592+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abcbd0 con 0x5556a6ab9040 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.592+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc037040 con 0x5556a6ab9040 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.592+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abcbd0 con 0x7f45b40141d0 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.592+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc037040 con 0x7f45b40141d0 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.592+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abcbd0 con 0x7f45b40141d0 2024-02-15T22:57:23.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.592+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc037040 con 0x7f45b40141d0 2024-02-15T22:57:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.592+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x7f45ac087070 2024-02-15T22:57:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.592+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45b400a4a0 con 0x7f45ac087070 2024-02-15T22:57:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.592+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6abede0 2024-02-15T22:57:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.593+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.593+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6ab9040 2024-02-15T22:57:23.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.593+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc037040 con 0x5556a6ab9040 2024-02-15T22:57:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.593+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x7f45b40141d0 2024-02-15T22:57:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.593+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc037040 con 0x7f45b40141d0 2024-02-15T22:57:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.593+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6ab9040 2024-02-15T22:57:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.593+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc037040 con 0x5556a6ab9040 2024-02-15T22:57:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.594+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x7f45ac087070 2024-02-15T22:57:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.594+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f45b403a040 con 0x7f45ac087070 2024-02-15T22:57:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.594+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6abede0 2024-02-15T22:57:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.594+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.594+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6abede0 2024-02-15T22:57:23.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.594+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.594+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x7f45b40141d0 2024-02-15T22:57:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.595+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc037040 con 0x7f45b40141d0 2024-02-15T22:57:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.595+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6abede0 2024-02-15T22:57:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.595+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.595+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6abede0 2024-02-15T22:57:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.595+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.595+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6ab9040 2024-02-15T22:57:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.595+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc037040 con 0x5556a6ab9040 2024-02-15T22:57:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.595+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6ab9040 2024-02-15T22:57:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.595+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.595+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x7f45b40141d0 2024-02-15T22:57:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.596+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.596+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6abede0 2024-02-15T22:57:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.596+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.596+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x7f45ac087070 2024-02-15T22:57:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.596+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45b403a040 con 0x7f45ac087070 2024-02-15T22:57:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.596+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6ab9040 2024-02-15T22:57:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.597+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.597+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x7f45b40141d0 2024-02-15T22:57:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.597+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.597+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6abede0 2024-02-15T22:57:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.597+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.597+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x7f45b40141d0 2024-02-15T22:57:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.597+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.597+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x7f45ac087070 2024-02-15T22:57:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.598+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45b403a040 con 0x7f45ac087070 2024-02-15T22:57:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.598+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6abede0 2024-02-15T22:57:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.598+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.598+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x7f45b40141d0 2024-02-15T22:57:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x5556a6ab9040 2024-02-15T22:57:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f45bc03c040 con 0x7f45ac087070 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45b403a040 con 0x7f45ac087070 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c6733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c6733800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c6733800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c6733800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c6733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c6733800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abcbd0 con 0x5556a6ab9040 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abd8c0 con 0x5556a6ab9040 2024-02-15T22:57:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.599+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abd8c0 con 0x5556a6ab9040 2024-02-15T22:57:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 20 zone default found 2024-02-15T22:57:23.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 4 Realm: () 2024-02-15T22:57:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 20 zonegroup default 2024-02-15T22:57:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abd7e0 con 0x7f45b40141d0 2024-02-15T22:57:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6abd7e0 con 0x5556a6abede0 2024-02-15T22:57:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.600+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac3110 con 0x5556a6abede0 2024-02-15T22:57:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.601+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.601+0000 7f45c6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.601+0000 7f45c6733800 20 started sync module instance, tier type = 2024-02-15T22:57:23.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.601+0000 7f45c6733800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:23.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.601+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac25b0 con 0x7f45ac087070 2024-02-15T22:57:23.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.602+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45b403a040 con 0x7f45ac087070 2024-02-15T22:57:23.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.602+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93830651849360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac3530 con 0x7f45ac087070 2024-02-15T22:57:23.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.602+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac3d30 con 0x5556a6ab9040 2024-02-15T22:57:23.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.603+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93830651849360] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45b403a040 con 0x7f45ac087070 2024-02-15T22:57:23.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.603+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.603+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93830651852080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac3df0 con 0x5556a6ab9040 2024-02-15T22:57:23.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.603+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac4760 con 0x5556a6abede0 2024-02-15T22:57:23.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.604+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93830651852080] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.604+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.604+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93830651853136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac3d70 con 0x5556a6abede0 2024-02-15T22:57:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.604+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac55f0 con 0x7f45ac087070 2024-02-15T22:57:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.605+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45b403a040 con 0x7f45ac087070 2024-02-15T22:57:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.605+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93830651859760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac5d70 con 0x7f45ac087070 2024-02-15T22:57:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.605+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac6840 con 0x5556a6ab9040 2024-02-15T22:57:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.605+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93830651853136] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.606+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93830651859760] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45b403a040 con 0x7f45ac087070 2024-02-15T22:57:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.606+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.606+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93830651863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac5d30 con 0x5556a6ab9040 2024-02-15T22:57:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.606+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac7090 con 0x7f45b40141d0 2024-02-15T22:57:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.607+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93830651863840] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.608+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.608+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93830651857728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac5d10 con 0x7f45b40141d0 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.608+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac76f0 con 0x7f45b40141d0 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.609+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93830651857728] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.609+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.609+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93830651867664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac76f0 con 0x7f45b40141d0 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.609+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac8100 con 0x7f45b40141d0 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.610+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93830651867664] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.610+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.610+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93830651865968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac8100 con 0x7f45b40141d0 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.610+0000 7f45c6733800 20 add_watcher() i=0 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.610+0000 7f45c6733800 20 add_watcher() i=1 2024-02-15T22:57:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.610+0000 7f45c6733800 20 add_watcher() i=2 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.610+0000 7f45c6733800 20 add_watcher() i=3 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.610+0000 7f45c6733800 20 add_watcher() i=4 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.610+0000 7f45c6733800 20 add_watcher() i=5 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.610+0000 7f45c6733800 20 add_watcher() i=6 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.611+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93830651865968] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.611+0000 7f45c6733800 20 add_watcher() i=7 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.611+0000 7f45c6733800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.611+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6acb640 con 0x5556a6ab9040 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.611+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.612+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93830651870192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac8990 con 0x5556a6ab9040 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.612+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93830651870192] v32'204 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.613+0000 7f4478fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.613+0000 7f45c6733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.613+0000 7f45c6733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.613+0000 7f45c6733800 5 note: GC not initialized 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.613+0000 7f43f37fe640 20 reqs_thread_entry: start 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.613+0000 7f45c6733800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.613+0000 7f45c6733800 20 Filter name: none 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.613+0000 7f43f17fa640 20 reqs_thread_entry: start 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.613+0000 7f45c6733800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.613+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6afd100 con 0x5556a6ab9040 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.613+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.614+0000 7f45c6733800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.614+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6afe610 con 0x7f45b40141d0 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.614+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.615+0000 7f4478fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.615+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93830651870192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6acaae0 con 0x5556a6ab9040 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.616+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93830651870192] v32'205 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.616+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93830651849360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac7bf0 con 0x7f45ac087070 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.617+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93830651849360] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45b403a040 con 0x7f45ac087070 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.617+0000 7f45c6733800 20 remove_watcher() i=0 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.617+0000 7f45c6733800 2 removed watcher, disabling cache 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.617+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93830651852080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac7bf0 con 0x5556a6ab9040 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.618+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93830651852080] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.618+0000 7f45c6733800 20 remove_watcher() i=1 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.618+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93830651853136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac7bf0 con 0x5556a6abede0 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.619+0000 7f45c1cf8640 1 -- 172.21.15.133:0/992393161 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93830651853136] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45ac06f020 con 0x5556a6abede0 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.619+0000 7f45c6733800 20 remove_watcher() i=2 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.619+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93830651859760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac39d0 con 0x7f45ac087070 2024-02-15T22:57:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.620+0000 7f45c2cfa640 1 -- 172.21.15.133:0/992393161 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93830651859760] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45b403a040 con 0x7f45ac087070 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.620+0000 7f45c6733800 20 remove_watcher() i=3 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.620+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93830651863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac39d0 con 0x5556a6ab9040 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.621+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93830651863840] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x5556a6ab9040 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.621+0000 7f45c6733800 20 remove_watcher() i=4 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.621+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93830651857728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac39d0 con 0x7f45b40141d0 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.623+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93830651857728] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.623+0000 7f45c6733800 20 remove_watcher() i=5 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.623+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93830651867664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac39d0 con 0x7f45b40141d0 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.624+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93830651867664] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.624+0000 7f45c6733800 20 remove_watcher() i=6 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.624+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93830651865968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5556a6ac39d0 con 0x7f45b40141d0 2024-02-15T22:57:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93830651865968] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45bc053060 con 0x7f45b40141d0 2024-02-15T22:57:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 20 remove_watcher() i=7 2024-02-15T22:57:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f45b40141d0 msgr2=0x7f45b4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f45b40141d0 0x7f45b4015940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5556a6ab9040 msgr2=0x5556a6abb4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5556a6ab9040 0x5556a6abb4d0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f45ac087070 msgr2=0x7f45ac0686f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f45ac087070 0x7f45ac0686f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5556a6abede0 msgr2=0x5556a6ac11d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5556a6abede0 0x5556a6ac11d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f448c036790 msgr2=0x7f448c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f448c036790 0x7f448c038c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f45b400b010 tx=0x7f45b4020000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 msgr2=0x5556a6aad5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c24f9640 1 -- 172.21.15.133:0/992393161 reap_dead start 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aad5d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0068b0 tx=0x7f45ac08d910 comp rx=0 tx=0).stop 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 shutdown_connections 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 --2- 172.21.15.133:0/992393161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6aa65c0 0x5556a6aad5d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 >> 172.21.15.133:0/992393161 conn(0x5556a6aa2920 msgr2=0x5556a6a9ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 shutdown_connections 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/992393161 wait complete. 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/2567950576 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f449c0367e0 msgr2=0x7f449c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 --2- 172.21.15.133:0/2567950576 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f449c0367e0 0x7f449c038ca0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5556a6a85c20 tx=0x7f45b4005840 comp rx=0 tx=0).stop 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 -- 172.21.15.133:0/2567950576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6a99400 msgr2=0x5556a6a99820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.625+0000 7f45c6733800 1 --2- 172.21.15.133:0/2567950576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6a99400 0x5556a6a99820 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f45ac000c00 tx=0x7f45ac002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 -- 172.21.15.133:0/2567950576 shutdown_connections 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 --2- 172.21.15.133:0/2567950576 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f449c0367e0 0x7f449c038ca0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 --2- 172.21.15.133:0/2567950576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6a99400 0x5556a6a99820 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 -- 172.21.15.133:0/2567950576 >> 172.21.15.133:0/2567950576 conn(0x5556a6a8d4a0 msgr2=0x5556a6a8d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 -- 172.21.15.133:0/2567950576 shutdown_connections 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 -- 172.21.15.133:0/2567950576 wait complete. 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5556a698c4d0 msgr2=0x5556a6a88680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5556a698c4d0 0x5556a6a88680 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44a8036790 msgr2=0x7f44a8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44a8036790 0x7f44a8038c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f45ac054000 tx=0x7f45ac04e000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 msgr2=0x5556a6a818f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a6a818f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x5556a68fc6a0 tx=0x7f45bc000ed0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 shutdown_connections 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5556a698c4d0 0x5556a6a88680 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f44a8036790 0x7f44a8038c50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 --2- 172.21.15.133:0/3635132526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556a6988040 0x5556a6a818f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 >> 172.21.15.133:0/3635132526 conn(0x5556a69835e0 msgr2=0x5556a68fbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 shutdown_connections 2024-02-15T22:57:23.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.626+0000 7f45c6733800 1 -- 172.21.15.133:0/3635132526 wait complete. 2024-02-15T22:57:23.651 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-02-15T22:57:23.651 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-02-15T22:57:23.651 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-15T22:57:23.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-15T22:57:23.651 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-02-15T22:57:23.696 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:23.696 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:23.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.694+0000 7f876992a800 1 Processor -- start 2024-02-15T22:57:23.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.694+0000 7f876992a800 1 -- start start 2024-02-15T22:57:23.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.694+0000 7f876992a800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55be6d442e90 0x55be6d4432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.694+0000 7f876992a800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55be6d38eba0 con 0x55be6d4440f0 2024-02-15T22:57:23.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.694+0000 7f876992a800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55be6d346450 con 0x55be6d442e90 2024-02-15T22:57:23.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.694+0000 7f8765631640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55be6d442e90 0x55be6d4432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.694+0000 7f8764e30640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55be6d4440f0 0x55be6d444570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45272/0 (socket says 172.21.15.133:45272) 2024-02-15T22:57:23.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.694+0000 7f8764e30640 1 -- 172.21.15.133:0/1355097307 learned_addr learned my addr 172.21.15.133:0/1355097307 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:23.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.695+0000 7f8765631640 1 -- 172.21.15.133:0/1355097307 >> v1:172.21.15.52:6789/0 conn(0x55be6d4440f0 legacy=0x55be6d444570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.695+0000 7f8765631640 1 -- 172.21.15.133:0/1355097307 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be6d443980 con 0x55be6d442e90 2024-02-15T22:57:23.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.697+0000 7f8765631640 1 --2- 172.21.15.133:0/1355097307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d4432b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f875800a470 tx=0x7f875801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399d9274497eb193 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.697+0000 7f8757fff640 1 -- 172.21.15.133:0/1355097307 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8758052570 con 0x55be6d442e90 2024-02-15T22:57:23.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.697+0000 7f8757fff640 1 -- 172.21.15.133:0/1355097307 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87580526d0 con 0x55be6d442e90 2024-02-15T22:57:23.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.697+0000 7f8757fff640 1 -- 172.21.15.133:0/1355097307 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8758052990 con 0x55be6d442e90 2024-02-15T22:57:23.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.698+0000 7f876992a800 1 -- 172.21.15.133:0/1355097307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 msgr2=0x55be6d4432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.698+0000 7f876992a800 1 --2- 172.21.15.133:0/1355097307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d4432b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f875800a470 tx=0x7f875801cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:23.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.698+0000 7f876992a800 1 -- 172.21.15.133:0/1355097307 shutdown_connections 2024-02-15T22:57:23.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.698+0000 7f876992a800 1 --2- 172.21.15.133:0/1355097307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d4432b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.698+0000 7f876992a800 1 -- 172.21.15.133:0/1355097307 >> 172.21.15.133:0/1355097307 conn(0x55be6d43e4f0 msgr2=0x55be6d440910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.698+0000 7f876992a800 1 -- 172.21.15.133:0/1355097307 shutdown_connections 2024-02-15T22:57:23.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.698+0000 7f876992a800 1 -- 172.21.15.133:0/1355097307 wait complete. 2024-02-15T22:57:23.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.710+0000 7f876992a800 1 Processor -- start 2024-02-15T22:57:23.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.711+0000 7f876992a800 1 -- start start 2024-02-15T22:57:23.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.711+0000 7f876992a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d3b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.711+0000 7f876992a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be6d343980 con 0x55be6d442e90 2024-02-15T22:57:23.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.711+0000 7f8765631640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d3b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.711+0000 7f8765631640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d3b6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33372/0 (socket says 172.21.15.133:33372) 2024-02-15T22:57:23.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.711+0000 7f8765631640 1 -- 172.21.15.133:0/1991312252 learned_addr learned my addr 172.21.15.133:0/1991312252 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.711+0000 7f8765631640 1 -- 172.21.15.133:0/1991312252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758005d20 con 0x55be6d442e90 2024-02-15T22:57:23.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.711+0000 7f8765631640 1 --2- 172.21.15.133:0/1991312252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d3b6f50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8758055040 tx=0x7f875804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b5e8def0c1d49f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.712+0000 7f8653606640 1 -- 172.21.15.133:0/1991312252 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f875800a180 con 0x55be6d442e90 2024-02-15T22:57:23.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.712+0000 7f8653606640 1 -- 172.21.15.133:0/1991312252 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875800a2e0 con 0x55be6d442e90 2024-02-15T22:57:23.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.712+0000 7f8653606640 1 -- 172.21.15.133:0/1991312252 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87580529b0 con 0x55be6d442e90 2024-02-15T22:57:23.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.712+0000 7f876992a800 1 -- 172.21.15.133:0/1991312252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 msgr2=0x55be6d3b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.712+0000 7f876992a800 1 --2- 172.21.15.133:0/1991312252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d3b6f50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8758055040 tx=0x7f875804c000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.712+0000 7f876992a800 1 -- 172.21.15.133:0/1991312252 shutdown_connections 2024-02-15T22:57:23.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.712+0000 7f876992a800 1 --2- 172.21.15.133:0/1991312252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d3b6f50 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.712+0000 7f876992a800 1 -- 172.21.15.133:0/1991312252 >> 172.21.15.133:0/1991312252 conn(0x55be6d43e4f0 msgr2=0x55be6d52ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.712+0000 7f876992a800 1 -- 172.21.15.133:0/1991312252 shutdown_connections 2024-02-15T22:57:23.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.712+0000 7f876992a800 1 -- 172.21.15.133:0/1991312252 wait complete. 2024-02-15T22:57:23.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.713+0000 7f876992a800 1 Processor -- start 2024-02-15T22:57:23.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.713+0000 7f876992a800 1 -- start start 2024-02-15T22:57:23.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.713+0000 7f876992a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d53ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.713+0000 7f876992a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be6d33f160 con 0x55be6d442e90 2024-02-15T22:57:23.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.713+0000 7f8765631640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d53ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.713+0000 7f8765631640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d53ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33380/0 (socket says 172.21.15.133:33380) 2024-02-15T22:57:23.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.713+0000 7f8765631640 1 -- 172.21.15.133:0/3140921905 learned_addr learned my addr 172.21.15.133:0/3140921905 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.713+0000 7f8765631640 1 -- 172.21.15.133:0/3140921905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875804e070 con 0x55be6d442e90 2024-02-15T22:57:23.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.713+0000 7f8765631640 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d53ba50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f875800a470 tx=0x7f8758002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.714+0000 7f8651e03640 1 -- 172.21.15.133:0/3140921905 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f875806a070 con 0x55be6d442e90 2024-02-15T22:57:23.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.714+0000 7f8651e03640 1 -- 172.21.15.133:0/3140921905 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8758052cc0 con 0x55be6d442e90 2024-02-15T22:57:23.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.714+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be6d53bf90 con 0x55be6d442e90 2024-02-15T22:57:23.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.714+0000 7f8651e03640 1 -- 172.21.15.133:0/3140921905 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f875805d420 con 0x55be6d442e90 2024-02-15T22:57:23.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.714+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be6d53c470 con 0x55be6d442e90 2024-02-15T22:57:23.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.714+0000 7f8651e03640 1 -- 172.21.15.133:0/3140921905 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f875805d580 con 0x55be6d442e90 2024-02-15T22:57:23.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.715+0000 7f8651e03640 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f864c036790 0x7f864c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.715+0000 7f8651e03640 1 -- 172.21.15.133:0/3140921905 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f875808d690 con 0x55be6d442e90 2024-02-15T22:57:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.715+0000 7f8764e30640 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f864c036790 0x7f864c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.715+0000 7f876992a800 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be6d4440f0 0x55be6d542710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.715+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d542c50 con 0x55be6d4440f0 2024-02-15T22:57:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.715+0000 7f8765e32640 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be6d4440f0 0x55be6d542710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.715+0000 7f8764e30640 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f864c036790 0x7f864c038c50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f875c000f60 tx=0x7f875c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.715+0000 7f8765e32640 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be6d4440f0 0x55be6d542710 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.715+0000 7f8765e32640 1 -- 172.21.15.133:0/3140921905 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55be6d4440f0 2024-02-15T22:57:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.716+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d53fe30 con 0x55be6d4440f0 2024-02-15T22:57:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.716+0000 7f8765e32640 1 -- 172.21.15.133:0/3140921905 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f876000a4a0 con 0x55be6d4440f0 2024-02-15T22:57:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.716+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d544980 con 0x55be6d4440f0 2024-02-15T22:57:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.716+0000 7f8765e32640 1 -- 172.21.15.133:0/3140921905 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f876000a4a0 con 0x55be6d4440f0 2024-02-15T22:57:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.716+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d543b80 con 0x55be6d4440f0 2024-02-15T22:57:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.716+0000 7f8765e32640 1 -- 172.21.15.133:0/3140921905 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f876000a4a0 con 0x55be6d4440f0 2024-02-15T22:57:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.716+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d543f90 con 0x55be6d4440f0 2024-02-15T22:57:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.717+0000 7f8765e32640 1 -- 172.21.15.133:0/3140921905 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f876000a4a0 con 0x55be6d4440f0 2024-02-15T22:57:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.717+0000 7f876992a800 1 Processor -- start 2024-02-15T22:57:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.717+0000 7f876992a800 1 -- start start 2024-02-15T22:57:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.717+0000 7f876992a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d553300 0x55be6d553720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.717+0000 7f876992a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be6d2e1e80 con 0x55be6d553300 2024-02-15T22:57:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.718+0000 7f8764e30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d553300 0x55be6d553720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.718+0000 7f8764e30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d553300 0x55be6d553720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33388/0 (socket says 172.21.15.133:33388) 2024-02-15T22:57:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.718+0000 7f8764e30640 1 -- 172.21.15.133:0/3613963113 learned_addr learned my addr 172.21.15.133:0/3613963113 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.718+0000 7f8764e30640 1 -- 172.21.15.133:0/3613963113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be6d553c60 con 0x55be6d553300 2024-02-15T22:57:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.718+0000 7f8764e30640 1 --2- 172.21.15.133:0/3613963113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d553300 0x55be6d553720 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f875c001ed0 tx=0x7f875c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.718+0000 7f864affd640 1 -- 172.21.15.133:0/3613963113 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f875c020070 con 0x55be6d553300 2024-02-15T22:57:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.718+0000 7f864affd640 1 -- 172.21.15.133:0/3613963113 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c01b550 con 0x55be6d553300 2024-02-15T22:57:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.718+0000 7f876992a800 1 -- 172.21.15.133:0/3613963113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be6d5546d0 con 0x55be6d553300 2024-02-15T22:57:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.718+0000 7f864affd640 1 -- 172.21.15.133:0/3613963113 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f875c013040 con 0x55be6d553300 2024-02-15T22:57:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.718+0000 7f876992a800 1 -- 172.21.15.133:0/3613963113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be6d554b90 con 0x55be6d553300 2024-02-15T22:57:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.719+0000 7f864affd640 1 -- 172.21.15.133:0/3613963113 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f875c01b8c0 con 0x55be6d553300 2024-02-15T22:57:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.719+0000 7f864affd640 1 --2- 172.21.15.133:0/3613963113 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8640036790 0x7f8640038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.719+0000 7f864affd640 1 -- 172.21.15.133:0/3613963113 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f875c04e3e0 con 0x55be6d553300 2024-02-15T22:57:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.719+0000 7f8765e32640 1 --2- 172.21.15.133:0/3613963113 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8640036790 0x7f8640038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.720+0000 7f876992a800 1 Processor -- start 2024-02-15T22:57:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.720+0000 7f8765e32640 1 --2- 172.21.15.133:0/3613963113 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8640036790 0x7f8640038c50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55be6d543620 tx=0x7f8760005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.720+0000 7f876992a800 1 -- start start 2024-02-15T22:57:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.720+0000 7f876992a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 0x55be6d534b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.720+0000 7f876992a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be6d2b75d0 con 0x55be6d534720 2024-02-15T22:57:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.720+0000 7f8764e30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 0x55be6d534b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.720+0000 7f8764e30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 0x55be6d534b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33400/0 (socket says 172.21.15.133:33400) 2024-02-15T22:57:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.720+0000 7f8764e30640 1 -- 172.21.15.133:0/2908740188 learned_addr learned my addr 172.21.15.133:0/2908740188 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.720+0000 7f8764e30640 1 -- 172.21.15.133:0/2908740188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be6d532f20 con 0x55be6d534720 2024-02-15T22:57:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.721+0000 7f8764e30640 1 --2- 172.21.15.133:0/2908740188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 0x55be6d534b40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f875c019cf0 tx=0x7f875c04c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c8e0d1f91e30b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.721+0000 7f8648ff9640 1 -- 172.21.15.133:0/2908740188 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f875c024a50 con 0x55be6d534720 2024-02-15T22:57:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.721+0000 7f8648ff9640 1 -- 172.21.15.133:0/2908740188 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c01bd50 con 0x55be6d534720 2024-02-15T22:57:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.721+0000 7f8648ff9640 1 -- 172.21.15.133:0/2908740188 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f875c04e200 con 0x55be6d534720 2024-02-15T22:57:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.721+0000 7f876992a800 1 -- 172.21.15.133:0/2908740188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 msgr2=0x55be6d534b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.721+0000 7f876992a800 1 --2- 172.21.15.133:0/2908740188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 0x55be6d534b40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f875c019cf0 tx=0x7f875c04c900 comp rx=0 tx=0).stop 2024-02-15T22:57:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.721+0000 7f876992a800 1 -- 172.21.15.133:0/2908740188 shutdown_connections 2024-02-15T22:57:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.721+0000 7f876992a800 1 --2- 172.21.15.133:0/2908740188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 0x55be6d534b40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.721+0000 7f876992a800 1 -- 172.21.15.133:0/2908740188 >> 172.21.15.133:0/2908740188 conn(0x55be6d55c8d0 msgr2=0x55be6d55a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.721+0000 7f876992a800 1 -- 172.21.15.133:0/2908740188 shutdown_connections 2024-02-15T22:57:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.721+0000 7f876992a800 1 -- 172.21.15.133:0/2908740188 wait complete. 2024-02-15T22:57:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.722+0000 7f876992a800 1 Processor -- start 2024-02-15T22:57:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.722+0000 7f876992a800 1 -- start start 2024-02-15T22:57:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.722+0000 7f876992a800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 0x55be6d56db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.722+0000 7f876992a800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be6d56e0d0 con 0x55be6d534720 2024-02-15T22:57:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.722+0000 7f8764e30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 0x55be6d56db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.722+0000 7f8764e30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 0x55be6d56db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33404/0 (socket says 172.21.15.133:33404) 2024-02-15T22:57:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.722+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 learned_addr learned my addr 172.21.15.133:0/1912417823 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.722+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be6d554b90 con 0x55be6d534720 2024-02-15T22:57:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.723+0000 7f8764e30640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 0x55be6d56db90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f875c00dcc0 tx=0x7f875c04c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.723+0000 7f8636ffd640 1 -- 172.21.15.133:0/1912417823 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f875c04e1a0 con 0x55be6d534720 2024-02-15T22:57:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.723+0000 7f8636ffd640 1 -- 172.21.15.133:0/1912417823 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c00cc60 con 0x55be6d534720 2024-02-15T22:57:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.723+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be6d56e2d0 con 0x55be6d534720 2024-02-15T22:57:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.723+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be6d56e730 con 0x55be6d534720 2024-02-15T22:57:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.723+0000 7f8636ffd640 1 -- 172.21.15.133:0/1912417823 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f875c00cdd0 con 0x55be6d534720 2024-02-15T22:57:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.724+0000 7f8636ffd640 1 -- 172.21.15.133:0/1912417823 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f875c0196a0 con 0x55be6d534720 2024-02-15T22:57:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.724+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.724+0000 7f8636ffd640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8630036740 0x7f8630038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.724+0000 7f8636ffd640 1 -- 172.21.15.133:0/1912417823 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f875c04fe20 con 0x55be6d534720 2024-02-15T22:57:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.725+0000 7f876992a800 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be6d579760 0x55be6d57bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.725+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d57c350 con 0x55be6d579760 2024-02-15T22:57:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.725+0000 7f8765e32640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8630036740 0x7f8630038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.725+0000 7f8765631640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be6d579760 0x55be6d57bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.725+0000 7f8765e32640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8630036740 0x7f8630038c00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f876000b010 tx=0x7f8760020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.725+0000 7f8765631640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be6d579760 0x55be6d57bc00 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.725+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.725+0000 7f876992a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.725+0000 7f876992a800 20 realm 2024-02-15T22:57:23.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.725+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.725+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d57c720 con 0x55be6d579760 2024-02-15T22:57:23.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:23.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d57cf70 con 0x55be6d579760 2024-02-15T22:57:23.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d57d2d0 con 0x55be6d579760 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d57cc10 con 0x55be6d579760 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 20 searching for the correct realm 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55be6d57f690 0x55be6d581a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.726+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d57f690 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.727+0000 7f8764e30640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55be6d57f690 0x55be6d581a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.727+0000 7f8764e30640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55be6d57f690 0x55be6d581a80 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.727+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.727+0000 7f8764e30640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f875c037020 0x7f875c0270b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.727+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f875c037020 2024-02-15T22:57:23.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.727+0000 7f8765e32640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f875c037020 0x7f875c0270b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.727+0000 7f8765e32640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f875c037020 0x7f875c0270b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.728+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c037020 2024-02-15T22:57:23.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.728+0000 7f8765e32640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f87600141d0 0x7f8760015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.728+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f87600141d0 2024-02-15T22:57:23.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.728+0000 7f8765631640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f87600141d0 0x7f8760015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.728+0000 7f8765631640 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f87600141d0 0x7f8760015940 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.728+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x7f87600141d0 2024-02-15T22:57:23.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.728+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d579760 2024-02-15T22:57:23.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.729+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.729+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d579760 2024-02-15T22:57:23.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.729+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.729+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f87600141d0 2024-02-15T22:57:23.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.729+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x7f87600141d0 2024-02-15T22:57:23.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.729+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f87600141d0 2024-02-15T22:57:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.729+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x7f87600141d0 2024-02-15T22:57:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.729+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f875c037020 2024-02-15T22:57:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.730+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c037020 2024-02-15T22:57:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.730+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d57f690 2024-02-15T22:57:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.730+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.730+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d579760 2024-02-15T22:57:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.730+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.730+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f87600141d0 2024-02-15T22:57:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.730+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x7f87600141d0 2024-02-15T22:57:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.730+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d579760 2024-02-15T22:57:23.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.731+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.731+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f875c037020 2024-02-15T22:57:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.731+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f876003a040 con 0x7f875c037020 2024-02-15T22:57:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.731+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d57f690 2024-02-15T22:57:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.731+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.731+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d57f690 2024-02-15T22:57:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.731+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.731+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f87600141d0 2024-02-15T22:57:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.732+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x7f87600141d0 2024-02-15T22:57:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.732+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d57f690 2024-02-15T22:57:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.732+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.732+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d57f690 2024-02-15T22:57:23.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.732+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.732+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d579760 2024-02-15T22:57:23.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.732+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.732+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d579760 2024-02-15T22:57:23.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.732+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.733+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f87600141d0 2024-02-15T22:57:23.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.733+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x7f87600141d0 2024-02-15T22:57:23.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.733+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d57f690 2024-02-15T22:57:23.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.733+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.733+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f875c037020 2024-02-15T22:57:23.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.734+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f876003a040 con 0x7f875c037020 2024-02-15T22:57:23.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.734+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d579760 2024-02-15T22:57:23.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.734+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8758059040 con 0x55be6d579760 2024-02-15T22:57:23.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.734+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f87600141d0 2024-02-15T22:57:23.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.734+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758059040 con 0x7f87600141d0 2024-02-15T22:57:23.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.734+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d57f690 2024-02-15T22:57:23.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.735+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.735+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f87600141d0 2024-02-15T22:57:23.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.735+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.735+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f875c037020 2024-02-15T22:57:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.735+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f876003a040 con 0x7f875c037020 2024-02-15T22:57:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.735+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d57f690 2024-02-15T22:57:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.735+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.735+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f87600141d0 2024-02-15T22:57:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x55be6d579760 2024-02-15T22:57:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582100 con 0x7f875c037020 2024-02-15T22:57:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f876003a040 con 0x7f875c037020 2024-02-15T22:57:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f876992a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f876992a800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:23.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f876992a800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:23.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f876992a800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:23.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f876992a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:23.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f876992a800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:23.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d57e140 con 0x55be6d579760 2024-02-15T22:57:23.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f876992a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.736+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d57ddc0 con 0x55be6d579760 2024-02-15T22:57:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d57ead0 con 0x55be6d579760 2024-02-15T22:57:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 20 zone default found 2024-02-15T22:57:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 4 Realm: () 2024-02-15T22:57:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:23.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 20 zonegroup default 2024-02-15T22:57:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d582520 con 0x7f87600141d0 2024-02-15T22:57:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.737+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5843a0 con 0x55be6d57f690 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.738+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.738+0000 7f876992a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.738+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.738+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d584700 con 0x55be6d57f690 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.738+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.738+0000 7f876992a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.738+0000 7f876992a800 20 started sync module instance, tier type = 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.738+0000 7f876992a800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.738+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d583970 con 0x7f875c037020 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.739+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f876003a040 con 0x7f875c037020 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.739+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94276366646864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d583970 con 0x7f875c037020 2024-02-15T22:57:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.739+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d585170 con 0x55be6d579760 2024-02-15T22:57:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.740+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94276366646864] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f876003a040 con 0x7f875c037020 2024-02-15T22:57:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.740+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.740+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94276366650448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d583970 con 0x55be6d579760 2024-02-15T22:57:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.740+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d585c50 con 0x55be6d57f690 2024-02-15T22:57:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.741+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94276366650448] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.742+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.742+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94276366644432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5838f0 con 0x55be6d57f690 2024-02-15T22:57:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.742+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d586ab0 con 0x7f875c037020 2024-02-15T22:57:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.743+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94276366644432] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.743+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f876003a040 con 0x7f875c037020 2024-02-15T22:57:23.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.743+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94276366657040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d586ed0 con 0x7f875c037020 2024-02-15T22:57:23.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.743+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d587840 con 0x55be6d579760 2024-02-15T22:57:23.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.744+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94276366657040] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f876003a040 con 0x7f875c037020 2024-02-15T22:57:23.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.744+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.744+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94276366658576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d587840 con 0x55be6d579760 2024-02-15T22:57:23.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.744+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5881f0 con 0x7f87600141d0 2024-02-15T22:57:23.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.745+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94276366658576] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.745+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.745+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94276366662928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d587840 con 0x7f87600141d0 2024-02-15T22:57:23.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.745+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d588bf0 con 0x7f87600141d0 2024-02-15T22:57:23.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.746+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94276366662928] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.746+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.746+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94276366665488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d588dd0 con 0x7f87600141d0 2024-02-15T22:57:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.746+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5895d0 con 0x7f87600141d0 2024-02-15T22:57:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.747+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.747+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94276366667760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d589a30 con 0x7f87600141d0 2024-02-15T22:57:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.747+0000 7f876992a800 20 add_watcher() i=0 2024-02-15T22:57:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.747+0000 7f876992a800 20 add_watcher() i=1 2024-02-15T22:57:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.747+0000 7f876992a800 20 add_watcher() i=2 2024-02-15T22:57:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.747+0000 7f876992a800 20 add_watcher() i=3 2024-02-15T22:57:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.747+0000 7f876992a800 20 add_watcher() i=4 2024-02-15T22:57:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.747+0000 7f876992a800 20 add_watcher() i=5 2024-02-15T22:57:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.747+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94276366665488] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.747+0000 7f876992a800 20 add_watcher() i=6 2024-02-15T22:57:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.748+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94276366667760] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.748+0000 7f876992a800 20 add_watcher() i=7 2024-02-15T22:57:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.748+0000 7f876992a800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.748+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d587480 con 0x55be6d579760 2024-02-15T22:57:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.748+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.749+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94276366669008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d587480 con 0x55be6d579760 2024-02-15T22:57:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.750+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94276366669008] v32'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.750+0000 7f861b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.750+0000 7f876992a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.750+0000 7f876992a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.750+0000 7f876992a800 5 note: GC not initialized 2024-02-15T22:57:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.750+0000 7f861a7e4640 20 reqs_thread_entry: start 2024-02-15T22:57:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.750+0000 7f876992a800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.750+0000 7f876992a800 20 Filter name: none 2024-02-15T22:57:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.750+0000 7f858bfff640 20 reqs_thread_entry: start 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.750+0000 7f876992a800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.750+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5be5d0 con 0x55be6d579760 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.751+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.751+0000 7f876992a800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.751+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5be5d0 con 0x7f87600141d0 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.751+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.752+0000 7f861b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.752+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94276366669008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5be5d0 con 0x55be6d579760 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.753+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94276366669008] v32'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.753+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94276366646864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5be5d0 con 0x7f875c037020 2024-02-15T22:57:23.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.754+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94276366646864] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f876003a040 con 0x7f875c037020 2024-02-15T22:57:23.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.754+0000 7f876992a800 20 remove_watcher() i=0 2024-02-15T22:57:23.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.754+0000 7f876992a800 2 removed watcher, disabling cache 2024-02-15T22:57:23.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.754+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94276366650448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5be5d0 con 0x55be6d579760 2024-02-15T22:57:23.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.755+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94276366650448] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.755+0000 7f876992a800 20 remove_watcher() i=1 2024-02-15T22:57:23.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.755+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94276366644432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5be5d0 con 0x55be6d57f690 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.756+0000 7f8764e30640 1 -- 172.21.15.133:0/1912417823 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94276366644432] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f875c034070 con 0x55be6d57f690 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.756+0000 7f876992a800 20 remove_watcher() i=2 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.756+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94276366657040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5834d0 con 0x7f875c037020 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.757+0000 7f8765e32640 1 -- 172.21.15.133:0/1912417823 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94276366657040] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f876003a040 con 0x7f875c037020 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.757+0000 7f876992a800 20 remove_watcher() i=3 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.757+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94276366658576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d586610 con 0x55be6d579760 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.758+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94276366658576] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x55be6d579760 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.758+0000 7f876992a800 20 remove_watcher() i=4 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.758+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94276366662928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5834d0 con 0x7f87600141d0 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.759+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94276366662928] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.759+0000 7f876992a800 20 remove_watcher() i=5 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.759+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94276366665488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d586610 con 0x7f87600141d0 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.760+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94276366665488] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.760+0000 7f876992a800 20 remove_watcher() i=6 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.760+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94276366667760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be6d5834d0 con 0x7f87600141d0 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.761+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94276366667760] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8758093040 con 0x7f87600141d0 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.761+0000 7f876992a800 20 remove_watcher() i=7 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.761+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f87600141d0 msgr2=0x7f8760015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.761+0000 7f876992a800 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f87600141d0 0x7f8760015940 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.761+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be6d579760 msgr2=0x55be6d57bc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.761+0000 7f876992a800 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be6d579760 0x55be6d57bc00 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.761+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f875c037020 msgr2=0x7f875c0270b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.761+0000 7f876992a800 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f875c037020 0x7f875c0270b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.761+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55be6d57f690 msgr2=0x55be6d581a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.761+0000 7f876992a800 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55be6d57f690 0x55be6d581a80 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.761+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8630036740 msgr2=0x7f8630038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8630036740 0x7f8630038c00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f876000b010 tx=0x7f8760020000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 msgr2=0x55be6d56db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/1912417823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d534720 0x55be6d56db90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f875c00dcc0 tx=0x7f875c04c750 comp rx=0 tx=0).stop 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 reap_dead start 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f8765631640 1 -- 172.21.15.133:0/1912417823 reap_dead start 2024-02-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 shutdown_connections 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 >> 172.21.15.133:0/1912417823 conn(0x55be6d55c8d0 msgr2=0x55be6d559f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 shutdown_connections 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/1912417823 wait complete. 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3613963113 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8640036790 msgr2=0x7f8640038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/3613963113 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8640036790 0x7f8640038c50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55be6d543620 tx=0x7f8760005840 comp rx=0 tx=0).stop 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3613963113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d553300 msgr2=0x55be6d553720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/3613963113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d553300 0x55be6d553720 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f875c001ed0 tx=0x7f875c00d7a0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3613963113 shutdown_connections 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/3613963113 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8640036790 0x7f8640038c50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/3613963113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d553300 0x55be6d553720 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3613963113 >> 172.21.15.133:0/3613963113 conn(0x55be6d5473a0 msgr2=0x55be6d5477a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3613963113 shutdown_connections 2024-02-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3613963113 wait complete. 2024-02-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be6d4440f0 msgr2=0x55be6d542710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be6d4440f0 0x55be6d542710 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f864c036790 msgr2=0x7f864c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f864c036790 0x7f864c038c50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f875c000f60 tx=0x7f875c0012b0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 msgr2=0x55be6d53ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d53ba50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f875800a470 tx=0x7f8758002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 shutdown_connections 2024-02-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be6d4440f0 0x55be6d542710 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f864c036790 0x7f864c038c50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 --2- 172.21.15.133:0/3140921905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be6d442e90 0x55be6d53ba50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 >> 172.21.15.133:0/3140921905 conn(0x55be6d43e4f0 msgr2=0x55be6d52d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.762+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 shutdown_connections 2024-02-15T22:57:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.763+0000 7f876992a800 1 -- 172.21.15.133:0/3140921905 wait complete. 2024-02-15T22:57:23.791 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-02-15T22:57:23.792 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-02-15T22:57:23.792 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-15T22:57:23.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-15T22:57:23.792 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-02-15T22:57:23.836 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:23.837 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.835+0000 7f690f5af800 1 Processor -- start 2024-02-15T22:57:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.835+0000 7f690f5af800 1 -- start start 2024-02-15T22:57:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.835+0000 7f690f5af800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561abecc8530 0x561abecca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.835+0000 7f690f5af800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561abec0eba0 con 0x561abecc4a20 2024-02-15T22:57:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.835+0000 7f690f5af800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x561abebc6450 con 0x561abecc8530 2024-02-15T22:57:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.835+0000 7f690c8ad640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561abecc8530 0x561abecca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.835+0000 7f690d0ae640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x561abecc4a20 0x561abecc6e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45282/0 (socket says 172.21.15.133:45282) 2024-02-15T22:57:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.835+0000 7f690d0ae640 1 -- 172.21.15.133:0/448299425 learned_addr learned my addr 172.21.15.133:0/448299425 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.836+0000 7f690c8ad640 1 -- 172.21.15.133:0/448299425 >> v1:172.21.15.52:6789/0 conn(0x561abecc4a20 legacy=0x561abecc6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.836+0000 7f690c8ad640 1 -- 172.21.15.133:0/448299425 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561abeccbe70 con 0x561abecc8530 2024-02-15T22:57:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.837+0000 7f690c8ad640 1 --2- 172.21.15.133:0/448299425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc8530 0x561abecca920 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f690400a470 tx=0x7f690401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5539416cefc235 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.838+0000 7f68fffff640 1 -- 172.21.15.133:0/448299425 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6904052570 con 0x561abecc8530 2024-02-15T22:57:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.838+0000 7f68fffff640 1 -- 172.21.15.133:0/448299425 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69040526d0 con 0x561abecc8530 2024-02-15T22:57:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.838+0000 7f68fffff640 1 -- 172.21.15.133:0/448299425 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6904052990 con 0x561abecc8530 2024-02-15T22:57:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.838+0000 7f690f5af800 1 -- 172.21.15.133:0/448299425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc8530 msgr2=0x561abecca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.838+0000 7f690f5af800 1 --2- 172.21.15.133:0/448299425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc8530 0x561abecca920 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f690400a470 tx=0x7f690401cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.838+0000 7f690f5af800 1 -- 172.21.15.133:0/448299425 shutdown_connections 2024-02-15T22:57:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.838+0000 7f690f5af800 1 --2- 172.21.15.133:0/448299425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc8530 0x561abecca920 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.838+0000 7f690f5af800 1 -- 172.21.15.133:0/448299425 >> 172.21.15.133:0/448299425 conn(0x561abecbe4f0 msgr2=0x561abecc0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.838+0000 7f690f5af800 1 -- 172.21.15.133:0/448299425 shutdown_connections 2024-02-15T22:57:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.838+0000 7f690f5af800 1 -- 172.21.15.133:0/448299425 wait complete. 2024-02-15T22:57:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.850+0000 7f690f5af800 1 Processor -- start 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.850+0000 7f690f5af800 1 -- start start 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.850+0000 7f690f5af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedb4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.850+0000 7f690f5af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abebc3980 con 0x561abecc4a20 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.850+0000 7f690d0ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedb4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.850+0000 7f690d0ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedb4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33430/0 (socket says 172.21.15.133:33430) 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.850+0000 7f690d0ae640 1 -- 172.21.15.133:0/3578835693 learned_addr learned my addr 172.21.15.133:0/3578835693 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.851+0000 7f690d0ae640 1 -- 172.21.15.133:0/3578835693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904005d20 con 0x561abecc4a20 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.851+0000 7f690d0ae640 1 --2- 172.21.15.133:0/3578835693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedb4060 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6900001c50 tx=0x7f690000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93f3e12490de1ff server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.851+0000 7f67fb606640 1 -- 172.21.15.133:0/3578835693 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f690000e470 con 0x561abecc4a20 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.851+0000 7f67fb606640 1 -- 172.21.15.133:0/3578835693 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690000e5d0 con 0x561abecc4a20 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.851+0000 7f67fb606640 1 -- 172.21.15.133:0/3578835693 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f690000e8d0 con 0x561abecc4a20 2024-02-15T22:57:23.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690f5af800 1 -- 172.21.15.133:0/3578835693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 msgr2=0x561abedb4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690f5af800 1 --2- 172.21.15.133:0/3578835693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedb4060 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6900001c50 tx=0x7f690000b6c0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690f5af800 1 -- 172.21.15.133:0/3578835693 shutdown_connections 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690f5af800 1 --2- 172.21.15.133:0/3578835693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedb4060 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690f5af800 1 -- 172.21.15.133:0/3578835693 >> 172.21.15.133:0/3578835693 conn(0x561abecbe4f0 msgr2=0x561abedaf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690f5af800 1 -- 172.21.15.133:0/3578835693 shutdown_connections 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690f5af800 1 -- 172.21.15.133:0/3578835693 wait complete. 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690f5af800 1 Processor -- start 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690f5af800 1 -- start start 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690f5af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedbb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690f5af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abebbf160 con 0x561abecc4a20 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.852+0000 7f690d0ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedbb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.853+0000 7f690d0ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedbb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33432/0 (socket says 172.21.15.133:33432) 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.853+0000 7f690d0ae640 1 -- 172.21.15.133:0/247116829 learned_addr learned my addr 172.21.15.133:0/247116829 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.853+0000 7f690d0ae640 1 -- 172.21.15.133:0/247116829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561abec0eba0 con 0x561abecc4a20 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.853+0000 7f690d0ae640 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedbb720 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6900000c00 tx=0x7f6900000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.853+0000 7f67f9e03640 1 -- 172.21.15.133:0/247116829 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f690001f070 con 0x561abecc4a20 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.853+0000 7f67f9e03640 1 -- 172.21.15.133:0/247116829 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6900018770 con 0x561abecc4a20 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.853+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561abedbbc60 con 0x561abecc4a20 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.853+0000 7f67f9e03640 1 -- 172.21.15.133:0/247116829 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6900018a30 con 0x561abecc4a20 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.853+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561abedbc140 con 0x561abecc4a20 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.854+0000 7f67f9e03640 1 -- 172.21.15.133:0/247116829 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6900018c20 con 0x561abecc4a20 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.854+0000 7f67f9e03640 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67f4036790 0x7f67f4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.854+0000 7f67f9e03640 1 -- 172.21.15.133:0/247116829 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f690004c250 con 0x561abecc4a20 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.854+0000 7f690c8ad640 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67f4036790 0x7f67f4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.854+0000 7f690f5af800 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561abecc8530 0x561abedc23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.854+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedc29a0 con 0x561abecc8530 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.854+0000 7f690d8af640 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561abecc8530 0x561abedc23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.855+0000 7f690c8ad640 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67f4036790 0x7f67f4038c50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6904054000 tx=0x7f690404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.855+0000 7f690d8af640 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561abecc8530 0x561abedc23d0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.855+0000 7f690d8af640 1 -- 172.21.15.133:0/247116829 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f690800a4a0 con 0x561abecc8530 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.855+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedbfac0 con 0x561abecc8530 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.855+0000 7f690d8af640 1 -- 172.21.15.133:0/247116829 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f690800a4a0 con 0x561abecc8530 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.855+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedc46d0 con 0x561abecc8530 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.856+0000 7f690d8af640 1 -- 172.21.15.133:0/247116829 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f690800a4a0 con 0x561abecc8530 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.856+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedc38d0 con 0x561abecc8530 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.856+0000 7f690d8af640 1 -- 172.21.15.133:0/247116829 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f690800a4a0 con 0x561abecc8530 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.856+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedc3ce0 con 0x561abecc8530 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.856+0000 7f690d8af640 1 -- 172.21.15.133:0/247116829 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f690800a4a0 con 0x561abecc8530 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.857+0000 7f690f5af800 1 Processor -- start 2024-02-15T22:57:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.857+0000 7f690f5af800 1 -- start start 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.857+0000 7f690f5af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abedd3150 0x561abedd3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.857+0000 7f690f5af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abeb61e80 con 0x561abedd3150 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.857+0000 7f690c8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abedd3150 0x561abedd3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.857+0000 7f690c8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abedd3150 0x561abedd3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33444/0 (socket says 172.21.15.133:33444) 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.857+0000 7f690c8ad640 1 -- 172.21.15.133:0/2949548914 learned_addr learned my addr 172.21.15.133:0/2949548914 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.857+0000 7f690c8ad640 1 -- 172.21.15.133:0/2949548914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561abedd3ab0 con 0x561abedd3150 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.858+0000 7f690c8ad640 1 --2- 172.21.15.133:0/2949548914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abedd3150 0x561abedd3570 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f69040447c0 tx=0x7f6904002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.858+0000 7f67f2ffd640 1 -- 172.21.15.133:0/2949548914 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6904052e40 con 0x561abedd3150 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.858+0000 7f67f2ffd640 1 -- 172.21.15.133:0/2949548914 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690405d890 con 0x561abedd3150 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.858+0000 7f690f5af800 1 -- 172.21.15.133:0/2949548914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561abedd3ca0 con 0x561abedd3150 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.858+0000 7f67f2ffd640 1 -- 172.21.15.133:0/2949548914 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f690405db30 con 0x561abedd3150 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.858+0000 7f690f5af800 1 -- 172.21.15.133:0/2949548914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561abedd4850 con 0x561abedd3150 2024-02-15T22:57:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f67f2ffd640 1 -- 172.21.15.133:0/2949548914 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f690405dd20 con 0x561abedd3150 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f67f2ffd640 1 --2- 172.21.15.133:0/2949548914 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67e4036790 0x7f67e4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f67f2ffd640 1 -- 172.21.15.133:0/2949548914 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f690408f6e0 con 0x561abedd3150 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f690d8af640 1 --2- 172.21.15.133:0/2949548914 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67e4036790 0x7f67e4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f690f5af800 1 Processor -- start 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f690f5af800 1 -- start start 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f690d8af640 1 --2- 172.21.15.133:0/2949548914 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67e4036790 0x7f67e4038c50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x561abedc3310 tx=0x7f6908005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f690f5af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f690f5af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abeb375d0 con 0x561abede0320 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f690c8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f690c8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33448/0 (socket says 172.21.15.133:33448) 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.859+0000 7f690c8ad640 1 -- 172.21.15.133:0/2060185050 learned_addr learned my addr 172.21.15.133:0/2060185050 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.860+0000 7f690c8ad640 1 -- 172.21.15.133:0/2060185050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561abede0d10 con 0x561abede0320 2024-02-15T22:57:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.860+0000 7f690c8ad640 1 --2- 172.21.15.133:0/2060185050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede0740 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6904066fd0 tx=0x7f6904088f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0e2e831be9dfbe server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.860+0000 7f67f0ff9640 1 -- 172.21.15.133:0/2060185050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69040654a0 con 0x561abede0320 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.860+0000 7f67f0ff9640 1 -- 172.21.15.133:0/2060185050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690406db60 con 0x561abede0320 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.860+0000 7f67f0ff9640 1 -- 172.21.15.133:0/2060185050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f690406de40 con 0x561abede0320 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.860+0000 7f690f5af800 1 -- 172.21.15.133:0/2060185050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 msgr2=0x561abede0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.860+0000 7f690f5af800 1 --2- 172.21.15.133:0/2060185050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede0740 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6904066fd0 tx=0x7f6904088f90 comp rx=0 tx=0).stop 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.860+0000 7f690f5af800 1 -- 172.21.15.133:0/2060185050 shutdown_connections 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.860+0000 7f690f5af800 1 --2- 172.21.15.133:0/2060185050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede0740 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.860+0000 7f690f5af800 1 -- 172.21.15.133:0/2060185050 >> 172.21.15.133:0/2060185050 conn(0x561abeddc640 msgr2=0x561abedda6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.861+0000 7f690f5af800 1 -- 172.21.15.133:0/2060185050 shutdown_connections 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.861+0000 7f690f5af800 1 -- 172.21.15.133:0/2060185050 wait complete. 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.861+0000 7f690f5af800 1 Processor -- start 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.861+0000 7f690f5af800 1 -- start start 2024-02-15T22:57:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.861+0000 7f690f5af800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.861+0000 7f690f5af800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abede7850 con 0x561abede0320 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.861+0000 7f690c8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.861+0000 7f690c8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33450/0 (socket says 172.21.15.133:33450) 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.861+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 learned_addr learned my addr 172.21.15.133:0/2831842334 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.861+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561abedd4850 con 0x561abede0320 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.862+0000 7f690c8ad640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede7310 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f690408caa0 tx=0x7f690400a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.862+0000 7f67e2ffd640 1 -- 172.21.15.133:0/2831842334 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f690405cab0 con 0x561abede0320 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.862+0000 7f67e2ffd640 1 -- 172.21.15.133:0/2831842334 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690405cc10 con 0x561abede0320 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.862+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561abede7a50 con 0x561abede0320 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.862+0000 7f67e2ffd640 1 -- 172.21.15.133:0/2831842334 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f690408f0d0 con 0x561abede0320 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.862+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561abede7eb0 con 0x561abede0320 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.863+0000 7f67e2ffd640 1 -- 172.21.15.133:0/2831842334 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f690408f230 con 0x561abede0320 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.863+0000 7f67e2ffd640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67d80367e0 0x7f67d8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.863+0000 7f67e2ffd640 1 -- 172.21.15.133:0/2831842334 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f690409abf0 con 0x561abede0320 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.863+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.863+0000 7f690d8af640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67d80367e0 0x7f67d8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.863+0000 7f690f5af800 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561abedf2eb0 0x561abedf5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.863+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedf5ac0 con 0x561abedf2eb0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.863+0000 7f690d0ae640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561abedf2eb0 0x561abedf5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.863+0000 7f690d8af640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67d80367e0 0x7f67d8038ca0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f690800b010 tx=0x7f6908020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.863+0000 7f690d0ae640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561abedf2eb0 0x561abedf5370 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 20 realm 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedf5e90 con 0x561abedf2eb0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedf66e0 con 0x561abedf2eb0 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedf6a40 con 0x561abedf2eb0 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedf6380 con 0x561abedf2eb0 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.864+0000 7f690f5af800 20 searching for the correct realm 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.865+0000 7f690f5af800 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x561abedf8e00 0x561abedfb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.865+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf8e00 2024-02-15T22:57:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.865+0000 7f690c8ad640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x561abedf8e00 0x561abedfb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.865+0000 7f690c8ad640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x561abedf8e00 0x561abedfb1f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.865+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.865+0000 7f690c8ad640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f6904099060 0x7f690409a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.865+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f6904099060 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.865+0000 7f690d8af640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f6904099060 0x7f690409a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.866+0000 7f690d8af640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f6904099060 0x7f690409a450 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.866+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f690800a4a0 con 0x7f6904099060 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.866+0000 7f690d8af640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f69080141d0 0x7f6908015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.866+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f69080141d0 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.866+0000 7f690d0ae640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f69080141d0 0x7f6908015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.866+0000 7f690d0ae640 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f69080141d0 0x7f6908015940 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.867+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x7f69080141d0 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.867+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf2eb0 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.867+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.867+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf2eb0 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.867+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.867+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f69080141d0 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.867+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x7f69080141d0 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.867+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f69080141d0 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.868+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x7f69080141d0 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.868+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f6904099060 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.868+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f690800a4a0 con 0x7f6904099060 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.868+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf8e00 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.868+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.868+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf2eb0 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.868+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.868+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f69080141d0 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.869+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x7f69080141d0 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.869+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf2eb0 2024-02-15T22:57:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.869+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.869+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f6904099060 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.869+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f690803a040 con 0x7f6904099060 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.869+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf8e00 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.869+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.869+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf8e00 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.869+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.869+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f69080141d0 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.870+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x7f69080141d0 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.870+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf8e00 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.870+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.870+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf8e00 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.870+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.870+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf2eb0 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.870+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.870+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf2eb0 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.871+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.871+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f69080141d0 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.871+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x7f69080141d0 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.871+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf8e00 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.871+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.871+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f6904099060 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.871+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f690803a040 con 0x7f6904099060 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.871+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf2eb0 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.872+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6900014070 con 0x561abedf2eb0 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.872+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f69080141d0 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.872+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900014070 con 0x7f69080141d0 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.872+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf8e00 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.872+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.872+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f69080141d0 2024-02-15T22:57:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.872+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.873+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f6904099060 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.873+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f690803a040 con 0x7f6904099060 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.873+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf8e00 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.873+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.873+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f69080141d0 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x561abedf2eb0 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfb8a0 con 0x7f6904099060 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f690803a040 con 0x7f6904099060 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedf7910 con 0x561abedf2eb0 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedf7590 con 0x561abedf2eb0 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.874+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedf8260 con 0x561abedf2eb0 2024-02-15T22:57:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 20 zone default found 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 4 Realm: () 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 20 zonegroup default 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfbcc0 con 0x7f69080141d0 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfdb40 con 0x561abedf8e00 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfdea0 con 0x561abedf8e00 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.875+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.876+0000 7f690f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.876+0000 7f690f5af800 20 started sync module instance, tier type = 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.876+0000 7f690f5af800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.876+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfd110 con 0x7f6904099060 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.877+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f690803a040 con 0x7f6904099060 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.877+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94672871478736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfd110 con 0x7f6904099060 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.877+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfe8d0 con 0x561abedf2eb0 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.877+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94672871478736] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f690803a040 con 0x7f6904099060 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.878+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.878+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94672871482320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfd110 con 0x561abedf2eb0 2024-02-15T22:57:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.878+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedff370 con 0x561abedf8e00 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.879+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94672871482320] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.879+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.879+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94672871476336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfd090 con 0x561abedf8e00 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.879+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee001d0 con 0x7f6904099060 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.880+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94672871476336] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.880+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f690803a040 con 0x7f6904099060 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.880+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94672871488816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee005f0 con 0x7f6904099060 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.880+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee00f60 con 0x561abedf2eb0 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.881+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.881+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94672871492288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee00ee0 con 0x561abedf2eb0 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.881+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee01ea0 con 0x7f69080141d0 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.881+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94672871488816] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f690803a040 con 0x7f6904099060 2024-02-15T22:57:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.882+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94672871492288] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.882+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.882+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94672871496064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee01e60 con 0x7f69080141d0 2024-02-15T22:57:23.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.882+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee01430 con 0x7f69080141d0 2024-02-15T22:57:23.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.884+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.884+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94672871496064] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.884+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94672871498320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee01430 con 0x7f69080141d0 2024-02-15T22:57:23.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.884+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee00150 con 0x7f69080141d0 2024-02-15T22:57:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94672871489872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee031d0 con 0x7f69080141d0 2024-02-15T22:57:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690f5af800 20 add_watcher() i=0 2024-02-15T22:57:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690f5af800 20 add_watcher() i=1 2024-02-15T22:57:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690f5af800 20 add_watcher() i=2 2024-02-15T22:57:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690f5af800 20 add_watcher() i=3 2024-02-15T22:57:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690f5af800 20 add_watcher() i=4 2024-02-15T22:57:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690f5af800 20 add_watcher() i=5 2024-02-15T22:57:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94672871498320] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690f5af800 20 add_watcher() i=6 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94672871489872] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.885+0000 7f690f5af800 20 add_watcher() i=7 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.886+0000 7f690f5af800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.886+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee02760 con 0x561abedf2eb0 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.886+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.886+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94672871501104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee02760 con 0x561abedf2eb0 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.887+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94672871501104] v32'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.887+0000 7f67c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.887+0000 7f690f5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.887+0000 7f690f5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.887+0000 7f690f5af800 5 note: GC not initialized 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.887+0000 7f67c27e4640 20 reqs_thread_entry: start 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.887+0000 7f690f5af800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.887+0000 7f690f5af800 20 Filter name: none 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.888+0000 7f6733fff640 20 reqs_thread_entry: start 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.888+0000 7f690f5af800 20 rados->read ofs=0 len=0 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.888+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee37dd0 con 0x561abedf2eb0 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.888+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.888+0000 7f690f5af800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.888+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee37dd0 con 0x7f69080141d0 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.888+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.889+0000 7f67c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.889+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94672871501104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee37dd0 con 0x561abedf2eb0 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.890+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94672871501104] v32'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.890+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94672871478736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee37dd0 con 0x7f6904099060 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.891+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94672871478736] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f690803a040 con 0x7f6904099060 2024-02-15T22:57:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.891+0000 7f690f5af800 20 remove_watcher() i=0 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.891+0000 7f690f5af800 2 removed watcher, disabling cache 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.891+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94672871482320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee37dd0 con 0x561abedf2eb0 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.892+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94672871482320] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.892+0000 7f690f5af800 20 remove_watcher() i=1 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.892+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94672871476336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abee37dd0 con 0x561abedf8e00 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.893+0000 7f690c8ad640 1 -- 172.21.15.133:0/2831842334 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94672871476336] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6904059040 con 0x561abedf8e00 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.893+0000 7f690f5af800 20 remove_watcher() i=2 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.893+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94672871488816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfd5d0 con 0x7f6904099060 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.894+0000 7f690d8af640 1 -- 172.21.15.133:0/2831842334 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94672871488816] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f690803a040 con 0x7f6904099060 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.894+0000 7f690f5af800 20 remove_watcher() i=3 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.894+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94672871492288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfe3d0 con 0x561abedf2eb0 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.895+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94672871492288] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x561abedf2eb0 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.895+0000 7f690f5af800 20 remove_watcher() i=4 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.895+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94672871496064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedfcc70 con 0x7f69080141d0 2024-02-15T22:57:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.896+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94672871496064] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.896+0000 7f690f5af800 20 remove_watcher() i=5 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.896+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94672871498320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedffd30 con 0x7f69080141d0 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.898+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94672871498320] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.898+0000 7f690f5af800 20 remove_watcher() i=6 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.898+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94672871489872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561abedffd30 con 0x7f69080141d0 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94672871489872] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6900052040 con 0x7f69080141d0 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 20 remove_watcher() i=7 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f69080141d0 msgr2=0x7f6908015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f69080141d0 0x7f6908015940 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561abedf2eb0 msgr2=0x561abedf5370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561abedf2eb0 0x561abedf5370 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f6904099060 msgr2=0x7f690409a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f6904099060 0x7f690409a450 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x561abedf8e00 msgr2=0x561abedfb1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x561abedf8e00 0x561abedfb1f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67d80367e0 msgr2=0x7f67d8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67d80367e0 0x7f67d8038ca0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f690800b010 tx=0x7f6908020000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 msgr2=0x561abede7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede7310 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f690408caa0 tx=0x7f690400a410 comp rx=0 tx=0).stop 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690d0ae640 1 -- 172.21.15.133:0/2831842334 reap_dead start 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 shutdown_connections 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 --2- 172.21.15.133:0/2831842334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abede0320 0x561abede7310 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 >> 172.21.15.133:0/2831842334 conn(0x561abeddc640 msgr2=0x561abedd9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 shutdown_connections 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2831842334 wait complete. 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2949548914 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67e4036790 msgr2=0x7f67e4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 --2- 172.21.15.133:0/2949548914 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67e4036790 0x7f67e4038c50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x561abedc3310 tx=0x7f6908005840 comp rx=0 tx=0).stop 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2949548914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abedd3150 msgr2=0x561abedd3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 --2- 172.21.15.133:0/2949548914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abedd3150 0x561abedd3570 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f69040447c0 tx=0x7f6904002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2949548914 shutdown_connections 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 --2- 172.21.15.133:0/2949548914 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67e4036790 0x7f67e4038c50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 --2- 172.21.15.133:0/2949548914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abedd3150 0x561abedd3570 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.899+0000 7f690f5af800 1 -- 172.21.15.133:0/2949548914 >> 172.21.15.133:0/2949548914 conn(0x561abedc71f0 msgr2=0x561abedc75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 -- 172.21.15.133:0/2949548914 shutdown_connections 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 -- 172.21.15.133:0/2949548914 wait complete. 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561abecc8530 msgr2=0x561abedc23d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561abecc8530 0x561abedc23d0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67f4036790 msgr2=0x7f67f4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67f4036790 0x7f67f4038c50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6904054000 tx=0x7f690404e000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 msgr2=0x561abedbb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedbb720 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6900000c00 tx=0x7f6900000ed0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 shutdown_connections 2024-02-15T22:57:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x561abecc8530 0x561abedc23d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f67f4036790 0x7f67f4038c50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 --2- 172.21.15.133:0/247116829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561abecc4a20 0x561abedbb720 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 >> 172.21.15.133:0/247116829 conn(0x561abecbe4f0 msgr2=0x561abedae200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 shutdown_connections 2024-02-15T22:57:23.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.900+0000 7f690f5af800 1 -- 172.21.15.133:0/247116829 wait complete. 2024-02-15T22:57:23.921 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-15T22:00:00.000000Z","epoch":1708034400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-02-15T22:57:23.922 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-15T22:00:00.000000Z', 'epoch': 1708034400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-02-15T22:57:23.922 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-15T22:57:23.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-15T22:57:23.922 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-02-15T22:57:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.971+0000 7fceff20f800 1 Processor -- start 2024-02-15T22:57:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.971+0000 7fceff20f800 1 -- start start 2024-02-15T22:57:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.972+0000 7fceff20f800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564fc05f4150 0x564fc0683b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.972+0000 7fceff20f800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564fc05cbbd0 con 0x564fc06840f0 2024-02-15T22:57:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.972+0000 7fceff20f800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x564fc0583450 con 0x564fc05f4150 2024-02-15T22:57:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.972+0000 7fcefa8e4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564fc05f4150 0x564fc0683b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.972+0000 7fcef20e3640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x564fc06840f0 0x564fc06865b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45292/0 (socket says 172.21.15.133:45292) 2024-02-15T22:57:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.972+0000 7fcef20e3640 1 -- 172.21.15.133:0/488334425 learned_addr learned my addr 172.21.15.133:0/488334425 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.972+0000 7fcefa8e4640 1 -- 172.21.15.133:0/488334425 >> v1:172.21.15.52:6789/0 conn(0x564fc06840f0 legacy=0x564fc06865b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.972+0000 7fcefa8e4640 1 -- 172.21.15.133:0/488334425 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fc0688ea0 con 0x564fc05f4150 2024-02-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.974+0000 7fcefa8e4640 1 --2- 172.21.15.133:0/488334425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0683b80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fceec00a470 tx=0x7fceec01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df79ed5bfdc80c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.974+0000 7fcefa0e3640 1 -- 172.21.15.133:0/488334425 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceec052570 con 0x564fc05f4150 2024-02-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.974+0000 7fcefa0e3640 1 -- 172.21.15.133:0/488334425 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec0526d0 con 0x564fc05f4150 2024-02-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.974+0000 7fcefa0e3640 1 -- 172.21.15.133:0/488334425 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceec052990 con 0x564fc05f4150 2024-02-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.975+0000 7fceff20f800 1 -- 172.21.15.133:0/488334425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 msgr2=0x564fc0683b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.975+0000 7fceff20f800 1 --2- 172.21.15.133:0/488334425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0683b80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fceec00a470 tx=0x7fceec01cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.975+0000 7fceff20f800 1 -- 172.21.15.133:0/488334425 shutdown_connections 2024-02-15T22:57:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.975+0000 7fceff20f800 1 --2- 172.21.15.133:0/488334425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0683b80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.975+0000 7fceff20f800 1 -- 172.21.15.133:0/488334425 >> 172.21.15.133:0/488334425 conn(0x564fc067b520 msgr2=0x564fc067d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.975+0000 7fceff20f800 1 -- 172.21.15.133:0/488334425 shutdown_connections 2024-02-15T22:57:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.975+0000 7fceff20f800 1 -- 172.21.15.133:0/488334425 wait complete. 2024-02-15T22:57:23.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.986+0000 7fceff20f800 1 Processor -- start 2024-02-15T22:57:23.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.986+0000 7fceff20f800 1 -- start start 2024-02-15T22:57:23.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.986+0000 7fceff20f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0771120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.986+0000 7fceff20f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc0580980 con 0x564fc05f4150 2024-02-15T22:57:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.987+0000 7fcefa8e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0771120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.987+0000 7fcefa8e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0771120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33460/0 (socket says 172.21.15.133:33460) 2024-02-15T22:57:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.987+0000 7fcefa8e4640 1 -- 172.21.15.133:0/3834216024 learned_addr learned my addr 172.21.15.133:0/3834216024 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.987+0000 7fcefa8e4640 1 -- 172.21.15.133:0/3834216024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec005d20 con 0x564fc05f4150 2024-02-15T22:57:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.987+0000 7fcefa8e4640 1 --2- 172.21.15.133:0/3834216024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0771120 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fceec055040 tx=0x7fceec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d6f2f310784e0f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.987+0000 7fcde8e09640 1 -- 172.21.15.133:0/3834216024 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceec00a180 con 0x564fc05f4150 2024-02-15T22:57:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.987+0000 7fcde8e09640 1 -- 172.21.15.133:0/3834216024 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec00a2e0 con 0x564fc05f4150 2024-02-15T22:57:23.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.987+0000 7fcde8e09640 1 -- 172.21.15.133:0/3834216024 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceec0529b0 con 0x564fc05f4150 2024-02-15T22:57:23.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.988+0000 7fceff20f800 1 -- 172.21.15.133:0/3834216024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 msgr2=0x564fc0771120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.988+0000 7fceff20f800 1 --2- 172.21.15.133:0/3834216024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0771120 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fceec055040 tx=0x7fceec04c000 comp rx=0 tx=0).stop 2024-02-15T22:57:23.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.988+0000 7fceff20f800 1 -- 172.21.15.133:0/3834216024 shutdown_connections 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.988+0000 7fceff20f800 1 --2- 172.21.15.133:0/3834216024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0771120 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.988+0000 7fceff20f800 1 -- 172.21.15.133:0/3834216024 >> 172.21.15.133:0/3834216024 conn(0x564fc067b520 msgr2=0x564fc076ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.988+0000 7fceff20f800 1 -- 172.21.15.133:0/3834216024 shutdown_connections 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.988+0000 7fceff20f800 1 -- 172.21.15.133:0/3834216024 wait complete. 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.988+0000 7fceff20f800 1 Processor -- start 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.989+0000 7fceff20f800 1 -- start start 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.989+0000 7fceff20f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0778670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.989+0000 7fceff20f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc057c160 con 0x564fc05f4150 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.989+0000 7fcefa8e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0778670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.989+0000 7fcefa8e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0778670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33470/0 (socket says 172.21.15.133:33470) 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.989+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2437472701 learned_addr learned my addr 172.21.15.133:0/2437472701 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.989+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2437472701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fc0688ea0 con 0x564fc05f4150 2024-02-15T22:57:23.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.989+0000 7fcefa8e4640 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0778670 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fceec005870 tx=0x7fceec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.990+0000 7fcde7606640 1 -- 172.21.15.133:0/2437472701 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceec06a070 con 0x564fc05f4150 2024-02-15T22:57:23.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.990+0000 7fcde7606640 1 -- 172.21.15.133:0/2437472701 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec05d550 con 0x564fc05f4150 2024-02-15T22:57:23.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.990+0000 7fcde7606640 1 -- 172.21.15.133:0/2437472701 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceec05d7f0 con 0x564fc05f4150 2024-02-15T22:57:23.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.990+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564fc0778bb0 con 0x564fc05f4150 2024-02-15T22:57:23.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.990+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564fc0779090 con 0x564fc05f4150 2024-02-15T22:57:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.990+0000 7fcde7606640 1 -- 172.21.15.133:0/2437472701 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fceec05d950 con 0x564fc05f4150 2024-02-15T22:57:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.991+0000 7fcde7606640 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcde00367e0 0x7fcde0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.991+0000 7fcde7606640 1 -- 172.21.15.133:0/2437472701 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fceec08dac0 con 0x564fc05f4150 2024-02-15T22:57:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.991+0000 7fcef20e3640 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcde00367e0 0x7fcde0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.991+0000 7fceff20f800 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564fc06840f0 0x564fc077f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.991+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc077f900 con 0x564fc06840f0 2024-02-15T22:57:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.991+0000 7fcefb0e5640 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564fc06840f0 0x564fc077f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.991+0000 7fcef20e3640 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcde00367e0 0x7fcde0038ca0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcee4000f60 tx=0x7fcee40012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.991+0000 7fcefb0e5640 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564fc06840f0 0x564fc077f330 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.991+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2437472701 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcef400a4a0 con 0x564fc06840f0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.991+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc077ca80 con 0x564fc06840f0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.992+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2437472701 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcef400a4a0 con 0x564fc06840f0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.992+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc077fdd0 con 0x564fc06840f0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.992+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2437472701 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fcef400a4a0 con 0x564fc06840f0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.992+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc0780ac0 con 0x564fc06840f0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.992+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2437472701 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcef400a4a0 con 0x564fc06840f0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.992+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc0780ed0 con 0x564fc06840f0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.993+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2437472701 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fcef400a4a0 con 0x564fc06840f0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.993+0000 7fceff20f800 1 Processor -- start 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.993+0000 7fceff20f800 1 -- start start 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.993+0000 7fceff20f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc07900b0 0x564fc07904d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.993+0000 7fceff20f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc051ee80 con 0x564fc07900b0 2024-02-15T22:57:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.993+0000 7fcef20e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc07900b0 0x564fc07904d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.994+0000 7fcef20e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc07900b0 0x564fc07904d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33472/0 (socket says 172.21.15.133:33472) 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.994+0000 7fcef20e3640 1 -- 172.21.15.133:0/2296717121 learned_addr learned my addr 172.21.15.133:0/2296717121 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.994+0000 7fcef20e3640 1 -- 172.21.15.133:0/2296717121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fc0790a10 con 0x564fc07900b0 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.994+0000 7fcef20e3640 1 --2- 172.21.15.133:0/2296717121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc07900b0 0x564fc07904d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcee4001ed0 tx=0x7fcee400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.994+0000 7fcde4e01640 1 -- 172.21.15.133:0/2296717121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcee4020070 con 0x564fc07900b0 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.994+0000 7fcde4e01640 1 -- 172.21.15.133:0/2296717121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee401b550 con 0x564fc07900b0 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.994+0000 7fceff20f800 1 -- 172.21.15.133:0/2296717121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564fc0791480 con 0x564fc07900b0 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.994+0000 7fcde4e01640 1 -- 172.21.15.133:0/2296717121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcee4013040 con 0x564fc07900b0 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.994+0000 7fceff20f800 1 -- 172.21.15.133:0/2296717121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564fc0791940 con 0x564fc07900b0 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.995+0000 7fcde4e01640 1 -- 172.21.15.133:0/2296717121 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcee401b8c0 con 0x564fc07900b0 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.995+0000 7fcde4e01640 1 --2- 172.21.15.133:0/2296717121 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcdd4036790 0x7fcdd4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.995+0000 7fcde4e01640 1 -- 172.21.15.133:0/2296717121 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fcee404e320 con 0x564fc07900b0 2024-02-15T22:57:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.995+0000 7fcefb0e5640 1 --2- 172.21.15.133:0/2296717121 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcdd4036790 0x7fcdd4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.995+0000 7fceff20f800 1 Processor -- start 2024-02-15T22:57:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.995+0000 7fcefb0e5640 1 --2- 172.21.15.133:0/2296717121 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcdd4036790 0x7fcdd4038c50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x564fc077c9a0 tx=0x7fcef4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.995+0000 7fceff20f800 1 -- start start 2024-02-15T22:57:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.996+0000 7fceff20f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc079d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.996+0000 7fceff20f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc04f45d0 con 0x564fc079d330 2024-02-15T22:57:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.996+0000 7fcef20e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc079d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.996+0000 7fcef20e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc079d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33476/0 (socket says 172.21.15.133:33476) 2024-02-15T22:57:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.996+0000 7fcef20e3640 1 -- 172.21.15.133:0/1868255557 learned_addr learned my addr 172.21.15.133:0/1868255557 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.996+0000 7fcef20e3640 1 -- 172.21.15.133:0/1868255557 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fc079dd20 con 0x564fc079d330 2024-02-15T22:57:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.996+0000 7fcef20e3640 1 --2- 172.21.15.133:0/1868255557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc079d750 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcee4019cf0 tx=0x7fcee4024990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40856816ead4e2c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fcdde7fc640 1 -- 172.21.15.133:0/1868255557 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcee404e110 con 0x564fc079d330 2024-02-15T22:57:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fcdde7fc640 1 -- 172.21.15.133:0/1868255557 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee401bd50 con 0x564fc079d330 2024-02-15T22:57:24.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fcdde7fc640 1 -- 172.21.15.133:0/1868255557 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcee4025a80 con 0x564fc079d330 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fceff20f800 1 -- 172.21.15.133:0/1868255557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 msgr2=0x564fc079d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fceff20f800 1 --2- 172.21.15.133:0/1868255557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc079d750 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcee4019cf0 tx=0x7fcee4024990 comp rx=0 tx=0).stop 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fceff20f800 1 -- 172.21.15.133:0/1868255557 shutdown_connections 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fceff20f800 1 --2- 172.21.15.133:0/1868255557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc079d750 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fceff20f800 1 -- 172.21.15.133:0/1868255557 >> 172.21.15.133:0/1868255557 conn(0x564fc0799690 msgr2=0x564fc07976f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fceff20f800 1 -- 172.21.15.133:0/1868255557 shutdown_connections 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fceff20f800 1 -- 172.21.15.133:0/1868255557 wait complete. 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fceff20f800 1 Processor -- start 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.997+0000 7fceff20f800 1 -- start start 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fceff20f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc07a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fceff20f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc07a4880 con 0x564fc079d330 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fcef20e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc07a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fcef20e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc07a4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33488/0 (socket says 172.21.15.133:33488) 2024-02-15T22:57:24.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 learned_addr learned my addr 172.21.15.133:0/2070124347 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fc0791940 con 0x564fc079d330 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fcef20e3640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc07a4340 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcee404b690 tx=0x7fcee404c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fcddcff9640 1 -- 172.21.15.133:0/2070124347 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcee404e110 con 0x564fc079d330 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fcddcff9640 1 -- 172.21.15.133:0/2070124347 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee404b260 con 0x564fc079d330 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564fc07a4a80 con 0x564fc079d330 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fcddcff9640 1 -- 172.21.15.133:0/2070124347 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcee404b410 con 0x564fc079d330 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.998+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564fc07a4a80 con 0x564fc079d330 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.999+0000 7fcddcff9640 1 -- 172.21.15.133:0/2070124347 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcee400cc60 con 0x564fc079d330 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.999+0000 7fcddcff9640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcdc4036740 0x7fcdc4038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.999+0000 7fcddcff9640 1 -- 172.21.15.133:0/2070124347 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fcee404fde0 con 0x564fc079d330 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:23.999+0000 7fcefb0e5640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcdc4036740 0x7fcdc4038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.000+0000 7fcefb0e5640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcdc4036740 0x7fcdc4038c00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcef400b010 tx=0x7fcef4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.000+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.000+0000 7fceff20f800 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564fc07afdf0 0x564fc07b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.000+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b2a00 con 0x564fc07afdf0 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.000+0000 7fcefa8e4640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564fc07afdf0 0x564fc07b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.000+0000 7fcefa8e4640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564fc07afdf0 0x564fc07b22b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.000+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.000+0000 7fceff20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.000+0000 7fceff20f800 20 realm 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.000+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.000+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b2dd0 con 0x564fc07afdf0 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b3650 con 0x564fc07afdf0 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b39b0 con 0x564fc07afdf0 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b41b0 con 0x564fc07afdf0 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 20 searching for the correct realm 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564fc07b6040 0x564fc07b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07b6040 2024-02-15T22:57:24.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.001+0000 7fcef20e3640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564fc07b6040 0x564fc07b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.002+0000 7fcef20e3640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564fc07b6040 0x564fc07b8500 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.002+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcee4035070 con 0x564fc07b6040 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.002+0000 7fcef20e3640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcee4038020 0x7fcee40234d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.002+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcee4038020 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.002+0000 7fcefb0e5640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcee4038020 0x7fcee40234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.002+0000 7fcefb0e5640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcee4038020 0x7fcee40234d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.003+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcef400a4a0 con 0x7fcee4038020 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.003+0000 7fcefb0e5640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcef40141d0 0x7fcef4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.003+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcef40141d0 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.003+0000 7fcefa8e4640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcef40141d0 0x7fcef4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.003+0000 7fcefa8e4640 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcef40141d0 0x7fcef4015940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.003+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.003+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07afdf0 2024-02-15T22:57:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.004+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.004+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07afdf0 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.004+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.004+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcef40141d0 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.004+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.004+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcef40141d0 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.004+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.004+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcee4038020 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.005+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcef400a4a0 con 0x7fcee4038020 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.005+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07b6040 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.005+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.005+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07afdf0 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.005+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.005+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcef40141d0 2024-02-15T22:57:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.005+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.005+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07afdf0 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.006+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.006+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcee4038020 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.006+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fcef403a040 con 0x7fcee4038020 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.006+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07b6040 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.006+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.006+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07b6040 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.006+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.006+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcef40141d0 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.007+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.007+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07b6040 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.007+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.007+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07b6040 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.007+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.007+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07afdf0 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.007+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.007+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07afdf0 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.007+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.007+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcef40141d0 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.008+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.008+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07b6040 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.008+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.008+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcee4038020 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.008+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcef403a040 con 0x7fcee4038020 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.008+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07afdf0 2024-02-15T22:57:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.008+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.008+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcef40141d0 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.009+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.009+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07b6040 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.009+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.009+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcef40141d0 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.009+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.009+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcee4038020 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.010+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcef403a040 con 0x7fcee4038020 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.010+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07b6040 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.010+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.010+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcef40141d0 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.010+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.010+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x564fc07afdf0 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.010+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.010+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b8bd0 con 0x7fcee4038020 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcef403a040 con 0x7fcee4038020 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b4b10 con 0x564fc07afdf0 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b5360 con 0x564fc07afdf0 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b9010 con 0x564fc07afdf0 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 zone default found 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 4 Realm: () 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:24.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 zonegroup default 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.011+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b9010 con 0x7fcef40141d0 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fceff20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bae90 con 0x564fc07b6040 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fceff20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bb1f0 con 0x564fc07b6040 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fceff20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fceff20f800 20 started sync module instance, tier type = 2024-02-15T22:57:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fceff20f800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.012+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07ba460 con 0x7fcee4038020 2024-02-15T22:57:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.013+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcef403a040 con 0x7fcee4038020 2024-02-15T22:57:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.013+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94900531734896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07ba460 con 0x7fcee4038020 2024-02-15T22:57:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.013+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bbc70 con 0x564fc07afdf0 2024-02-15T22:57:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.014+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94900531734896] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcef403a040 con 0x7fcee4038020 2024-02-15T22:57:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.015+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.015+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94900531738480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07ba460 con 0x564fc07afdf0 2024-02-15T22:57:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.015+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bc760 con 0x564fc07b6040 2024-02-15T22:57:24.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.015+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94900531738480] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.016+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.016+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94900531732416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07ba3e0 con 0x564fc07b6040 2024-02-15T22:57:24.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.016+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bd5c0 con 0x7fcee4038020 2024-02-15T22:57:24.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.016+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94900531732416] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.017+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcef403a040 con 0x7fcee4038020 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.017+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94900531745056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bd9e0 con 0x7fcee4038020 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.017+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07be350 con 0x564fc07afdf0 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.018+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94900531745056] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcef403a040 con 0x7fcee4038020 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.018+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.018+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94900531746112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07be350 con 0x564fc07afdf0 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.018+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bed20 con 0x7fcef40141d0 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.019+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94900531746112] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.019+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.019+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94900531748528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07be2d0 con 0x7fcef40141d0 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.019+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bf790 con 0x7fcef40141d0 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.020+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94900531748528] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.020+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.020+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94900531752160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bf790 con 0x7fcef40141d0 2024-02-15T22:57:24.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.020+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bf790 con 0x7fcef40141d0 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.021+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94900531752160] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.021+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.021+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94900531753712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07c02e0 con 0x7fcef40141d0 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.021+0000 7fceff20f800 20 add_watcher() i=0 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.021+0000 7fceff20f800 20 add_watcher() i=1 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.021+0000 7fceff20f800 20 add_watcher() i=2 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.021+0000 7fceff20f800 20 add_watcher() i=3 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.021+0000 7fceff20f800 20 add_watcher() i=4 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.021+0000 7fceff20f800 20 add_watcher() i=5 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.021+0000 7fceff20f800 20 add_watcher() i=6 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.022+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94900531753712] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.022+0000 7fceff20f800 20 add_watcher() i=7 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.022+0000 7fceff20f800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.022+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07c3680 con 0x564fc07afdf0 2024-02-15T22:57:24.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.022+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.022+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94900531769504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07c0340 con 0x564fc07afdf0 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.023+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94900531769504] v32'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.023+0000 7fcdb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.023+0000 7fceff20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.023+0000 7fceff20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.024+0000 7fceff20f800 5 note: GC not initialized 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.024+0000 7fcd2bfff640 20 reqs_thread_entry: start 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.024+0000 7fceff20f800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.024+0000 7fceff20f800 20 Filter name: none 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.024+0000 7fcd29ffb640 20 reqs_thread_entry: start 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.024+0000 7fceff20f800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.024+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.024+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07f5690 con 0x7fcef40141d0 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07f3d20 con 0x564fc07afdf0 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.025+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07f4220 con 0x7fcef40141d0 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.026+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~347] v32'9 uv9 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.026+0000 7fceff20f800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.026+0000 7fceff20f800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.026+0000 7fceff20f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.026+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94900531974384 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07f8c70 con 0x7fcef40141d0 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.027+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== watch-notify(notify (1) cookie 94900531753712 notify 137438953495 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x564fc0779090 con 0x7fcef40141d0 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.027+0000 7fcdde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94900531753712 notifier 4719 bl.length()=523 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.027+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(65 notify.7 [notify cookie 94900531974384 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.027+0000 7fcdde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.027+0000 7fcdde7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.027+0000 7fcdde7fc640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fcdc0003e90 con 0x7fcef40141d0 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.027+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.027+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== watch-notify(notify_complete (2) cookie 94900531974384 notify 137438953495 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564fc0778bb0 con 0x7fcef40141d0 2024-02-15T22:57:24.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.027+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07f6b60 con 0x564fc07afdf0 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.028+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.029+0000 7fceff20f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.029+0000 7fceff20f800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.029+0000 7fceff20f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.029+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94900531972032 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07f6b60 con 0x7fcef40141d0 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.029+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== watch-notify(notify (1) cookie 94900531748528 notify 137438953496 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x564fc0778bb0 con 0x7fcef40141d0 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.029+0000 7fcdddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94900531748528 notifier 4719 bl.length()=177 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.029+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(68 notify.5 [notify cookie 94900531972032 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.029+0000 7fcdddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.029+0000 7fcdddffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.029+0000 7fcdddffb640 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fcd300033f0 con 0x7fcef40141d0 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.030+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== watch-notify(notify_complete (2) cookie 94900531972032 notify 137438953496 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564fc0688ea0 con 0x7fcef40141d0 2024-02-15T22:57:24.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.030+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.044 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:57:24.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.030+0000 7fcdb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:24.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.030+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94900531769504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07f6b60 con 0x564fc07afdf0 2024-02-15T22:57:24.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.031+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94900531769504] v32'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.031+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94900531734896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07f6b60 con 0x7fcee4038020 2024-02-15T22:57:24.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.032+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94900531734896] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcef403a040 con 0x7fcee4038020 2024-02-15T22:57:24.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.032+0000 7fceff20f800 20 remove_watcher() i=0 2024-02-15T22:57:24.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.032+0000 7fceff20f800 2 removed watcher, disabling cache 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.032+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94900531738480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07f6b60 con 0x564fc07afdf0 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.033+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94900531738480] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.033+0000 7fceff20f800 20 remove_watcher() i=1 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.033+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94900531732416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07f6b60 con 0x564fc07b6040 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.034+0000 7fcef20e3640 1 -- 172.21.15.133:0/2070124347 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94900531732416] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcee405a040 con 0x564fc07b6040 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.034+0000 7fceff20f800 20 remove_watcher() i=2 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.034+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94900531745056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07b9fc0 con 0x7fcee4038020 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.035+0000 7fcefb0e5640 1 -- 172.21.15.133:0/2070124347 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94900531745056] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcef403a040 con 0x7fcee4038020 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.035+0000 7fceff20f800 20 remove_watcher() i=3 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.035+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94900531746112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bd120 con 0x564fc07afdf0 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.036+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94900531746112] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x564fc07afdf0 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.036+0000 7fceff20f800 20 remove_watcher() i=4 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.036+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94900531748528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bd5c0 con 0x7fcef40141d0 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.037+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94900531748528] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.037+0000 7fceff20f800 20 remove_watcher() i=5 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.037+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94900531752160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bd5c0 con 0x7fcef40141d0 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.038+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94900531752160] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.038+0000 7fceff20f800 20 remove_watcher() i=6 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.038+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94900531753712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564fc07bd5c0 con 0x7fcef40141d0 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.039+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94900531753712] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceec059040 con 0x7fcef40141d0 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.039+0000 7fceff20f800 20 remove_watcher() i=7 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcef40141d0 msgr2=0x7fcef4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fcef40141d0 0x7fcef4015940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564fc07afdf0 msgr2=0x564fc07b22b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564fc07afdf0 0x564fc07b22b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcee4038020 msgr2=0x7fcee40234d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fcee4038020 0x7fcee40234d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564fc07b6040 msgr2=0x564fc07b8500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564fc07b6040 0x564fc07b8500 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcdc4036740 msgr2=0x7fcdc4038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcdc4036740 0x7fcdc4038c00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcef400b010 tx=0x7fcef4020000 comp rx=0 tx=0).stop 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 msgr2=0x564fc07a4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fcefa8e4640 1 -- 172.21.15.133:0/2070124347 reap_dead start 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc07a4340 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcee404b690 tx=0x7fcee404c750 comp rx=0 tx=0).stop 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 shutdown_connections 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 --2- 172.21.15.133:0/2070124347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc079d330 0x564fc07a4340 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 >> 172.21.15.133:0/2070124347 conn(0x564fc0799690 msgr2=0x564fc0796cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 shutdown_connections 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2070124347 wait complete. 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2296717121 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcdd4036790 msgr2=0x7fcdd4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 --2- 172.21.15.133:0/2296717121 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcdd4036790 0x7fcdd4038c50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x564fc077c9a0 tx=0x7fcef4005840 comp rx=0 tx=0).stop 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2296717121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc07900b0 msgr2=0x564fc07904d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 --2- 172.21.15.133:0/2296717121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc07900b0 0x564fc07904d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcee4001ed0 tx=0x7fcee400d7a0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2296717121 shutdown_connections 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 --2- 172.21.15.133:0/2296717121 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcdd4036790 0x7fcdd4038c50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 --2- 172.21.15.133:0/2296717121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc07900b0 0x564fc07904d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2296717121 >> 172.21.15.133:0/2296717121 conn(0x564fc0784150 msgr2=0x564fc0784550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2296717121 shutdown_connections 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.040+0000 7fceff20f800 1 -- 172.21.15.133:0/2296717121 wait complete. 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564fc06840f0 msgr2=0x564fc077f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564fc06840f0 0x564fc077f330 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcde00367e0 msgr2=0x7fcde0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcde00367e0 0x7fcde0038ca0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcee4000f60 tx=0x7fcee40012b0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 msgr2=0x564fc0778670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0778670 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fceec005870 tx=0x7fceec002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 shutdown_connections 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564fc06840f0 0x564fc077f330 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcde00367e0 0x7fcde0038ca0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 --2- 172.21.15.133:0/2437472701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fc05f4150 0x564fc0778670 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 >> 172.21.15.133:0/2437472701 conn(0x564fc067b520 msgr2=0x564fc076b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 shutdown_connections 2024-02-15T22:57:24.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.041+0000 7fceff20f800 1 -- 172.21.15.133:0/2437472701 wait complete. 2024-02-15T22:57:24.055 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:57:24.066 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:57:24.071 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-02-15T22:57:24.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-15T22:57:24.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-15T22:57:24.071 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-02-15T22:57:24.115 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:24.115 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.114+0000 7f1293011800 1 Processor -- start 2024-02-15T22:57:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.114+0000 7f1293011800 1 -- start start 2024-02-15T22:57:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.114+0000 7f1293011800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55affd1a3120 0x55affd232b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.114+0000 7f1293011800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55affd17aba0 con 0x55affd2330c0 2024-02-15T22:57:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.114+0000 7f1293011800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55affd132450 con 0x55affd1a3120 2024-02-15T22:57:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.114+0000 7f128e619640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55affd1a3120 0x55affd232b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.114+0000 7f128de18640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55affd2330c0 0x55affd235580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45294/0 (socket says 172.21.15.133:45294) 2024-02-15T22:57:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.114+0000 7f128de18640 1 -- 172.21.15.133:0/2847722244 learned_addr learned my addr 172.21.15.133:0/2847722244 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.114+0000 7f128e619640 1 -- 172.21.15.133:0/2847722244 >> v1:172.21.15.52:6789/0 conn(0x55affd2330c0 legacy=0x55affd235580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.114+0000 7f128e619640 1 -- 172.21.15.133:0/2847722244 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55affd237e70 con 0x55affd1a3120 2024-02-15T22:57:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.116+0000 7f128e619640 1 --2- 172.21.15.133:0/2847722244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd232b50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f128800a470 tx=0x7f128801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a04a4c585a95ffd server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.116+0000 7f128d617640 1 -- 172.21.15.133:0/2847722244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1288052570 con 0x55affd1a3120 2024-02-15T22:57:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.116+0000 7f128d617640 1 -- 172.21.15.133:0/2847722244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12880526d0 con 0x55affd1a3120 2024-02-15T22:57:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.116+0000 7f128d617640 1 -- 172.21.15.133:0/2847722244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1288052990 con 0x55affd1a3120 2024-02-15T22:57:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.117+0000 7f1293011800 1 -- 172.21.15.133:0/2847722244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 msgr2=0x55affd232b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.117+0000 7f1293011800 1 --2- 172.21.15.133:0/2847722244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd232b50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f128800a470 tx=0x7f128801cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.117+0000 7f1293011800 1 -- 172.21.15.133:0/2847722244 shutdown_connections 2024-02-15T22:57:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.117+0000 7f1293011800 1 --2- 172.21.15.133:0/2847722244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd232b50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.117+0000 7f1293011800 1 -- 172.21.15.133:0/2847722244 >> 172.21.15.133:0/2847722244 conn(0x55affd22a4f0 msgr2=0x55affd22c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.117+0000 7f1293011800 1 -- 172.21.15.133:0/2847722244 shutdown_connections 2024-02-15T22:57:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.117+0000 7f1293011800 1 -- 172.21.15.133:0/2847722244 wait complete. 2024-02-15T22:57:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.129+0000 7f1293011800 1 Processor -- start 2024-02-15T22:57:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.129+0000 7f1293011800 1 -- start start 2024-02-15T22:57:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.129+0000 7f1293011800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd320030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.129+0000 7f1293011800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55affd12f980 con 0x55affd1a3120 2024-02-15T22:57:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.129+0000 7f128e619640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd320030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.129+0000 7f128e619640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd320030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33494/0 (socket says 172.21.15.133:33494) 2024-02-15T22:57:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.129+0000 7f128e619640 1 -- 172.21.15.133:0/356377270 learned_addr learned my addr 172.21.15.133:0/356377270 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:24.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.129+0000 7f128e619640 1 -- 172.21.15.133:0/356377270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288005d20 con 0x55affd1a3120 2024-02-15T22:57:24.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.130+0000 7f128e619640 1 --2- 172.21.15.133:0/356377270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd320030 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1288055040 tx=0x7f128804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cc0827c12739ef server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.130+0000 7f117c608640 1 -- 172.21.15.133:0/356377270 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f128800a180 con 0x55affd1a3120 2024-02-15T22:57:24.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.130+0000 7f117c608640 1 -- 172.21.15.133:0/356377270 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128800a2e0 con 0x55affd1a3120 2024-02-15T22:57:24.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.130+0000 7f117c608640 1 -- 172.21.15.133:0/356377270 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12880529b0 con 0x55affd1a3120 2024-02-15T22:57:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.130+0000 7f1293011800 1 -- 172.21.15.133:0/356377270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 msgr2=0x55affd320030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.130+0000 7f1293011800 1 --2- 172.21.15.133:0/356377270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd320030 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1288055040 tx=0x7f128804c000 comp rx=0 tx=0).stop 2024-02-15T22:57:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.130+0000 7f1293011800 1 -- 172.21.15.133:0/356377270 shutdown_connections 2024-02-15T22:57:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.130+0000 7f1293011800 1 --2- 172.21.15.133:0/356377270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd320030 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.130+0000 7f1293011800 1 -- 172.21.15.133:0/356377270 >> 172.21.15.133:0/356377270 conn(0x55affd22a4f0 msgr2=0x55affd31b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.130+0000 7f1293011800 1 -- 172.21.15.133:0/356377270 shutdown_connections 2024-02-15T22:57:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.130+0000 7f1293011800 1 -- 172.21.15.133:0/356377270 wait complete. 2024-02-15T22:57:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.131+0000 7f1293011800 1 Processor -- start 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.131+0000 7f1293011800 1 -- start start 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.131+0000 7f1293011800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd327660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.131+0000 7f1293011800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55affd12b160 con 0x55affd1a3120 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.131+0000 7f128e619640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd327660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.131+0000 7f128e619640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd327660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33506/0 (socket says 172.21.15.133:33506) 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.131+0000 7f128e619640 1 -- 172.21.15.133:0/2407089618 learned_addr learned my addr 172.21.15.133:0/2407089618 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.132+0000 7f128e619640 1 -- 172.21.15.133:0/2407089618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55affd237e70 con 0x55affd1a3120 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.132+0000 7f128e619640 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd327660 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f128800a470 tx=0x7f1288002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.132+0000 7f117ae05640 1 -- 172.21.15.133:0/2407089618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f128806a070 con 0x55affd1a3120 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.132+0000 7f117ae05640 1 -- 172.21.15.133:0/2407089618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128805d420 con 0x55affd1a3120 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.132+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55affd327ba0 con 0x55affd1a3120 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.132+0000 7f117ae05640 1 -- 172.21.15.133:0/2407089618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f128805d5d0 con 0x55affd1a3120 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.132+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55affd328080 con 0x55affd1a3120 2024-02-15T22:57:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.133+0000 7f117ae05640 1 -- 172.21.15.133:0/2407089618 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f128805d730 con 0x55affd1a3120 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.133+0000 7f117ae05640 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1174036790 0x7f1174038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.133+0000 7f117ae05640 1 -- 172.21.15.133:0/2407089618 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f128808dad0 con 0x55affd1a3120 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.133+0000 7f128de18640 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1174036790 0x7f1174038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.133+0000 7f1293011800 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55affd2330c0 0x55affd32e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.133+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd32e990 con 0x55affd2330c0 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.133+0000 7f128ee1a640 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55affd2330c0 0x55affd32e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.133+0000 7f128de18640 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1174036790 0x7f1174038c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1278000f60 tx=0x7f12780012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.133+0000 7f128ee1a640 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55affd2330c0 0x55affd32e3c0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.134+0000 7f128ee1a640 1 -- 172.21.15.133:0/2407089618 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f128000a4a0 con 0x55affd2330c0 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.134+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd32ba70 con 0x55affd2330c0 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.134+0000 7f128ee1a640 1 -- 172.21.15.133:0/2407089618 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f128000a4a0 con 0x55affd2330c0 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.134+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3306f0 con 0x55affd2330c0 2024-02-15T22:57:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.134+0000 7f128ee1a640 1 -- 172.21.15.133:0/2407089618 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f128000a4a0 con 0x55affd2330c0 2024-02-15T22:57:24.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.134+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd32fa00 con 0x55affd2330c0 2024-02-15T22:57:24.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.135+0000 7f128ee1a640 1 -- 172.21.15.133:0/2407089618 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f128000a4a0 con 0x55affd2330c0 2024-02-15T22:57:24.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.135+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd32fe10 con 0x55affd2330c0 2024-02-15T22:57:24.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.135+0000 7f128ee1a640 1 -- 172.21.15.133:0/2407089618 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f128000a4a0 con 0x55affd2330c0 2024-02-15T22:57:24.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.135+0000 7f1293011800 1 Processor -- start 2024-02-15T22:57:24.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.135+0000 7f1293011800 1 -- start start 2024-02-15T22:57:24.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.135+0000 7f1293011800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd33f0f0 0x55affd33f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.135+0000 7f1293011800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55affd0cde80 con 0x55affd33f0f0 2024-02-15T22:57:24.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.136+0000 7f128de18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd33f0f0 0x55affd33f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.136+0000 7f128de18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd33f0f0 0x55affd33f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33508/0 (socket says 172.21.15.133:33508) 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.136+0000 7f128de18640 1 -- 172.21.15.133:0/2350192128 learned_addr learned my addr 172.21.15.133:0/2350192128 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.136+0000 7f128de18640 1 -- 172.21.15.133:0/2350192128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55affd33fa50 con 0x55affd33f0f0 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.136+0000 7f128de18640 1 --2- 172.21.15.133:0/2350192128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd33f0f0 0x55affd33f510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1278001ed0 tx=0x7f127800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.136+0000 7f1173fff640 1 -- 172.21.15.133:0/2350192128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1278020070 con 0x55affd33f0f0 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.136+0000 7f1173fff640 1 -- 172.21.15.133:0/2350192128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127801b550 con 0x55affd33f0f0 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.136+0000 7f1293011800 1 -- 172.21.15.133:0/2350192128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55affd3404c0 con 0x55affd33f0f0 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.136+0000 7f1173fff640 1 -- 172.21.15.133:0/2350192128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1278013040 con 0x55affd33f0f0 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.136+0000 7f1293011800 1 -- 172.21.15.133:0/2350192128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55affd340980 con 0x55affd33f0f0 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.137+0000 7f1173fff640 1 -- 172.21.15.133:0/2350192128 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f127801b7f0 con 0x55affd33f0f0 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.137+0000 7f1173fff640 1 --2- 172.21.15.133:0/2350192128 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11680367e0 0x7f1168038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.137+0000 7f1173fff640 1 -- 172.21.15.133:0/2350192128 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f127804e370 con 0x55affd33f0f0 2024-02-15T22:57:24.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.137+0000 7f128ee1a640 1 --2- 172.21.15.133:0/2350192128 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11680367e0 0x7f1168038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.137+0000 7f1293011800 1 Processor -- start 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f128ee1a640 1 --2- 172.21.15.133:0/2350192128 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11680367e0 0x7f1168038ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55affd32f440 tx=0x7f1280005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f1293011800 1 -- start start 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f1293011800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 0x55affd34c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f1293011800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55affd0a35d0 con 0x55affd34c3f0 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f128de18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 0x55affd34c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f128de18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 0x55affd34c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33522/0 (socket says 172.21.15.133:33522) 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f128de18640 1 -- 172.21.15.133:0/3262449141 learned_addr learned my addr 172.21.15.133:0/3262449141 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f128de18640 1 -- 172.21.15.133:0/3262449141 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55affd34cde0 con 0x55affd34c3f0 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f128de18640 1 --2- 172.21.15.133:0/3262449141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 0x55affd34c810 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f127804c750 tx=0x7f127804c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2e7d19a377fc6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f1171ffb640 1 -- 172.21.15.133:0/3262449141 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f127804b260 con 0x55affd34c3f0 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f1171ffb640 1 -- 172.21.15.133:0/3262449141 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1278040e90 con 0x55affd34c3f0 2024-02-15T22:57:24.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.138+0000 7f1171ffb640 1 -- 172.21.15.133:0/3262449141 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1278025930 con 0x55affd34c3f0 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.139+0000 7f1293011800 1 -- 172.21.15.133:0/3262449141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 msgr2=0x55affd34c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.139+0000 7f1293011800 1 --2- 172.21.15.133:0/3262449141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 0x55affd34c810 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f127804c750 tx=0x7f127804c890 comp rx=0 tx=0).stop 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.139+0000 7f1293011800 1 -- 172.21.15.133:0/3262449141 shutdown_connections 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.139+0000 7f1293011800 1 --2- 172.21.15.133:0/3262449141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 0x55affd34c810 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.139+0000 7f1293011800 1 -- 172.21.15.133:0/3262449141 >> 172.21.15.133:0/3262449141 conn(0x55affd348750 msgr2=0x55affd3467b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.139+0000 7f1293011800 1 -- 172.21.15.133:0/3262449141 shutdown_connections 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.139+0000 7f1293011800 1 -- 172.21.15.133:0/3262449141 wait complete. 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.139+0000 7f1293011800 1 Processor -- start 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.139+0000 7f1293011800 1 -- start start 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.139+0000 7f1293011800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 0x55affd353400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.139+0000 7f1293011800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55affd353940 con 0x55affd34c3f0 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.140+0000 7f128de18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 0x55affd353400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.140+0000 7f128de18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 0x55affd353400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33538/0 (socket says 172.21.15.133:33538) 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.140+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 learned_addr learned my addr 172.21.15.133:0/4286666326 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.140+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55affd340980 con 0x55affd34c3f0 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.140+0000 7f128de18640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 0x55affd353400 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f127804e2e0 tx=0x7f1278024e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.140+0000 7f115ffff640 1 -- 172.21.15.133:0/4286666326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1278025930 con 0x55affd34c3f0 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.140+0000 7f115ffff640 1 -- 172.21.15.133:0/4286666326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1278025a90 con 0x55affd34c3f0 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.140+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55affd353b40 con 0x55affd34c3f0 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.140+0000 7f115ffff640 1 -- 172.21.15.133:0/4286666326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f127801bc80 con 0x55affd34c3f0 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.140+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55affd353b40 con 0x55affd34c3f0 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.141+0000 7f115ffff640 1 -- 172.21.15.133:0/4286666326 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f127800cc60 con 0x55affd34c3f0 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.141+0000 7f115ffff640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11580367e0 0x7f1158038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.141+0000 7f115ffff640 1 -- 172.21.15.133:0/4286666326 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f127804fd70 con 0x55affd34c3f0 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.141+0000 7f128ee1a640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11580367e0 0x7f1158038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.141+0000 7f128ee1a640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11580367e0 0x7f1158038ca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f128000b010 tx=0x7f1280020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.142+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.142+0000 7f1293011800 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55affd35edb0 0x55affd361270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.142+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3619c0 con 0x55affd35edb0 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.142+0000 7f128e619640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55affd35edb0 0x55affd361270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.142+0000 7f128e619640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55affd35edb0 0x55affd361270 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.142+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1288059040 con 0x55affd35edb0 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.142+0000 7f1293011800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.142+0000 7f1293011800 20 realm 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.142+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.142+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd361d90 con 0x55affd35edb0 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1288059040 con 0x55affd35edb0 2024-02-15T22:57:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd362610 con 0x55affd35edb0 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1288059040 con 0x55affd35edb0 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd362970 con 0x55affd35edb0 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1288059040 con 0x55affd35edb0 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd363170 con 0x55affd35edb0 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 20 searching for the correct realm 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55affd365060 0x55affd367520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd365060 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.143+0000 7f128de18640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55affd365060 0x55affd367520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.144+0000 7f128de18640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55affd365060 0x55affd367520 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.144+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.144+0000 7f128de18640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1278032c10 0x7f127802e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.144+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f1278032c10 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.144+0000 7f128ee1a640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1278032c10 0x7f127802e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.144+0000 7f128ee1a640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1278032c10 0x7f127802e850 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.145+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128000a4a0 con 0x7f1278032c10 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.145+0000 7f128ee1a640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f12800141d0 0x7f1280015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.145+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f12800141d0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.145+0000 7f128e619640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f12800141d0 0x7f1280015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.145+0000 7f128e619640 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f12800141d0 0x7f1280015940 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.145+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.145+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd35edb0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.146+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.146+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd35edb0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.146+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.146+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f12800141d0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.146+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.146+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f12800141d0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.146+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.146+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f1278032c10 2024-02-15T22:57:24.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.147+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128000a4a0 con 0x7f1278032c10 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.147+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd365060 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.147+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.147+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd35edb0 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.147+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.147+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f12800141d0 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.147+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.147+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd35edb0 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.148+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.148+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f1278032c10 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.148+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.148+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd365060 2024-02-15T22:57:24.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.148+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.148+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd365060 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.148+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.148+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f12800141d0 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.149+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.149+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd365060 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.149+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.149+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd365060 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.149+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.149+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd35edb0 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.149+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.149+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd35edb0 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.150+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.150+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f12800141d0 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.150+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.150+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd365060 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.150+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.150+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f1278032c10 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.150+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.150+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd35edb0 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.150+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.151+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f12800141d0 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.151+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.151+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd365060 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.151+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.151+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f12800141d0 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.151+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.151+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f1278032c10 2024-02-15T22:57:24.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.152+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.152+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd365060 2024-02-15T22:57:24.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.152+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.152+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f12800141d0 2024-02-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.152+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.152+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x55affd35edb0 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.152+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.152+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd367bf0 con 0x7f1278032c10 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3639a0 con 0x55affd35edb0 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd363d50 con 0x55affd35edb0 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd364130 con 0x55affd35edb0 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 zone default found 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 4 Realm: () 2024-02-15T22:57:24.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 zonegroup default 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.153+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd368030 con 0x7f12800141d0 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f1293011800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd369eb0 con 0x55affd365060 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f1293011800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36a210 con 0x55affd365060 2024-02-15T22:57:24.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f1293011800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f1293011800 20 started sync module instance, tier type = 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f1293011800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.154+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd369480 con 0x7f1278032c10 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.155+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.155+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94214355851360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd369480 con 0x7f1278032c10 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.155+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36ac20 con 0x55affd35edb0 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.156+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94214355851360] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.156+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.156+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94214355855120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd369480 con 0x55affd35edb0 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.156+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36b710 con 0x55affd365060 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.157+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94214355855120] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.158+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.158+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94214355849184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd369400 con 0x55affd365060 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.158+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36c570 con 0x7f1278032c10 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.159+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94214355849184] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.159+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.159+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94214355861712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36c990 con 0x7f1278032c10 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.159+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36d300 con 0x55affd35edb0 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.160+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94214355861712] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.160+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.160+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94214355865664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36c990 con 0x55affd35edb0 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.160+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36dd00 con 0x7f12800141d0 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.161+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94214355865664] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.161+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.161+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94214355867680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36c990 con 0x7f12800141d0 2024-02-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.161+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36e700 con 0x7f12800141d0 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.162+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94214355867680] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.162+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.163+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94214355870240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36e8e0 con 0x7f12800141d0 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.163+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36f0e0 con 0x7f12800141d0 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.164+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.164+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94214355870240] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.164+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94214355872448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36c530 con 0x7f12800141d0 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.164+0000 7f1293011800 20 add_watcher() i=0 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.164+0000 7f1293011800 20 add_watcher() i=1 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.164+0000 7f1293011800 20 add_watcher() i=2 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.164+0000 7f1293011800 20 add_watcher() i=3 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.164+0000 7f1293011800 20 add_watcher() i=4 2024-02-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.164+0000 7f1293011800 20 add_watcher() i=5 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.164+0000 7f1293011800 20 add_watcher() i=6 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.165+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94214355872448] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.165+0000 7f1293011800 20 add_watcher() i=7 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.165+0000 7f1293011800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.165+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd372640 con 0x55affd35edb0 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.165+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.165+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94214355873504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd36f990 con 0x55affd35edb0 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.166+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94214355873504] v32'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.166+0000 7f1144fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.166+0000 7f1293011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.166+0000 7f1293011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.166+0000 7f1293011800 5 note: GC not initialized 2024-02-15T22:57:24.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.166+0000 7f10bf7fe640 20 reqs_thread_entry: start 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.166+0000 7f1293011800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.167+0000 7f1293011800 20 Filter name: none 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.167+0000 7f10bd7fa640 20 reqs_thread_entry: start 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.167+0000 7f1293011800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.167+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.167+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3a45a0 con 0x7f12800141d0 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.167+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(62 bar [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.167+0000 7f1293011800 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.167+0000 7f1293011800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.167+0000 7f1293011800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.167+0000 7f1293011800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.167+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3a8270 con 0x7f1278032c10 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.168+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(63 bud [create,call,writefull 0~181] v32'1 uv1 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.168+0000 7f1293011800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.168+0000 7f1293011800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.168+0000 7f1293011800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.168+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94214356103200 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3a8ef0 con 0x7f12800141d0 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.169+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== watch-notify(notify (1) cookie 94214355867680 notify 137438953498 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x55affd328080 con 0x7f12800141d0 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.169+0000 7f1171ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94214355867680 notifier 4726 bl.length()=357 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.169+0000 7f1171ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.169+0000 7f1171ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.169+0000 7f1171ffb640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1154003e90 con 0x7f12800141d0 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.169+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(64 notify.5 [notify cookie 94214356103200 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.169+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.169+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== watch-notify(notify_complete (2) cookie 94214356103200 notify 137438953498 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55affd327ba0 con 0x7f12800141d0 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.169+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3a7490 con 0x55affd35edb0 2024-02-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f1293011800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 : miss 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 8.19 8:9d284258:root::.bucket.meta.myfoo6%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3a7490 con 0x55affd35edb0 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(67 .bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f1293011800 20 rados_obj.operate() r=0 bl.length=353 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f1293011800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 info.flags=0x17 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f1293011800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 to cache LRU end 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f1293011800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f1293011800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f1293011800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.170+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 8.19 8:9d284258:root::.bucket.meta.myfoo6%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3b0260 con 0x55affd35edb0 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.171+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 .bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 [delete,create,call,call,writefull 0~353,setxattr (117)] v32'4 uv4 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.171+0000 7f1293011800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 info.flags=0x17 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.171+0000 7f1293011800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 to cache LRU end 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.171+0000 7f1293011800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.171+0000 7f1293011800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9, ofs0, ns] 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.171+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.9 7:93e5b521:::notify.7:head [notify cookie 94214356106848 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3aa8f0 con 0x7f12800141d0 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== watch-notify(notify (1) cookie 94214355872448 notify 137438953499 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x55affd327ba0 con 0x7f12800141d0 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f11717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94214355872448 notifier 4726 bl.length()=721 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f11717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 info.flags=0x17 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f11717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 to cache LRU end 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(69 notify.7 [notify cookie 94214356106848 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f11717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f11717fa640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f10c4003520 con 0x7f12800141d0 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(70 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== watch-notify(notify_complete (2) cookie 94214356106848 notify 137438953499 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55affd237e70 con 0x7f12800141d0 2024-02-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f1293011800 20 handle_bi_update(): bucket=:myfoo6[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9]): orig_sources= new_sources= 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f1293011800 20 handle_bi_update(): bucket=:myfoo6[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9]): potential sources added=[] removed=[] 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f1293011800 20 handle_bi_update(): bucket=:myfoo6[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9]): orig_dests= new_dests= 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f1293011800 20 handle_bi_update(): bucket=:myfoo6[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9]): potential dests added=[] removed=[] 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.172+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3a7e60 con 0x55affd35edb0 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.173+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(71 bud.buckets [call] v32'5 uv0 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.173+0000 7f1293011800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.173+0000 7f1293011800 20 rados->read ofs=0 len=0 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.173+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3a7e20 con 0x55affd35edb0 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.173+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(72 myfoo6 [call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 234+0+289 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.173+0000 7f1293011800 20 rados_obj.operate() r=0 bl.length=166 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.173+0000 7f1293011800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.173+0000 7f1293011800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.173+0000 7f1293011800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.173+0000 7f1293011800 0 bucket entry point user mismatch, can't unlink bucket: bar != bud 2024-02-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.173+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:73 4.1 4:82f9ae3e:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3a7e20 con 0x7f1278032c10 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.174+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(73 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.174+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 4.34 4:2eb7804d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3a7e20 con 0x7f1278032c10 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.174+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(74 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.174+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:75 4.19 4:9b3e63df:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3a7e20 con 0x55affd365060 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.174+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(75 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.175+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:76 4.10 4:0a9e4b3c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3aa8f0 con 0x55affd365060 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.175+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(76 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.3 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.175+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 4.3b 4:dd132693:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3aad00 con 0x55affd365060 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.175+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(77 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.175+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:78 4.2f 4:f722ef90:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3ab150 con 0x55affd35edb0 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.175+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(78 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.175+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:79 4.33 4:cdca6f5b:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3ab150 con 0x7f12800141d0 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.176+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(79 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.176+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 4.35 4:aed97077:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3ab150 con 0x55affd35edb0 2024-02-15T22:57:24.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.177+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(80 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.177+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 4.2f 4:f6a79823:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3ab150 con 0x55affd35edb0 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.177+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(81 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.177+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:82 4.18 4:1b597548:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3ab150 con 0x7f1278032c10 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.177+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(82 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.9 [call out=377b] v0'0 uv13 ondisk = 0) v8 ==== 194+0+377 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.177+0000 7f1293011800 10 cls_bucket_list_unordered: got thirteen 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.177+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:83 4.4 4:214481f1:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3ab150 con 0x7f12800141d0 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(83 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 get_obj_state: octx=0x7f1280029040 obj=myfoo6:thirteen state=0x55affd3aedc8 s->prefetch_data=0 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 3.18 3:18c6112d:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3ab150 con 0x55affd365060 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(84 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+870 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 10 manifest: total_size = 8 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 get_obj_state: setting s->obj_tag to b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.5828479624518476817 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 Read xattr rgw_rados: user.rgw.acl 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 Read xattr rgw_rados: user.rgw.content_type 2024-02-15T22:57:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 Read xattr rgw_rados: user.rgw.etag 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 Read xattr rgw_rados: user.rgw.idtag 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 Read xattr rgw_rados: user.rgw.manifest 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 get_obj_state: octx=0x7f1280029040 obj=myfoo6:thirteen state=0x55affd3aedc8 s->prefetch_data=0 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 : hit (requested=0x17, cached=0x17) 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 20 bucket index object: :.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.9 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.178+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:85 4.18 4:1b597548:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3b4900 con 0x7f1278032c10 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.179+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(85 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.9 [stat,call,call] v32'14 uv14 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.179+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 3.18 3:18c6112d:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3aa330 con 0x55affd365060 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.180+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(86 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v32'2 uv2 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.180+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:87 4.18 4:1b597548:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3b3f90 con 0x7f1278032c10 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:1 objects processed in :myfoo6[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9]). Next marker thirteen 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.181+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:88 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3b3f90 con 0x7f1278032c10 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(87 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.9.9 [stat,call,call] v32'15 uv15 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f11717fa640 20 handle_completion(): completion ok for obj=thirteen 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(88 bud [delete,create,call,writefull 0~347] v32'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f1293011800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f1293011800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f1293011800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:89 7.3 7:c609908c:::notify.5:head [notify cookie 94214356157728 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3b3f90 con 0x7f12800141d0 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== watch-notify(notify (1) cookie 94214355867680 notify 137438953500 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7f12880a5040 con 0x7f12800141d0 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f1171ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94214355867680 notifier 4726 bl.length()=523 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f1171ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f1171ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(89 notify.5 [notify cookie 94214356157728 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f1171ffb640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1154003e90 con 0x7f12800141d0 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 30 ==== osd_op_reply(90 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 31 ==== watch-notify(notify_complete (2) cookie 94214356157728 notify 137438953500 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55affd237e70 con 0x7f12800141d0 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.182+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:91 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3a5260 con 0x55affd35edb0 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.183+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(91 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'2 uv2 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.183+0000 7f1293011800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.183+0000 7f1293011800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.183+0000 7f1293011800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.183+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 7.3 7:c609908c:::notify.5:head [notify cookie 94214356113632 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3b3f70 con 0x7f12800141d0 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.184+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 32 ==== watch-notify(notify (1) cookie 94214355867680 notify 137438953501 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55affd237e70 con 0x7f12800141d0 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.184+0000 7f11717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94214355867680 notifier 4726 bl.length()=177 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.184+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 33 ==== osd_op_reply(92 notify.5 [notify cookie 94214356113632 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.184+0000 7f11717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.184+0000 7f11717fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.184+0000 7f11717fa640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f10c4003880 con 0x7f12800141d0 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.184+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 34 ==== osd_op_reply(93 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.184+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 35 ==== watch-notify(notify_complete (2) cookie 94214356113632 notify 137438953501 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1288005d20 con 0x7f12800141d0 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.185+0000 7f1293011800 10 removing user index: bar 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.185+0000 7f1293011800 10 removing default.rgw.meta+users.uid+bar from cache 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.185+0000 7f1293011800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.185+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:94 7.9 7:93e5b521:::notify.7:head [notify cookie 94214356157728 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3b3f70 con 0x7f12800141d0 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.185+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 36 ==== watch-notify(notify (1) cookie 94214355872448 notify 137438953502 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f1288005d20 con 0x7f12800141d0 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.185+0000 7f11717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94214355872448 notifier 4726 bl.length()=152 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.185+0000 7f11717fa640 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:95 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f10c4003880 con 0x7f12800141d0 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.185+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 37 ==== osd_op_reply(94 notify.7 [notify cookie 94214356157728 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.185+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 38 ==== osd_op_reply(95 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.185+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 39 ==== watch-notify(notify_complete (2) cookie 94214356157728 notify 137438953502 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f128804e070 con 0x7f12800141d0 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.185+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:96 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd3b3f70 con 0x7f12800141d0 2024-02-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.186+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 40 ==== osd_op_reply(96 bar [delete] v32'10 uv10 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.202 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.187+0000 7f1144fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.187+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94214355873504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd38e5a0 con 0x55affd35edb0 2024-02-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.188+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94214355873504] v32'213 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.188+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94214355851360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd38e5a0 con 0x7f1278032c10 2024-02-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.189+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94214355851360] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.189+0000 7f1293011800 20 remove_watcher() i=0 2024-02-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.189+0000 7f1293011800 2 removed watcher, disabling cache 2024-02-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.189+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94214355855120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd363d50 con 0x55affd35edb0 2024-02-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.190+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94214355855120] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.190+0000 7f1293011800 20 remove_watcher() i=1 2024-02-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.190+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94214355849184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd363d50 con 0x55affd365060 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.191+0000 7f128de18640 1 -- 172.21.15.133:0/4286666326 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94214355849184] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1278034020 con 0x55affd365060 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.191+0000 7f1293011800 20 remove_watcher() i=2 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.191+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94214355861712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd363d50 con 0x7f1278032c10 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.192+0000 7f128ee1a640 1 -- 172.21.15.133:0/4286666326 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94214355861712] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128003a040 con 0x7f1278032c10 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.192+0000 7f1293011800 20 remove_watcher() i=3 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.192+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94214355865664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd363d50 con 0x55affd35edb0 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.193+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94214355865664] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x55affd35edb0 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.193+0000 7f1293011800 20 remove_watcher() i=4 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.193+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94214355867680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd363d50 con 0x7f12800141d0 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.194+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 41 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94214355867680] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.194+0000 7f1293011800 20 remove_watcher() i=5 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.194+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94214355870240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd363d50 con 0x7f12800141d0 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.195+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 42 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94214355870240] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.195+0000 7f1293011800 20 remove_watcher() i=6 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.195+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94214355872448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55affd363d50 con 0x7f12800141d0 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 <== osd.0 v2:172.21.15.52:6800/431200118 43 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94214355872448] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f128807e040 con 0x7f12800141d0 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 20 remove_watcher() i=7 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f12800141d0 msgr2=0x7f1280015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f12800141d0 0x7f1280015940 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55affd35edb0 msgr2=0x55affd361270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55affd35edb0 0x55affd361270 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1278032c10 msgr2=0x7f127802e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f1278032c10 0x7f127802e850 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55affd365060 msgr2=0x55affd367520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55affd365060 0x55affd367520 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11580367e0 msgr2=0x7f1158038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11580367e0 0x7f1158038ca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f128000b010 tx=0x7f1280020000 comp rx=0 tx=0).stop 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 msgr2=0x55affd353400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f1293011800 1 --2- 172.21.15.133:0/4286666326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd34c3f0 0x55affd353400 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f127804e2e0 tx=0x7f1278024e90 comp rx=0 tx=0).stop 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 reap_dead start 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.196+0000 7f128e619640 1 -- 172.21.15.133:0/4286666326 reap_dead start 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 shutdown_connections 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 >> 172.21.15.133:0/4286666326 conn(0x55affd348750 msgr2=0x55affd345db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 shutdown_connections 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/4286666326 wait complete. 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2350192128 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11680367e0 msgr2=0x7f1168038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 --2- 172.21.15.133:0/2350192128 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11680367e0 0x7f1168038ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55affd32f440 tx=0x7f1280005840 comp rx=0 tx=0).stop 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2350192128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd33f0f0 msgr2=0x55affd33f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 --2- 172.21.15.133:0/2350192128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd33f0f0 0x55affd33f510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1278001ed0 tx=0x7f127800d7a0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2350192128 shutdown_connections 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 --2- 172.21.15.133:0/2350192128 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11680367e0 0x7f1168038ca0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 --2- 172.21.15.133:0/2350192128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd33f0f0 0x55affd33f510 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2350192128 >> 172.21.15.133:0/2350192128 conn(0x55affd333190 msgr2=0x55affd333590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2350192128 shutdown_connections 2024-02-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2350192128 wait complete. 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55affd2330c0 msgr2=0x55affd32e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55affd2330c0 0x55affd32e3c0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1174036790 msgr2=0x7f1174038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1174036790 0x7f1174038c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1278000f60 tx=0x7f12780012b0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 msgr2=0x55affd327660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd327660 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f128800a470 tx=0x7f1288002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 shutdown_connections 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55affd2330c0 0x55affd32e3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1174036790 0x7f1174038c50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 --2- 172.21.15.133:0/2407089618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55affd1a3120 0x55affd327660 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 >> 172.21.15.133:0/2407089618 conn(0x55affd22a4f0 msgr2=0x55affd31a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 shutdown_connections 2024-02-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:24.197+0000 7f1293011800 1 -- 172.21.15.133:0/2407089618 wait complete. 2024-02-15T22:57:24.212 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:57:29.218 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:57:29.218 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-15T22:57:29.219 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-15T22:57:29.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-15T22:57:29.219 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-02-15T22:57:29.276 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:29.276 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:29.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.275+0000 7fc9c3610800 1 Processor -- start 2024-02-15T22:57:29.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.275+0000 7fc9c3610800 1 -- start start 2024-02-15T22:57:29.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.275+0000 7fc9c3610800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56192fc0b440 0x56192fc13f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.275+0000 7fc9c3610800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56192fb55bd0 con 0x56192fc09900 2024-02-15T22:57:29.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.275+0000 7fc9c3610800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x56192fb0d450 con 0x56192fc0b440 2024-02-15T22:57:29.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.275+0000 7fc9be5bd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56192fc0b440 0x56192fc13f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.275+0000 7fc9bedbe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x56192fc09900 0x56192fc09d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45306/0 (socket says 172.21.15.133:45306) 2024-02-15T22:57:29.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.275+0000 7fc9bedbe640 1 -- 172.21.15.133:0/839879499 learned_addr learned my addr 172.21.15.133:0/839879499 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:29.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.276+0000 7fc9be5bd640 1 -- 172.21.15.133:0/839879499 >> v1:172.21.15.52:6789/0 conn(0x56192fc09900 legacy=0x56192fc09d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.276+0000 7fc9be5bd640 1 -- 172.21.15.133:0/839879499 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56192fb7e1b0 con 0x56192fc0b440 2024-02-15T22:57:29.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.278+0000 7fc9be5bd640 1 --2- 172.21.15.133:0/839879499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc0b440 0x56192fc13f40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400a470 tx=0x7fc9b401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4145eadba7e3c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.278+0000 7fc9bddbc640 1 -- 172.21.15.133:0/839879499 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b404ad40 con 0x56192fc0b440 2024-02-15T22:57:29.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.278+0000 7fc9bddbc640 1 -- 172.21.15.133:0/839879499 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b4052440 con 0x56192fc0b440 2024-02-15T22:57:29.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.278+0000 7fc9bddbc640 1 -- 172.21.15.133:0/839879499 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b404aea0 con 0x56192fc0b440 2024-02-15T22:57:29.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.278+0000 7fc9c3610800 1 -- 172.21.15.133:0/839879499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc0b440 msgr2=0x56192fc13f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.278+0000 7fc9c3610800 1 --2- 172.21.15.133:0/839879499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc0b440 0x56192fc13f40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400a470 tx=0x7fc9b401cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:29.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.278+0000 7fc9c3610800 1 -- 172.21.15.133:0/839879499 shutdown_connections 2024-02-15T22:57:29.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.278+0000 7fc9c3610800 1 --2- 172.21.15.133:0/839879499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc0b440 0x56192fc13f40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.278+0000 7fc9c3610800 1 -- 172.21.15.133:0/839879499 >> 172.21.15.133:0/839879499 conn(0x56192fc05520 msgr2=0x56192fc07940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.278+0000 7fc9c3610800 1 -- 172.21.15.133:0/839879499 shutdown_connections 2024-02-15T22:57:29.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.278+0000 7fc9c3610800 1 -- 172.21.15.133:0/839879499 wait complete. 2024-02-15T22:57:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.292+0000 7fc9c3610800 1 Processor -- start 2024-02-15T22:57:29.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.292+0000 7fc9c3610800 1 -- start start 2024-02-15T22:57:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.292+0000 7fc9c3610800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fcfd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.292+0000 7fc9c3610800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56192fb0a980 con 0x56192fc09900 2024-02-15T22:57:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.292+0000 7fc9bedbe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fcfd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.292+0000 7fc9bedbe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fcfd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33570/0 (socket says 172.21.15.133:33570) 2024-02-15T22:57:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.292+0000 7fc9bedbe640 1 -- 172.21.15.133:0/1388222776 learned_addr learned my addr 172.21.15.133:0/1388222776 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.292+0000 7fc9bedbe640 1 -- 172.21.15.133:0/1388222776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4005d20 con 0x56192fc09900 2024-02-15T22:57:29.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.293+0000 7fc9bedbe640 1 --2- 172.21.15.133:0/1388222776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fcfd400 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0001c50 tx=0x7fc9b000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfeff9ee8860a72 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.293+0000 7fc8ace09640 1 -- 172.21.15.133:0/1388222776 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b000e470 con 0x56192fc09900 2024-02-15T22:57:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.293+0000 7fc8ace09640 1 -- 172.21.15.133:0/1388222776 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b000e5d0 con 0x56192fc09900 2024-02-15T22:57:29.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.293+0000 7fc8ace09640 1 -- 172.21.15.133:0/1388222776 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b000e8d0 con 0x56192fc09900 2024-02-15T22:57:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.293+0000 7fc9c3610800 1 -- 172.21.15.133:0/1388222776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 msgr2=0x56192fcfd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.293+0000 7fc9c3610800 1 --2- 172.21.15.133:0/1388222776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fcfd400 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0001c50 tx=0x7fc9b000b6c0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9c3610800 1 -- 172.21.15.133:0/1388222776 shutdown_connections 2024-02-15T22:57:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9c3610800 1 --2- 172.21.15.133:0/1388222776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fcfd400 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9c3610800 1 -- 172.21.15.133:0/1388222776 >> 172.21.15.133:0/1388222776 conn(0x56192fc05520 msgr2=0x56192fcf8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9c3610800 1 -- 172.21.15.133:0/1388222776 shutdown_connections 2024-02-15T22:57:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9c3610800 1 -- 172.21.15.133:0/1388222776 wait complete. 2024-02-15T22:57:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9c3610800 1 Processor -- start 2024-02-15T22:57:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9c3610800 1 -- start start 2024-02-15T22:57:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9c3610800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fd04ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9c3610800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56192fb06160 con 0x56192fc09900 2024-02-15T22:57:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9bedbe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fd04ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9bedbe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fd04ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33586/0 (socket says 172.21.15.133:33586) 2024-02-15T22:57:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.294+0000 7fc9bedbe640 1 -- 172.21.15.133:0/391611085 learned_addr learned my addr 172.21.15.133:0/391611085 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.295+0000 7fc9bedbe640 1 -- 172.21.15.133:0/391611085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56192fb55bd0 con 0x56192fc09900 2024-02-15T22:57:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.295+0000 7fc9bedbe640 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fd04ac0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000c00 tx=0x7fc9b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.295+0000 7fc8ab606640 1 -- 172.21.15.133:0/391611085 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b001f070 con 0x56192fc09900 2024-02-15T22:57:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.295+0000 7fc8ab606640 1 -- 172.21.15.133:0/391611085 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0018770 con 0x56192fc09900 2024-02-15T22:57:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.295+0000 7fc8ab606640 1 -- 172.21.15.133:0/391611085 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b0018a30 con 0x56192fc09900 2024-02-15T22:57:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.295+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56192fd05000 con 0x56192fc09900 2024-02-15T22:57:29.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.295+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56192fd054e0 con 0x56192fc09900 2024-02-15T22:57:29.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.296+0000 7fc8ab606640 1 -- 172.21.15.133:0/391611085 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc9b0018b90 con 0x56192fc09900 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.296+0000 7fc8ab606640 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8a4036830 0x7fc8a4038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.296+0000 7fc8ab606640 1 -- 172.21.15.133:0/391611085 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fc9b004c260 con 0x56192fc09900 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.296+0000 7fc9be5bd640 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8a4036830 0x7fc8a4038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.296+0000 7fc9c3610800 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56192fc0b440 0x56192fd0b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.296+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd0bd40 con 0x56192fc0b440 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.296+0000 7fc9bf5bf640 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56192fc0b440 0x56192fd0b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.297+0000 7fc9be5bd640 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8a4036830 0x7fc8a4038cf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4054000 tx=0x7fc9b404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.297+0000 7fc9bf5bf640 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56192fc0b440 0x56192fd0b770 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.297+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/391611085 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc9b800a4a0 con 0x56192fc0b440 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.297+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd08e60 con 0x56192fc0b440 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.297+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/391611085 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc9b800a4a0 con 0x56192fc0b440 2024-02-15T22:57:29.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.297+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd0da70 con 0x56192fc0b440 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.298+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/391611085 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc9b800a4a0 con 0x56192fc0b440 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.298+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd0cc70 con 0x56192fc0b440 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.298+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/391611085 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc9b800a4a0 con 0x56192fc0b440 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.298+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd0d080 con 0x56192fc0b440 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.298+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/391611085 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc9b800a4a0 con 0x56192fc0b440 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.299+0000 7fc9c3610800 1 Processor -- start 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.299+0000 7fc9c3610800 1 -- start start 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.299+0000 7fc9c3610800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd1c4f0 0x56192fd1c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.299+0000 7fc9c3610800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56192faa8e80 con 0x56192fd1c4f0 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.299+0000 7fc9be5bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd1c4f0 0x56192fd1c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.299+0000 7fc9be5bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd1c4f0 0x56192fd1c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33602/0 (socket says 172.21.15.133:33602) 2024-02-15T22:57:29.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.299+0000 7fc9be5bd640 1 -- 172.21.15.133:0/215880193 learned_addr learned my addr 172.21.15.133:0/215880193 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.299+0000 7fc9be5bd640 1 -- 172.21.15.133:0/215880193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56192fd1ce50 con 0x56192fd1c4f0 2024-02-15T22:57:29.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.300+0000 7fc9be5bd640 1 --2- 172.21.15.133:0/215880193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd1c4f0 0x56192fd1c910 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc9b401d490 tx=0x7fc9b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.300+0000 7fc8a8e01640 1 -- 172.21.15.133:0/215880193 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b405c540 con 0x56192fd1c4f0 2024-02-15T22:57:29.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.300+0000 7fc8a8e01640 1 -- 172.21.15.133:0/215880193 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b4063040 con 0x56192fd1c4f0 2024-02-15T22:57:29.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.300+0000 7fc8a8e01640 1 -- 172.21.15.133:0/215880193 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b405c810 con 0x56192fd1c4f0 2024-02-15T22:57:29.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.300+0000 7fc9c3610800 1 -- 172.21.15.133:0/215880193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56192fd1d040 con 0x56192fd1c4f0 2024-02-15T22:57:29.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.300+0000 7fc9c3610800 1 -- 172.21.15.133:0/215880193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56192fd1dbf0 con 0x56192fd1c4f0 2024-02-15T22:57:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.301+0000 7fc8a8e01640 1 -- 172.21.15.133:0/215880193 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc9b405c970 con 0x56192fd1c4f0 2024-02-15T22:57:29.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.301+0000 7fc8a8e01640 1 --2- 172.21.15.133:0/215880193 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8980367e0 0x7fc898038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.301+0000 7fc8a8e01640 1 -- 172.21.15.133:0/215880193 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fc9b408e630 con 0x56192fd1c4f0 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.301+0000 7fc9bf5bf640 1 --2- 172.21.15.133:0/215880193 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8980367e0 0x7fc898038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.301+0000 7fc9c3610800 1 Processor -- start 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.301+0000 7fc9c3610800 1 -- start start 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.301+0000 7fc9bf5bf640 1 --2- 172.21.15.133:0/215880193 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8980367e0 0x7fc898038ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x56192fd0c6b0 tx=0x7fc9b8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.301+0000 7fc9c3610800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd29a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.301+0000 7fc9c3610800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56192fa7e5d0 con 0x56192fd29650 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.302+0000 7fc9be5bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd29a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.302+0000 7fc9be5bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd29a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33604/0 (socket says 172.21.15.133:33604) 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.302+0000 7fc9be5bd640 1 -- 172.21.15.133:0/2644062915 learned_addr learned my addr 172.21.15.133:0/2644062915 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.302+0000 7fc9be5bd640 1 -- 172.21.15.133:0/2644062915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56192fd2a040 con 0x56192fd29650 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.302+0000 7fc9be5bd640 1 --2- 172.21.15.133:0/2644062915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd29a70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc9b408ca80 tx=0x7fc9b4070920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2235dce1770dd7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.302+0000 7fc8a27fc640 1 -- 172.21.15.133:0/2644062915 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b405be10 con 0x56192fd29650 2024-02-15T22:57:29.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.302+0000 7fc8a27fc640 1 -- 172.21.15.133:0/2644062915 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b406f360 con 0x56192fd29650 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.302+0000 7fc8a27fc640 1 -- 172.21.15.133:0/2644062915 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b406f510 con 0x56192fd29650 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.303+0000 7fc9c3610800 1 -- 172.21.15.133:0/2644062915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 msgr2=0x56192fd29a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.303+0000 7fc9c3610800 1 --2- 172.21.15.133:0/2644062915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd29a70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc9b408ca80 tx=0x7fc9b4070920 comp rx=0 tx=0).stop 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.303+0000 7fc9c3610800 1 -- 172.21.15.133:0/2644062915 shutdown_connections 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.303+0000 7fc9c3610800 1 --2- 172.21.15.133:0/2644062915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd29a70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.303+0000 7fc9c3610800 1 -- 172.21.15.133:0/2644062915 >> 172.21.15.133:0/2644062915 conn(0x56192fd25970 msgr2=0x56192fd239d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.303+0000 7fc9c3610800 1 -- 172.21.15.133:0/2644062915 shutdown_connections 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.303+0000 7fc9c3610800 1 -- 172.21.15.133:0/2644062915 wait complete. 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.303+0000 7fc9c3610800 1 Processor -- start 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.303+0000 7fc9c3610800 1 -- start start 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.303+0000 7fc9c3610800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd30770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.303+0000 7fc9c3610800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56192fd30cb0 con 0x56192fd29650 2024-02-15T22:57:29.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.304+0000 7fc9be5bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd30770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.304+0000 7fc9be5bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd30770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33606/0 (socket says 172.21.15.133:33606) 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.304+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 learned_addr learned my addr 172.21.15.133:0/459645775 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.304+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56192fd1dbf0 con 0x56192fd29650 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.304+0000 7fc9be5bd640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd30770 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc9b406f8a0 tx=0x7fc9b408c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.304+0000 7fc8a0ff9640 1 -- 172.21.15.133:0/459645775 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b406f910 con 0x56192fd29650 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.305+0000 7fc8a0ff9640 1 -- 172.21.15.133:0/459645775 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b405be10 con 0x56192fd29650 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.305+0000 7fc8a0ff9640 1 -- 172.21.15.133:0/459645775 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b406f4d0 con 0x56192fd29650 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.305+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56192fd30eb0 con 0x56192fd29650 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.305+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56192fd31310 con 0x56192fd29650 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.305+0000 7fc8a0ff9640 1 -- 172.21.15.133:0/459645775 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc9b408b1b0 con 0x56192fd29650 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.306+0000 7fc8a0ff9640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8880367e0 0x7fc888038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.306+0000 7fc8a0ff9640 1 -- 172.21.15.133:0/459645775 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fc9b4086bb0 con 0x56192fd29650 2024-02-15T22:57:29.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.306+0000 7fc9bf5bf640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8880367e0 0x7fc888038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.306+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.306+0000 7fc9c3610800 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56192fd3c2a0 0x56192fd3e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.306+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd3eeb0 con 0x56192fd3c2a0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.306+0000 7fc9bf5bf640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8880367e0 0x7fc888038ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800b010 tx=0x7fc9b8020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.306+0000 7fc9bedbe640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56192fd3c2a0 0x56192fd3e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9bedbe640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56192fd3c2a0 0x56192fd3e760 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc9b0014070 con 0x56192fd3c2a0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9c3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9c3610800 20 realm 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd3f280 con 0x56192fd3c2a0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc9b0014070 con 0x56192fd3c2a0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9c3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9c3610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd3fb00 con 0x56192fd3c2a0 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc9b0014070 con 0x56192fd3c2a0 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9c3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.307+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd3fe60 con 0x56192fd3c2a0 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.308+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc9b0014070 con 0x56192fd3c2a0 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.308+0000 7fc9c3610800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.308+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.308+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd40660 con 0x56192fd3c2a0 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.308+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fc9b0014070 con 0x56192fd3c2a0 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.308+0000 7fc9c3610800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:29.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.308+0000 7fc9c3610800 20 searching for the correct realm 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.308+0000 7fc9c3610800 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x56192fd424f0 0x56192fd449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.308+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd424f0 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.308+0000 7fc9be5bd640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x56192fd424f0 0x56192fd449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.308+0000 7fc9be5bd640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x56192fd424f0 0x56192fd449b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.309+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.309+0000 7fc9be5bd640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fc9b40703b0 0x7fc9b408e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.309+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b40703b0 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.309+0000 7fc9bf5bf640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fc9b40703b0 0x7fc9b408e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.309+0000 7fc9bf5bf640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fc9b40703b0 0x7fc9b408e890 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.309+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b800a4a0 con 0x7fc9b40703b0 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.309+0000 7fc9bf5bf640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fc9b80141d0 0x7fc9b8015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.309+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b80141d0 2024-02-15T22:57:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.310+0000 7fc9bedbe640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fc9b80141d0 0x7fc9b8015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.310+0000 7fc9bedbe640 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fc9b80141d0 0x7fc9b8015940 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.310+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0035040 con 0x7fc9b80141d0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.310+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd3c2a0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.311+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0035040 con 0x56192fd3c2a0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.311+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd3c2a0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.311+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0035040 con 0x56192fd3c2a0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.311+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b80141d0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.311+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0035040 con 0x7fc9b80141d0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.311+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b80141d0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.311+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0035040 con 0x7fc9b80141d0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.311+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b40703b0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.312+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b800a4a0 con 0x7fc9b40703b0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.312+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd424f0 2024-02-15T22:57:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.312+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.312+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd3c2a0 2024-02-15T22:57:29.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.312+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0035040 con 0x56192fd3c2a0 2024-02-15T22:57:29.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.312+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b80141d0 2024-02-15T22:57:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.313+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0035040 con 0x7fc9b80141d0 2024-02-15T22:57:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.313+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd3c2a0 2024-02-15T22:57:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.313+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0035040 con 0x56192fd3c2a0 2024-02-15T22:57:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.313+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b40703b0 2024-02-15T22:57:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.313+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc9b803a040 con 0x7fc9b40703b0 2024-02-15T22:57:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.313+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd424f0 2024-02-15T22:57:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.313+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.313+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd424f0 2024-02-15T22:57:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.314+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.314+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b80141d0 2024-02-15T22:57:29.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.314+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0035040 con 0x7fc9b80141d0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.314+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd424f0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.314+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.314+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd424f0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.314+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.314+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd3c2a0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.315+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0035040 con 0x56192fd3c2a0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.315+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd3c2a0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.315+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc9b0035040 con 0x56192fd3c2a0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.315+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b80141d0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.315+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.315+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd424f0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.316+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.316+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b40703b0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.316+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b803a040 con 0x7fc9b40703b0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.316+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd3c2a0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.316+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.316+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b80141d0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.316+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.316+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd424f0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.317+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.317+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b80141d0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.317+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.317+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b40703b0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.317+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b803a040 con 0x7fc9b40703b0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.317+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd424f0 2024-02-15T22:57:29.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.317+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.317+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b80141d0 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x56192fd3c2a0 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd45080 con 0x7fc9b40703b0 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc9b803a040 con 0x7fc9b40703b0 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9c3610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9c3610800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9c3610800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9c3610800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9c3610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9c3610800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:29.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.318+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd40f90 con 0x56192fd3c2a0 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd417e0 con 0x56192fd3c2a0 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd454c0 con 0x56192fd3c2a0 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 20 zone default found 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 4 Realm: () 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:29.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 20 zonegroup default 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd454c0 con 0x7fc9b80141d0 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.319+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd47340 con 0x56192fd424f0 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.320+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.320+0000 7fc9c3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.320+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.320+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd476a0 con 0x56192fd424f0 2024-02-15T22:57:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.320+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.320+0000 7fc9c3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.320+0000 7fc9c3610800 20 started sync module instance, tier type = 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.320+0000 7fc9c3610800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.320+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd46910 con 0x7fc9b40703b0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.321+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b803a040 con 0x7fc9b40703b0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.321+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94666176622080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd46910 con 0x7fc9b40703b0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.321+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd48090 con 0x56192fd3c2a0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.322+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94666176622080] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b803a040 con 0x7fc9b40703b0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.323+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.323+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94666176625520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd480b0 con 0x56192fd3c2a0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.323+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd48b50 con 0x56192fd424f0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.324+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94666176625520] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.324+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.324+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94666176628272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd48eb0 con 0x56192fd424f0 2024-02-15T22:57:29.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.324+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd49920 con 0x7fc9b40703b0 2024-02-15T22:57:29.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.325+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94666176628272] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.325+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b803a040 con 0x7fc9b40703b0 2024-02-15T22:57:29.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.325+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94666176631808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd49d00 con 0x7fc9b40703b0 2024-02-15T22:57:29.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.325+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4a7a0 con 0x56192fd3c2a0 2024-02-15T22:57:29.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.327+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94666176631808] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b803a040 con 0x7fc9b40703b0 2024-02-15T22:57:29.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.327+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.327+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94666176635520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4a760 con 0x56192fd3c2a0 2024-02-15T22:57:29.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.327+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4b200 con 0x7fc9b80141d0 2024-02-15T22:57:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.329+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94666176635520] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.329+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.329+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94666176619632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4b200 con 0x7fc9b80141d0 2024-02-15T22:57:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.329+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4bbc0 con 0x7fc9b80141d0 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.330+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94666176619632] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.330+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.330+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94666176638192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4bbc0 con 0x7fc9b80141d0 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.330+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4c570 con 0x7fc9b80141d0 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.331+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94666176638192] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.331+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.331+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94666176643216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4c770 con 0x7fc9b80141d0 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.331+0000 7fc9c3610800 20 add_watcher() i=0 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.331+0000 7fc9c3610800 20 add_watcher() i=1 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.331+0000 7fc9c3610800 20 add_watcher() i=2 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.331+0000 7fc9c3610800 20 add_watcher() i=3 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.331+0000 7fc9c3610800 20 add_watcher() i=4 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.331+0000 7fc9c3610800 20 add_watcher() i=5 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.331+0000 7fc9c3610800 20 add_watcher() i=6 2024-02-15T22:57:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.332+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94666176643216] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.332+0000 7fc9c3610800 20 add_watcher() i=7 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.332+0000 7fc9c3610800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.333+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4fb40 con 0x56192fd3c2a0 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.333+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.333+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94666176644720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4d000 con 0x56192fd3c2a0 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.334+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94666176644720] v32'214 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.334+0000 7fc8757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.334+0000 7fc9c3610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.334+0000 7fc9c3610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.334+0000 7fc9c3610800 5 note: GC not initialized 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.334+0000 7fc7effff640 20 reqs_thread_entry: start 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.334+0000 7fc9c3610800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.334+0000 7fc9c3610800 20 Filter name: none 2024-02-15T22:57:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.335+0000 7fc7edffb640 20 reqs_thread_entry: start 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.335+0000 7fc9c3610800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.335+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.335+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd81c00 con 0x7fc9b80141d0 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.335+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.335+0000 7fc9c3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.335+0000 7fc9c3610800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.335+0000 7fc9c3610800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.335+0000 7fc9c3610800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.335+0000 7fc9c3610800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.335+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd80300 con 0x7fc9b80141d0 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.336+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.336+0000 7fc9c3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.336+0000 7fc9c3610800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.336+0000 7fc9c3610800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:57:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.336+0000 7fc9c3610800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.336+0000 7fc9c3610800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.336+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd80b80 con 0x7fc9b80141d0 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~347] v32'11 uv11 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc9c3610800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc9c3610800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc9c3610800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94666176857824 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd80b60 con 0x7fc9b80141d0 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== watch-notify(notify (1) cookie 94666176619632 notify 137438953503 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x56192fd054e0 con 0x7fc9b80141d0 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc8a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94666176619632 notifier 4733 bl.length()=523 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc8a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc8a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(65 notify.5 [notify cookie 94666176857824 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc8a27fc640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc884003e90 con 0x7fc9b80141d0 2024-02-15T22:57:29.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== watch-notify(notify_complete (2) cookie 94666176857824 notify 137438953503 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56192fd05000 con 0x7fc9b80141d0 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.337+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd80ae0 con 0x7fc9b80141d0 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.338+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.338+0000 7fc9c3610800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.338+0000 7fc9c3610800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.339+0000 7fc9c3610800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.339+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94666176857664 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd80a60 con 0x56192fd424f0 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.339+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== watch-notify(notify (1) cookie 94666176628272 notify 137438953478 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x56192fd30eb0 con 0x56192fd424f0 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.339+0000 7fc8a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94666176628272 notifier 4733 bl.length()=177 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.339+0000 7fc8a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.339+0000 7fc8a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.339+0000 7fc8a27fc640 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc884003e90 con 0x56192fd424f0 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.339+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(68 notify.2 [notify cookie 94666176857664 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.339+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.339+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== watch-notify(notify_complete (2) cookie 94666176857664 notify 137438953478 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56192fd1dbf0 con 0x56192fd424f0 2024-02-15T22:57:29.350 INFO:teuthology.orchestra.run.smithi133.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.340+0000 7fc8757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.340+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94666176644720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4f650 con 0x56192fd3c2a0 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.341+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94666176644720] v32'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.341+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94666176622080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd4c670 con 0x7fc9b40703b0 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.342+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94666176622080] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b803a040 con 0x7fc9b40703b0 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.342+0000 7fc9c3610800 20 remove_watcher() i=0 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.342+0000 7fc9c3610800 2 removed watcher, disabling cache 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.342+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94666176625520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd46e00 con 0x56192fd3c2a0 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.343+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94666176625520] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.343+0000 7fc9c3610800 20 remove_watcher() i=1 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.343+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94666176628272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd47b70 con 0x56192fd424f0 2024-02-15T22:57:29.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.344+0000 7fc9be5bd640 1 -- 172.21.15.133:0/459645775 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94666176628272] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b4009750 con 0x56192fd424f0 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.344+0000 7fc9c3610800 20 remove_watcher() i=2 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.344+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94666176631808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd48630 con 0x7fc9b40703b0 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.345+0000 7fc9bf5bf640 1 -- 172.21.15.133:0/459645775 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94666176631808] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b803a040 con 0x7fc9b40703b0 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.345+0000 7fc9c3610800 20 remove_watcher() i=3 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.345+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94666176635520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd48630 con 0x56192fd3c2a0 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.347+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94666176635520] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x56192fd3c2a0 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.347+0000 7fc9c3610800 20 remove_watcher() i=4 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.347+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94666176619632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd48630 con 0x7fc9b80141d0 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.348+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94666176619632] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.348+0000 7fc9c3610800 20 remove_watcher() i=5 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.348+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94666176638192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd46470 con 0x7fc9b80141d0 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.349+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94666176638192] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.349+0000 7fc9c3610800 20 remove_watcher() i=6 2024-02-15T22:57:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.349+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94666176643216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56192fd48630 con 0x7fc9b80141d0 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94666176643216] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc9b0052040 con 0x7fc9b80141d0 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 20 remove_watcher() i=7 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fc9b80141d0 msgr2=0x7fc9b8015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fc9b80141d0 0x7fc9b8015940 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56192fd3c2a0 msgr2=0x56192fd3e760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56192fd3c2a0 0x56192fd3e760 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fc9b40703b0 msgr2=0x7fc9b408e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fc9b40703b0 0x7fc9b408e890 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x56192fd424f0 msgr2=0x56192fd449b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x56192fd424f0 0x56192fd449b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8880367e0 msgr2=0x7fc888038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8880367e0 0x7fc888038ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800b010 tx=0x7fc9b8020000 comp rx=0 tx=0).stop 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 msgr2=0x56192fd30770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9bedbe640 1 -- 172.21.15.133:0/459645775 reap_dead start 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd30770 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc9b406f8a0 tx=0x7fc9b408c9e0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 shutdown_connections 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 --2- 172.21.15.133:0/459645775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd29650 0x56192fd30770 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 >> 172.21.15.133:0/459645775 conn(0x56192fd25970 msgr2=0x56192fd22fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 shutdown_connections 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.350+0000 7fc9c3610800 1 -- 172.21.15.133:0/459645775 wait complete. 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/215880193 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8980367e0 msgr2=0x7fc898038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 --2- 172.21.15.133:0/215880193 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8980367e0 0x7fc898038ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x56192fd0c6b0 tx=0x7fc9b8005840 comp rx=0 tx=0).stop 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/215880193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd1c4f0 msgr2=0x56192fd1c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 --2- 172.21.15.133:0/215880193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd1c4f0 0x56192fd1c910 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc9b401d490 tx=0x7fc9b4002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/215880193 shutdown_connections 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 --2- 172.21.15.133:0/215880193 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8980367e0 0x7fc898038ca0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 --2- 172.21.15.133:0/215880193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fd1c4f0 0x56192fd1c910 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/215880193 >> 172.21.15.133:0/215880193 conn(0x56192fd10590 msgr2=0x56192fd10990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/215880193 shutdown_connections 2024-02-15T22:57:29.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/215880193 wait complete. 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56192fc0b440 msgr2=0x56192fd0b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56192fc0b440 0x56192fd0b770 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8a4036830 msgr2=0x7fc8a4038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8a4036830 0x7fc8a4038cf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4054000 tx=0x7fc9b404e000 comp rx=0 tx=0).stop 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 msgr2=0x56192fd04ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fd04ac0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000c00 tx=0x7fc9b0000ed0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 shutdown_connections 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56192fc0b440 0x56192fd0b770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fc8a4036830 0x7fc8a4038cf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 --2- 172.21.15.133:0/391611085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56192fc09900 0x56192fd04ac0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 >> 172.21.15.133:0/391611085 conn(0x56192fc05520 msgr2=0x56192fcf75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 shutdown_connections 2024-02-15T22:57:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.351+0000 7fc9c3610800 1 -- 172.21.15.133:0/391611085 wait complete. 2024-02-15T22:57:29.362 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-15T22:57:29.377 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:57:29.382 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-02-15T22:57:29.382 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-15T22:57:29.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-15T22:57:29.383 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-02-15T22:57:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:29.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.425+0000 7f2f45b28800 1 Processor -- start 2024-02-15T22:57:29.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.425+0000 7f2f45b28800 1 -- start start 2024-02-15T22:57:29.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.425+0000 7f2f45b28800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55fc4c049aa0 0x55fc4c04be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.425+0000 7f2f45b28800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fc4bf93ba0 con 0x55fc4c04c3d0 2024-02-15T22:57:29.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.425+0000 7f2f45b28800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fc4bf4b450 con 0x55fc4c049aa0 2024-02-15T22:57:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.426+0000 7f2f417cf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55fc4c049aa0 0x55fc4c04be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.426+0000 7f2f40fce640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55fc4c04c3d0 0x55fc4c04e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45320/0 (socket says 172.21.15.133:45320) 2024-02-15T22:57:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.426+0000 7f2f417cf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55fc4c049aa0 0x55fc4c04be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33618/0 (socket says 172.21.15.133:33618) 2024-02-15T22:57:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.426+0000 7f2f40fce640 1 -- 172.21.15.133:0/2145783291 learned_addr learned my addr 172.21.15.133:0/2145783291 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.426+0000 7f2f417cf640 1 -- 172.21.15.133:0/2145783291 >> v1:172.21.15.52:6789/0 conn(0x55fc4c04c3d0 legacy=0x55fc4c04e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.426+0000 7f2f417cf640 1 -- 172.21.15.133:0/2145783291 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc4c050ef0 con 0x55fc4c049aa0 2024-02-15T22:57:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.428+0000 7f2f417cf640 1 --2- 172.21.15.133:0/2145783291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c04be90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400a470 tx=0x7f2f3401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71bb3e61b148217 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.428+0000 7f2f33fff640 1 -- 172.21.15.133:0/2145783291 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f34052570 con 0x55fc4c049aa0 2024-02-15T22:57:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.428+0000 7f2f33fff640 1 -- 172.21.15.133:0/2145783291 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f340526d0 con 0x55fc4c049aa0 2024-02-15T22:57:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.428+0000 7f2f33fff640 1 -- 172.21.15.133:0/2145783291 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f34052990 con 0x55fc4c049aa0 2024-02-15T22:57:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.429+0000 7f2f45b28800 1 -- 172.21.15.133:0/2145783291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 msgr2=0x55fc4c04be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.429+0000 7f2f45b28800 1 --2- 172.21.15.133:0/2145783291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c04be90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400a470 tx=0x7f2f3401cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.429+0000 7f2f45b28800 1 -- 172.21.15.133:0/2145783291 shutdown_connections 2024-02-15T22:57:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.429+0000 7f2f45b28800 1 --2- 172.21.15.133:0/2145783291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c04be90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.429+0000 7f2f45b28800 1 -- 172.21.15.133:0/2145783291 >> 172.21.15.133:0/2145783291 conn(0x55fc4c0434f0 msgr2=0x55fc4c045910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.429+0000 7f2f45b28800 1 -- 172.21.15.133:0/2145783291 shutdown_connections 2024-02-15T22:57:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.429+0000 7f2f45b28800 1 -- 172.21.15.133:0/2145783291 wait complete. 2024-02-15T22:57:29.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.440+0000 7f2f45b28800 1 Processor -- start 2024-02-15T22:57:29.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.440+0000 7f2f45b28800 1 -- start start 2024-02-15T22:57:29.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.440+0000 7f2f45b28800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c138f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.440+0000 7f2f45b28800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4bf48980 con 0x55fc4c049aa0 2024-02-15T22:57:29.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.441+0000 7f2f417cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.441+0000 7f2f417cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c138f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33624/0 (socket says 172.21.15.133:33624) 2024-02-15T22:57:29.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.441+0000 7f2f417cf640 1 -- 172.21.15.133:0/956839467 learned_addr learned my addr 172.21.15.133:0/956839467 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.441+0000 7f2f417cf640 1 -- 172.21.15.133:0/956839467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f34005d20 con 0x55fc4c049aa0 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.441+0000 7f2f417cf640 1 --2- 172.21.15.133:0/956839467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c138f80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2f34055040 tx=0x7f2f3404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147b660110de55f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.441+0000 7f2e2f606640 1 -- 172.21.15.133:0/956839467 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f3400a180 con 0x55fc4c049aa0 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.441+0000 7f2e2f606640 1 -- 172.21.15.133:0/956839467 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3400a300 con 0x55fc4c049aa0 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.441+0000 7f2e2f606640 1 -- 172.21.15.133:0/956839467 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f340529b0 con 0x55fc4c049aa0 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.442+0000 7f2f45b28800 1 -- 172.21.15.133:0/956839467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 msgr2=0x55fc4c138f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.442+0000 7f2f45b28800 1 --2- 172.21.15.133:0/956839467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c138f80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2f34055040 tx=0x7f2f3404c000 comp rx=0 tx=0).stop 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.442+0000 7f2f45b28800 1 -- 172.21.15.133:0/956839467 shutdown_connections 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.442+0000 7f2f45b28800 1 --2- 172.21.15.133:0/956839467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c138f80 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.442+0000 7f2f45b28800 1 -- 172.21.15.133:0/956839467 >> 172.21.15.133:0/956839467 conn(0x55fc4c0434f0 msgr2=0x55fc4c1348a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.442+0000 7f2f45b28800 1 -- 172.21.15.133:0/956839467 shutdown_connections 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.442+0000 7f2f45b28800 1 -- 172.21.15.133:0/956839467 wait complete. 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.443+0000 7f2f45b28800 1 Processor -- start 2024-02-15T22:57:29.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.443+0000 7f2f45b28800 1 -- start start 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.443+0000 7f2f45b28800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c1405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.443+0000 7f2f45b28800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4bf44160 con 0x55fc4c049aa0 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.443+0000 7f2f417cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c1405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.443+0000 7f2f417cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c1405d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33638/0 (socket says 172.21.15.133:33638) 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.443+0000 7f2f417cf640 1 -- 172.21.15.133:0/2138579208 learned_addr learned my addr 172.21.15.133:0/2138579208 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.443+0000 7f2f417cf640 1 -- 172.21.15.133:0/2138579208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc4c050ef0 con 0x55fc4c049aa0 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.443+0000 7f2f417cf640 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c1405d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2f3405f040 tx=0x7f2f34002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.444+0000 7f2e2de03640 1 -- 172.21.15.133:0/2138579208 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f3406a070 con 0x55fc4c049aa0 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.444+0000 7f2e2de03640 1 -- 172.21.15.133:0/2138579208 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3405d420 con 0x55fc4c049aa0 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.444+0000 7f2e2de03640 1 -- 172.21.15.133:0/2138579208 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f3405d6c0 con 0x55fc4c049aa0 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.444+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc4c140b10 con 0x55fc4c049aa0 2024-02-15T22:57:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.444+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc4c140ff0 con 0x55fc4c049aa0 2024-02-15T22:57:29.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.444+0000 7f2e2de03640 1 -- 172.21.15.133:0/2138579208 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2f3405d820 con 0x55fc4c049aa0 2024-02-15T22:57:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.445+0000 7f2e2de03640 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e28036790 0x7f2e28038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.445+0000 7f2e2de03640 1 -- 172.21.15.133:0/2138579208 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f2f3408daa0 con 0x55fc4c049aa0 2024-02-15T22:57:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.445+0000 7f2f40fce640 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e28036790 0x7f2e28038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.445+0000 7f2f45b28800 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fc4c04c3d0 0x55fc4c1472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.445+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c1478a0 con 0x55fc4c04c3d0 2024-02-15T22:57:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.445+0000 7f2f41fd0640 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fc4c04c3d0 0x55fc4c1472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.445+0000 7f2f40fce640 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e28036790 0x7f2e28038c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f38000f60 tx=0x7f2f380012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.445+0000 7f2f41fd0640 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fc4c04c3d0 0x55fc4c1472d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.445+0000 7f2f41fd0640 1 -- 172.21.15.133:0/2138579208 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2f3c00a4a0 con 0x55fc4c04c3d0 2024-02-15T22:57:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.446+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c1449c0 con 0x55fc4c04c3d0 2024-02-15T22:57:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.446+0000 7f2f41fd0640 1 -- 172.21.15.133:0/2138579208 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2f3c00a4a0 con 0x55fc4c04c3d0 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.446+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c1495d0 con 0x55fc4c04c3d0 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.446+0000 7f2f41fd0640 1 -- 172.21.15.133:0/2138579208 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f2f3c00a4a0 con 0x55fc4c04c3d0 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.446+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c1487d0 con 0x55fc4c04c3d0 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.446+0000 7f2f41fd0640 1 -- 172.21.15.133:0/2138579208 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2f3c00a4a0 con 0x55fc4c04c3d0 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.446+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c148be0 con 0x55fc4c04c3d0 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.447+0000 7f2f41fd0640 1 -- 172.21.15.133:0/2138579208 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2f3c00a4a0 con 0x55fc4c04c3d0 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.447+0000 7f2f45b28800 1 Processor -- start 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.447+0000 7f2f45b28800 1 -- start start 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.447+0000 7f2f45b28800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c157fe0 0x55fc4c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.447+0000 7f2f45b28800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4bee6e80 con 0x55fc4c157fe0 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.447+0000 7f2f40fce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c157fe0 0x55fc4c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.447+0000 7f2f40fce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c157fe0 0x55fc4c158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33642/0 (socket says 172.21.15.133:33642) 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.447+0000 7f2f40fce640 1 -- 172.21.15.133:0/4127387272 learned_addr learned my addr 172.21.15.133:0/4127387272 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.448+0000 7f2f40fce640 1 -- 172.21.15.133:0/4127387272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc4c158940 con 0x55fc4c157fe0 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.448+0000 7f2f40fce640 1 --2- 172.21.15.133:0/4127387272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c157fe0 0x55fc4c158400 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2f38001ed0 tx=0x7f2f3800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.448+0000 7f2e26ffd640 1 -- 172.21.15.133:0/4127387272 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f38020070 con 0x55fc4c157fe0 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.448+0000 7f2e26ffd640 1 -- 172.21.15.133:0/4127387272 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3801b550 con 0x55fc4c157fe0 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.448+0000 7f2e26ffd640 1 -- 172.21.15.133:0/4127387272 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f38013040 con 0x55fc4c157fe0 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.448+0000 7f2f45b28800 1 -- 172.21.15.133:0/4127387272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc4c1593b0 con 0x55fc4c157fe0 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.448+0000 7f2f45b28800 1 -- 172.21.15.133:0/4127387272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc4c159870 con 0x55fc4c157fe0 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.449+0000 7f2e26ffd640 1 -- 172.21.15.133:0/4127387272 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2f3801b8c0 con 0x55fc4c157fe0 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.449+0000 7f2e26ffd640 1 --2- 172.21.15.133:0/4127387272 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e1c036790 0x7f2e1c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.449+0000 7f2e26ffd640 1 -- 172.21.15.133:0/4127387272 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f2f3804e3e0 con 0x55fc4c157fe0 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.449+0000 7f2f41fd0640 1 --2- 172.21.15.133:0/4127387272 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e1c036790 0x7f2e1c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.449+0000 7f2f45b28800 1 Processor -- start 2024-02-15T22:57:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.449+0000 7f2f45b28800 1 -- start start 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.449+0000 7f2f41fd0640 1 --2- 172.21.15.133:0/4127387272 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e1c036790 0x7f2e1c038c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55fc4c148210 tx=0x7f2f3c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.450+0000 7f2f45b28800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c0494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.450+0000 7f2f45b28800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4bebc5d0 con 0x55fc4c049090 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.450+0000 7f2f40fce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c0494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.450+0000 7f2f40fce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c0494b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33644/0 (socket says 172.21.15.133:33644) 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.450+0000 7f2f40fce640 1 -- 172.21.15.133:0/2612249105 learned_addr learned my addr 172.21.15.133:0/2612249105 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.450+0000 7f2f40fce640 1 -- 172.21.15.133:0/2612249105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc4c047890 con 0x55fc4c049090 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.450+0000 7f2f40fce640 1 --2- 172.21.15.133:0/2612249105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c0494b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2f38019cf0 tx=0x7f2f3804c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc839ed67890c2b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.450+0000 7f2e24ff9640 1 -- 172.21.15.133:0/2612249105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f38024a50 con 0x55fc4c049090 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.450+0000 7f2e24ff9640 1 -- 172.21.15.133:0/2612249105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3801bd50 con 0x55fc4c049090 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.450+0000 7f2e24ff9640 1 -- 172.21.15.133:0/2612249105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f3804e200 con 0x55fc4c049090 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.451+0000 7f2f45b28800 1 -- 172.21.15.133:0/2612249105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 msgr2=0x55fc4c0494b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.451+0000 7f2f45b28800 1 --2- 172.21.15.133:0/2612249105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c0494b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2f38019cf0 tx=0x7f2f3804c900 comp rx=0 tx=0).stop 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.451+0000 7f2f45b28800 1 -- 172.21.15.133:0/2612249105 shutdown_connections 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.451+0000 7f2f45b28800 1 --2- 172.21.15.133:0/2612249105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c0494b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.451+0000 7f2f45b28800 1 -- 172.21.15.133:0/2612249105 >> 172.21.15.133:0/2612249105 conn(0x55fc4c1615c0 msgr2=0x55fc4c15f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.451+0000 7f2f45b28800 1 -- 172.21.15.133:0/2612249105 shutdown_connections 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.451+0000 7f2f45b28800 1 -- 172.21.15.133:0/2612249105 wait complete. 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.451+0000 7f2f45b28800 1 Processor -- start 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.451+0000 7f2f45b28800 1 -- start start 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.451+0000 7f2f45b28800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c16e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.451+0000 7f2f45b28800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4c16e9a0 con 0x55fc4c049090 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.452+0000 7f2f40fce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c16e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.452+0000 7f2f40fce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c16e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33654/0 (socket says 172.21.15.133:33654) 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.452+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 learned_addr learned my addr 172.21.15.133:0/174287556 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.452+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc4c159870 con 0x55fc4c049090 2024-02-15T22:57:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.452+0000 7f2f40fce640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c16e460 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800dcc0 tx=0x7f2f3804c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.452+0000 7f2e12ffd640 1 -- 172.21.15.133:0/174287556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f3804e1a0 con 0x55fc4c049090 2024-02-15T22:57:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.452+0000 7f2e12ffd640 1 -- 172.21.15.133:0/174287556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3800cc60 con 0x55fc4c049090 2024-02-15T22:57:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.452+0000 7f2e12ffd640 1 -- 172.21.15.133:0/174287556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f3800ce10 con 0x55fc4c049090 2024-02-15T22:57:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.452+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc4c16eba0 con 0x55fc4c049090 2024-02-15T22:57:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.452+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc4c16f000 con 0x55fc4c049090 2024-02-15T22:57:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.453+0000 7f2e12ffd640 1 -- 172.21.15.133:0/174287556 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2f380196a0 con 0x55fc4c049090 2024-02-15T22:57:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.453+0000 7f2e12ffd640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e0c0367e0 0x7f2e0c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.453+0000 7f2e12ffd640 1 -- 172.21.15.133:0/174287556 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f2f3804fe70 con 0x55fc4c049090 2024-02-15T22:57:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.453+0000 7f2f41fd0640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e0c0367e0 0x7f2e0c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.454+0000 7f2f41fd0640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e0c0367e0 0x7f2e0c038ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00b010 tx=0x7f2f3c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.454+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.454+0000 7f2f45b28800 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fc4c17a040 0x55fc4c17c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.454+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c17cc50 con 0x55fc4c17a040 2024-02-15T22:57:29.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.454+0000 7f2f417cf640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fc4c17a040 0x55fc4c17c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.454+0000 7f2f417cf640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fc4c17a040 0x55fc4c17c500 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.454+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.454+0000 7f2f45b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.454+0000 7f2f45b28800 20 realm 2024-02-15T22:57:29.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.454+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.454+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c17d020 con 0x55fc4c17a040 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c17d8a0 con 0x55fc4c17a040 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c17dc00 con 0x55fc4c17a040 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c17e400 con 0x55fc4c17a040 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 20 searching for the correct realm 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55fc4c1802c0 0x55fc4c182760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.455+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c182e30 con 0x55fc4c1802c0 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.456+0000 7f2f40fce640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55fc4c1802c0 0x55fc4c182760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.456+0000 7f2f40fce640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55fc4c1802c0 0x55fc4c182760 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.456+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.456+0000 7f2f40fce640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f2f38037020 0x7f2f3802e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.456+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c182e30 con 0x7f2f38037020 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.456+0000 7f2f41fd0640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f2f38037020 0x7f2f3802e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.457+0000 7f2f41fd0640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f2f38037020 0x7f2f3802e3f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.457+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f3c00a4a0 con 0x7f2f38037020 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.457+0000 7f2f41fd0640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f2f3c0141d0 0x7f2f3c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.457+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c182e30 con 0x7f2f3c0141d0 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.457+0000 7f2f417cf640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f2f3c0141d0 0x7f2f3c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.457+0000 7f2f417cf640 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f2f3c0141d0 0x7f2f3c015940 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.458+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.458+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c182e30 con 0x55fc4c17a040 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.458+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.458+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c182e30 con 0x55fc4c17a040 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.458+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.458+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c182e30 con 0x7f2f3c0141d0 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.458+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.458+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c182e30 con 0x7f2f3c0141d0 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.459+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.459+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c182e30 con 0x7f2f38037020 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.459+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f3c00a4a0 con 0x7f2f38037020 2024-02-15T22:57:29.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.459+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c182e30 con 0x55fc4c1802c0 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.459+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.459+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c17a040 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.459+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.459+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.460+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.460+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c17a040 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.460+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.460+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x7f2f38037020 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.460+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2f3c03a040 con 0x7f2f38037020 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.460+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c1802c0 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.460+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.460+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c1802c0 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.461+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.461+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.461+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.461+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c1802c0 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.461+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.461+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c1802c0 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.461+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.461+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c17a040 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.462+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.462+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c17a040 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.462+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.462+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.462+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.462+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c1802c0 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.463+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.463+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x7f2f38037020 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.463+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f3c03a040 con 0x7f2f38037020 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.463+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c17a040 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.463+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2f34059040 con 0x55fc4c17a040 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.463+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.463+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f34059040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.463+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c1802c0 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.464+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.464+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.464+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.464+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x7f2f38037020 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.464+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f3c03a040 con 0x7f2f38037020 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.464+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c1802c0 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.465+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.465+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.465+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.465+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x55fc4c17a040 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.465+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.465+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2f3805a040 con 0x7f2f38037020 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f3c03a040 con 0x7f2f38037020 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c17f8d0 con 0x55fc4c17a040 2024-02-15T22:57:29.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c17f0f0 con 0x55fc4c17a040 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c183270 con 0x55fc4c17a040 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 zone default found 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 4 Realm: () 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:29.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 zonegroup default 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.466+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c1835d0 con 0x7f2f3c0141d0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f45b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c185450 con 0x55fc4c1802c0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f45b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c1857b0 con 0x55fc4c1802c0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f45b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f45b28800 20 started sync module instance, tier type = 2024-02-15T22:57:29.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f45b28800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.467+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c184a20 con 0x7f2f38037020 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.468+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3c03a040 con 0x7f2f38037020 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.468+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94542096781072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c184a20 con 0x7f2f38037020 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.468+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c186220 con 0x55fc4c17a040 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.469+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94542096781072] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3c03a040 con 0x7f2f38037020 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.470+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.470+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94542096784640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c184a20 con 0x55fc4c17a040 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.470+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c186d20 con 0x55fc4c1802c0 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.471+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.471+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94542096787488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c187570 con 0x55fc4c1802c0 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.471+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c188020 con 0x7f2f38037020 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.471+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94542096784640] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.472+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94542096787488] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.472+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3c03a040 con 0x7f2f38037020 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.472+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94542096789712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c184580 con 0x7f2f38037020 2024-02-15T22:57:29.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.472+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c1889e0 con 0x55fc4c17a040 2024-02-15T22:57:29.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.473+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.473+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94542096794944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c188e00 con 0x55fc4c17a040 2024-02-15T22:57:29.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.473+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c189840 con 0x7f2f3c0141d0 2024-02-15T22:57:29.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.473+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94542096789712] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3c03a040 con 0x7f2f38037020 2024-02-15T22:57:29.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.474+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.474+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94542096792352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c189840 con 0x7f2f3c0141d0 2024-02-15T22:57:29.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.474+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c18a270 con 0x7f2f3c0141d0 2024-02-15T22:57:29.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.474+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94542096794944] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.475+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94542096792352] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.475+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.475+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94542096796000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c189d90 con 0x7f2f3c0141d0 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.475+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c18a700 con 0x7f2f3c0141d0 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.476+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94542096796000] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.476+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.476+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94542096798544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c18a700 con 0x7f2f3c0141d0 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.476+0000 7f2f45b28800 20 add_watcher() i=0 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.476+0000 7f2f45b28800 20 add_watcher() i=1 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.476+0000 7f2f45b28800 20 add_watcher() i=2 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.476+0000 7f2f45b28800 20 add_watcher() i=3 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.476+0000 7f2f45b28800 20 add_watcher() i=4 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.476+0000 7f2f45b28800 20 add_watcher() i=5 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.476+0000 7f2f45b28800 20 add_watcher() i=6 2024-02-15T22:57:29.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.477+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94542096798544] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.477+0000 7f2f45b28800 20 add_watcher() i=7 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.477+0000 7f2f45b28800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.477+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c18a6b0 con 0x55fc4c17a040 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.478+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.478+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94542096804544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c18b380 con 0x55fc4c17a040 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94542096804544] v32'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2df77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2f45b28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2f45b28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2f45b28800 5 note: GC not initialized 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2df67e4640 20 reqs_thread_entry: start 2024-02-15T22:57:29.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2f45b28800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2f45b28800 20 Filter name: none 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2d67fff640 20 reqs_thread_entry: start 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2f45b28800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2f45b28800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.479+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c1bfc70 con 0x7f2f38037020 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.480+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(62 bud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f2f3c03a040 con 0x7f2f38037020 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.480+0000 7f2f45b28800 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.480+0000 7f2f45b28800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.480+0000 7f2f45b28800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.480+0000 7f2f45b28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.480+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c1c3950 con 0x7f2f3c0141d0 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.481+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 fud [create,call,writefull 0~181] v32'12 uv11 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-02-15T22:57:29.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.482+0000 7f2df77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.482+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94542096804544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c18d260 con 0x55fc4c17a040 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.483+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94542096804544] v32'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.483+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94542096781072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c18aac0 con 0x7f2f38037020 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.484+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94542096781072] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3c03a040 con 0x7f2f38037020 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.484+0000 7f2f45b28800 20 remove_watcher() i=0 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.484+0000 7f2f45b28800 2 removed watcher, disabling cache 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.484+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94542096784640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c18aac0 con 0x55fc4c17a040 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.485+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94542096784640] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.485+0000 7f2f45b28800 20 remove_watcher() i=1 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.485+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94542096787488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c18aac0 con 0x55fc4c1802c0 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.486+0000 7f2f40fce640 1 -- 172.21.15.133:0/174287556 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94542096787488] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f38034070 con 0x55fc4c1802c0 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.486+0000 7f2f45b28800 20 remove_watcher() i=2 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.486+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94542096789712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c186820 con 0x7f2f38037020 2024-02-15T22:57:29.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.487+0000 7f2f41fd0640 1 -- 172.21.15.133:0/174287556 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94542096789712] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3c03a040 con 0x7f2f38037020 2024-02-15T22:57:29.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.487+0000 7f2f45b28800 20 remove_watcher() i=3 2024-02-15T22:57:29.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.487+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94542096794944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c1870d0 con 0x55fc4c17a040 2024-02-15T22:57:29.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.488+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94542096794944] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x55fc4c17a040 2024-02-15T22:57:29.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.488+0000 7f2f45b28800 20 remove_watcher() i=4 2024-02-15T22:57:29.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.488+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94542096792352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c188540 con 0x7f2f3c0141d0 2024-02-15T22:57:29.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.489+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94542096792352] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.489+0000 7f2f45b28800 20 remove_watcher() i=5 2024-02-15T22:57:29.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.489+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94542096796000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c187b20 con 0x7f2f3c0141d0 2024-02-15T22:57:29.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.490+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94542096796000] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.490+0000 7f2f45b28800 20 remove_watcher() i=6 2024-02-15T22:57:29.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.490+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94542096798544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc4c187b20 con 0x7f2f3c0141d0 2024-02-15T22:57:29.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94542096798544] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f3409e040 con 0x7f2f3c0141d0 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 20 remove_watcher() i=7 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f2f3c0141d0 msgr2=0x7f2f3c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f2f3c0141d0 0x7f2f3c015940 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fc4c17a040 msgr2=0x55fc4c17c500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fc4c17a040 0x55fc4c17c500 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f2f38037020 msgr2=0x7f2f3802e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f2f38037020 0x7f2f3802e3f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55fc4c1802c0 msgr2=0x55fc4c182760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55fc4c1802c0 0x55fc4c182760 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e0c0367e0 msgr2=0x7f2e0c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e0c0367e0 0x7f2e0c038ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00b010 tx=0x7f2f3c020000 comp rx=0 tx=0).stop 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 msgr2=0x55fc4c16e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c16e460 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800dcc0 tx=0x7f2f3804c750 comp rx=0 tx=0).stop 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f417cf640 1 -- 172.21.15.133:0/174287556 reap_dead start 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 shutdown_connections 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 --2- 172.21.15.133:0/174287556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049090 0x55fc4c16e460 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 >> 172.21.15.133:0/174287556 conn(0x55fc4c1615c0 msgr2=0x55fc4c15ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 shutdown_connections 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.491+0000 7f2f45b28800 1 -- 172.21.15.133:0/174287556 wait complete. 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/4127387272 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e1c036790 msgr2=0x7f2e1c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 --2- 172.21.15.133:0/4127387272 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e1c036790 0x7f2e1c038c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55fc4c148210 tx=0x7f2f3c005840 comp rx=0 tx=0).stop 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/4127387272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c157fe0 msgr2=0x55fc4c158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 --2- 172.21.15.133:0/4127387272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c157fe0 0x55fc4c158400 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2f38001ed0 tx=0x7f2f3800d7a0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/4127387272 shutdown_connections 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 --2- 172.21.15.133:0/4127387272 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e1c036790 0x7f2e1c038c50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 --2- 172.21.15.133:0/4127387272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c157fe0 0x55fc4c158400 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/4127387272 >> 172.21.15.133:0/4127387272 conn(0x55fc4c14c080 msgr2=0x55fc4c14c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/4127387272 shutdown_connections 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/4127387272 wait complete. 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fc4c04c3d0 msgr2=0x55fc4c1472d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fc4c04c3d0 0x55fc4c1472d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e28036790 msgr2=0x7f2e28038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e28036790 0x7f2e28038c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f38000f60 tx=0x7f2f380012b0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 msgr2=0x55fc4c1405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c1405d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2f3405f040 tx=0x7f2f34002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 shutdown_connections 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55fc4c04c3d0 0x55fc4c1472d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f2e28036790 0x7f2e28038c50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 --2- 172.21.15.133:0/2138579208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc4c049aa0 0x55fc4c1405d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 >> 172.21.15.133:0/2138579208 conn(0x55fc4c0434f0 msgr2=0x55fc4c1330e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 shutdown_connections 2024-02-15T22:57:29.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.492+0000 7f2f45b28800 1 -- 172.21.15.133:0/2138579208 wait complete. 2024-02-15T22:57:29.504 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-15T22:57:29.509 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:57:29.509 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-15T22:57:29.513 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-15T22:57:29.513 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-02-15T22:57:29.513 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-15T22:57:29.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-15T22:57:29.513 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-02-15T22:57:29.588 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:29.588 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.586+0000 7fa5a712b800 1 Processor -- start 2024-02-15T22:57:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.586+0000 7fa5a712b800 1 -- start start 2024-02-15T22:57:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.587+0000 7fa5a712b800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560fbc240e90 0x560fbc2412b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.587+0000 7fa5a712b800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560fbc18cba0 con 0x560fbc2420f0 2024-02-15T22:57:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.587+0000 7fa5a712b800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x560fbc144450 con 0x560fbc240e90 2024-02-15T22:57:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.587+0000 7fa5a2db0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560fbc240e90 0x560fbc2412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.587+0000 7fa5a25af640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x560fbc2420f0 0x560fbc242570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45324/0 (socket says 172.21.15.133:45324) 2024-02-15T22:57:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.587+0000 7fa5a2db0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560fbc240e90 0x560fbc2412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33666/0 (socket says 172.21.15.133:33666) 2024-02-15T22:57:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.587+0000 7fa5a25af640 1 -- 172.21.15.133:0/2705158436 learned_addr learned my addr 172.21.15.133:0/2705158436 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.587+0000 7fa5a2db0640 1 -- 172.21.15.133:0/2705158436 >> v1:172.21.15.52:6789/0 conn(0x560fbc2420f0 legacy=0x560fbc242570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.587+0000 7fa5a2db0640 1 -- 172.21.15.133:0/2705158436 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fbc241980 con 0x560fbc240e90 2024-02-15T22:57:29.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.589+0000 7fa5a2db0640 1 --2- 172.21.15.133:0/2705158436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc2412b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa59400c6b0 tx=0x7fa59401f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c41632160b50aa server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.589+0000 7fa5a1dae640 1 -- 172.21.15.133:0/2705158436 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa59404d6f0 con 0x560fbc240e90 2024-02-15T22:57:29.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.589+0000 7fa5a1dae640 1 -- 172.21.15.133:0/2705158436 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59404d850 con 0x560fbc240e90 2024-02-15T22:57:29.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.589+0000 7fa5a1dae640 1 -- 172.21.15.133:0/2705158436 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa59404db70 con 0x560fbc240e90 2024-02-15T22:57:29.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.590+0000 7fa5a712b800 1 -- 172.21.15.133:0/2705158436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 msgr2=0x560fbc2412b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.590+0000 7fa5a712b800 1 --2- 172.21.15.133:0/2705158436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc2412b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa59400c6b0 tx=0x7fa59401f260 comp rx=0 tx=0).stop 2024-02-15T22:57:29.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.590+0000 7fa5a712b800 1 -- 172.21.15.133:0/2705158436 shutdown_connections 2024-02-15T22:57:29.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.590+0000 7fa5a712b800 1 --2- 172.21.15.133:0/2705158436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc2412b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.590+0000 7fa5a712b800 1 -- 172.21.15.133:0/2705158436 >> 172.21.15.133:0/2705158436 conn(0x560fbc23c4f0 msgr2=0x560fbc23e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.590+0000 7fa5a712b800 1 -- 172.21.15.133:0/2705158436 shutdown_connections 2024-02-15T22:57:29.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.590+0000 7fa5a712b800 1 -- 172.21.15.133:0/2705158436 wait complete. 2024-02-15T22:57:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.601+0000 7fa5a712b800 1 Processor -- start 2024-02-15T22:57:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.601+0000 7fa5a712b800 1 -- start start 2024-02-15T22:57:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.601+0000 7fa5a712b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc330260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.601+0000 7fa5a712b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbc141980 con 0x560fbc240e90 2024-02-15T22:57:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.602+0000 7fa5a2db0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc330260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.602+0000 7fa5a2db0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc330260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33668/0 (socket says 172.21.15.133:33668) 2024-02-15T22:57:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.602+0000 7fa5a2db0640 1 -- 172.21.15.133:0/2814779035 learned_addr learned my addr 172.21.15.133:0/2814779035 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.602+0000 7fa5a2db0640 1 -- 172.21.15.133:0/2814779035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59400c390 con 0x560fbc240e90 2024-02-15T22:57:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.602+0000 7fa5a2db0640 1 --2- 172.21.15.133:0/2814779035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc330260 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa59401fa00 tx=0x7fa59404f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51085d54342e4fff server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.602+0000 7fa490e09640 1 -- 172.21.15.133:0/2814779035 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa59404ec40 con 0x560fbc240e90 2024-02-15T22:57:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.602+0000 7fa490e09640 1 -- 172.21.15.133:0/2814779035 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59404eda0 con 0x560fbc240e90 2024-02-15T22:57:29.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.602+0000 7fa490e09640 1 -- 172.21.15.133:0/2814779035 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa594060590 con 0x560fbc240e90 2024-02-15T22:57:29.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.603+0000 7fa5a712b800 1 -- 172.21.15.133:0/2814779035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 msgr2=0x560fbc330260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.603+0000 7fa5a712b800 1 --2- 172.21.15.133:0/2814779035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc330260 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa59401fa00 tx=0x7fa59404f000 comp rx=0 tx=0).stop 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.603+0000 7fa5a712b800 1 -- 172.21.15.133:0/2814779035 shutdown_connections 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.603+0000 7fa5a712b800 1 --2- 172.21.15.133:0/2814779035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc330260 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.603+0000 7fa5a712b800 1 -- 172.21.15.133:0/2814779035 >> 172.21.15.133:0/2814779035 conn(0x560fbc23c4f0 msgr2=0x560fbc32bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.603+0000 7fa5a712b800 1 -- 172.21.15.133:0/2814779035 shutdown_connections 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.603+0000 7fa5a712b800 1 -- 172.21.15.133:0/2814779035 wait complete. 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.603+0000 7fa5a712b800 1 Processor -- start 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.603+0000 7fa5a712b800 1 -- start start 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa5a712b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc33bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa5a712b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbc13d160 con 0x560fbc240e90 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa5a2db0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc33bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa5a2db0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc33bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33680/0 (socket says 172.21.15.133:33680) 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1345566912 learned_addr learned my addr 172.21.15.133:0/1345566912 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1345566912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fbc33c200 con 0x560fbc240e90 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa5a2db0640 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc33bcc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa594062040 tx=0x7fa594003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa48f606640 1 -- 172.21.15.133:0/1345566912 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5940608a0 con 0x560fbc240e90 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa48f606640 1 -- 172.21.15.133:0/1345566912 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594060a00 con 0x560fbc240e90 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560fbc33c450 con 0x560fbc240e90 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa48f606640 1 -- 172.21.15.133:0/1345566912 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa594060ce0 con 0x560fbc240e90 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.604+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fbc33f140 con 0x560fbc240e90 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.605+0000 7fa48f606640 1 -- 172.21.15.133:0/1345566912 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa594055410 con 0x560fbc240e90 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.605+0000 7fa48f606640 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa4880367e0 0x7fa488038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.605+0000 7fa48f606640 1 -- 172.21.15.133:0/1345566912 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fa59408e3a0 con 0x560fbc240e90 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.605+0000 7fa5a25af640 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa4880367e0 0x7fa488038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.606+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560fbc2420f0 0x560fbc342b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.606+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc343050 con 0x560fbc2420f0 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.606+0000 7fa5a35b1640 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560fbc2420f0 0x560fbc342b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.606+0000 7fa5a25af640 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa4880367e0 0x7fa488038ca0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa598000f60 tx=0x7fa5980012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.606+0000 7fa5a35b1640 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560fbc2420f0 0x560fbc342b10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.606+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1345566912 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa59c0083e0 con 0x560fbc2420f0 2024-02-15T22:57:29.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.606+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc343410 con 0x560fbc2420f0 2024-02-15T22:57:29.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.607+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1345566912 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa59c0083e0 con 0x560fbc2420f0 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.607+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc344cc0 con 0x560fbc2420f0 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.607+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1345566912 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa59c0083e0 con 0x560fbc2420f0 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.607+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc343fd0 con 0x560fbc2420f0 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.607+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1345566912 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa59c0083e0 con 0x560fbc2420f0 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.607+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3443e0 con 0x560fbc2420f0 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.607+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1345566912 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa59c012040 con 0x560fbc2420f0 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.608+0000 7fa5a712b800 1 Processor -- start 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.608+0000 7fa5a712b800 1 -- start start 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.608+0000 7fa5a712b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc3536e0 0x560fbc353b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.608+0000 7fa5a712b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbc0dfe80 con 0x560fbc3536e0 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.608+0000 7fa5a25af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc3536e0 0x560fbc353b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.608+0000 7fa5a25af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc3536e0 0x560fbc353b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33690/0 (socket says 172.21.15.133:33690) 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.608+0000 7fa5a25af640 1 -- 172.21.15.133:0/689622719 learned_addr learned my addr 172.21.15.133:0/689622719 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.608+0000 7fa5a25af640 1 -- 172.21.15.133:0/689622719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fbc354040 con 0x560fbc3536e0 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.608+0000 7fa5a25af640 1 --2- 172.21.15.133:0/689622719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc3536e0 0x560fbc353b00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa598001ed0 tx=0x7fa59800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.609+0000 7fa48ce01640 1 -- 172.21.15.133:0/689622719 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa598020070 con 0x560fbc3536e0 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.609+0000 7fa48ce01640 1 -- 172.21.15.133:0/689622719 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59801b550 con 0x560fbc3536e0 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.609+0000 7fa48ce01640 1 -- 172.21.15.133:0/689622719 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa598013040 con 0x560fbc3536e0 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.609+0000 7fa5a712b800 1 -- 172.21.15.133:0/689622719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560fbc354ab0 con 0x560fbc3536e0 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.609+0000 7fa5a712b800 1 -- 172.21.15.133:0/689622719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fbc354f70 con 0x560fbc3536e0 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.609+0000 7fa48ce01640 1 -- 172.21.15.133:0/689622719 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa59801b7f0 con 0x560fbc3536e0 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.610+0000 7fa48ce01640 1 --2- 172.21.15.133:0/689622719 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa47c0367e0 0x7fa47c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.610+0000 7fa48ce01640 1 -- 172.21.15.133:0/689622719 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fa59804e370 con 0x560fbc3536e0 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.610+0000 7fa5a35b1640 1 --2- 172.21.15.133:0/689622719 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa47c0367e0 0x7fa47c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.610+0000 7fa5a712b800 1 Processor -- start 2024-02-15T22:57:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.610+0000 7fa5a712b800 1 -- start start 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.610+0000 7fa5a35b1640 1 --2- 172.21.15.133:0/689622719 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa47c0367e0 0x7fa47c038ca0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x560fbc343a10 tx=0x7fa59c000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.610+0000 7fa5a712b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc360e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.610+0000 7fa5a712b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbc0b55d0 con 0x560fbc360a20 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.610+0000 7fa5a25af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc360e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.610+0000 7fa5a25af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc360e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33704/0 (socket says 172.21.15.133:33704) 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.610+0000 7fa5a25af640 1 -- 172.21.15.133:0/2110035749 learned_addr learned my addr 172.21.15.133:0/2110035749 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.611+0000 7fa5a25af640 1 -- 172.21.15.133:0/2110035749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fbc361410 con 0x560fbc360a20 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.611+0000 7fa5a25af640 1 --2- 172.21.15.133:0/2110035749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc360e40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa59804c750 tx=0x7fa59804c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5b5d687337e5a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.611+0000 7fa4867fc640 1 -- 172.21.15.133:0/2110035749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa59804b260 con 0x560fbc360a20 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.611+0000 7fa4867fc640 1 -- 172.21.15.133:0/2110035749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa598040e90 con 0x560fbc360a20 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.611+0000 7fa4867fc640 1 -- 172.21.15.133:0/2110035749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa598025930 con 0x560fbc360a20 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.611+0000 7fa5a712b800 1 -- 172.21.15.133:0/2110035749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 msgr2=0x560fbc360e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a712b800 1 --2- 172.21.15.133:0/2110035749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc360e40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa59804c750 tx=0x7fa59804c890 comp rx=0 tx=0).stop 2024-02-15T22:57:29.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a712b800 1 -- 172.21.15.133:0/2110035749 shutdown_connections 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a712b800 1 --2- 172.21.15.133:0/2110035749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc360e40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a712b800 1 -- 172.21.15.133:0/2110035749 >> 172.21.15.133:0/2110035749 conn(0x560fbc35cd40 msgr2=0x560fbc35ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a712b800 1 -- 172.21.15.133:0/2110035749 shutdown_connections 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a712b800 1 -- 172.21.15.133:0/2110035749 wait complete. 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a712b800 1 Processor -- start 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a712b800 1 -- start start 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a712b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc367a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a712b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbc367fa0 con 0x560fbc360a20 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a25af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc367a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a25af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc367a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33714/0 (socket says 172.21.15.133:33714) 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.612+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 learned_addr learned my addr 172.21.15.133:0/1653804715 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.613+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fbc354f70 con 0x560fbc360a20 2024-02-15T22:57:29.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.613+0000 7fa5a25af640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc367a60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa59801afd0 tx=0x7fa598024e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.613+0000 7fa484ff9640 1 -- 172.21.15.133:0/1653804715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa598025930 con 0x560fbc360a20 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.613+0000 7fa484ff9640 1 -- 172.21.15.133:0/1653804715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa598025a90 con 0x560fbc360a20 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.613+0000 7fa484ff9640 1 -- 172.21.15.133:0/1653804715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa59801bc80 con 0x560fbc360a20 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.613+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560fbc3681a0 con 0x560fbc360a20 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.613+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fbc3681a0 con 0x560fbc360a20 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.614+0000 7fa484ff9640 1 -- 172.21.15.133:0/1653804715 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa59800cc60 con 0x560fbc360a20 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.614+0000 7fa484ff9640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa46c0367e0 0x7fa46c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.614+0000 7fa484ff9640 1 -- 172.21.15.133:0/1653804715 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fa59804fd30 con 0x560fbc360a20 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.614+0000 7fa5a35b1640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa46c0367e0 0x7fa46c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.614+0000 7fa5a35b1640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa46c0367e0 0x7fa46c038ca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x560fbc343ad0 tx=0x7fa59c00c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.614+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.614+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560fbc373470 0x560fbc375930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.614+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc376080 con 0x560fbc373470 2024-02-15T22:57:29.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a2db0640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560fbc373470 0x560fbc375930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a2db0640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560fbc373470 0x560fbc375930 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa594070070 con 0x560fbc373470 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a712b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a712b800 20 realm 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc376450 con 0x560fbc373470 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa594070070 con 0x560fbc373470 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a712b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a712b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc376cd0 con 0x560fbc373470 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa594082040 con 0x560fbc373470 2024-02-15T22:57:29.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a712b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.615+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc377030 con 0x560fbc373470 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.616+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa594082040 con 0x560fbc373470 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.616+0000 7fa5a712b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.616+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.616+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc377830 con 0x560fbc373470 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.616+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa594082040 con 0x560fbc373470 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.616+0000 7fa5a712b800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.616+0000 7fa5a712b800 20 searching for the correct realm 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.616+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560fbc3796c0 0x560fbc37bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.616+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc3796c0 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.616+0000 7fa5a25af640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560fbc3796c0 0x560fbc37bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.616+0000 7fa5a25af640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560fbc3796c0 0x560fbc37bb40 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.617+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.617+0000 7fa5a25af640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa59802ea60 0x7fa598023950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.617+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59802ea60 2024-02-15T22:57:29.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.617+0000 7fa5a35b1640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa59802ea60 0x7fa598023950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.617+0000 7fa5a35b1640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa59802ea60 0x7fa598023950 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.617+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa59c02c040 con 0x7fa59802ea60 2024-02-15T22:57:29.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.617+0000 7fa5a35b1640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa59c027940 0x7fa59c0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.617+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59c027940 2024-02-15T22:57:29.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.618+0000 7fa5a2db0640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa59c027940 0x7fa59c0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.618+0000 7fa5a2db0640 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa59c027940 0x7fa59c0333c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.618+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x7fa59c027940 2024-02-15T22:57:29.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.618+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc373470 2024-02-15T22:57:29.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.619+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x560fbc373470 2024-02-15T22:57:29.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.619+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc373470 2024-02-15T22:57:29.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.619+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x560fbc373470 2024-02-15T22:57:29.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.619+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59c027940 2024-02-15T22:57:29.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.619+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x7fa59c027940 2024-02-15T22:57:29.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.619+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59c027940 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.619+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x7fa59c027940 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.619+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59802ea60 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.620+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa59c02c040 con 0x7fa59802ea60 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.620+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc3796c0 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.620+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.620+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc373470 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.620+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x560fbc373470 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.620+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59c027940 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.620+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x7fa59c027940 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.620+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc373470 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.621+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x560fbc373470 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.621+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59802ea60 2024-02-15T22:57:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.621+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa59c02c040 con 0x7fa59802ea60 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.621+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc3796c0 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.621+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.621+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc3796c0 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.621+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.621+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59c027940 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.622+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x7fa59c027940 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.622+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc3796c0 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.622+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.622+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc3796c0 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.622+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.622+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc373470 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.622+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x560fbc373470 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.622+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc373470 2024-02-15T22:57:29.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.623+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa594082040 con 0x560fbc373470 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.623+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59c027940 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.623+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x7fa59c027940 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.623+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc3796c0 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.623+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.623+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59802ea60 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.623+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa59c02c040 con 0x7fa59802ea60 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.623+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc373470 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.624+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa594082040 con 0x560fbc373470 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.624+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59c027940 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.624+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa594082040 con 0x7fa59c027940 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.624+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc3796c0 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.624+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.624+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59c027940 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.624+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.624+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59802ea60 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.625+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa59c02c040 con 0x7fa59802ea60 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.625+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc3796c0 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.625+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.625+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59c027940 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.625+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.625+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x560fbc373470 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c210 con 0x7fa59802ea60 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa59c02c040 con 0x7fa59802ea60 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:29.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc378190 con 0x560fbc373470 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3789e0 con 0x560fbc373470 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.626+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c650 con 0x560fbc373470 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 20 zone default found 2024-02-15T22:57:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 4 Realm: () 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 20 zonegroup default 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37c650 con 0x7fa59c027940 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37e3e0 con 0x560fbc3796c0 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37e790 con 0x560fbc3796c0 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 20 started sync module instance, tier type = 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.627+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37dcc0 con 0x7fa59802ea60 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.628+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.628+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94625582274592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37e070 con 0x7fa59802ea60 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.628+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37f4f0 con 0x560fbc373470 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.630+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94625582274592] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.630+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.630+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94625582279872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37f660 con 0x560fbc373470 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.630+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc380130 con 0x560fbc3796c0 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.631+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94625582279872] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.631+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.631+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94625582283792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3804e0 con 0x560fbc3796c0 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.631+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc380ec0 con 0x7fa59802ea60 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.632+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.632+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94625582287328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc381740 con 0x7fa59802ea60 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.632+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3821f0 con 0x560fbc373470 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.632+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94625582283792] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.633+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.633+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94625582292208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3821b0 con 0x560fbc373470 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.633+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc382c20 con 0x7fa59c027940 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.633+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94625582287328] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.634+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.634+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94625582292208] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.634+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94625582289568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc382740 con 0x7fa59c027940 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.634+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc382740 con 0x7fa59c027940 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.635+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94625582289568] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.635+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.635+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94625582280928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc383190 con 0x7fa59c027940 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.635+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc383b00 con 0x7fa59c027940 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.637+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.637+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94625582280928] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.637+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94625582298720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc383f60 con 0x7fa59c027940 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.637+0000 7fa5a712b800 20 add_watcher() i=0 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.637+0000 7fa5a712b800 20 add_watcher() i=1 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.637+0000 7fa5a712b800 20 add_watcher() i=2 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.637+0000 7fa5a712b800 20 add_watcher() i=3 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.637+0000 7fa5a712b800 20 add_watcher() i=4 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.637+0000 7fa5a712b800 20 add_watcher() i=5 2024-02-15T22:57:29.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.637+0000 7fa5a712b800 20 add_watcher() i=6 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.638+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94625582298720] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.638+0000 7fa5a712b800 20 add_watcher() i=7 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.638+0000 7fa5a712b800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.638+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc387370 con 0x560fbc373470 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.638+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.638+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94625582299776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3847e0 con 0x560fbc373470 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.639+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94625582299776] v32'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.639+0000 7fa4597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.639+0000 7fa5a712b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.639+0000 7fa5a712b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.639+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc38f990 con 0x560fbc373470 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.640+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.640+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc38ffa0 con 0x7fa59c027940 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.642+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'27 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.642+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3904d0 con 0x560fbc3796c0 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.643+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.643+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc390ea0 con 0x560fbc373470 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.644+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'219 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.644+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc38b8d0 con 0x7fa59802ea60 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.644+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'68 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.645+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc38b870 con 0x560fbc3796c0 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.646+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'45 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.646+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc392080 con 0x560fbc373470 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.647+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.647+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc392080 con 0x7fa59c027940 2024-02-15T22:57:29.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.649+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'45 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.649+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc392080 con 0x7fa59802ea60 2024-02-15T22:57:29.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.650+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.650+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc38d9f0 con 0x560fbc3796c0 2024-02-15T22:57:29.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.651+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.651+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc392bf0 con 0x7fa59802ea60 2024-02-15T22:57:29.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.652+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'69 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.652+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393120 con 0x7fa59c027940 2024-02-15T22:57:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.653+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.653+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393120 con 0x7fa59802ea60 2024-02-15T22:57:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.653+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.654+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x7fa59c027940 2024-02-15T22:57:29.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.655+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'51 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.655+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc373470 2024-02-15T22:57:29.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.656+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'220 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.656+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc3796c0 2024-02-15T22:57:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.657+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'62 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.657+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x7fa59802ea60 2024-02-15T22:57:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.658+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'70 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.658+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc3796c0 2024-02-15T22:57:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.659+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.659+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc373470 2024-02-15T22:57:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.660+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.660+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc373470 2024-02-15T22:57:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.661+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'221 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.661+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc3796c0 2024-02-15T22:57:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.662+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'63 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.662+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x7fa59802ea60 2024-02-15T22:57:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.663+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'36 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.663+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc3796c0 2024-02-15T22:57:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.664+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.664+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc3796c0 2024-02-15T22:57:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.665+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.665+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc3796c0 2024-02-15T22:57:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.666+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'24 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.666+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc3796c0 2024-02-15T22:57:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.667+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'46 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.667+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x7fa59c027940 2024-02-15T22:57:29.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.668+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.668+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc3796c0 2024-02-15T22:57:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.669+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.669+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x7fa59c027940 2024-02-15T22:57:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.670+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'46 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.670+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x560fbc3796c0 2024-02-15T22:57:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.671+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'64 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.671+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x7fa59c027940 2024-02-15T22:57:29.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.672+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'52 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.672+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc393370 con 0x7fa59802ea60 2024-02-15T22:57:29.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.673+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'33 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa3d3fff640 20 reqs_thread_entry: start 2024-02-15T22:57:29.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa5a712b800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:29.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa5a712b800 20 Filter name: none 2024-02-15T22:57:29.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa3d1ffb640 20 reqs_thread_entry: start 2024-02-15T22:57:29.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa5a712b800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-15T22:57:29.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa5a712b800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3bccd0 con 0x7fa59802ea60 2024-02-15T22:57:29.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(94 bud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa5a712b800 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T22:57:29.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa5a712b800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-15T22:57:29.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa5a712b800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-15T22:57:29.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa5a712b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:57:29.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.674+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3bf1b0 con 0x560fbc373470 2024-02-15T22:57:29.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.675+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(95 bud.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.675+0000 7fa5a712b800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-02-15T22:57:29.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.675+0000 7fa5a712b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-15T22:57:29.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.675+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 94625582021648 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3bf6f0 con 0x7fa59c027940 2024-02-15T22:57:29.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.675+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== watch-notify(notify (1) cookie 94625582289568 notify 137438953505 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x560fbc33f140 con 0x7fa59c027940 2024-02-15T22:57:29.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.675+0000 7fa4867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94625582289568 notifier 4747 bl.length()=170 2024-02-15T22:57:29.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.675+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(96 notify.5 [notify cookie 94625582021648 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.675+0000 7fa4867fc640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa468003d50 con 0x7fa59c027940 2024-02-15T22:57:29.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.675+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.675+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== watch-notify(notify_complete (2) cookie 94625582021648 notify 137438953505 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560fbc33c450 con 0x7fa59c027940 2024-02-15T22:57:29.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.675+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:98 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3bf670 con 0x560fbc373470 2024-02-15T22:57:29.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.676+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(98 NX5QOQKC6BH2IDN8HC7A [delete] v32'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.676+0000 7fa5a712b800 10 removing email index: 2024-02-15T22:57:29.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.676+0000 7fa5a712b800 10 removing user buckets index 2024-02-15T22:57:29.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.676+0000 7fa5a712b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-02-15T22:57:29.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.676+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94625582021648 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3bf650 con 0x7fa59c027940 2024-02-15T22:57:29.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.677+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== watch-notify(notify (1) cookie 94625582280928 notify 137438953506 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x560fbc33c450 con 0x7fa59c027940 2024-02-15T22:57:29.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.677+0000 7fa4867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94625582280928 notifier 4747 bl.length()=160 2024-02-15T22:57:29.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.677+0000 7fa4867fc640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa468003d50 con 0x7fa59c027940 2024-02-15T22:57:29.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.677+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(99 notify.6 [notify cookie 94625582021648 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.677+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 30 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.677+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 31 ==== watch-notify(notify_complete (2) cookie 94625582021648 notify 137438953506 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560fbc33c200 con 0x7fa59c027940 2024-02-15T22:57:29.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.677+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:101 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc33fc10 con 0x560fbc373470 2024-02-15T22:57:29.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.678+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(101 bud.buckets [delete] v32'6 uv4 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.678+0000 7fa5a712b800 10 removing user index: bud 2024-02-15T22:57:29.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.678+0000 7fa5a712b800 10 removing default.rgw.meta+users.uid+bud from cache 2024-02-15T22:57:29.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.678+0000 7fa5a712b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-15T22:57:29.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.678+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94625582021648 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3be6a0 con 0x7fa59c027940 2024-02-15T22:57:29.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.678+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 32 ==== watch-notify(notify (1) cookie 94625582289568 notify 137438953507 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x560fbc33c200 con 0x7fa59c027940 2024-02-15T22:57:29.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.678+0000 7fa485ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94625582289568 notifier 4747 bl.length()=152 2024-02-15T22:57:29.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.678+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 33 ==== osd_op_reply(102 notify.5 [notify cookie 94625582021648 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.678+0000 7fa485ffb640 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa3d80032b0 con 0x7fa59c027940 2024-02-15T22:57:29.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.679+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 34 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.679+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 35 ==== watch-notify(notify_complete (2) cookie 94625582021648 notify 137438953507 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa59400c390 con 0x7fa59c027940 2024-02-15T22:57:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.679+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:104 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc3bf650 con 0x7fa59802ea60 2024-02-15T22:57:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.680+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(104 bud [call,call,delete] v32'3 uv3 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.680+0000 7fa4597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.681+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94625582299776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc38c810 con 0x560fbc373470 2024-02-15T22:57:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.682+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94625582299776] v32'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.682+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94625582274592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc383a80 con 0x7fa59802ea60 2024-02-15T22:57:29.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.683+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94625582274592] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.683+0000 7fa5a712b800 20 remove_watcher() i=0 2024-02-15T22:57:29.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.683+0000 7fa5a712b800 2 removed watcher, disabling cache 2024-02-15T22:57:29.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.683+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94625582279872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc383a80 con 0x560fbc373470 2024-02-15T22:57:29.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.684+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94625582279872] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.684+0000 7fa5a712b800 20 remove_watcher() i=1 2024-02-15T22:57:29.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.684+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94625582283792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37ecc0 con 0x560fbc3796c0 2024-02-15T22:57:29.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.685+0000 7fa5a25af640 1 -- 172.21.15.133:0/1653804715 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94625582283792] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa598034020 con 0x560fbc3796c0 2024-02-15T22:57:29.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.685+0000 7fa5a712b800 20 remove_watcher() i=2 2024-02-15T22:57:29.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.685+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94625582287328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc383a80 con 0x7fa59802ea60 2024-02-15T22:57:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.686+0000 7fa5a35b1640 1 -- 172.21.15.133:0/1653804715 <== osd.2 v2:172.21.15.133:6800/2073628168 21 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94625582287328] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59c03f040 con 0x7fa59802ea60 2024-02-15T22:57:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.686+0000 7fa5a712b800 20 remove_watcher() i=3 2024-02-15T22:57:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.686+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94625582292208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37fc10 con 0x560fbc373470 2024-02-15T22:57:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.687+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94625582292208] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x560fbc373470 2024-02-15T22:57:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.687+0000 7fa5a712b800 20 remove_watcher() i=4 2024-02-15T22:57:29.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.687+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94625582289568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37ecc0 con 0x7fa59c027940 2024-02-15T22:57:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.688+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 36 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94625582289568] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.688+0000 7fa5a712b800 20 remove_watcher() i=5 2024-02-15T22:57:29.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.688+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94625582280928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc383a80 con 0x7fa59c027940 2024-02-15T22:57:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.689+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 37 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94625582280928] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.689+0000 7fa5a712b800 20 remove_watcher() i=6 2024-02-15T22:57:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.689+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94625582298720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560fbc37fc10 con 0x7fa59c027940 2024-02-15T22:57:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 <== osd.0 v2:172.21.15.52:6800/431200118 38 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94625582298720] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa59409e040 con 0x7fa59c027940 2024-02-15T22:57:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 20 remove_watcher() i=7 2024-02-15T22:57:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa59c027940 msgr2=0x7fa59c0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fa59c027940 0x7fa59c0333c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560fbc373470 msgr2=0x560fbc375930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560fbc373470 0x560fbc375930 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa59802ea60 msgr2=0x7fa598023950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fa59802ea60 0x7fa598023950 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560fbc3796c0 msgr2=0x560fbc37bb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x560fbc3796c0 0x560fbc37bb40 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa46c0367e0 msgr2=0x7fa46c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa46c0367e0 0x7fa46c038ca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x560fbc343ad0 tx=0x7fa59c00c040 comp rx=0 tx=0).stop 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 msgr2=0x560fbc367a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a2db0640 1 -- 172.21.15.133:0/1653804715 reap_dead start 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.690+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc367a60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa59801afd0 tx=0x7fa598024e90 comp rx=0 tx=0).stop 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 shutdown_connections 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1653804715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc360a20 0x560fbc367a60 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 >> 172.21.15.133:0/1653804715 conn(0x560fbc35cd40 msgr2=0x560fbc35a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 shutdown_connections 2024-02-15T22:57:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/1653804715 wait complete. 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/689622719 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa47c0367e0 msgr2=0x7fa47c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 --2- 172.21.15.133:0/689622719 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa47c0367e0 0x7fa47c038ca0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x560fbc343a10 tx=0x7fa59c000f90 comp rx=0 tx=0).stop 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/689622719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc3536e0 msgr2=0x560fbc353b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 --2- 172.21.15.133:0/689622719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc3536e0 0x560fbc353b00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa598001ed0 tx=0x7fa59800d7a0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/689622719 shutdown_connections 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 --2- 172.21.15.133:0/689622719 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa47c0367e0 0x7fa47c038ca0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 --2- 172.21.15.133:0/689622719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc3536e0 0x560fbc353b00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/689622719 >> 172.21.15.133:0/689622719 conn(0x560fbc347780 msgr2=0x560fbc347b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/689622719 shutdown_connections 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/689622719 wait complete. 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560fbc2420f0 msgr2=0x560fbc342b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560fbc2420f0 0x560fbc342b10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa4880367e0 msgr2=0x7fa488038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa4880367e0 0x7fa488038ca0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa598000f60 tx=0x7fa5980012b0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 msgr2=0x560fbc33bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc33bcc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa594062040 tx=0x7fa594003330 comp rx=0 tx=0).stop 2024-02-15T22:57:29.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 shutdown_connections 2024-02-15T22:57:29.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x560fbc2420f0 0x560fbc342b10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fa4880367e0 0x7fa488038ca0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 --2- 172.21.15.133:0/1345566912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560fbc240e90 0x560fbc33bcc0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 >> 172.21.15.133:0/1345566912 conn(0x560fbc23c4f0 msgr2=0x560fbc32a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 shutdown_connections 2024-02-15T22:57:29.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.691+0000 7fa5a712b800 1 -- 172.21.15.133:0/1345566912 wait complete. 2024-02-15T22:57:29.702 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-15T22:57:29.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-15T22:57:29.702 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-02-15T22:57:29.786 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:29.786 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:29.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.784+0000 7fd07912f800 1 Processor -- start 2024-02-15T22:57:29.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.784+0000 7fd07912f800 1 -- start start 2024-02-15T22:57:29.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.784+0000 7fd07912f800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5625dfa14a20 0x5625dfa16e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.784+0000 7fd07912f800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5625df95eba0 con 0x5625dfa17350 2024-02-15T22:57:29.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.784+0000 7fd07912f800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5625df916450 con 0x5625dfa14a20 2024-02-15T22:57:29.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.785+0000 7fd074ec5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5625dfa14a20 0x5625dfa16e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.785+0000 7fd06c6c4640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5625dfa17350 0x5625dfa19740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:45332/0 (socket says 172.21.15.133:45332) 2024-02-15T22:57:29.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.785+0000 7fd06c6c4640 1 -- 172.21.15.133:0/865931776 learned_addr learned my addr 172.21.15.133:0/865931776 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:29.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.785+0000 7fd074ec5640 1 -- 172.21.15.133:0/865931776 >> v1:172.21.15.52:6789/0 conn(0x5625dfa17350 legacy=0x5625dfa19740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.785+0000 7fd074ec5640 1 -- 172.21.15.133:0/865931776 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625dfa1be70 con 0x5625dfa14a20 2024-02-15T22:57:29.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.787+0000 7fd074ec5640 1 --2- 172.21.15.133:0/865931776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfa16e10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd06400a470 tx=0x7fd06401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51388db36b056d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.787+0000 7fd06ffff640 1 -- 172.21.15.133:0/865931776 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd064052570 con 0x5625dfa14a20 2024-02-15T22:57:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.787+0000 7fd06ffff640 1 -- 172.21.15.133:0/865931776 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0640526d0 con 0x5625dfa14a20 2024-02-15T22:57:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.787+0000 7fd06ffff640 1 -- 172.21.15.133:0/865931776 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd064052990 con 0x5625dfa14a20 2024-02-15T22:57:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.787+0000 7fd07912f800 1 -- 172.21.15.133:0/865931776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 msgr2=0x5625dfa16e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.787+0000 7fd07912f800 1 --2- 172.21.15.133:0/865931776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfa16e10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd06400a470 tx=0x7fd06401cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:29.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.787+0000 7fd07912f800 1 -- 172.21.15.133:0/865931776 shutdown_connections 2024-02-15T22:57:29.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.787+0000 7fd07912f800 1 --2- 172.21.15.133:0/865931776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfa16e10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.787+0000 7fd07912f800 1 -- 172.21.15.133:0/865931776 >> 172.21.15.133:0/865931776 conn(0x5625dfa0e4f0 msgr2=0x5625dfa10910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.788+0000 7fd07912f800 1 -- 172.21.15.133:0/865931776 shutdown_connections 2024-02-15T22:57:29.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.788+0000 7fd07912f800 1 -- 172.21.15.133:0/865931776 wait complete. 2024-02-15T22:57:29.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.799+0000 7fd07912f800 1 Processor -- start 2024-02-15T22:57:29.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.799+0000 7fd07912f800 1 -- start start 2024-02-15T22:57:29.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.799+0000 7fd07912f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfb03ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.799+0000 7fd07912f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625df913980 con 0x5625dfa14a20 2024-02-15T22:57:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.800+0000 7fd074ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfb03ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.800+0000 7fd074ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfb03ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33732/0 (socket says 172.21.15.133:33732) 2024-02-15T22:57:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.800+0000 7fd074ec5640 1 -- 172.21.15.133:0/674653651 learned_addr learned my addr 172.21.15.133:0/674653651 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.800+0000 7fd074ec5640 1 -- 172.21.15.133:0/674653651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd064005d20 con 0x5625dfa14a20 2024-02-15T22:57:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.800+0000 7fd074ec5640 1 --2- 172.21.15.133:0/674653651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfb03ff0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd064055040 tx=0x7fd06404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572ff137bc4cc238 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.800+0000 7fcf62e0d640 1 -- 172.21.15.133:0/674653651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd06400a180 con 0x5625dfa14a20 2024-02-15T22:57:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.800+0000 7fcf62e0d640 1 -- 172.21.15.133:0/674653651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06400a2e0 con 0x5625dfa14a20 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.800+0000 7fcf62e0d640 1 -- 172.21.15.133:0/674653651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0640529b0 con 0x5625dfa14a20 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.801+0000 7fd07912f800 1 -- 172.21.15.133:0/674653651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 msgr2=0x5625dfb03ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.801+0000 7fd07912f800 1 --2- 172.21.15.133:0/674653651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfb03ff0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd064055040 tx=0x7fd06404c000 comp rx=0 tx=0).stop 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.801+0000 7fd07912f800 1 -- 172.21.15.133:0/674653651 shutdown_connections 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.801+0000 7fd07912f800 1 --2- 172.21.15.133:0/674653651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfb03ff0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.801+0000 7fd07912f800 1 -- 172.21.15.133:0/674653651 >> 172.21.15.133:0/674653651 conn(0x5625dfa0e4f0 msgr2=0x5625dfaff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.801+0000 7fd07912f800 1 -- 172.21.15.133:0/674653651 shutdown_connections 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.801+0000 7fd07912f800 1 -- 172.21.15.133:0/674653651 wait complete. 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.801+0000 7fd07912f800 1 Processor -- start 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.802+0000 7fd07912f800 1 -- start start 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.802+0000 7fd07912f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfa14330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.802+0000 7fd07912f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625df90f160 con 0x5625dfa14a20 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.802+0000 7fd074ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfa14330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.802+0000 7fd074ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfa14330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33744/0 (socket says 172.21.15.133:33744) 2024-02-15T22:57:29.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.802+0000 7fd074ec5640 1 -- 172.21.15.133:0/1193751565 learned_addr learned my addr 172.21.15.133:0/1193751565 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.802+0000 7fd074ec5640 1 -- 172.21.15.133:0/1193751565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625dfa1be70 con 0x5625dfa14a20 2024-02-15T22:57:29.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.802+0000 7fd074ec5640 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfa14330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd064005870 tx=0x7fd064002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.803+0000 7fcf6160a640 1 -- 172.21.15.133:0/1193751565 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd06406a070 con 0x5625dfa14a20 2024-02-15T22:57:29.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.803+0000 7fcf6160a640 1 -- 172.21.15.133:0/1193751565 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06405d550 con 0x5625dfa14a20 2024-02-15T22:57:29.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.803+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625dfa14870 con 0x5625dfa14a20 2024-02-15T22:57:29.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.803+0000 7fcf6160a640 1 -- 172.21.15.133:0/1193751565 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd06405d7f0 con 0x5625dfa14a20 2024-02-15T22:57:29.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.803+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625dfa12dc0 con 0x5625dfa14a20 2024-02-15T22:57:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.803+0000 7fcf6160a640 1 -- 172.21.15.133:0/1193751565 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd06405d950 con 0x5625dfa14a20 2024-02-15T22:57:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.804+0000 7fcf6160a640 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf5c0367e0 0x7fcf5c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.804+0000 7fcf6160a640 1 -- 172.21.15.133:0/1193751565 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fd06408db30 con 0x5625dfa14a20 2024-02-15T22:57:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.804+0000 7fd06c6c4640 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf5c0367e0 0x7fcf5c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.804+0000 7fd07912f800 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5625dfa17350 0x5625dfb148b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.804+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfa136d0 con 0x5625dfa17350 2024-02-15T22:57:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.804+0000 7fd0756c6640 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5625dfa17350 0x5625dfb148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.804+0000 7fd06c6c4640 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf5c0367e0 0x7fcf5c038ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd05c000f60 tx=0x7fd05c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.804+0000 7fd0756c6640 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5625dfa17350 0x5625dfb148b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.804+0000 7fd0756c6640 1 -- 172.21.15.133:0/1193751565 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd07000a4a0 con 0x5625dfa17350 2024-02-15T22:57:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.804+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb14e60 con 0x5625dfa17350 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.805+0000 7fd0756c6640 1 -- 172.21.15.133:0/1193751565 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd07000a4a0 con 0x5625dfa17350 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.805+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb16710 con 0x5625dfa17350 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.805+0000 7fd0756c6640 1 -- 172.21.15.133:0/1193751565 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd07000a4a0 con 0x5625dfa17350 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.805+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb15960 con 0x5625dfa17350 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.805+0000 7fd0756c6640 1 -- 172.21.15.133:0/1193751565 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd07000a4a0 con 0x5625dfa17350 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.805+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb15d70 con 0x5625dfa17350 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.805+0000 7fd0756c6640 1 -- 172.21.15.133:0/1193751565 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd07000a4a0 con 0x5625dfa17350 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.806+0000 7fd07912f800 1 Processor -- start 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.806+0000 7fd07912f800 1 -- start start 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.806+0000 7fd07912f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb25180 0x5625dfb255a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.806+0000 7fd07912f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625df8b1e80 con 0x5625dfb25180 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.806+0000 7fd06c6c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb25180 0x5625dfb255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.806+0000 7fd06c6c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb25180 0x5625dfb255a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33754/0 (socket says 172.21.15.133:33754) 2024-02-15T22:57:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.806+0000 7fd06c6c4640 1 -- 172.21.15.133:0/819135108 learned_addr learned my addr 172.21.15.133:0/819135108 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.806+0000 7fd06c6c4640 1 -- 172.21.15.133:0/819135108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625dfb25ae0 con 0x5625dfb25180 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.807+0000 7fd06c6c4640 1 --2- 172.21.15.133:0/819135108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb25180 0x5625dfb255a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd05c001ed0 tx=0x7fd05c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.807+0000 7fcf5a7fc640 1 -- 172.21.15.133:0/819135108 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd05c020070 con 0x5625dfb25180 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.807+0000 7fcf5a7fc640 1 -- 172.21.15.133:0/819135108 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c01b550 con 0x5625dfb25180 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.807+0000 7fcf5a7fc640 1 -- 172.21.15.133:0/819135108 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd05c013040 con 0x5625dfb25180 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.807+0000 7fd07912f800 1 -- 172.21.15.133:0/819135108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625dfb26550 con 0x5625dfb25180 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.807+0000 7fd07912f800 1 -- 172.21.15.133:0/819135108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625dfb26a10 con 0x5625dfb25180 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fcf5a7fc640 1 -- 172.21.15.133:0/819135108 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd05c01b8c0 con 0x5625dfb25180 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fcf5a7fc640 1 --2- 172.21.15.133:0/819135108 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf4c036790 0x7fcf4c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fcf5a7fc640 1 -- 172.21.15.133:0/819135108 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fd05c04e320 con 0x5625dfb25180 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fd0756c6640 1 --2- 172.21.15.133:0/819135108 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf4c036790 0x7fcf4c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fd07912f800 1 Processor -- start 2024-02-15T22:57:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fd07912f800 1 -- start start 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fd0756c6640 1 --2- 172.21.15.133:0/819135108 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf4c036790 0x7fcf4c038c50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5625dfb153a0 tx=0x7fd070005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fd07912f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 0x5625dfb32890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fd07912f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625df8875d0 con 0x5625dfb32490 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fd06c6c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 0x5625dfb32890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fd06c6c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 0x5625dfb32890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33760/0 (socket says 172.21.15.133:33760) 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.808+0000 7fd06c6c4640 1 -- 172.21.15.133:0/3923685017 learned_addr learned my addr 172.21.15.133:0/3923685017 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fd06c6c4640 1 -- 172.21.15.133:0/3923685017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625dfb32e60 con 0x5625dfb32490 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fd06c6c4640 1 --2- 172.21.15.133:0/3923685017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 0x5625dfb32890 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd05c019cf0 tx=0x7fd05c024990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3192f4f08b4a1f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fcf4bfff640 1 -- 172.21.15.133:0/3923685017 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd05c04e110 con 0x5625dfb32490 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fcf4bfff640 1 -- 172.21.15.133:0/3923685017 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c01bd50 con 0x5625dfb32490 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fcf4bfff640 1 -- 172.21.15.133:0/3923685017 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd05c025a80 con 0x5625dfb32490 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fd07912f800 1 -- 172.21.15.133:0/3923685017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 msgr2=0x5625dfb32890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fd07912f800 1 --2- 172.21.15.133:0/3923685017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 0x5625dfb32890 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd05c019cf0 tx=0x7fd05c024990 comp rx=0 tx=0).stop 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fd07912f800 1 -- 172.21.15.133:0/3923685017 shutdown_connections 2024-02-15T22:57:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fd07912f800 1 --2- 172.21.15.133:0/3923685017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 0x5625dfb32890 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fd07912f800 1 -- 172.21.15.133:0/3923685017 >> 172.21.15.133:0/3923685017 conn(0x5625dfb2e760 msgr2=0x5625dfb2c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fd07912f800 1 -- 172.21.15.133:0/3923685017 shutdown_connections 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.809+0000 7fd07912f800 1 -- 172.21.15.133:0/3923685017 wait complete. 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.810+0000 7fd07912f800 1 Processor -- start 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.810+0000 7fd07912f800 1 -- start start 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.810+0000 7fd07912f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 0x5625dfb39490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.810+0000 7fd07912f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dfb399d0 con 0x5625dfb32490 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.810+0000 7fd06c6c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 0x5625dfb39490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.810+0000 7fd06c6c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 0x5625dfb39490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:33776/0 (socket says 172.21.15.133:33776) 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.810+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 learned_addr learned my addr 172.21.15.133:0/896073747 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.810+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625dfb26a10 con 0x5625dfb32490 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.811+0000 7fd06c6c4640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 0x5625dfb39490 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd05c01afd0 tx=0x7fd05c04c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.811+0000 7fcf4a7fc640 1 -- 172.21.15.133:0/896073747 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd05c04e110 con 0x5625dfb32490 2024-02-15T22:57:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.811+0000 7fcf4a7fc640 1 -- 172.21.15.133:0/896073747 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c04b260 con 0x5625dfb32490 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.811+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625dfb39bd0 con 0x5625dfb32490 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.811+0000 7fcf4a7fc640 1 -- 172.21.15.133:0/896073747 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd05c04b450 con 0x5625dfb32490 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.811+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625dfb39bd0 con 0x5625dfb32490 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.811+0000 7fcf4a7fc640 1 -- 172.21.15.133:0/896073747 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd05c00cc60 con 0x5625dfb32490 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.812+0000 7fcf4a7fc640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf40036790 0x7fcf40038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.812+0000 7fcf4a7fc640 1 -- 172.21.15.133:0/896073747 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fd05c04fde0 con 0x5625dfb32490 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.812+0000 7fd0756c6640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf40036790 0x7fcf40038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.812+0000 7fd0756c6640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf40036790 0x7fcf40038c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd07000b010 tx=0x7fd070020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.812+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.812+0000 7fd07912f800 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5625dfb44f10 0x5625dfb473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.812+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb47b20 con 0x5625dfb44f10 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.812+0000 7fd074ec5640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5625dfb44f10 0x5625dfb473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd074ec5640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5625dfb44f10 0x5625dfb473d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 20 realm 2024-02-15T22:57:29.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb47ef0 con 0x5625dfb44f10 2024-02-15T22:57:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb48770 con 0x5625dfb44f10 2024-02-15T22:57:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb48ad0 con 0x5625dfb44f10 2024-02-15T22:57:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.813+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.814+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb492d0 con 0x5625dfb44f10 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.814+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.814+0000 7fd07912f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.814+0000 7fd07912f800 20 searching for the correct realm 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.814+0000 7fd07912f800 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5625dfb4b1f0 0x5625dfb4d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.814+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb4b1f0 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.814+0000 7fd06c6c4640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5625dfb4b1f0 0x5625dfb4d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.814+0000 7fd06c6c4640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5625dfb4b1f0 0x5625dfb4d690 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.815+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.815+0000 7fd06c6c4640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd05c038020 0x7fd05c015640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.815+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd05c038020 2024-02-15T22:57:29.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.815+0000 7fd0756c6640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd05c038020 0x7fd05c015640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.815+0000 7fd0756c6640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd05c038020 0x7fd05c015640 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.815+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd07000a4a0 con 0x7fd05c038020 2024-02-15T22:57:29.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.815+0000 7fd0756c6640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd0700141d0 0x7fd070015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:29.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.815+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd0700141d0 2024-02-15T22:57:29.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.815+0000 7fd074ec5640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd0700141d0 0x7fd070015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:29.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.816+0000 7fd074ec5640 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd0700141d0 0x7fd070015940 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:29.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.816+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.816+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb44f10 2024-02-15T22:57:29.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.816+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.816+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb44f10 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.817+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.817+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd0700141d0 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.817+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.817+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd0700141d0 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.817+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.817+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd05c038020 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.817+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd07000a4a0 con 0x7fd05c038020 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.817+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb4b1f0 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.818+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.818+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb44f10 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.818+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.818+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd0700141d0 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.818+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.818+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb44f10 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.818+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.818+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd05c038020 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.819+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.819+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb4b1f0 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.819+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.819+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb4b1f0 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.819+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.819+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd0700141d0 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.819+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.819+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb4b1f0 2024-02-15T22:57:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.820+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.820+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb4b1f0 2024-02-15T22:57:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.820+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.820+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb44f10 2024-02-15T22:57:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.820+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.820+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb44f10 2024-02-15T22:57:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.820+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.820+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd0700141d0 2024-02-15T22:57:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.821+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.821+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb4b1f0 2024-02-15T22:57:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.821+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.821+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd05c038020 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.821+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.821+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb44f10 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.821+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.822+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd0700141d0 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.822+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.822+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb4b1f0 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.822+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.822+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd0700141d0 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.822+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.822+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd05c038020 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.823+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.823+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb4b1f0 2024-02-15T22:57:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.823+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.823+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd0700141d0 2024-02-15T22:57:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.823+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.823+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x5625dfb44f10 2024-02-15T22:57:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4dd60 con 0x7fd05c038020 2024-02-15T22:57:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4a800 con 0x5625dfb44f10 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4a020 con 0x5625dfb44f10 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.824+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4e1a0 con 0x5625dfb44f10 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 20 zone default found 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 4 Realm: () 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 20 zonegroup default 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4e500 con 0x7fd0700141d0 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb50380 con 0x5625dfb4b1f0 2024-02-15T22:57:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb506e0 con 0x5625dfb4b1f0 2024-02-15T22:57:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 20 started sync module instance, tier type = 2024-02-15T22:57:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.825+0000 7fd07912f800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.826+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4f950 con 0x7fd05c038020 2024-02-15T22:57:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.827+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.827+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94720666959456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4f950 con 0x7fd05c038020 2024-02-15T22:57:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.827+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb51180 con 0x5625dfb44f10 2024-02-15T22:57:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.828+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94720666959456] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.828+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.828+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94720666963040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4f950 con 0x5625dfb44f10 2024-02-15T22:57:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.828+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb51c30 con 0x5625dfb4b1f0 2024-02-15T22:57:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.829+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94720666963040] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.829+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.829+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94720666956976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4f8d0 con 0x5625dfb4b1f0 2024-02-15T22:57:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.829+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb52a90 con 0x7fd05c038020 2024-02-15T22:57:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.830+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94720666956976] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.831+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.831+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94720666969584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb52eb0 con 0x7fd05c038020 2024-02-15T22:57:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.831+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb53820 con 0x5625dfb44f10 2024-02-15T22:57:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.832+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94720666969584] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.832+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.832+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94720666971120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb53820 con 0x5625dfb44f10 2024-02-15T22:57:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.832+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb541d0 con 0x7fd0700141d0 2024-02-15T22:57:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.833+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.833+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94720666975472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb54170 con 0x7fd0700141d0 2024-02-15T22:57:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.833+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94720666971120] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.833+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb53380 con 0x7fd0700141d0 2024-02-15T22:57:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.834+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94720666975472] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.834+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.835+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94720666973056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb54c70 con 0x7fd0700141d0 2024-02-15T22:57:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.835+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb55620 con 0x7fd0700141d0 2024-02-15T22:57:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.836+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94720666973056] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.836+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.836+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94720666977632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb555e0 con 0x7fd0700141d0 2024-02-15T22:57:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.836+0000 7fd07912f800 20 add_watcher() i=0 2024-02-15T22:57:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.836+0000 7fd07912f800 20 add_watcher() i=1 2024-02-15T22:57:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.836+0000 7fd07912f800 20 add_watcher() i=2 2024-02-15T22:57:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.836+0000 7fd07912f800 20 add_watcher() i=3 2024-02-15T22:57:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.836+0000 7fd07912f800 20 add_watcher() i=4 2024-02-15T22:57:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.836+0000 7fd07912f800 20 add_watcher() i=5 2024-02-15T22:57:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.836+0000 7fd07912f800 20 add_watcher() i=6 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.837+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94720666977632] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.837+0000 7fd07912f800 20 add_watcher() i=7 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.837+0000 7fd07912f800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.837+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb58ba0 con 0x5625dfb44f10 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.837+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.837+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94720666981488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb55ea0 con 0x5625dfb44f10 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.838+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94720666981488] v32'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.838+0000 7fcf2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.838+0000 7fd07912f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.838+0000 7fd07912f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.838+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb61470 con 0x5625dfb44f10 2024-02-15T22:57:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.839+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.839+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb61a80 con 0x7fd0700141d0 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.840+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'28 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.840+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb61fb0 con 0x5625dfb4b1f0 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.841+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.841+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb62980 con 0x5625dfb44f10 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.842+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'224 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.842+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb5d340 con 0x7fd05c038020 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.843+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'71 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.843+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb5d340 con 0x5625dfb4b1f0 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.844+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'47 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.844+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb63b60 con 0x5625dfb44f10 2024-02-15T22:57:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.845+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.845+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb63b60 con 0x7fd0700141d0 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.846+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'47 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.846+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb63b60 con 0x7fd05c038020 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.847+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.847+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb5f4c0 con 0x5625dfb4b1f0 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.848+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.848+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb5fad0 con 0x7fd05c038020 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.849+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'72 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.849+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb648a0 con 0x7fd0700141d0 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.850+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.850+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb648a0 con 0x7fd05c038020 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.851+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.851+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x7fd0700141d0 2024-02-15T22:57:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.852+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'53 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.852+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb44f10 2024-02-15T22:57:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.853+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'225 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.853+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb4b1f0 2024-02-15T22:57:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.854+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'65 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.854+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x7fd05c038020 2024-02-15T22:57:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.855+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'73 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.855+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb4b1f0 2024-02-15T22:57:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.856+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.856+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb44f10 2024-02-15T22:57:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.857+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.857+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb44f10 2024-02-15T22:57:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.858+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'226 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.858+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb4b1f0 2024-02-15T22:57:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.859+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'66 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.859+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x7fd05c038020 2024-02-15T22:57:29.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.860+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'37 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.860+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb4b1f0 2024-02-15T22:57:29.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.861+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.861+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb4b1f0 2024-02-15T22:57:29.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.862+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.862+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb4b1f0 2024-02-15T22:57:29.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.863+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'25 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.863+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb4b1f0 2024-02-15T22:57:29.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.864+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'48 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.864+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x7fd0700141d0 2024-02-15T22:57:29.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.865+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.865+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb4b1f0 2024-02-15T22:57:29.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.866+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.866+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x7fd0700141d0 2024-02-15T22:57:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.867+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'48 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.867+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x5625dfb4b1f0 2024-02-15T22:57:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.868+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'67 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.868+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x7fd0700141d0 2024-02-15T22:57:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.869+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'54 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.869+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb64d40 con 0x7fd05c038020 2024-02-15T22:57:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.870+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'34 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fcf29fe3640 20 reqs_thread_entry: start 2024-02-15T22:57:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fd07912f800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fd07912f800 20 Filter name: none 2024-02-15T22:57:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fce9b7fe640 20 reqs_thread_entry: start 2024-02-15T22:57:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fd07912f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-15T22:57:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb8eb80 con 0x7fd0700141d0 2024-02-15T22:57:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fd07912f800 20 rados_obj.operate() r=0 bl.length=347 2024-02-15T22:57:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fd07912f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-15T22:57:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fd07912f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-15T22:57:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fd07912f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:57:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.871+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb90d10 con 0x7fd0700141d0 2024-02-15T22:57:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.872+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) v8 ==== 155+0+186 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.872+0000 7fd07912f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 : miss 2024-02-15T22:57:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.872+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.872+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:96 8.5 8:a1eec6e2:root::.bucket.meta.myfoo7%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb90f00 con 0x5625dfb44f10 2024-02-15T22:57:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.873+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(96 .bucket.meta.myfoo7:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 [call out=48b,stat out=16b,read 0~355 out=355b,getxattrs out=218b] v0'0 uv4 ondisk = 0) v8 ==== 334+0+637 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.873+0000 7fd07912f800 20 rados_obj.operate() r=0 bl.length=355 2024-02-15T22:57:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.873+0000 7fd07912f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 info.flags=0x17 2024-02-15T22:57:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.873+0000 7fd07912f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 to cache LRU end 2024-02-15T22:57:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.873+0000 7fd07912f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:57:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.873+0000 7fd07912f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:57:29.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.873+0000 7fd07912f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 2024-02-15T22:57:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.873+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:97 4.1d 4:bb99a390:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfc0e7c0 con 0x5625dfb4b1f0 2024-02-15T22:57:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.873+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(97 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.873+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:98 4.31 4:8c3b74d2:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfc0e800 con 0x5625dfb44f10 2024-02-15T22:57:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.874+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(98 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.874+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:99 4.b 4:d2c2b3a0:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfc0e800 con 0x7fd05c038020 2024-02-15T22:57:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.874+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(99 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.874+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:100 4.3e 4:7fff711c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfc0e800 con 0x7fd05c038020 2024-02-15T22:57:29.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.874+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(100 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.3 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.874+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:101 4.37 4:eca34fa3:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfc0e840 con 0x7fd0700141d0 2024-02-15T22:57:29.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.875+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(101 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.4 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.875+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:102 4.3a 4:5dc8c62a:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfc0e840 con 0x5625dfb4b1f0 2024-02-15T22:57:29.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.875+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 27 ==== osd_op_reply(102 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5 [call out=377b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+377 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.875+0000 7fd07912f800 10 cls_bucket_list_unordered: got fourteen 2024-02-15T22:57:29.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.875+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:103 4.20 4:078abef6:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfc0ee10 con 0x5625dfb44f10 2024-02-15T22:57:29.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.875+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(103 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.875+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:104 4.11 4:89a4fb62:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfc0ee10 con 0x7fd0700141d0 2024-02-15T22:57:29.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.876+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(104 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.876+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:105 4.2a 4:57444bec:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfc0ee10 con 0x5625dfb44f10 2024-02-15T22:57:29.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.876+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(105 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.8 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.876+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:106 4.10 4:090b3f4c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfc0ee10 con 0x5625dfb4b1f0 2024-02-15T22:57:29.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.876+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 28 ==== osd_op_reply(106 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.9 [call out=85b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.876+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:107 4.32 4:4f64e52f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfc0ee10 con 0x5625dfb44f10 2024-02-15T22:57:29.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.877+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(107 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.877+0000 7fd07912f800 20 get_obj_state: octx=0x7fd070029040 obj=myfoo7:fourteen state=0x5625dfb92158 s->prefetch_data=0 2024-02-15T22:57:29.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.877+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:108 3.24 3:27db7d7a:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb93150 con 0x7fd0700141d0 2024-02-15T22:57:29.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.877+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(108 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 239+0+872 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.877+0000 7fd07912f800 10 manifest: total_size = 8 2024-02-15T22:57:29.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.877+0000 7fd07912f800 20 get_obj_state: setting s->obj_tag to b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.4733594007733060109 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.877+0000 7fd07912f800 20 get_obj_state: octx=0x7fd070029040 obj=myfoo7:fourteen state=0x5625dfb92158 s->prefetch_data=0 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.877+0000 7fd07912f800 20 prepare_atomic_modification: state is not atomic. state=0x5625dfb92158 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.877+0000 7fd07912f800 20 bucket index object: :.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.877+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:109 4.3a 4:5dc8c62a:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb97a00 con 0x5625dfb4b1f0 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.878+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 29 ==== osd_op_reply(109 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5 [stat,call,call] v32'8 uv8 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.878+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:110 3.24 3:27db7d7a:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb959e0 con 0x7fd0700141d0 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(110 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10_fourteen [call] v32'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:111 4.3a 4:5dc8c62a:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb97a00 con 0x5625dfb4b1f0 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 20 list_objects_ordered: starting attempt 1 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:112 4.1d 4:bb99a390:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb97a00 con 0x5625dfb4b1f0 2024-02-15T22:57:29.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:113 4.31 4:8c3b74d2:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb9bc90 con 0x5625dfb44f10 2024-02-15T22:57:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:114 4.b 4:d2c2b3a0:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb97a00 con 0x7fd05c038020 2024-02-15T22:57:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:115 4.3e 4:7fff711c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba0b00 con 0x7fd05c038020 2024-02-15T22:57:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:116 4.37 4:eca34fa3:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba3860 con 0x7fd0700141d0 2024-02-15T22:57:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:117 4.3a 4:5dc8c62a:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba61f0 con 0x5625dfb4b1f0 2024-02-15T22:57:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:118 4.20 4:078abef6:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba8ba0 con 0x5625dfb44f10 2024-02-15T22:57:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:119 4.11 4:89a4fb62:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb97a00 con 0x7fd0700141d0 2024-02-15T22:57:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:120 4.2a 4:57444bec:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb97a00 con 0x5625dfb44f10 2024-02-15T22:57:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 30 ==== osd_op_reply(112 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.880+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:121 4.10 4:090b3f4c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb99330 con 0x5625dfb4b1f0 2024-02-15T22:57:29.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:122 4.32 4:4f64e52f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfbb0420 con 0x5625dfb44f10 2024-02-15T22:57:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 30 ==== osd_op_reply(116 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.4 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(113 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 31 ==== osd_op_reply(119 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(118 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 36 ==== osd_op_reply(120 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.8 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(114 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 21 ==== osd_op_reply(115 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.3 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 31 ==== osd_op_reply(121 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.9 [call out=85b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 37 ==== osd_op_reply(122 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 32 ==== osd_op_reply(111 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5 [stat,call,call] v32'9 uv9 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fcf4bfff640 20 handle_completion(): completion ok for obj=fourteen 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 33 ==== osd_op_reply(117 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd07912f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd07912f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd07912f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd07912f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.881+0000 7fd07912f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10])"; uploads.size()=0; is_truncated=0 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:123 4.1d 4:bb99a390:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba0f60 con 0x5625dfb4b1f0 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:124 4.31 4:8c3b74d2:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb99250 con 0x5625dfb44f10 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:125 4.b 4:d2c2b3a0:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x7fd05c038020 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:126 4.3e 4:7fff711c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba0f60 con 0x7fd05c038020 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:127 4.37 4:eca34fa3:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb99250 con 0x7fd0700141d0 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:128 4.3a 4:5dc8c62a:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba3860 con 0x5625dfb4b1f0 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:129 4.20 4:078abef6:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb99250 con 0x5625dfb44f10 2024-02-15T22:57:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:130 4.11 4:89a4fb62:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x7fd0700141d0 2024-02-15T22:57:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:131 4.2a 4:57444bec:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba0f60 con 0x5625dfb44f10 2024-02-15T22:57:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 38 ==== osd_op_reply(124 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 32 ==== osd_op_reply(127 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.4 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 22 ==== osd_op_reply(125 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 33 ==== osd_op_reply(130 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 39 ==== osd_op_reply(129 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:132 4.10 4:090b3f4c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x5625dfb4b1f0 2024-02-15T22:57:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 34 ==== osd_op_reply(123 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:133 4.32 4:4f64e52f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba3860 con 0x5625dfb44f10 2024-02-15T22:57:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 23 ==== osd_op_reply(126 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.3 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 35 ==== osd_op_reply(128 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 40 ==== osd_op_reply(131 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.8 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 41 ==== osd_op_reply(133 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 36 ==== osd_op_reply(132 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.9 [call out=85b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.882+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba0ee0 con 0x7fd0700141d0 2024-02-15T22:57:29.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 34 ==== osd_op_reply(134 fud.buckets [call] v32'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd07912f800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-02-15T22:57:29.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba0ee0 con 0x7fd05c038020 2024-02-15T22:57:29.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 24 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) v8 ==== 192+0+216 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd07912f800 20 rados_obj.operate() r=0 bl.length=168 2024-02-15T22:57:29.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd07912f800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-02-15T22:57:29.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd07912f800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-02-15T22:57:29.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd07912f800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-02-15T22:57:29.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd07912f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-02-15T22:57:29.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:136 7.e 7:7759931f:::notify.3:head [notify cookie 94720667300112 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1380 con 0x7fd05c038020 2024-02-15T22:57:29.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 25 ==== watch-notify(notify (1) cookie 94720666969584 notify 137438953492 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x7fd070042040 con 0x7fd05c038020 2024-02-15T22:57:29.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fcf4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94720666969584 notifier 4754 bl.length()=150 2024-02-15T22:57:29.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fcf4bfff640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fcf38003d50 con 0x7fd05c038020 2024-02-15T22:57:29.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.884+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 26 ==== osd_op_reply(136 notify.3 [notify cookie 94720667300112 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.885+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 27 ==== osd_op_reply(137 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.885+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 28 ==== watch-notify(notify_complete (2) cookie 94720667300112 notify 137438953492 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd070026bc0 con 0x7fd05c038020 2024-02-15T22:57:29.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.885+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:138 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x7fd05c038020 2024-02-15T22:57:29.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.886+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 29 ==== osd_op_reply(138 myfoo7 [call,call,delete] v32'45 uv45 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.886+0000 7fd07912f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 from cache 2024-02-15T22:57:29.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.886+0000 7fd07912f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10, ofs0, ns] 2024-02-15T22:57:29.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.886+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:139 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94720667300112 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x7fd0700141d0 2024-02-15T22:57:29.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.887+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 35 ==== watch-notify(notify (1) cookie 94720666973056 notify 137438953508 ret 0) v3 ==== 250+0+0 (crc 0 0 0) 0x7fd0640b8060 con 0x7fd0700141d0 2024-02-15T22:57:29.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.887+0000 7fcf4b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 94720666973056 notifier 4754 bl.length()=208 2024-02-15T22:57:29.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.887+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 36 ==== osd_op_reply(139 notify.6 [notify cookie 94720667300112 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.887+0000 7fcf4b7fe640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fcea8003310 con 0x7fd0700141d0 2024-02-15T22:57:29.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.887+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 37 ==== osd_op_reply(140 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.887+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 38 ==== watch-notify(notify_complete (2) cookie 94720667300112 notify 137438953508 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5625dfa12dc0 con 0x7fd0700141d0 2024-02-15T22:57:29.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.887+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:141 8.5 8:a1eec6e2:root::.bucket.meta.myfoo7%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1380 con 0x5625dfb44f10 2024-02-15T22:57:29.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.888+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 42 ==== osd_op_reply(141 .bucket.meta.myfoo7:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 [call,call,delete] v32'5 uv5 ondisk = 0) v8 ==== 292+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.888+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:142 4.1d 4:bb99a390:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x5625dfb4b1f0 2024-02-15T22:57:29.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.888+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:143 4.31 4:8c3b74d2:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1380 con 0x5625dfb44f10 2024-02-15T22:57:29.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.888+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:144 4.b 4:d2c2b3a0:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba23c0 con 0x7fd05c038020 2024-02-15T22:57:29.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.888+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:145 4.3e 4:7fff711c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba2bc0 con 0x7fd05c038020 2024-02-15T22:57:29.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.888+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:146 4.37 4:eca34fa3:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb8f6a0 con 0x7fd0700141d0 2024-02-15T22:57:29.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.888+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:147 4.3a 4:5dc8c62a:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x5625dfb4b1f0 2024-02-15T22:57:29.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.888+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:148 4.20 4:078abef6:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1380 con 0x5625dfb44f10 2024-02-15T22:57:29.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.889+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:149 4.11 4:89a4fb62:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba23c0 con 0x7fd0700141d0 2024-02-15T22:57:29.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.889+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:150 4.2a 4:57444bec:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x5625dfb44f10 2024-02-15T22:57:29.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.889+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:151 4.10 4:090b3f4c:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb8f6a0 con 0x5625dfb4b1f0 2024-02-15T22:57:29.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.889+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:152 4.32 4:4f64e52f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x5625dfb44f10 2024-02-15T22:57:29.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.890+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 43 ==== osd_op_reply(148 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.6 [delete] v32'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.890+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 37 ==== osd_op_reply(147 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.5 [delete] v32'10 uv10 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.890+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 39 ==== osd_op_reply(146 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.4 [delete] v32'7 uv7 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.890+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 40 ==== osd_op_reply(149 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.7 [delete] v32'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.890+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 30 ==== osd_op_reply(144 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.2 [delete] v32'3 uv3 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.890+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 31 ==== osd_op_reply(145 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.3 [delete] v32'10 uv10 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.890+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 44 ==== osd_op_reply(143 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.1 [delete] v32'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 38 ==== osd_op_reply(142 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.0 [delete] v32'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 45 ==== osd_op_reply(150 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.8 [delete] v32'13 uv13 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 46 ==== osd_op_reply(152 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.10 [delete] v32'5 uv5 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 39 ==== osd_op_reply(151 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10.9 [delete] v32'9 uv9 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd07912f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 : miss 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd07912f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:153 6.1f 6:fd0e7484:::pubsub..bucket.myfoo7%2fb92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x7fd0700141d0 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 41 ==== osd_op_reply(153 pubsub..bucket.myfoo7/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd07912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd07912f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 info.flags=0x0 2024-02-15T22:57:29.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd07912f800 10 adding default.rgw.log++pubsub..bucket.myfoo7/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 to cache LRU end 2024-02-15T22:57:29.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd07912f800 10 removing default.rgw.log++pubsub..bucket.myfoo7/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 from cache 2024-02-15T22:57:29.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd07912f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo7/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10, ofs0, ns] 2024-02-15T22:57:29.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify cookie 94720667295520 in=217b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x7fd05c038020 2024-02-15T22:57:29.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 32 ==== watch-notify(notify (1) cookie 94720666969584 notify 137438953493 ret 0) v3 ==== 247+0+0 (crc 0 0 0) 0x7fd070026bc0 con 0x7fd05c038020 2024-02-15T22:57:29.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fcf4b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94720666969584 notifier 4754 bl.length()=205 2024-02-15T22:57:29.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fcf4b7fe640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:155 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fcea80032f0 con 0x7fd05c038020 2024-02-15T22:57:29.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.891+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 33 ==== osd_op_reply(154 notify.3 [notify cookie 94720667295520 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.892+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 34 ==== osd_op_reply(155 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.892+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 35 ==== watch-notify(notify_complete (2) cookie 94720667295520 notify 137438953493 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd070030410 con 0x7fd05c038020 2024-02-15T22:57:29.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.892+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:156 6.1f 6:fd0e7484:::pubsub..bucket.myfoo7%2fb92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x7fd0700141d0 2024-02-15T22:57:29.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.893+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 42 ==== osd_op_reply(156 pubsub..bucket.myfoo7/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.10 [delete] v32'30 uv23 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.893+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:157 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x7fd0700141d0 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.894+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 43 ==== osd_op_reply(157 fud.buckets [call] v32'7 uv7 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.894+0000 7fd07912f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.894+0000 7fd07912f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.894+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify cookie 94720667293536 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba25e0 con 0x5625dfb4b1f0 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.894+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 40 ==== watch-notify(notify (1) cookie 94720666956976 notify 137438953479 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x5625dfb26a10 con 0x5625dfb4b1f0 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.894+0000 7fcf4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94720666956976 notifier 4754 bl.length()=170 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.894+0000 7fcf4bfff640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:159 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fcf38003d50 con 0x5625dfb4b1f0 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.894+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 41 ==== osd_op_reply(158 notify.2 [notify cookie 94720667293536 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.894+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 42 ==== osd_op_reply(159 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.894+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 43 ==== watch-notify(notify_complete (2) cookie 94720667293536 notify 137438953479 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd05c06e040 con 0x5625dfb4b1f0 2024-02-15T22:57:29.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.894+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:160 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x7fd0700141d0 2024-02-15T22:57:29.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.895+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 44 ==== osd_op_reply(160 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.895+0000 7fd07912f800 10 removing email index: 2024-02-15T22:57:29.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.896+0000 7fd07912f800 10 removing user buckets index 2024-02-15T22:57:29.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.896+0000 7fd07912f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-15T22:57:29.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.896+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94720667293536 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1f20 con 0x7fd0700141d0 2024-02-15T22:57:29.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.896+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 45 ==== watch-notify(notify (1) cookie 94720666973056 notify 137438953509 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x5625dfa12dc0 con 0x7fd0700141d0 2024-02-15T22:57:29.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.896+0000 7fcf4b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94720666973056 notifier 4754 bl.length()=160 2024-02-15T22:57:29.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.896+0000 7fcf4b7fe640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:162 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fcea80032f0 con 0x7fd0700141d0 2024-02-15T22:57:29.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.896+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 46 ==== osd_op_reply(161 notify.6 [notify cookie 94720667293536 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.896+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 47 ==== osd_op_reply(162 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.896+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 48 ==== watch-notify(notify_complete (2) cookie 94720667293536 notify 137438953509 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5625dfa14870 con 0x7fd0700141d0 2024-02-15T22:57:29.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.896+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:163 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x7fd0700141d0 2024-02-15T22:57:29.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.897+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 49 ==== osd_op_reply(163 fud.buckets [delete] v32'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.897+0000 7fd07912f800 10 removing user index: fud 2024-02-15T22:57:29.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.897+0000 7fd07912f800 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-15T22:57:29.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.897+0000 7fd07912f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-15T22:57:29.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.897+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94720667293536 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1f20 con 0x7fd0700141d0 2024-02-15T22:57:29.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.897+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 50 ==== watch-notify(notify (1) cookie 94720666975472 notify 137438953510 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x5625dfa14870 con 0x7fd0700141d0 2024-02-15T22:57:29.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.897+0000 7fcf4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94720666975472 notifier 4754 bl.length()=152 2024-02-15T22:57:29.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.897+0000 7fcf4bfff640 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fcf38003d50 con 0x7fd0700141d0 2024-02-15T22:57:29.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.897+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 51 ==== osd_op_reply(164 notify.5 [notify cookie 94720667293536 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.898+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 52 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.898+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 53 ==== watch-notify(notify_complete (2) cookie 94720667293536 notify 137438953510 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5625dfa1be70 con 0x7fd0700141d0 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.898+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:166 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb99150 con 0x7fd0700141d0 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.899+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 54 ==== osd_op_reply(166 fud [call,call,delete] v32'13 uv13 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.899+0000 7fcf2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.900+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:167 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94720666981488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfba1760 con 0x5625dfb44f10 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.901+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 47 ==== osd_op_reply(167 data_loggenerations_metadata [watch unwatch cookie 94720666981488] v32'227 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.901+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:168 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94720666959456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb55470 con 0x7fd05c038020 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.902+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 36 ==== osd_op_reply(168 notify.0 [watch unwatch cookie 94720666959456] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.902+0000 7fd07912f800 20 remove_watcher() i=0 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.902+0000 7fd07912f800 2 removed watcher, disabling cache 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.902+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:169 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94720666963040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb55470 con 0x5625dfb44f10 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.903+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 48 ==== osd_op_reply(169 notify.1 [watch unwatch cookie 94720666963040] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.903+0000 7fd07912f800 20 remove_watcher() i=1 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.903+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:170 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94720666956976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb50c60 con 0x5625dfb4b1f0 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.904+0000 7fd06c6c4640 1 -- 172.21.15.133:0/896073747 <== osd.3 v2:172.21.15.133:6816/1065500544 44 ==== osd_op_reply(170 notify.2 [watch unwatch cookie 94720666956976] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd05c035070 con 0x5625dfb4b1f0 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.904+0000 7fd07912f800 20 remove_watcher() i=2 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.904+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:171 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94720666969584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb55470 con 0x7fd05c038020 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.905+0000 7fd0756c6640 1 -- 172.21.15.133:0/896073747 <== osd.2 v2:172.21.15.133:6800/2073628168 37 ==== osd_op_reply(171 notify.3 [watch unwatch cookie 94720666969584] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd07003a040 con 0x7fd05c038020 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.905+0000 7fd07912f800 20 remove_watcher() i=3 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.905+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:172 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94720666971120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb4f4b0 con 0x5625dfb44f10 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.906+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.1 v2:172.21.15.133:6808/2671624067 49 ==== osd_op_reply(172 notify.4 [watch unwatch cookie 94720666971120] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x5625dfb44f10 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.906+0000 7fd07912f800 20 remove_watcher() i=4 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.906+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:173 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94720666975472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb50c60 con 0x7fd0700141d0 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.907+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 55 ==== osd_op_reply(173 notify.5 [watch unwatch cookie 94720666975472] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.907+0000 7fd07912f800 20 remove_watcher() i=5 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.907+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:174 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94720666973056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb525f0 con 0x7fd0700141d0 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.908+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 56 ==== osd_op_reply(174 notify.6 [watch unwatch cookie 94720666973056] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.908+0000 7fd07912f800 20 remove_watcher() i=6 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.908+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:175 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94720666977632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625dfb55470 con 0x7fd0700141d0 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 <== osd.0 v2:172.21.15.52:6800/431200118 57 ==== osd_op_reply(175 notify.7 [watch unwatch cookie 94720666977632] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd064059040 con 0x7fd0700141d0 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 20 remove_watcher() i=7 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd0700141d0 msgr2=0x7fd070015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fd0700141d0 0x7fd070015940 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5625dfb44f10 msgr2=0x5625dfb473d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5625dfb44f10 0x5625dfb473d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd05c038020 msgr2=0x7fd05c015640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fd05c038020 0x7fd05c015640 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5625dfb4b1f0 msgr2=0x5625dfb4d690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5625dfb4b1f0 0x5625dfb4d690 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf40036790 msgr2=0x7fcf40038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf40036790 0x7fcf40038c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd07000b010 tx=0x7fd070020000 comp rx=0 tx=0).stop 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 msgr2=0x5625dfb39490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 --2- 172.21.15.133:0/896073747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb32490 0x5625dfb39490 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd05c01afd0 tx=0x7fd05c04c750 comp rx=0 tx=0).stop 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 reap_dead start 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd074ec5640 1 -- 172.21.15.133:0/896073747 reap_dead start 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 shutdown_connections 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 >> 172.21.15.133:0/896073747 conn(0x5625dfb2e760 msgr2=0x5625dfb2c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 shutdown_connections 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.909+0000 7fd07912f800 1 -- 172.21.15.133:0/896073747 wait complete. 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/819135108 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf4c036790 msgr2=0x7fcf4c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 --2- 172.21.15.133:0/819135108 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf4c036790 0x7fcf4c038c50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5625dfb153a0 tx=0x7fd070005840 comp rx=0 tx=0).stop 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/819135108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb25180 msgr2=0x5625dfb255a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 --2- 172.21.15.133:0/819135108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb25180 0x5625dfb255a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd05c001ed0 tx=0x7fd05c00d7a0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/819135108 shutdown_connections 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 --2- 172.21.15.133:0/819135108 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf4c036790 0x7fcf4c038c50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 --2- 172.21.15.133:0/819135108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfb25180 0x5625dfb255a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/819135108 >> 172.21.15.133:0/819135108 conn(0x5625dfb19220 msgr2=0x5625dfb19620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/819135108 shutdown_connections 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/819135108 wait complete. 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5625dfa17350 msgr2=0x5625dfb148b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5625dfa17350 0x5625dfb148b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf5c0367e0 msgr2=0x7fcf5c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf5c0367e0 0x7fcf5c038ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd05c000f60 tx=0x7fd05c0012b0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 msgr2=0x5625dfa14330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:29.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfa14330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd064005870 tx=0x7fd064002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 shutdown_connections 2024-02-15T22:57:29.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5625dfa17350 0x5625dfb148b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcf5c0367e0 0x7fcf5c038ca0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 --2- 172.21.15.133:0/1193751565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625dfa14a20 0x5625dfa14330 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:29.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 >> 172.21.15.133:0/1193751565 conn(0x5625dfa0e4f0 msgr2=0x5625dfafe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:29.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 shutdown_connections 2024-02-15T22:57:29.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:29.910+0000 7fd07912f800 1 -- 172.21.15.133:0/1193751565 wait complete. 2024-02-15T22:57:34.932 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-02-15T22:57:34.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-02-15T22:57:34.933 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-02-15T22:57:34.983 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:34.983 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:34.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.981+0000 7f791920f800 1 Processor -- start 2024-02-15T22:57:34.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.981+0000 7f791920f800 1 -- start start 2024-02-15T22:57:34.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.981+0000 7f791920f800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5621bd20f100 0x5621bd29eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:34.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.981+0000 7f791920f800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5621bd1e6bb0 con 0x5621bd29f0a0 2024-02-15T22:57:34.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.981+0000 7f791920f800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5621bd19e450 con 0x5621bd20f100 2024-02-15T22:57:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.982+0000 7f79148e4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5621bd20f100 0x5621bd29eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.982+0000 7f790ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5621bd29f0a0 0x5621bd2a1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41674/0 (socket says 172.21.15.133:41674) 2024-02-15T22:57:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.982+0000 7f79148e4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5621bd20f100 0x5621bd29eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45828/0 (socket says 172.21.15.133:45828) 2024-02-15T22:57:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.982+0000 7f790ffff640 1 -- 172.21.15.133:0/2888055008 learned_addr learned my addr 172.21.15.133:0/2888055008 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.982+0000 7f79148e4640 1 -- 172.21.15.133:0/2888055008 >> v1:172.21.15.52:6789/0 conn(0x5621bd29f0a0 legacy=0x5621bd2a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.982+0000 7f79148e4640 1 -- 172.21.15.133:0/2888055008 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621bd2a3e50 con 0x5621bd20f100 2024-02-15T22:57:34.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.984+0000 7f79148e4640 1 --2- 172.21.15.133:0/2888055008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd29eb30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f790800a470 tx=0x7f790801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5729802a6e962bca server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:34.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.984+0000 7f790f7fe640 1 -- 172.21.15.133:0/2888055008 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7908052570 con 0x5621bd20f100 2024-02-15T22:57:34.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.984+0000 7f790f7fe640 1 -- 172.21.15.133:0/2888055008 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79080526d0 con 0x5621bd20f100 2024-02-15T22:57:34.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.984+0000 7f790f7fe640 1 -- 172.21.15.133:0/2888055008 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7908052990 con 0x5621bd20f100 2024-02-15T22:57:34.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.985+0000 7f791920f800 1 -- 172.21.15.133:0/2888055008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 msgr2=0x5621bd29eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:34.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.985+0000 7f791920f800 1 --2- 172.21.15.133:0/2888055008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd29eb30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f790800a470 tx=0x7f790801cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:34.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.985+0000 7f791920f800 1 -- 172.21.15.133:0/2888055008 shutdown_connections 2024-02-15T22:57:34.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.985+0000 7f791920f800 1 --2- 172.21.15.133:0/2888055008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd29eb30 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:34.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.985+0000 7f791920f800 1 -- 172.21.15.133:0/2888055008 >> 172.21.15.133:0/2888055008 conn(0x5621bd2964d0 msgr2=0x5621bd2988f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:34.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.985+0000 7f791920f800 1 -- 172.21.15.133:0/2888055008 shutdown_connections 2024-02-15T22:57:34.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.985+0000 7f791920f800 1 -- 172.21.15.133:0/2888055008 wait complete. 2024-02-15T22:57:35.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.999+0000 7f791920f800 1 Processor -- start 2024-02-15T22:57:35.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.999+0000 7f791920f800 1 -- start start 2024-02-15T22:57:35.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.999+0000 7f791920f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd29c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.999+0000 7f791920f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bd19b980 con 0x5621bd20f100 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.999+0000 7f79148e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd29c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.999+0000 7f79148e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd29c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45836/0 (socket says 172.21.15.133:45836) 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:34.999+0000 7f79148e4640 1 -- 172.21.15.133:0/554791143 learned_addr learned my addr 172.21.15.133:0/554791143 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.000+0000 7f79148e4640 1 -- 172.21.15.133:0/554791143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908005d20 con 0x5621bd20f100 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.000+0000 7f79148e4640 1 --2- 172.21.15.133:0/554791143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd29c460 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7908055040 tx=0x7f790804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a915cdf30b0d38 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.000+0000 7f7802e05640 1 -- 172.21.15.133:0/554791143 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f790800a180 con 0x5621bd20f100 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.000+0000 7f7802e05640 1 -- 172.21.15.133:0/554791143 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790800a2e0 con 0x5621bd20f100 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.000+0000 7f7802e05640 1 -- 172.21.15.133:0/554791143 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79080529b0 con 0x5621bd20f100 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.001+0000 7f791920f800 1 -- 172.21.15.133:0/554791143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 msgr2=0x5621bd29c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.001+0000 7f791920f800 1 --2- 172.21.15.133:0/554791143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd29c460 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7908055040 tx=0x7f790804c000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.001+0000 7f791920f800 1 -- 172.21.15.133:0/554791143 shutdown_connections 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.001+0000 7f791920f800 1 --2- 172.21.15.133:0/554791143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd29c460 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.001+0000 7f791920f800 1 -- 172.21.15.133:0/554791143 >> 172.21.15.133:0/554791143 conn(0x5621bd2964d0 msgr2=0x5621bd387930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.001+0000 7f791920f800 1 -- 172.21.15.133:0/554791143 shutdown_connections 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.001+0000 7f791920f800 1 -- 172.21.15.133:0/554791143 wait complete. 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.001+0000 7f791920f800 1 Processor -- start 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.001+0000 7f791920f800 1 -- start start 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.002+0000 7f791920f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd3957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.002+0000 7f791920f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bd197160 con 0x5621bd20f100 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.002+0000 7f79148e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd3957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.002+0000 7f79148e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd3957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45844/0 (socket says 172.21.15.133:45844) 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.002+0000 7f79148e4640 1 -- 172.21.15.133:0/1196186746 learned_addr learned my addr 172.21.15.133:0/1196186746 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.002+0000 7f79148e4640 1 -- 172.21.15.133:0/1196186746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621bd2a3e50 con 0x5621bd20f100 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.002+0000 7f79148e4640 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd3957e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f790800a470 tx=0x7f7908002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.003+0000 7f7801602640 1 -- 172.21.15.133:0/1196186746 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f790806a070 con 0x5621bd20f100 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.003+0000 7f7801602640 1 -- 172.21.15.133:0/1196186746 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790805d420 con 0x5621bd20f100 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.003+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621bd395d20 con 0x5621bd20f100 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.003+0000 7f7801602640 1 -- 172.21.15.133:0/1196186746 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f790805d5d0 con 0x5621bd20f100 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.003+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621bd396200 con 0x5621bd20f100 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.004+0000 7f7801602640 1 -- 172.21.15.133:0/1196186746 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f790805d730 con 0x5621bd20f100 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.004+0000 7f7801602640 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77fc0367e0 0x7f77fc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.004+0000 7f7801602640 1 -- 172.21.15.133:0/1196186746 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f790808d9e0 con 0x5621bd20f100 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.004+0000 7f790ffff640 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77fc0367e0 0x7f77fc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.004+0000 7f791920f800 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5621bd29f0a0 0x5621bd39c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.004+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd39cae0 con 0x5621bd29f0a0 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.004+0000 7f79150e5640 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5621bd29f0a0 0x5621bd39c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.004+0000 7f790ffff640 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77fc0367e0 0x7f77fc038ca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7900000f60 tx=0x7f79000012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.004+0000 7f79150e5640 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5621bd29f0a0 0x5621bd39c4c0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.005+0000 7f79150e5640 1 -- 172.21.15.133:0/1196186746 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f791000a4a0 con 0x5621bd29f0a0 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.005+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd399bd0 con 0x5621bd29f0a0 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.005+0000 7f79150e5640 1 -- 172.21.15.133:0/1196186746 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f791000a4a0 con 0x5621bd29f0a0 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.005+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd39e810 con 0x5621bd29f0a0 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.005+0000 7f79150e5640 1 -- 172.21.15.133:0/1196186746 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f791000a4a0 con 0x5621bd29f0a0 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.005+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd39da10 con 0x5621bd29f0a0 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.006+0000 7f79150e5640 1 -- 172.21.15.133:0/1196186746 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f791000a4a0 con 0x5621bd29f0a0 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.006+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd39de20 con 0x5621bd29f0a0 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.006+0000 7f79150e5640 1 -- 172.21.15.133:0/1196186746 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f791000a4a0 con 0x5621bd29f0a0 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.006+0000 7f791920f800 1 Processor -- start 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.006+0000 7f791920f800 1 -- start start 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.006+0000 7f791920f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ad290 0x5621bd3ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.006+0000 7f791920f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bd139e80 con 0x5621bd3ad290 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.007+0000 7f790ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ad290 0x5621bd3ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.007+0000 7f790ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ad290 0x5621bd3ad6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45860/0 (socket says 172.21.15.133:45860) 2024-02-15T22:57:35.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.007+0000 7f790ffff640 1 -- 172.21.15.133:0/607047556 learned_addr learned my addr 172.21.15.133:0/607047556 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.007+0000 7f790ffff640 1 -- 172.21.15.133:0/607047556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621bd3adbf0 con 0x5621bd3ad290 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.007+0000 7f790ffff640 1 --2- 172.21.15.133:0/607047556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ad290 0x5621bd3ad6b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7900001ed0 tx=0x7f790000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.007+0000 7f77fa7fc640 1 -- 172.21.15.133:0/607047556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7900020070 con 0x5621bd3ad290 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.007+0000 7f77fa7fc640 1 -- 172.21.15.133:0/607047556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790001b550 con 0x5621bd3ad290 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.007+0000 7f791920f800 1 -- 172.21.15.133:0/607047556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621bd3ae660 con 0x5621bd3ad290 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.008+0000 7f77fa7fc640 1 -- 172.21.15.133:0/607047556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7900013040 con 0x5621bd3ad290 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.008+0000 7f791920f800 1 -- 172.21.15.133:0/607047556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621bd3aeb20 con 0x5621bd3ad290 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.008+0000 7f77fa7fc640 1 -- 172.21.15.133:0/607047556 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f790001b8c0 con 0x5621bd3ad290 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.009+0000 7f77fa7fc640 1 --2- 172.21.15.133:0/607047556 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77ec036790 0x7f77ec038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.009+0000 7f77fa7fc640 1 -- 172.21.15.133:0/607047556 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f790004e3e0 con 0x5621bd3ad290 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.009+0000 7f79150e5640 1 --2- 172.21.15.133:0/607047556 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77ec036790 0x7f77ec038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.009+0000 7f791920f800 1 Processor -- start 2024-02-15T22:57:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.009+0000 7f791920f800 1 -- start start 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.009+0000 7f79150e5640 1 --2- 172.21.15.133:0/607047556 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77ec036790 0x7f77ec038c50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5621bd39d450 tx=0x7f7910005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.009+0000 7f791920f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3ba980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.009+0000 7f791920f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bd10f5d0 con 0x5621bd3ba5a0 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.009+0000 7f790ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3ba980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.010+0000 7f790ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3ba980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45876/0 (socket says 172.21.15.133:45876) 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.010+0000 7f790ffff640 1 -- 172.21.15.133:0/679073607 learned_addr learned my addr 172.21.15.133:0/679073607 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.010+0000 7f790ffff640 1 -- 172.21.15.133:0/679073607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621bd3baf50 con 0x5621bd3ba5a0 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.010+0000 7f790ffff640 1 --2- 172.21.15.133:0/679073607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3ba980 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7900019cf0 tx=0x7f790004c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeeb486c76163c12 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.010+0000 7f77ebfff640 1 -- 172.21.15.133:0/679073607 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7900024a50 con 0x5621bd3ba5a0 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.010+0000 7f77ebfff640 1 -- 172.21.15.133:0/679073607 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790001bd50 con 0x5621bd3ba5a0 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.010+0000 7f77ebfff640 1 -- 172.21.15.133:0/679073607 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f790004e200 con 0x5621bd3ba5a0 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.011+0000 7f791920f800 1 -- 172.21.15.133:0/679073607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 msgr2=0x5621bd3ba980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.011+0000 7f791920f800 1 --2- 172.21.15.133:0/679073607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3ba980 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7900019cf0 tx=0x7f790004c900 comp rx=0 tx=0).stop 2024-02-15T22:57:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.011+0000 7f791920f800 1 -- 172.21.15.133:0/679073607 shutdown_connections 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.011+0000 7f791920f800 1 --2- 172.21.15.133:0/679073607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3ba980 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.011+0000 7f791920f800 1 -- 172.21.15.133:0/679073607 >> 172.21.15.133:0/679073607 conn(0x5621bd3b6870 msgr2=0x5621bd3b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.011+0000 7f791920f800 1 -- 172.21.15.133:0/679073607 shutdown_connections 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.011+0000 7f791920f800 1 -- 172.21.15.133:0/679073607 wait complete. 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.011+0000 7f791920f800 1 Processor -- start 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.011+0000 7f791920f800 1 -- start start 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.011+0000 7f791920f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.011+0000 7f791920f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bd3c1b00 con 0x5621bd3ba5a0 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.012+0000 7f790ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.012+0000 7f790ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3c15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45880/0 (socket says 172.21.15.133:45880) 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.012+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 learned_addr learned my addr 172.21.15.133:0/166959206 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.012+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621bd3aeb20 con 0x5621bd3ba5a0 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.012+0000 7f790ffff640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3c15c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f790000dcc0 tx=0x7f790004c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.012+0000 7f77ea7fc640 1 -- 172.21.15.133:0/166959206 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7900019320 con 0x5621bd3ba5a0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.012+0000 7f77ea7fc640 1 -- 172.21.15.133:0/166959206 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900019480 con 0x5621bd3ba5a0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.012+0000 7f77ea7fc640 1 -- 172.21.15.133:0/166959206 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f790000cc60 con 0x5621bd3ba5a0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.012+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621bd3c1d00 con 0x5621bd3ba5a0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.012+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621bd3c2160 con 0x5621bd3ba5a0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.013+0000 7f77ea7fc640 1 -- 172.21.15.133:0/166959206 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f79000196a0 con 0x5621bd3ba5a0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.013+0000 7f77ea7fc640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77e0036790 0x7f77e0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.013+0000 7f77ea7fc640 1 -- 172.21.15.133:0/166959206 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f790004fe20 con 0x5621bd3ba5a0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.013+0000 7f79150e5640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77e0036790 0x7f77e0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.014+0000 7f79150e5640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77e0036790 0x7f77e0038c50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f791000b010 tx=0x7f7910020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.014+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.014+0000 7f791920f800 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5621bd3cd190 0x5621bd3cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.014+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3cfda0 con 0x5621bd3cd190 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.014+0000 7f79148e4640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5621bd3cd190 0x5621bd3cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.014+0000 7f79148e4640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5621bd3cd190 0x5621bd3cf650 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7908059040 con 0x5621bd3cd190 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 20 realm 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d0130 con 0x5621bd3cd190 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7908059040 con 0x5621bd3cd190 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d09b0 con 0x5621bd3cd190 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7908059040 con 0x5621bd3cd190 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d0d10 con 0x5621bd3cd190 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7908059040 con 0x5621bd3cd190 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.015+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d1510 con 0x5621bd3cd190 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.016+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.016+0000 7f791920f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.016+0000 7f791920f800 20 searching for the correct realm 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.016+0000 7f791920f800 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5621bd3d3460 0x5621bd3d5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.016+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d5fd0 con 0x5621bd3d3460 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.016+0000 7f790ffff640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5621bd3d3460 0x5621bd3d5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.016+0000 7f790ffff640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5621bd3d3460 0x5621bd3d5900 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.017+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.017+0000 7f790ffff640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f7900037020 0x7f79000146c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.017+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d5fd0 con 0x7f7900037020 2024-02-15T22:57:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.017+0000 7f79150e5640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f7900037020 0x7f79000146c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.017+0000 7f79150e5640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f7900037020 0x7f79000146c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.017+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f791000a4a0 con 0x7f7900037020 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.017+0000 7f79150e5640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f79100141d0 0x7f7910015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.017+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d5fd0 con 0x7f79100141d0 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.018+0000 7f79148e4640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f79100141d0 0x7f7910015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.018+0000 7f79148e4640 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f79100141d0 0x7f7910015940 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.019+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.019+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d5fd0 con 0x5621bd3cd190 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.019+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.019+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d5fd0 con 0x5621bd3cd190 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.019+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.019+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d5fd0 con 0x7f79100141d0 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.019+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.019+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d5fd0 con 0x7f79100141d0 2024-02-15T22:57:35.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.020+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.020+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d5fd0 con 0x7f7900037020 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.020+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f791000a4a0 con 0x7f7900037020 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.020+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d5fd0 con 0x5621bd3d3460 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.020+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.020+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3cd190 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.020+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.020+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x7f79100141d0 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.021+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.021+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3cd190 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.021+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.021+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x7f7900037020 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.021+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f791003a040 con 0x7f7900037020 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.021+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3d3460 2024-02-15T22:57:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.022+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.022+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3d3460 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.022+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.022+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x7f79100141d0 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.022+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.022+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3d3460 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.022+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.022+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3d3460 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.023+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.023+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3cd190 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.023+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.023+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3cd190 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.023+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.023+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x7f79100141d0 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.023+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.023+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3d3460 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.024+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.024+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x7f7900037020 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.024+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f791003a040 con 0x7f7900037020 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.024+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3cd190 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.024+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.024+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x7f79100141d0 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.025+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.025+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3d3460 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.025+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.025+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x7f79100141d0 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.025+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.025+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x7f7900037020 2024-02-15T22:57:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.025+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f791003a040 con 0x7f7900037020 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.025+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3d3460 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.026+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.026+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x7f79100141d0 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.026+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.026+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x5621bd3cd190 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.026+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.026+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f790005a040 con 0x7f7900037020 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f791003a040 con 0x7f7900037020 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d2a40 con 0x5621bd3cd190 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d2290 con 0x5621bd3cd190 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d1a20 con 0x5621bd3cd190 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 zone default found 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 4 Realm: () 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 zonegroup default 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.027+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d6410 con 0x7f79100141d0 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f791920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d8290 con 0x5621bd3d3460 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f791920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d85f0 con 0x5621bd3d3460 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f791920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f791920f800 20 started sync module instance, tier type = 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f791920f800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.028+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d7860 con 0x7f7900037020 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.030+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f791003a040 con 0x7f7900037020 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.030+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94702908833088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d7860 con 0x7f7900037020 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.030+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d8fc0 con 0x5621bd3cd190 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.031+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94702908833088] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f791003a040 con 0x7f7900037020 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.031+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.031+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94702908836544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d7860 con 0x5621bd3cd190 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.031+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d9aa0 con 0x5621bd3d3460 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.032+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.032+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94702908839360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3da2f0 con 0x5621bd3d3460 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.032+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3dada0 con 0x7f7900037020 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.033+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94702908836544] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.034+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94702908839360] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.034+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f791003a040 con 0x7f7900037020 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.034+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94702908841552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d73c0 con 0x7f7900037020 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.034+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3db760 con 0x5621bd3cd190 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.035+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94702908841552] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f791003a040 con 0x7f7900037020 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.035+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.035+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94702908844192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3db760 con 0x5621bd3cd190 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.035+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3dc0d0 con 0x7f79100141d0 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.036+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.036+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94702908844192] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.036+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94702908849200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3dc050 con 0x7f79100141d0 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.036+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3dcaf0 con 0x7f79100141d0 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.038+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94702908849200] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.038+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.038+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94702908846784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3dcaf0 con 0x7f79100141d0 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.038+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3dd4c0 con 0x7f79100141d0 2024-02-15T22:57:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.039+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.039+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94702908854208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3dd480 con 0x7f79100141d0 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.039+0000 7f791920f800 20 add_watcher() i=0 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.039+0000 7f791920f800 20 add_watcher() i=1 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.039+0000 7f791920f800 20 add_watcher() i=2 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.039+0000 7f791920f800 20 add_watcher() i=3 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.039+0000 7f791920f800 20 add_watcher() i=4 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.039+0000 7f791920f800 20 add_watcher() i=5 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.039+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94702908846784] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.039+0000 7f791920f800 20 add_watcher() i=6 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.040+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94702908854208] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.040+0000 7f791920f800 20 add_watcher() i=7 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.040+0000 7f791920f800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.040+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3dc510 con 0x5621bd3cd190 2024-02-15T22:57:35.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.040+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.040+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94702908856352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3de320 con 0x5621bd3cd190 2024-02-15T22:57:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.041+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94702908856352] v32'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.041+0000 7f77cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.042+0000 7f791920f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.042+0000 7f791920f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.042+0000 7f791920f800 5 note: GC not initialized 2024-02-15T22:57:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.042+0000 7f77c9fe3640 20 reqs_thread_entry: start 2024-02-15T22:57:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.042+0000 7f791920f800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.042+0000 7f791920f800 20 Filter name: none 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.042+0000 7f773b7fe640 20 reqs_thread_entry: start 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.042+0000 7f791920f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.042+0000 7f791920f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.042+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd412b00 con 0x5621bd3cd190 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.043+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.043+0000 7f791920f800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.043+0000 7f791920f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.043+0000 7f791920f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.043+0000 7f791920f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.043+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd415020 con 0x7f79100141d0 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.044+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 usage.10 [call] v32'32 uv32 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.044+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd415020 con 0x7f79100141d0 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.045+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(64 usage.10 [call] v32'33 uv32 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.046+0000 7f77cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.046+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94702908856352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3c9620 con 0x5621bd3cd190 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.047+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94702908856352] v32'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.047+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94702908833088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3dd7e0 con 0x7f7900037020 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.048+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94702908833088] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f791003a040 con 0x7f7900037020 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.048+0000 7f791920f800 20 remove_watcher() i=0 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.048+0000 7f791920f800 2 removed watcher, disabling cache 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.048+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94702908836544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d7d40 con 0x5621bd3cd190 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.049+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94702908836544] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.049+0000 7f791920f800 20 remove_watcher() i=1 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.049+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94702908839360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d8ac0 con 0x5621bd3d3460 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.050+0000 7f790ffff640 1 -- 172.21.15.133:0/166959206 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94702908839360] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7900034070 con 0x5621bd3d3460 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.050+0000 7f791920f800 20 remove_watcher() i=2 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.050+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94702908841552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d95c0 con 0x7f7900037020 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.051+0000 7f79150e5640 1 -- 172.21.15.133:0/166959206 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94702908841552] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f791003a040 con 0x7f7900037020 2024-02-15T22:57:35.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.051+0000 7f791920f800 20 remove_watcher() i=3 2024-02-15T22:57:35.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.051+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94702908844192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d9e50 con 0x5621bd3cd190 2024-02-15T22:57:35.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.052+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94702908844192] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x5621bd3cd190 2024-02-15T22:57:35.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.052+0000 7f791920f800 20 remove_watcher() i=4 2024-02-15T22:57:35.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.052+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94702908849200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3d9e50 con 0x7f79100141d0 2024-02-15T22:57:35.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.053+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94702908849200] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.054+0000 7f791920f800 20 remove_watcher() i=5 2024-02-15T22:57:35.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.054+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94702908846784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3dbc30 con 0x7f79100141d0 2024-02-15T22:57:35.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.055+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94702908846784] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.055+0000 7f791920f800 20 remove_watcher() i=6 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.055+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94702908854208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621bd3dbc30 con 0x7f79100141d0 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94702908854208] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f790807e380 con 0x7f79100141d0 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f791920f800 20 remove_watcher() i=7 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f79100141d0 msgr2=0x7f7910015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f791920f800 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f79100141d0 0x7f7910015940 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5621bd3cd190 msgr2=0x5621bd3cf650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f791920f800 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5621bd3cd190 0x5621bd3cf650 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f7900037020 msgr2=0x7f79000146c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f791920f800 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f7900037020 0x7f79000146c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5621bd3d3460 msgr2=0x5621bd3d5900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f791920f800 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x5621bd3d3460 0x5621bd3d5900 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77e0036790 msgr2=0x7f77e0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.056+0000 7f791920f800 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77e0036790 0x7f77e0038c50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f791000b010 tx=0x7f7910020000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 msgr2=0x5621bd3c15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3c15c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f790000dcc0 tx=0x7f790004c750 comp rx=0 tx=0).stop 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f79148e4640 1 -- 172.21.15.133:0/166959206 reap_dead start 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 shutdown_connections 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/166959206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ba5a0 0x5621bd3c15c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 >> 172.21.15.133:0/166959206 conn(0x5621bd3b6870 msgr2=0x5621bd3b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 shutdown_connections 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/166959206 wait complete. 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/607047556 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77ec036790 msgr2=0x7f77ec038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/607047556 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77ec036790 0x7f77ec038c50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5621bd39d450 tx=0x7f7910005840 comp rx=0 tx=0).stop 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/607047556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ad290 msgr2=0x5621bd3ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/607047556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ad290 0x5621bd3ad6b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7900001ed0 tx=0x7f790000d7a0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/607047556 shutdown_connections 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/607047556 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77ec036790 0x7f77ec038c50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/607047556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd3ad290 0x5621bd3ad6b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/607047556 >> 172.21.15.133:0/607047556 conn(0x5621bd3a1330 msgr2=0x5621bd3a1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/607047556 shutdown_connections 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/607047556 wait complete. 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5621bd29f0a0 msgr2=0x5621bd39c4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5621bd29f0a0 0x5621bd39c4c0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77fc0367e0 msgr2=0x7f77fc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77fc0367e0 0x7f77fc038ca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7900000f60 tx=0x7f79000012b0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 msgr2=0x5621bd3957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd3957e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f790800a470 tx=0x7f7908002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 shutdown_connections 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5621bd29f0a0 0x5621bd39c4c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f77fc0367e0 0x7f77fc038ca0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 --2- 172.21.15.133:0/1196186746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5621bd20f100 0x5621bd3957e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.057+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 >> 172.21.15.133:0/1196186746 conn(0x5621bd2964d0 msgr2=0x5621bd29ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.058+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 shutdown_connections 2024-02-15T22:57:35.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.058+0000 7f791920f800 1 -- 172.21.15.133:0/1196186746 wait complete. 2024-02-15T22:57:35.086 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-15T22:57:35.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-15T22:57:35.086 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-15T22:57:35.129 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:35.129 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:35.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.127+0000 7f3e7dd2d800 1 Processor -- start 2024-02-15T22:57:35.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.127+0000 7f3e7dd2d800 1 -- start start 2024-02-15T22:57:35.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.127+0000 7f3e7dd2d800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564f399d3300 0x564f399d56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.127+0000 7f3e7dd2d800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564f3991abb0 con 0x564f399cee70 2024-02-15T22:57:35.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.127+0000 7f3e7dd2d800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x564f398d2450 con 0x564f399d3300 2024-02-15T22:57:35.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.128+0000 7f3e7117c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564f399d3300 0x564f399d56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.128+0000 7f3e7997d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x564f399cee70 0x564f399cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41684/0 (socket says 172.21.15.133:41684) 2024-02-15T22:57:35.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.128+0000 7f3e7997d640 1 -- 172.21.15.133:0/1156464028 learned_addr learned my addr 172.21.15.133:0/1156464028 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:35.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.128+0000 7f3e7117c640 1 --2- 172.21.15.133:0/1156464028 >> v2:172.21.15.52:3300/0 conn(0x564f399d3300 0x564f399d56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45890/0 (socket says 172.21.15.133:45890) 2024-02-15T22:57:35.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.128+0000 7f3e7117c640 1 -- 172.21.15.133:0/1156464028 >> v1:172.21.15.52:6789/0 conn(0x564f399cee70 legacy=0x564f399cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.128+0000 7f3e7117c640 1 -- 172.21.15.133:0/1156464028 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f399d6d20 con 0x564f399d3300 2024-02-15T22:57:35.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.130+0000 7f3e7117c640 1 --2- 172.21.15.133:0/1156464028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399d3300 0x564f399d56f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400a470 tx=0x7f3e6401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48d09b07cbd789f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.130+0000 7f3e7917c640 1 -- 172.21.15.133:0/1156464028 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e64052570 con 0x564f399d3300 2024-02-15T22:57:35.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.130+0000 7f3e7917c640 1 -- 172.21.15.133:0/1156464028 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e640526d0 con 0x564f399d3300 2024-02-15T22:57:35.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.130+0000 7f3e7917c640 1 -- 172.21.15.133:0/1156464028 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e64052990 con 0x564f399d3300 2024-02-15T22:57:35.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.130+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/1156464028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399d3300 msgr2=0x564f399d56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.130+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/1156464028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399d3300 0x564f399d56f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400a470 tx=0x7f3e6401cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:35.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.130+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/1156464028 shutdown_connections 2024-02-15T22:57:35.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.130+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/1156464028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399d3300 0x564f399d56f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.131+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/1156464028 >> 172.21.15.133:0/1156464028 conn(0x564f399ca4d0 msgr2=0x564f399cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.131+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/1156464028 shutdown_connections 2024-02-15T22:57:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.131+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/1156464028 wait complete. 2024-02-15T22:57:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.142+0000 7f3e7dd2d800 1 Processor -- start 2024-02-15T22:57:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.142+0000 7f3e7dd2d800 1 -- start start 2024-02-15T22:57:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.142+0000 7f3e7dd2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39942f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.142+0000 7f3e7dd2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f398cf980 con 0x564f399cee70 2024-02-15T22:57:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.142+0000 7f3e7997d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39942f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.143+0000 7f3e7997d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39942f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45904/0 (socket says 172.21.15.133:45904) 2024-02-15T22:57:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.143+0000 7f3e7997d640 1 -- 172.21.15.133:0/2088847216 learned_addr learned my addr 172.21.15.133:0/2088847216 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.143+0000 7f3e7997d640 1 -- 172.21.15.133:0/2088847216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64005d20 con 0x564f399cee70 2024-02-15T22:57:35.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.143+0000 7f3e7997d640 1 --2- 172.21.15.133:0/2088847216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39942f30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c001c80 tx=0x7f3e6c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411f11c139122e2f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.143+0000 7f3d67e07640 1 -- 172.21.15.133:0/2088847216 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c00e470 con 0x564f399cee70 2024-02-15T22:57:35.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.143+0000 7f3d67e07640 1 -- 172.21.15.133:0/2088847216 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c00e5d0 con 0x564f399cee70 2024-02-15T22:57:35.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.143+0000 7f3d67e07640 1 -- 172.21.15.133:0/2088847216 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c00e8d0 con 0x564f399cee70 2024-02-15T22:57:35.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.144+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2088847216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 msgr2=0x564f39942f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.144+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/2088847216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39942f30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c001c80 tx=0x7f3e6c00b6c0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.144+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2088847216 shutdown_connections 2024-02-15T22:57:35.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.144+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/2088847216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39942f30 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.144+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2088847216 >> 172.21.15.133:0/2088847216 conn(0x564f399ca4d0 msgr2=0x564f39aba810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.144+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2088847216 shutdown_connections 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.144+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2088847216 wait complete. 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.144+0000 7f3e7dd2d800 1 Processor -- start 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.144+0000 7f3e7dd2d800 1 -- start start 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.144+0000 7f3e7dd2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39ac76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.144+0000 7f3e7dd2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f398cb160 con 0x564f399cee70 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.145+0000 7f3e7997d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39ac76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.145+0000 7f3e7997d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39ac76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45908/0 (socket says 172.21.15.133:45908) 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.145+0000 7f3e7997d640 1 -- 172.21.15.133:0/323556044 learned_addr learned my addr 172.21.15.133:0/323556044 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.145+0000 7f3e7997d640 1 -- 172.21.15.133:0/323556044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f3991abb0 con 0x564f399cee70 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.145+0000 7f3e7997d640 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39ac76f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c001c80 tx=0x7f3e6c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.145+0000 7f3d66604640 1 -- 172.21.15.133:0/323556044 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c01f070 con 0x564f399cee70 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.145+0000 7f3d66604640 1 -- 172.21.15.133:0/323556044 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c018640 con 0x564f399cee70 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.145+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f39ac7c30 con 0x564f399cee70 2024-02-15T22:57:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.145+0000 7f3d66604640 1 -- 172.21.15.133:0/323556044 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c0188e0 con 0x564f399cee70 2024-02-15T22:57:35.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.146+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f39ac8110 con 0x564f399cee70 2024-02-15T22:57:35.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.146+0000 7f3d66604640 1 -- 172.21.15.133:0/323556044 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3e6c018a40 con 0x564f399cee70 2024-02-15T22:57:35.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.146+0000 7f3d66604640 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d600367e0 0x7f3d60038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.147+0000 7f3d66604640 1 -- 172.21.15.133:0/323556044 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f3e6c04c170 con 0x564f399cee70 2024-02-15T22:57:35.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.147+0000 7f3e7117c640 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d600367e0 0x7f3d60038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.147+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564f399d3300 0x564f39ace3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.147+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39acea10 con 0x564f399d3300 2024-02-15T22:57:35.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.147+0000 7f3e7a17e640 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564f399d3300 0x564f39ace3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.147+0000 7f3e7117c640 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d600367e0 0x7f3d60038ca0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3e64054000 tx=0x7f3e6404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.147+0000 7f3e7a17e640 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564f399d3300 0x564f39ace3d0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.147+0000 7f3e7a17e640 1 -- 172.21.15.133:0/323556044 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e7400a4a0 con 0x564f399d3300 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.147+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39acbae0 con 0x564f399d3300 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.148+0000 7f3e7a17e640 1 -- 172.21.15.133:0/323556044 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3e7400a4a0 con 0x564f399d3300 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.148+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39ad0710 con 0x564f399d3300 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.148+0000 7f3e7a17e640 1 -- 172.21.15.133:0/323556044 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3e7400a4a0 con 0x564f399d3300 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.148+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39acfa20 con 0x564f399d3300 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.148+0000 7f3e7a17e640 1 -- 172.21.15.133:0/323556044 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3e7400a4a0 con 0x564f399d3300 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.148+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39acfe30 con 0x564f399d3300 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.148+0000 7f3e7a17e640 1 -- 172.21.15.133:0/323556044 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3e7400a4a0 con 0x564f399d3300 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.149+0000 7f3e7dd2d800 1 Processor -- start 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.149+0000 7f3e7dd2d800 1 -- start start 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.149+0000 7f3e7dd2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39adf130 0x564f39adf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.149+0000 7f3e7dd2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3986de80 con 0x564f39adf130 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.149+0000 7f3e7117c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39adf130 0x564f39adf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.149+0000 7f3e7117c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39adf130 0x564f39adf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45914/0 (socket says 172.21.15.133:45914) 2024-02-15T22:57:35.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.149+0000 7f3e7117c640 1 -- 172.21.15.133:0/2880072819 learned_addr learned my addr 172.21.15.133:0/2880072819 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.150+0000 7f3e7117c640 1 -- 172.21.15.133:0/2880072819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f39adfa90 con 0x564f39adf130 2024-02-15T22:57:35.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.150+0000 7f3e7117c640 1 --2- 172.21.15.133:0/2880072819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39adf130 0x564f39adf550 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3e640447c0 tx=0x7f3e64002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.150+0000 7f3d5f7fe640 1 -- 172.21.15.133:0/2880072819 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e64052e40 con 0x564f39adf130 2024-02-15T22:57:35.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.150+0000 7f3d5f7fe640 1 -- 172.21.15.133:0/2880072819 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6405d890 con 0x564f39adf130 2024-02-15T22:57:35.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.150+0000 7f3d5f7fe640 1 -- 172.21.15.133:0/2880072819 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6405db30 con 0x564f39adf130 2024-02-15T22:57:35.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.150+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2880072819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f39adfc80 con 0x564f39adf130 2024-02-15T22:57:35.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.150+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2880072819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f39ae0830 con 0x564f39adf130 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.151+0000 7f3d5f7fe640 1 -- 172.21.15.133:0/2880072819 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3e6405dd20 con 0x564f39adf130 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.151+0000 7f3d5f7fe640 1 --2- 172.21.15.133:0/2880072819 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d54036850 0x7f3d54038d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.151+0000 7f3d5f7fe640 1 -- 172.21.15.133:0/2880072819 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f3e6408f760 con 0x564f39adf130 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.151+0000 7f3e7a17e640 1 --2- 172.21.15.133:0/2880072819 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d54036850 0x7f3d54038d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.151+0000 7f3e7dd2d800 1 Processor -- start 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.152+0000 7f3e7dd2d800 1 -- start start 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.152+0000 7f3e7a17e640 1 --2- 172.21.15.133:0/2880072819 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d54036850 0x7f3d54038d10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x564f39acf460 tx=0x7f3e74005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.152+0000 7f3e7dd2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39aec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.152+0000 7f3e7dd2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f398435d0 con 0x564f39aec2c0 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.152+0000 7f3e7117c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39aec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.152+0000 7f3e7117c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39aec6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45918/0 (socket says 172.21.15.133:45918) 2024-02-15T22:57:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.152+0000 7f3e7117c640 1 -- 172.21.15.133:0/3891284788 learned_addr learned my addr 172.21.15.133:0/3891284788 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.152+0000 7f3e7117c640 1 -- 172.21.15.133:0/3891284788 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f39aeccb0 con 0x564f39aec2c0 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.152+0000 7f3e7117c640 1 --2- 172.21.15.133:0/3891284788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39aec6e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3e64066fd0 tx=0x7f3e64088f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7e8bd414254881 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3d5d7fa640 1 -- 172.21.15.133:0/3891284788 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e64065e30 con 0x564f39aec2c0 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3d5d7fa640 1 -- 172.21.15.133:0/3891284788 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e64065370 con 0x564f39aec2c0 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3d5d7fa640 1 -- 172.21.15.133:0/3891284788 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6406db60 con 0x564f39aec2c0 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3891284788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 msgr2=0x564f39aec6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/3891284788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39aec6e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3e64066fd0 tx=0x7f3e64088f90 comp rx=0 tx=0).stop 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3891284788 shutdown_connections 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/3891284788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39aec6e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3891284788 >> 172.21.15.133:0/3891284788 conn(0x564f39ae8620 msgr2=0x564f39ae6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3891284788 shutdown_connections 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3891284788 wait complete. 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3e7dd2d800 1 Processor -- start 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3e7dd2d800 1 -- start start 2024-02-15T22:57:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3e7dd2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39ac0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.153+0000 7f3e7dd2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f39ac0b90 con 0x564f39aec2c0 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.154+0000 7f3e7117c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39ac0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.154+0000 7f3e7117c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39ac0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45920/0 (socket says 172.21.15.133:45920) 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.154+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 learned_addr learned my addr 172.21.15.133:0/3651010638 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.154+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f39ae0830 con 0x564f39aec2c0 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.154+0000 7f3e7117c640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39ac0650 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3e6405ca40 tx=0x7f3e6400a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.154+0000 7f3d4b7fe640 1 -- 172.21.15.133:0/3651010638 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e64065930 con 0x564f39aec2c0 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.154+0000 7f3d4b7fe640 1 -- 172.21.15.133:0/3651010638 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e64065a90 con 0x564f39aec2c0 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.154+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f39abed40 con 0x564f39aec2c0 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.155+0000 7f3d4b7fe640 1 -- 172.21.15.133:0/3651010638 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6405cbe0 con 0x564f39aec2c0 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.155+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f39abf1a0 con 0x564f39aec2c0 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.155+0000 7f3d4b7fe640 1 -- 172.21.15.133:0/3651010638 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3e6405cd40 con 0x564f39aec2c0 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.155+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3d4b7fe640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d44036790 0x7f3d44038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3d4b7fe640 1 -- 172.21.15.133:0/3651010638 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f3e6409abf0 con 0x564f39aec2c0 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3e7a17e640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d44036790 0x7f3d44038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564f39b01100 0x564f39b035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b03d10 con 0x564f39b01100 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3e7997d640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564f39b01100 0x564f39b035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3e7997d640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564f39b01100 0x564f39b035c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3e7a17e640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d44036790 0x7f3d44038c50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400b010 tx=0x7f3e74020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3e7dd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3e7dd2d800 20 realm 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.156+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b040e0 con 0x564f39b01100 2024-02-15T22:57:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b04930 con 0x564f39b01100 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b04c90 con 0x564f39b01100 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b045d0 con 0x564f39b01100 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 20 searching for the correct realm 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564f39b07050 0x564f39b09440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b07050 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.157+0000 7f3e7117c640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564f39b07050 0x564f39b09440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.158+0000 7f3e7117c640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564f39b07050 0x564f39b09440 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.158+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.158+0000 7f3e7117c640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f3e64099060 0x7f3e64079480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.158+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e64099060 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.158+0000 7f3e7a17e640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f3e64099060 0x7f3e64079480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.158+0000 7f3e7a17e640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f3e64099060 0x7f3e64079480 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.159+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7400a4a0 con 0x7f3e64099060 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.159+0000 7f3e7a17e640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f3e740141d0 0x7f3e74015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.159+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e740141d0 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.159+0000 7f3e7997d640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f3e740141d0 0x7f3e74015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.159+0000 7f3e7997d640 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f3e740141d0 0x7f3e74015940 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.160+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x7f3e740141d0 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.160+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b01100 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.160+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.160+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b01100 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.160+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.160+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e740141d0 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.160+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x7f3e740141d0 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.160+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e740141d0 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.161+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x7f3e740141d0 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.161+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e64099060 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.161+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7400a4a0 con 0x7f3e64099060 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.161+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b07050 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.161+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.161+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b01100 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.161+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.161+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e740141d0 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.162+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x7f3e740141d0 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.162+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b01100 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.162+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.162+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e64099060 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.162+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3e7403a040 con 0x7f3e64099060 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.162+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b07050 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.162+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.162+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b07050 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.162+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.162+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e740141d0 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.163+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x7f3e740141d0 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.163+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b07050 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.163+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.163+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b07050 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.163+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.163+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b01100 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.164+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.164+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b01100 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.164+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.164+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e740141d0 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.164+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x7f3e740141d0 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.164+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b07050 2024-02-15T22:57:35.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.164+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.164+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e64099060 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.165+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7403a040 con 0x7f3e64099060 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.165+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b01100 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.165+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3e6c014070 con 0x564f39b01100 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.165+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e740141d0 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.165+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x7f3e740141d0 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.165+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b07050 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.166+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.166+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e740141d0 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.166+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c014070 con 0x7f3e740141d0 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.166+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e64099060 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.166+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7403a040 con 0x7f3e64099060 2024-02-15T22:57:35.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.166+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b07050 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.166+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.166+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e740141d0 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x564f39b01100 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ac0 con 0x7f3e64099060 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7403a040 con 0x7f3e64099060 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7dd2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7dd2d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7dd2d800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7dd2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7dd2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7dd2d800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b05b00 con 0x564f39b01100 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7dd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.167+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b05780 con 0x564f39b01100 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b06490 con 0x564f39b01100 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 20 zone default found 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 4 Realm: () 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 20 zonegroup default 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b09ee0 con 0x7f3e740141d0 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.168+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0bd60 con 0x564f39b07050 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.169+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.169+0000 7f3e7dd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.169+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.169+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0c0c0 con 0x564f39b07050 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.169+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.169+0000 7f3e7dd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.169+0000 7f3e7dd2d800 20 started sync module instance, tier type = 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.169+0000 7f3e7dd2d800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.169+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0b330 con 0x7f3e64099060 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.170+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7403a040 con 0x7f3e64099060 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.170+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94898270287888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0c420 con 0x7f3e64099060 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.170+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0cc20 con 0x564f39b01100 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.171+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94898270287888] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7403a040 con 0x7f3e64099060 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.171+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.172+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94898270290976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0cce0 con 0x564f39b01100 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.172+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0d650 con 0x564f39b07050 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.173+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94898270290976] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.173+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.173+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94898270292032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0cc60 con 0x564f39b07050 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.173+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0e3a0 con 0x7f3e64099060 2024-02-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.174+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7403a040 con 0x7f3e64099060 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.174+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94898270297760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0ebf0 con 0x7f3e64099060 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.174+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0f660 con 0x564f39b01100 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.174+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94898270292032] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.175+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94898270297760] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7403a040 con 0x7f3e64099060 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.175+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.175+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94898270302624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0e750 con 0x564f39b01100 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.175+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0fc70 con 0x7f3e740141d0 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.176+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.176+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94898270304208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b10090 con 0x7f3e740141d0 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.176+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b10ae0 con 0x7f3e740141d0 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.176+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94898270302624] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.177+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94898270304208] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.177+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.178+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94898270307776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0fbf0 con 0x7f3e740141d0 2024-02-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.178+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b11160 con 0x7f3e740141d0 2024-02-15T22:57:35.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.179+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.179+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94898270309568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b11580 con 0x7f3e740141d0 2024-02-15T22:57:35.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.179+0000 7f3e7dd2d800 20 add_watcher() i=0 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.179+0000 7f3e7dd2d800 20 add_watcher() i=1 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.179+0000 7f3e7dd2d800 20 add_watcher() i=2 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.179+0000 7f3e7dd2d800 20 add_watcher() i=3 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.179+0000 7f3e7dd2d800 20 add_watcher() i=4 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.179+0000 7f3e7dd2d800 20 add_watcher() i=5 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.179+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94898270307776] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.179+0000 7f3e7dd2d800 20 add_watcher() i=6 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.180+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94898270309568] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.180+0000 7f3e7dd2d800 20 add_watcher() i=7 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.180+0000 7f3e7dd2d800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.180+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b145b0 con 0x564f39b01100 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.180+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.180+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94898270310624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b11a10 con 0x564f39b01100 2024-02-15T22:57:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.181+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94898270310624] v32'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.181+0000 7f3d2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.181+0000 7f3e7dd2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.181+0000 7f3e7dd2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.181+0000 7f3e7dd2d800 5 note: GC not initialized 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.181+0000 7f3d2a7fc640 20 reqs_thread_entry: start 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.181+0000 7f3e7dd2d800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.182+0000 7f3e7dd2d800 20 Filter name: none 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.182+0000 7f3c9bfff640 20 reqs_thread_entry: start 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.182+0000 7f3e7dd2d800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.182+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b45f40 con 0x564f39b01100 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.182+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.182+0000 7f3e7dd2d800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.182+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b45f40 con 0x7f3e740141d0 2024-02-15T22:57:35.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.183+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.183+0000 7f3d2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.183+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94898270310624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b45f00 con 0x564f39b01100 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.184+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94898270310624] v32'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.184+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94898270287888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b45f00 con 0x7f3e64099060 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.185+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94898270287888] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7403a040 con 0x7f3e64099060 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.185+0000 7f3e7dd2d800 20 remove_watcher() i=0 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.185+0000 7f3e7dd2d800 2 removed watcher, disabling cache 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.185+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94898270290976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b45f00 con 0x564f39b01100 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.186+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94898270290976] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.186+0000 7f3e7dd2d800 20 remove_watcher() i=1 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.186+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94898270292032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b45f00 con 0x564f39b07050 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.188+0000 7f3e7117c640 1 -- 172.21.15.133:0/3651010638 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94898270292032] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e64059040 con 0x564f39b07050 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.188+0000 7f3e7dd2d800 20 remove_watcher() i=2 2024-02-15T22:57:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.188+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94898270297760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b110e0 con 0x7f3e64099060 2024-02-15T22:57:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.189+0000 7f3e7a17e640 1 -- 172.21.15.133:0/3651010638 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94898270297760] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7403a040 con 0x7f3e64099060 2024-02-15T22:57:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.189+0000 7f3e7dd2d800 20 remove_watcher() i=3 2024-02-15T22:57:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.189+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94898270302624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b110e0 con 0x564f39b01100 2024-02-15T22:57:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.190+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94898270302624] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x564f39b01100 2024-02-15T22:57:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.190+0000 7f3e7dd2d800 20 remove_watcher() i=4 2024-02-15T22:57:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.190+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94898270304208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b110e0 con 0x7f3e740141d0 2024-02-15T22:57:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.192+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94898270304208] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.192+0000 7f3e7dd2d800 20 remove_watcher() i=5 2024-02-15T22:57:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.192+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94898270307776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b0f7d0 con 0x7f3e740141d0 2024-02-15T22:57:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.193+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94898270307776] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.193+0000 7f3e7dd2d800 20 remove_watcher() i=6 2024-02-15T22:57:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.193+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94898270309568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f39b110e0 con 0x7f3e740141d0 2024-02-15T22:57:35.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94898270309568] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e6c054040 con 0x7f3e740141d0 2024-02-15T22:57:35.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 20 remove_watcher() i=7 2024-02-15T22:57:35.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f3e740141d0 msgr2=0x7f3e74015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f3e740141d0 0x7f3e74015940 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564f39b01100 msgr2=0x564f39b035c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564f39b01100 0x564f39b035c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f3e64099060 msgr2=0x7f3e64079480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f3e64099060 0x7f3e64079480 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564f39b07050 msgr2=0x564f39b09440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x564f39b07050 0x564f39b09440 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d44036790 msgr2=0x7f3d44038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d44036790 0x7f3d44038c50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400b010 tx=0x7f3e74020000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 msgr2=0x564f39ac0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7997d640 1 -- 172.21.15.133:0/3651010638 reap_dead start 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39ac0650 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3e6405ca40 tx=0x7f3e6400a410 comp rx=0 tx=0).stop 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 shutdown_connections 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/3651010638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39aec2c0 0x564f39ac0650 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 >> 172.21.15.133:0/3651010638 conn(0x564f39ae8620 msgr2=0x564f39ae5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 shutdown_connections 2024-02-15T22:57:35.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.194+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/3651010638 wait complete. 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2880072819 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d54036850 msgr2=0x7f3d54038d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/2880072819 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d54036850 0x7f3d54038d10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x564f39acf460 tx=0x7f3e74005840 comp rx=0 tx=0).stop 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2880072819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39adf130 msgr2=0x564f39adf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/2880072819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39adf130 0x564f39adf550 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3e640447c0 tx=0x7f3e64002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2880072819 shutdown_connections 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/2880072819 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d54036850 0x7f3d54038d10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/2880072819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f39adf130 0x564f39adf550 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2880072819 >> 172.21.15.133:0/2880072819 conn(0x564f39ad31d0 msgr2=0x564f39ad35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2880072819 shutdown_connections 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/2880072819 wait complete. 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564f399d3300 msgr2=0x564f39ace3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564f399d3300 0x564f39ace3d0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d600367e0 msgr2=0x7f3d60038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d600367e0 0x7f3d60038ca0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3e64054000 tx=0x7f3e6404e000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 msgr2=0x564f39ac76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39ac76f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c001c80 tx=0x7f3e6c000ed0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 shutdown_connections 2024-02-15T22:57:35.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x564f399d3300 0x564f39ace3d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f3d600367e0 0x7f3d60038ca0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 --2- 172.21.15.133:0/323556044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f399cee70 0x564f39ac76f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 >> 172.21.15.133:0/323556044 conn(0x564f399ca4d0 msgr2=0x564f39ab9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 shutdown_connections 2024-02-15T22:57:35.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.195+0000 7f3e7dd2d800 1 -- 172.21.15.133:0/323556044 wait complete. 2024-02-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi133.stdout:{"entries":[],"summary":[]} 2024-02-15T22:57:35.206 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-15T22:57:35.206 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-15T22:57:35.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-15T22:57:35.206 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-02-15T22:57:35.291 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:35.291 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:35.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.289+0000 7f4f123d6800 1 Processor -- start 2024-02-15T22:57:35.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.289+0000 7f4f123d6800 1 -- start start 2024-02-15T22:57:35.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.289+0000 7f4f123d6800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55917c6e22b0 0x55917c6e4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.289+0000 7f4f123d6800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55917c628ba0 con 0x55917c651140 2024-02-15T22:57:35.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.289+0000 7f4f123d6800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55917c5e0450 con 0x55917c6e22b0 2024-02-15T22:57:35.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.290+0000 7f4f076d4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55917c6e22b0 0x55917c6e4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.290+0000 7f4f0fed5640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55917c651140 0x55917c6e0b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41696/0 (socket says 172.21.15.133:41696) 2024-02-15T22:57:35.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.290+0000 7f4f076d4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55917c6e22b0 0x55917c6e4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45934/0 (socket says 172.21.15.133:45934) 2024-02-15T22:57:35.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.290+0000 7f4f0fed5640 1 -- 172.21.15.133:0/3150770144 learned_addr learned my addr 172.21.15.133:0/3150770144 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:35.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.290+0000 7f4f076d4640 1 -- 172.21.15.133:0/3150770144 >> v1:172.21.15.52:6789/0 conn(0x55917c651140 legacy=0x55917c6e0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.290+0000 7f4f076d4640 1 -- 172.21.15.133:0/3150770144 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55917c6e5e30 con 0x55917c6e22b0 2024-02-15T22:57:35.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.292+0000 7f4f076d4640 1 --2- 172.21.15.133:0/3150770144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c6e22b0 0x55917c6e4750 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800a470 tx=0x7f4ef801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38d45219138d523 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.292+0000 7f4f0f6d4640 1 -- 172.21.15.133:0/3150770144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ef8052570 con 0x55917c6e22b0 2024-02-15T22:57:35.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.292+0000 7f4f0f6d4640 1 -- 172.21.15.133:0/3150770144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef80526d0 con 0x55917c6e22b0 2024-02-15T22:57:35.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.292+0000 7f4f0f6d4640 1 -- 172.21.15.133:0/3150770144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ef8052990 con 0x55917c6e22b0 2024-02-15T22:57:35.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.292+0000 7f4f123d6800 1 -- 172.21.15.133:0/3150770144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c6e22b0 msgr2=0x55917c6e4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.292+0000 7f4f123d6800 1 --2- 172.21.15.133:0/3150770144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c6e22b0 0x55917c6e4750 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800a470 tx=0x7f4ef801cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:35.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.292+0000 7f4f123d6800 1 -- 172.21.15.133:0/3150770144 shutdown_connections 2024-02-15T22:57:35.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.292+0000 7f4f123d6800 1 --2- 172.21.15.133:0/3150770144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c6e22b0 0x55917c6e4750 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.292+0000 7f4f123d6800 1 -- 172.21.15.133:0/3150770144 >> 172.21.15.133:0/3150770144 conn(0x55917c6d84f0 msgr2=0x55917c6da910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.292+0000 7f4f123d6800 1 -- 172.21.15.133:0/3150770144 shutdown_connections 2024-02-15T22:57:35.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.292+0000 7f4f123d6800 1 -- 172.21.15.133:0/3150770144 wait complete. 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.304+0000 7f4f123d6800 1 Processor -- start 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.304+0000 7f4f123d6800 1 -- start start 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.304+0000 7f4f123d6800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.304+0000 7f4f123d6800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55917c5dd980 con 0x55917c651140 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.305+0000 7f4f0fed5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.305+0000 7f4f0fed5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7cdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45948/0 (socket says 172.21.15.133:45948) 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.305+0000 7f4f0fed5640 1 -- 172.21.15.133:0/2809768893 learned_addr learned my addr 172.21.15.133:0/2809768893 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.305+0000 7f4f0fed5640 1 -- 172.21.15.133:0/2809768893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8005d20 con 0x55917c651140 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.305+0000 7f4f0fed5640 1 --2- 172.21.15.133:0/2809768893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7cdfa0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4f00001bc0 tx=0x7f4f0000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd6bf55b7fdca2d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.305+0000 7f4dfde0b640 1 -- 172.21.15.133:0/2809768893 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f0000e470 con 0x55917c651140 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.305+0000 7f4dfde0b640 1 -- 172.21.15.133:0/2809768893 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0000e5f0 con 0x55917c651140 2024-02-15T22:57:35.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.305+0000 7f4dfde0b640 1 -- 172.21.15.133:0/2809768893 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f0000e950 con 0x55917c651140 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.306+0000 7f4f123d6800 1 -- 172.21.15.133:0/2809768893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 msgr2=0x55917c7cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.306+0000 7f4f123d6800 1 --2- 172.21.15.133:0/2809768893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7cdfa0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4f00001bc0 tx=0x7f4f0000b6c0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.306+0000 7f4f123d6800 1 -- 172.21.15.133:0/2809768893 shutdown_connections 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.306+0000 7f4f123d6800 1 --2- 172.21.15.133:0/2809768893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7cdfa0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.306+0000 7f4f123d6800 1 -- 172.21.15.133:0/2809768893 >> 172.21.15.133:0/2809768893 conn(0x55917c6d84f0 msgr2=0x55917c7c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.306+0000 7f4f123d6800 1 -- 172.21.15.133:0/2809768893 shutdown_connections 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.306+0000 7f4f123d6800 1 -- 172.21.15.133:0/2809768893 wait complete. 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.306+0000 7f4f123d6800 1 Processor -- start 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.306+0000 7f4f123d6800 1 -- start start 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.307+0000 7f4f123d6800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7d7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.307+0000 7f4f123d6800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55917c5d9160 con 0x55917c651140 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.307+0000 7f4f0fed5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7d7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.307+0000 7f4f0fed5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7d7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45964/0 (socket says 172.21.15.133:45964) 2024-02-15T22:57:35.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.307+0000 7f4f0fed5640 1 -- 172.21.15.133:0/1286689937 learned_addr learned my addr 172.21.15.133:0/1286689937 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.307+0000 7f4f0fed5640 1 -- 172.21.15.133:0/1286689937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55917c628ba0 con 0x55917c651140 2024-02-15T22:57:35.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.307+0000 7f4f0fed5640 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7d7880 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000c010 tx=0x7f4f00000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.307+0000 7f4df7fff640 1 -- 172.21.15.133:0/1286689937 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f0001f070 con 0x55917c651140 2024-02-15T22:57:35.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.308+0000 7f4df7fff640 1 -- 172.21.15.133:0/1286689937 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f000197c0 con 0x55917c651140 2024-02-15T22:57:35.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.308+0000 7f4df7fff640 1 -- 172.21.15.133:0/1286689937 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f00019a60 con 0x55917c651140 2024-02-15T22:57:35.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.308+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55917c7d7dc0 con 0x55917c651140 2024-02-15T22:57:35.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.308+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55917c7d8240 con 0x55917c651140 2024-02-15T22:57:35.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.308+0000 7f4df7fff640 1 -- 172.21.15.133:0/1286689937 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4f00019bc0 con 0x55917c651140 2024-02-15T22:57:35.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.309+0000 7f4df7fff640 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4df8036790 0x7f4df8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.309+0000 7f4df7fff640 1 -- 172.21.15.133:0/1286689937 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f4f0004c620 con 0x55917c651140 2024-02-15T22:57:35.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.309+0000 7f4f076d4640 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4df8036790 0x7f4df8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.309+0000 7f4f123d6800 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55917c6e22b0 0x55917c7de660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.309+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c7deba0 con 0x55917c6e22b0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.309+0000 7f4f106d6640 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55917c6e22b0 0x55917c7de660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.309+0000 7f4f076d4640 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4df8036790 0x7f4df8038c50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8054000 tx=0x7f4ef804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.309+0000 7f4f106d6640 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55917c6e22b0 0x55917c7de660 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.309+0000 7f4f106d6640 1 -- 172.21.15.133:0/1286689937 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4f0800a4a0 con 0x55917c6e22b0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.309+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c7def90 con 0x55917c6e22b0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.310+0000 7f4f106d6640 1 -- 172.21.15.133:0/1286689937 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4f0800a4a0 con 0x55917c6e22b0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.310+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c7e0840 con 0x55917c6e22b0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.310+0000 7f4f106d6640 1 -- 172.21.15.133:0/1286689937 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4f0800a4a0 con 0x55917c6e22b0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.310+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c7dfb50 con 0x55917c6e22b0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.310+0000 7f4f106d6640 1 -- 172.21.15.133:0/1286689937 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4f0800a4a0 con 0x55917c6e22b0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.310+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c7dff60 con 0x55917c6e22b0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.311+0000 7f4f106d6640 1 -- 172.21.15.133:0/1286689937 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4f0800a4a0 con 0x55917c6e22b0 2024-02-15T22:57:35.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.311+0000 7f4f123d6800 1 Processor -- start 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.311+0000 7f4f123d6800 1 -- start start 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.311+0000 7f4f123d6800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7ef2a0 0x55917c7ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.311+0000 7f4f123d6800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55917c57be80 con 0x55917c7ef2a0 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.311+0000 7f4f076d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7ef2a0 0x55917c7ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.311+0000 7f4f076d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7ef2a0 0x55917c7ef6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45970/0 (socket says 172.21.15.133:45970) 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.311+0000 7f4f076d4640 1 -- 172.21.15.133:0/322164417 learned_addr learned my addr 172.21.15.133:0/322164417 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.312+0000 7f4f076d4640 1 -- 172.21.15.133:0/322164417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55917c7efc00 con 0x55917c7ef2a0 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.312+0000 7f4f076d4640 1 --2- 172.21.15.133:0/322164417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7ef2a0 0x55917c7ef6c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80447c0 tx=0x7f4ef8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.312+0000 7f4df57fa640 1 -- 172.21.15.133:0/322164417 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ef805da40 con 0x55917c7ef2a0 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.312+0000 7f4df57fa640 1 -- 172.21.15.133:0/322164417 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef805dba0 con 0x55917c7ef2a0 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.312+0000 7f4df57fa640 1 -- 172.21.15.133:0/322164417 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ef805de40 con 0x55917c7ef2a0 2024-02-15T22:57:35.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.312+0000 7f4f123d6800 1 -- 172.21.15.133:0/322164417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55917c7efdf0 con 0x55917c7ef2a0 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.312+0000 7f4f123d6800 1 -- 172.21.15.133:0/322164417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55917c7f0940 con 0x55917c7ef2a0 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.313+0000 7f4df57fa640 1 -- 172.21.15.133:0/322164417 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4ef8066040 con 0x55917c7ef2a0 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.313+0000 7f4df57fa640 1 --2- 172.21.15.133:0/322164417 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4de80367e0 0x7f4de8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.313+0000 7f4df57fa640 1 -- 172.21.15.133:0/322164417 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f4ef8063040 con 0x55917c7ef2a0 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.313+0000 7f4f106d6640 1 --2- 172.21.15.133:0/322164417 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4de80367e0 0x7f4de8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.313+0000 7f4f123d6800 1 Processor -- start 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.314+0000 7f4f123d6800 1 -- start start 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.314+0000 7f4f106d6640 1 --2- 172.21.15.133:0/322164417 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4de80367e0 0x7f4de8038ca0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55917c7df590 tx=0x7f4f08005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.314+0000 7f4f123d6800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c7fc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.314+0000 7f4f123d6800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55917c5515d0 con 0x55917c7fc510 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.314+0000 7f4f076d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c7fc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.314+0000 7f4f076d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c7fc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45972/0 (socket says 172.21.15.133:45972) 2024-02-15T22:57:35.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.314+0000 7f4f076d4640 1 -- 172.21.15.133:0/1279576846 learned_addr learned my addr 172.21.15.133:0/1279576846 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.314+0000 7f4f076d4640 1 -- 172.21.15.133:0/1279576846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55917c7fcee0 con 0x55917c7fc510 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.314+0000 7f4f076d4640 1 --2- 172.21.15.133:0/1279576846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c7fc910 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8006ef0 tx=0x7f4ef8068430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda5dd165217cf70 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4deeffd640 1 -- 172.21.15.133:0/1279576846 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ef8068800 con 0x55917c7fc510 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4deeffd640 1 -- 172.21.15.133:0/1279576846 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef8068960 con 0x55917c7fc510 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4deeffd640 1 -- 172.21.15.133:0/1279576846 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ef805c380 con 0x55917c7fc510 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4f123d6800 1 -- 172.21.15.133:0/1279576846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 msgr2=0x55917c7fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4f123d6800 1 --2- 172.21.15.133:0/1279576846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c7fc910 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8006ef0 tx=0x7f4ef8068430 comp rx=0 tx=0).stop 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4f123d6800 1 -- 172.21.15.133:0/1279576846 shutdown_connections 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4f123d6800 1 --2- 172.21.15.133:0/1279576846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c7fc910 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4f123d6800 1 -- 172.21.15.133:0/1279576846 >> 172.21.15.133:0/1279576846 conn(0x55917c7f87e0 msgr2=0x55917c7f6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4f123d6800 1 -- 172.21.15.133:0/1279576846 shutdown_connections 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4f123d6800 1 -- 172.21.15.133:0/1279576846 wait complete. 2024-02-15T22:57:35.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4f123d6800 1 Processor -- start 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4f123d6800 1 -- start start 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4f123d6800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c8034e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.315+0000 7f4f123d6800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55917c803a20 con 0x55917c7fc510 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.316+0000 7f4f076d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c8034e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.316+0000 7f4f076d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c8034e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:45986/0 (socket says 172.21.15.133:45986) 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.316+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 learned_addr learned my addr 172.21.15.133:0/369936768 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.316+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55917c7f0940 con 0x55917c7fc510 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.316+0000 7f4f076d4640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c8034e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4ef808ceb0 tx=0x7f4ef808ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.316+0000 7f4ded7fa640 1 -- 172.21.15.133:0/369936768 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ef808fbb0 con 0x55917c7fc510 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.316+0000 7f4ded7fa640 1 -- 172.21.15.133:0/369936768 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef808fd10 con 0x55917c7fc510 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.316+0000 7f4ded7fa640 1 -- 172.21.15.133:0/369936768 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ef805c700 con 0x55917c7fc510 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.317+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55917c803c20 con 0x55917c7fc510 2024-02-15T22:57:35.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.317+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55917c804080 con 0x55917c7fc510 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.317+0000 7f4ded7fa640 1 -- 172.21.15.133:0/369936768 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4ef805c860 con 0x55917c7fc510 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.318+0000 7f4ded7fa640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4dd8036790 0x7f4dd8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.318+0000 7f4ded7fa640 1 -- 172.21.15.133:0/369936768 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f4ef8098bb0 con 0x55917c7fc510 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.318+0000 7f4f106d6640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4dd8036790 0x7f4dd8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.318+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.318+0000 7f4f123d6800 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55917c80f0a0 0x55917c811560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.318+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c811cb0 con 0x55917c80f0a0 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.318+0000 7f4f106d6640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4dd8036790 0x7f4dd8038c50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800b010 tx=0x7f4f08020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.318+0000 7f4f0fed5640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55917c80f0a0 0x55917c811560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.318+0000 7f4f0fed5640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55917c80f0a0 0x55917c811560 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4f0000db20 con 0x55917c80f0a0 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 20 realm 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c812080 con 0x55917c80f0a0 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4f0000db20 con 0x55917c80f0a0 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c812900 con 0x55917c80f0a0 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4f0000db20 con 0x55917c80f0a0 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c812c60 con 0x55917c80f0a0 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4f00042040 con 0x55917c80f0a0 2024-02-15T22:57:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.319+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c813460 con 0x55917c80f0a0 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.320+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4f00042040 con 0x55917c80f0a0 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.320+0000 7f4f123d6800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.320+0000 7f4f123d6800 20 searching for the correct realm 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.320+0000 7f4f123d6800 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55917c8152f0 0x55917c8177b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.320+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c8152f0 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.320+0000 7f4f076d4640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55917c8152f0 0x55917c8177b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.320+0000 7f4f076d4640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55917c8152f0 0x55917c8177b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.320+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ef806e070 con 0x55917c8152f0 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.320+0000 7f4f076d4640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4ef8071020 0x7f4ef8067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.320+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4ef8071020 2024-02-15T22:57:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.320+0000 7f4f106d6640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4ef8071020 0x7f4ef8067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.321+0000 7f4f106d6640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4ef8071020 0x7f4ef8067530 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.321+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4a0 con 0x7f4ef8071020 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.321+0000 7f4f106d6640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4f080141d0 0x7f4f08015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.321+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4f080141d0 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.321+0000 7f4f0fed5640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4f080141d0 0x7f4f08015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.322+0000 7f4f0fed5640 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4f080141d0 0x7f4f08015940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.322+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f00042040 con 0x7f4f080141d0 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.322+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c80f0a0 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.322+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0003a040 con 0x55917c80f0a0 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.322+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c80f0a0 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.322+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0003a040 con 0x55917c80f0a0 2024-02-15T22:57:35.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.322+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4f080141d0 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.323+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0003a040 con 0x7f4f080141d0 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.323+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4f080141d0 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.323+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0003a040 con 0x7f4f080141d0 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.323+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4ef8071020 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.323+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4a0 con 0x7f4ef8071020 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.323+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c8152f0 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.323+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.323+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c80f0a0 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.324+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0003a040 con 0x55917c80f0a0 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.324+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4f080141d0 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.324+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0003a040 con 0x7f4f080141d0 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.324+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c80f0a0 2024-02-15T22:57:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.324+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0003a040 con 0x55917c80f0a0 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.324+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4ef8071020 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.324+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.324+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c8152f0 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.325+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.325+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c8152f0 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.325+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.325+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4f080141d0 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.325+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0003a040 con 0x7f4f080141d0 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.325+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c8152f0 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.325+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.326+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c8152f0 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.326+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.326+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c80f0a0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.326+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0003a040 con 0x55917c80f0a0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.326+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c80f0a0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.326+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4f0003a040 con 0x55917c80f0a0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.326+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4f080141d0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.327+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0003a040 con 0x7f4f080141d0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.327+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c8152f0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.327+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.327+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4ef8071020 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.327+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.327+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c80f0a0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.327+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4f0003a040 con 0x55917c80f0a0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.327+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4f080141d0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.328+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0003a040 con 0x7f4f080141d0 2024-02-15T22:57:35.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.328+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c8152f0 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.328+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.328+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4f080141d0 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.328+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.328+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4ef8071020 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.328+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.328+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c8152f0 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.329+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.329+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4f080141d0 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.329+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.329+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x55917c80f0a0 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.329+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.329+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c817e80 con 0x7f4ef8071020 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.329+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c813d90 con 0x55917c80f0a0 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8145e0 con 0x55917c80f0a0 2024-02-15T22:57:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8145e0 con 0x55917c80f0a0 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 zone default found 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 4 Realm: () 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 zonegroup default 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.330+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8145e0 con 0x7f4f080141d0 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f123d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c819ca0 con 0x55917c8152f0 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f123d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81a000 con 0x55917c8152f0 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f123d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f123d6800 20 started sync module instance, tier type = 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f123d6800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:35.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.331+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c819580 con 0x7f4ef8071020 2024-02-15T22:57:35.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.332+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.332+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94083347484896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c819930 con 0x7f4ef8071020 2024-02-15T22:57:35.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.332+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81ad60 con 0x55917c80f0a0 2024-02-15T22:57:35.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.333+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94083347484896] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.334+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.334+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94083347490096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81ae70 con 0x55917c80f0a0 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.334+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81b940 con 0x55917c8152f0 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.335+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.335+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94083347493920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81c190 con 0x55917c8152f0 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.335+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81cc30 con 0x7f4ef8071020 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.335+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94083347490096] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.336+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94083347493920] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.336+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.336+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94083347496176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81a950 con 0x7f4ef8071020 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.336+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81d5f0 con 0x55917c80f0a0 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.337+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94083347496176] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.337+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.337+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94083347498768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81d5f0 con 0x55917c80f0a0 2024-02-15T22:57:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.337+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81df60 con 0x7f4f080141d0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.338+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94083347498768] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.338+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.338+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94083347501872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81df60 con 0x7f4f080141d0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.338+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81e8d0 con 0x7f4f080141d0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.340+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94083347501872] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.340+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.340+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94083347503808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81eab0 con 0x7f4f080141d0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.340+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81f2b0 con 0x7f4f080141d0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.341+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94083347503808] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.341+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.341+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94083347507968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81f3c0 con 0x7f4f080141d0 2024-02-15T22:57:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.341+0000 7f4f123d6800 20 add_watcher() i=0 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.341+0000 7f4f123d6800 20 add_watcher() i=1 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.341+0000 7f4f123d6800 20 add_watcher() i=2 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.341+0000 7f4f123d6800 20 add_watcher() i=3 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.341+0000 7f4f123d6800 20 add_watcher() i=4 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.341+0000 7f4f123d6800 20 add_watcher() i=5 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.341+0000 7f4f123d6800 20 add_watcher() i=6 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.342+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94083347507968] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.342+0000 7f4f123d6800 20 add_watcher() i=7 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.342+0000 7f4f123d6800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.342+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c822840 con 0x55917c80f0a0 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.342+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.342+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94083347522080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c81f530 con 0x55917c80f0a0 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.343+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94083347522080] v32'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.344+0000 7f4dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.344+0000 7f4f123d6800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.344+0000 7f4f123d6800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.344+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82b170 con 0x55917c80f0a0 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.345+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.345+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82b780 con 0x7f4f080141d0 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.346+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'29 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.346+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82bcb0 con 0x55917c8152f0 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.347+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.347+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82c680 con 0x55917c80f0a0 2024-02-15T22:57:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.348+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'233 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.348+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c827040 con 0x7f4ef8071020 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.349+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'74 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.349+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c827040 con 0x55917c8152f0 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.350+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'49 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.350+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82d860 con 0x55917c80f0a0 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.352+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.352+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82d860 con 0x7f4f080141d0 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.353+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'49 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.353+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82d860 con 0x7f4ef8071020 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.354+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.354+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82dd90 con 0x55917c8152f0 2024-02-15T22:57:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.355+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.355+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82d7f0 con 0x7f4ef8071020 2024-02-15T22:57:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.356+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'75 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.356+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82e930 con 0x7f4f080141d0 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.357+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'34 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.357+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82e930 con 0x7f4ef8071020 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.358+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.358+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x7f4f080141d0 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.359+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'55 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.359+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c80f0a0 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.360+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'234 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.360+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c8152f0 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.361+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'68 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.361+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x7f4ef8071020 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.362+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'76 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.362+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c8152f0 2024-02-15T22:57:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.363+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.363+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c80f0a0 2024-02-15T22:57:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.365+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.365+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c80f0a0 2024-02-15T22:57:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.366+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'235 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.366+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c8152f0 2024-02-15T22:57:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.367+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'69 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.367+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x7f4ef8071020 2024-02-15T22:57:35.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.368+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'38 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.368+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c8152f0 2024-02-15T22:57:35.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.369+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.369+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c8152f0 2024-02-15T22:57:35.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.370+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.370+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c8152f0 2024-02-15T22:57:35.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.370+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'26 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.370+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c8152f0 2024-02-15T22:57:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.371+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'50 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.371+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x7f4f080141d0 2024-02-15T22:57:35.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.372+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.373+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c8152f0 2024-02-15T22:57:35.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.373+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.373+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x7f4f080141d0 2024-02-15T22:57:35.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.375+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'50 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.375+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x55917c8152f0 2024-02-15T22:57:35.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.376+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'70 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.376+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x7f4f080141d0 2024-02-15T22:57:35.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.377+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'56 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.377+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c82edd0 con 0x7f4ef8071020 2024-02-15T22:57:35.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.378+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'35 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.378+0000 7f4dc4fe1640 20 reqs_thread_entry: start 2024-02-15T22:57:35.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.378+0000 7f4f123d6800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:35.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.379+0000 7f4f123d6800 20 Filter name: none 2024-02-15T22:57:35.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.379+0000 7f4d3e7fc640 20 reqs_thread_entry: start 2024-02-15T22:57:35.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.379+0000 7f4f123d6800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-15T22:57:35.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.379+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.379+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c858b20 con 0x55917c80f0a0 2024-02-15T22:57:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.379+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.379+0000 7f4f123d6800 20 rados_obj.operate() r=0 bl.length=358 2024-02-15T22:57:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.379+0000 7f4f123d6800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-15T22:57:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.379+0000 7f4f123d6800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-15T22:57:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.379+0000 7f4f123d6800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:57:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.379+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c821720 con 0x7f4ef8071020 2024-02-15T22:57:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f123d6800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 : miss 2024-02-15T22:57:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:96 8.2 8:40c3d555:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c85ad10 con 0x7f4ef8071020 2024-02-15T22:57:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(96 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f123d6800 20 rados_obj.operate() r=0 bl.length=352 2024-02-15T22:57:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f123d6800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 info.flags=0x17 2024-02-15T22:57:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f123d6800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 to cache LRU end 2024-02-15T22:57:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f123d6800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-15T22:57:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f123d6800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-15T22:57:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f123d6800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 2024-02-15T22:57:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.380+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:97 4.2a 4:55f2e033:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d8210 con 0x55917c80f0a0 2024-02-15T22:57:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.381+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(97 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.0 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.381+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:98 4.38 4:1c477a99:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d8210 con 0x55917c80f0a0 2024-02-15T22:57:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.381+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(98 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.381+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:99 4.24 4:278f98fc:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d8210 con 0x7f4f080141d0 2024-02-15T22:57:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.382+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(99 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.382+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:100 4.37 4:edb30d84:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d8210 con 0x7f4f080141d0 2024-02-15T22:57:35.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.382+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(100 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.382+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:101 4.29 4:96f3fd5f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d8190 con 0x55917c8152f0 2024-02-15T22:57:35.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.383+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(101 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4 [call out=426b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.383+0000 7f4f123d6800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-02-15T22:57:35.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.383+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:102 4.27 4:e59db72d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d81c0 con 0x55917c80f0a0 2024-02-15T22:57:35.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.383+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(102 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.5 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.383+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:103 4.b 4:d1f18089:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d81c0 con 0x7f4ef8071020 2024-02-15T22:57:35.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.383+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(103 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.383+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:104 4.16 4:6b118837:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d81c0 con 0x55917c8152f0 2024-02-15T22:57:35.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.384+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 27 ==== osd_op_reply(104 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.384+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:105 4.32 4:4c07715e:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d81c0 con 0x55917c80f0a0 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.384+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(105 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.384+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:106 4.1f 4:fb929f1f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d81c0 con 0x55917c8152f0 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.384+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 28 ==== osd_op_reply(106 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.384+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:107 4.1e 4:7a5af15f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d81c0 con 0x7f4f080141d0 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.385+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(107 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.385+0000 7f4f123d6800 20 get_obj_state: octx=0x7f4f08029040 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55917c8d6238 s->prefetch_data=0 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.385+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:108 3.2e 3:7682de79:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d7050 con 0x7f4ef8071020 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.385+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 21 ==== osd_op_reply(108 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.386+0000 7f4f123d6800 10 manifest: total_size = 6 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.386+0000 7f4f123d6800 20 get_obj_state: setting s->obj_tag to b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.12078794938463533345 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.386+0000 7f4f123d6800 20 get_obj_state: octx=0x7f4f08029040 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55917c8d6238 s->prefetch_data=0 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.386+0000 7f4f123d6800 20 prepare_atomic_modification: state is not atomic. state=0x55917c8d6238 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.386+0000 7f4f123d6800 20 bucket index object: :.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4 2024-02-15T22:57:35.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.386+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:109 4.29 4:96f3fd5f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d7b90 con 0x55917c8152f0 2024-02-15T22:57:35.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.387+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 29 ==== osd_op_reply(109 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4 [stat,call,call] v32'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.387+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:110 3.2e 3:7682de79:::b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8d7b90 con 0x7f4ef8071020 2024-02-15T22:57:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 22 ==== osd_op_reply(110 b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7_15f6f8dc036519d7fe15b39338f6e5db [call] v32'6 uv6 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:111 4.29 4:96f3fd5f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c85f5d0 con 0x55917c8152f0 2024-02-15T22:57:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 20 list_objects_ordered: starting attempt 1 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:112 4.2a 4:55f2e033:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c85f5d0 con 0x55917c80f0a0 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:113 4.38 4:1c477a99:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8638d0 con 0x55917c80f0a0 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:114 4.24 4:278f98fc:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c85f5d0 con 0x7f4f080141d0 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:115 4.37 4:edb30d84:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8686a0 con 0x7f4f080141d0 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:116 4.29 4:96f3fd5f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c86af40 con 0x55917c8152f0 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:117 4.27 4:e59db72d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c86d8e0 con 0x55917c80f0a0 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:118 4.b 4:d1f18089:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:119 4.16 4:6b118837:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c873070 con 0x55917c8152f0 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:120 4.32 4:4c07715e:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c875ea0 con 0x55917c80f0a0 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:121 4.1f 4:fb929f1f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c878cd0 con 0x55917c8152f0 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:122 4.1e 4:7a5af15f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c87bb00 con 0x7f4f080141d0 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(112 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.0 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(113 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 36 ==== osd_op_reply(117 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.5 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.388+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 23 ==== osd_op_reply(118 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(114 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(115 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(122 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 37 ==== osd_op_reply(120 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 30 ==== osd_op_reply(119 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 31 ==== osd_op_reply(121 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 32 ==== osd_op_reply(111 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4 [stat,call,call] v32'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4deeffd640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 33 ==== osd_op_reply(116 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-15T22:57:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7])"; uploads.size()=0; is_truncated=0 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:123 4.2a 4:55f2e033:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c878cd0 con 0x55917c80f0a0 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:124 4.38 4:1c477a99:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x55917c80f0a0 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:125 4.24 4:278f98fc:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c878840 con 0x7f4f080141d0 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:126 4.37 4:edb30d84:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c86af40 con 0x7f4f080141d0 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:127 4.29 4:96f3fd5f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c878cd0 con 0x55917c8152f0 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:128 4.27 4:e59db72d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c875ea0 con 0x55917c80f0a0 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:129 4.b 4:d1f18089:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:130 4.16 4:6b118837:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c878cd0 con 0x55917c8152f0 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.389+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:131 4.32 4:4c07715e:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c878cd0 con 0x55917c80f0a0 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 34 ==== osd_op_reply(127 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:132 4.1f 4:fb929f1f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c878840 con 0x55917c8152f0 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 30 ==== osd_op_reply(126 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 35 ==== osd_op_reply(130 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 31 ==== osd_op_reply(125 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:133 4.1e 4:7a5af15f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c87bb10 con 0x7f4f080141d0 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 38 ==== osd_op_reply(123 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.0 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 24 ==== osd_op_reply(129 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 39 ==== osd_op_reply(124 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 40 ==== osd_op_reply(128 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.5 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 41 ==== osd_op_reply(131 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 36 ==== osd_op_reply(132 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 32 ==== osd_op_reply(133 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.390+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.391+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 25 ==== osd_op_reply(134 foo.buckets [call] v32'46 uv46 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.391+0000 7f4f123d6800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.391+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.391+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 26 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f123d6800 20 rados_obj.operate() r=0 bl.length=165 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f123d6800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f123d6800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f123d6800 10 removing default.rgw.meta+root+myfoo from cache 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f123d6800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:136 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94083347853424 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4f080141d0 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 33 ==== watch-notify(notify (1) cookie 94083347503808 notify 137438953511 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f4f00073040 con 0x7f4f080141d0 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4deeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94083347503808 notifier 4775 bl.length()=149 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 34 ==== osd_op_reply(136 notify.6 [notify cookie 94083347853424 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4deeffd640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4dd4003d50 con 0x7f4f080141d0 2024-02-15T22:57:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 35 ==== osd_op_reply(137 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 36 ==== watch-notify(notify_complete (2) cookie 94083347853424 notify 137438953511 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4f0006b060 con 0x7f4f080141d0 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.392+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:138 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.393+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 27 ==== osd_op_reply(138 myfoo [call,call,delete] v32'47 uv47 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.393+0000 7f4f123d6800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 from cache 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.393+0000 7f4f123d6800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7, ofs0, ns] 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.394+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:139 7.d 7:b4812045:::notify.4:head [notify cookie 94083348265872 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x55917c80f0a0 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.394+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 42 ==== watch-notify(notify (1) cookie 94083347498768 notify 137438953505 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7f4f0006b060 con 0x55917c80f0a0 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.394+0000 7f4dee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94083347498768 notifier 4775 bl.length()=206 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.394+0000 7f4dee7fc640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4d44003310 con 0x55917c80f0a0 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.394+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 43 ==== osd_op_reply(139 notify.4 [notify cookie 94083348265872 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.394+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 44 ==== osd_op_reply(140 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.394+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 45 ==== watch-notify(notify_complete (2) cookie 94083348265872 notify 137438953505 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55917c7d8240 con 0x55917c80f0a0 2024-02-15T22:57:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.394+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:141 8.2 8:40c3d555:root::.bucket.meta.myfoo%3ab92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.395+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 28 ==== osd_op_reply(141 .bucket.meta.myfoo:b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 [call,call,delete] v32'4 uv4 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.395+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:142 4.2a 4:55f2e033:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x55917c80f0a0 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.395+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:143 4.38 4:1c477a99:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8756a0 con 0x55917c80f0a0 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.395+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:144 4.24 4:278f98fc:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c875a00 con 0x7f4f080141d0 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.395+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:145 4.37 4:edb30d84:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4f080141d0 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.395+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:146 4.29 4:96f3fd5f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c8756a0 con 0x55917c8152f0 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.395+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:147 4.27 4:e59db72d:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c875a00 con 0x55917c80f0a0 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.395+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:148 4.b 4:d1f18089:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.395+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:149 4.16 4:6b118837:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c875a00 con 0x55917c8152f0 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.395+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:150 4.32 4:4c07715e:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c859b30 con 0x55917c80f0a0 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.396+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:151 4.1f 4:fb929f1f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x55917c8152f0 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.396+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:152 4.1e 4:7a5af15f:::.dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c859b30 con 0x7f4f080141d0 2024-02-15T22:57:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.397+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 29 ==== osd_op_reply(148 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.6 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.397+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 46 ==== osd_op_reply(147 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.5 [delete] v32'12 uv12 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.397+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 37 ==== osd_op_reply(144 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.2 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.397+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 37 ==== osd_op_reply(146 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.4 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.397+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 38 ==== osd_op_reply(145 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.3 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.397+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 39 ==== osd_op_reply(152 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.10 [delete] v32'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.397+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 47 ==== osd_op_reply(142 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.0 [delete] v32'14 uv14 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.397+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 48 ==== osd_op_reply(143 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.1 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.397+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 49 ==== osd_op_reply(150 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.8 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.397+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 38 ==== osd_op_reply(149 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.7 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 39 ==== osd_op_reply(151 .dir.b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7.9 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f123d6800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 : miss 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f123d6800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:153 6.5 6:a3e2c7b8:::pubsub..bucket.myfoo%2fb92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 30 ==== osd_op_reply(153 pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f123d6800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f123d6800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 info.flags=0x0 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f123d6800 10 adding default.rgw.log++pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 to cache LRU end 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f123d6800 10 removing default.rgw.log++pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 from cache 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f123d6800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7, ofs0, ns] 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify cookie 94083347754112 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 31 ==== watch-notify(notify (1) cookie 94083347496176 notify 137438953494 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7f4f080305e0 con 0x7f4ef8071020 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4deeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94083347496176 notifier 4775 bl.length()=203 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4deeffd640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:155 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4dd4003d50 con 0x7f4ef8071020 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.398+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 32 ==== osd_op_reply(154 notify.3 [notify cookie 94083347754112 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.399+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 33 ==== watch-notify(notify_complete (2) cookie 94083347754112 notify 137438953494 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4f08030840 con 0x7f4ef8071020 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.399+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 34 ==== osd_op_reply(155 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.399+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:156 6.5 6:a3e2c7b8:::pubsub..bucket.myfoo%2fb92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.399+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 35 ==== osd_op_reply(156 pubsub..bucket.myfoo/b92e6ab7-703a-4505-95e4-c2a94e620f9c.4222.7 [delete] v32'17 uv15 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.399+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:157 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.401+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 36 ==== osd_op_reply(157 foo.buckets [call] v32'48 uv48 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.401+0000 7f4f123d6800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.401+0000 7f4f123d6800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.401+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify cookie 94083347754112 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c85a6a0 con 0x7f4ef8071020 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.401+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 37 ==== watch-notify(notify (1) cookie 94083347496176 notify 137438953495 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f4f08030840 con 0x7f4ef8071020 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.401+0000 7f4dee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94083347496176 notifier 4775 bl.length()=170 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.401+0000 7f4dee7fc640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:159 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4d44003310 con 0x7f4ef8071020 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.401+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 38 ==== osd_op_reply(158 notify.3 [notify cookie 94083347754112 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.401+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 39 ==== osd_op_reply(159 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.401+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 40 ==== watch-notify(notify_complete (2) cookie 94083347754112 notify 137438953495 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4f08030aa0 con 0x7f4ef8071020 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.401+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:160 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4f080141d0 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.402+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 40 ==== osd_op_reply(160 9te6NH5mcdcq0Tc5i8i1 [delete] v32'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.402+0000 7f4f123d6800 10 removing email index: foo@foo.com 2024-02-15T22:57:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.402+0000 7f4f123d6800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.402+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify cookie 94083347754112 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.403+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 41 ==== watch-notify(notify (1) cookie 94083347496176 notify 137438953496 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x7f4f08030aa0 con 0x7f4ef8071020 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.403+0000 7f4deeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94083347496176 notifier 4775 bl.length()=162 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.403+0000 7f4deeffd640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:162 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4dd4003d50 con 0x7f4ef8071020 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.403+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 42 ==== osd_op_reply(161 notify.3 [notify cookie 94083347754112 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.403+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 43 ==== osd_op_reply(162 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.403+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 44 ==== watch-notify(notify_complete (2) cookie 94083347754112 notify 137438953496 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4f08030c30 con 0x7f4ef8071020 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.403+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:163 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x55917c80f0a0 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.404+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 50 ==== osd_op_reply(163 foo@foo.com [delete] v32'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.404+0000 7f4f123d6800 10 removing user buckets index 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.404+0000 7f4f123d6800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.404+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94083347754112 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4f080141d0 2024-02-15T22:57:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.404+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 41 ==== watch-notify(notify (1) cookie 94083347501872 notify 137438953512 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55917c7d8240 con 0x7f4f080141d0 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.404+0000 7f4dee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953512 cookie 94083347501872 notifier 4775 bl.length()=160 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.404+0000 7f4dee7fc640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4d44003310 con 0x7f4f080141d0 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.404+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 42 ==== osd_op_reply(164 notify.5 [notify cookie 94083347754112 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.405+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 43 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.405+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 44 ==== watch-notify(notify_complete (2) cookie 94083347754112 notify 137438953512 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55917c7d7dc0 con 0x7f4f080141d0 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.405+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:166 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 45 ==== osd_op_reply(166 foo.buckets [delete] v32'49 uv49 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4f123d6800 10 removing user index: foo 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4f123d6800 10 removing default.rgw.meta+users.uid+foo from cache 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4f123d6800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify cookie 94083347754112 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x55917c80f0a0 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 51 ==== watch-notify(notify (1) cookie 94083347498768 notify 137438953506 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55917c7d7dc0 con 0x55917c80f0a0 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4deeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94083347498768 notifier 4775 bl.length()=152 2024-02-15T22:57:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4deeffd640 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:168 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4dd4003d50 con 0x55917c80f0a0 2024-02-15T22:57:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 52 ==== osd_op_reply(167 notify.4 [notify cookie 94083347754112 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 53 ==== osd_op_reply(168 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 54 ==== watch-notify(notify_complete (2) cookie 94083347754112 notify 137438953506 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55917c628ba0 con 0x55917c80f0a0 2024-02-15T22:57:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.406+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:169 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x55917c80f0a0 2024-02-15T22:57:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.407+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 55 ==== osd_op_reply(169 foo [call,call,delete] v32'17 uv17 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.408+0000 7f4dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.408+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94083347522080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x55917c80f0a0 2024-02-15T22:57:35.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.409+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 56 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94083347522080] v32'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.409+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94083347484896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.410+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 46 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94083347484896] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.410+0000 7f4f123d6800 20 remove_watcher() i=0 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.410+0000 7f4f123d6800 2 removed watcher, disabling cache 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.410+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94083347490096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x55917c80f0a0 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.411+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 57 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94083347490096] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.411+0000 7f4f123d6800 20 remove_watcher() i=1 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.411+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94083347493920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x55917c8152f0 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.412+0000 7f4f076d4640 1 -- 172.21.15.133:0/369936768 <== osd.3 v2:172.21.15.133:6816/1065500544 40 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94083347493920] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ef80a9040 con 0x55917c8152f0 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.412+0000 7f4f123d6800 20 remove_watcher() i=2 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.412+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94083347496176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4ef8071020 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.413+0000 7f4f106d6640 1 -- 172.21.15.133:0/369936768 <== osd.2 v2:172.21.15.133:6800/2073628168 47 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94083347496176] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0803a040 con 0x7f4ef8071020 2024-02-15T22:57:35.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.413+0000 7f4f123d6800 20 remove_watcher() i=3 2024-02-15T22:57:35.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.413+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94083347498768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x55917c80f0a0 2024-02-15T22:57:35.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.414+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.1 v2:172.21.15.133:6808/2671624067 58 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94083347498768] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x55917c80f0a0 2024-02-15T22:57:35.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.414+0000 7f4f123d6800 20 remove_watcher() i=4 2024-02-15T22:57:35.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.414+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94083347501872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4f080141d0 2024-02-15T22:57:35.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.416+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 45 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94083347501872] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.416+0000 7f4f123d6800 20 remove_watcher() i=5 2024-02-15T22:57:35.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.416+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94083347503808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4f080141d0 2024-02-15T22:57:35.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.417+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 46 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94083347503808] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.417+0000 7f4f123d6800 20 remove_watcher() i=6 2024-02-15T22:57:35.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.417+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94083347507968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55917c870260 con 0x7f4f080141d0 2024-02-15T22:57:35.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 <== osd.0 v2:172.21.15.52:6800/431200118 47 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94083347507968] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f0005c040 con 0x7f4f080141d0 2024-02-15T22:57:35.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 20 remove_watcher() i=7 2024-02-15T22:57:35.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4f080141d0 msgr2=0x7f4f08015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f4f080141d0 0x7f4f08015940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55917c80f0a0 msgr2=0x55917c811560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55917c80f0a0 0x55917c811560 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4ef8071020 msgr2=0x7f4ef8067530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f4ef8071020 0x7f4ef8067530 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55917c8152f0 msgr2=0x55917c8177b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55917c8152f0 0x55917c8177b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4dd8036790 msgr2=0x7f4dd8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4dd8036790 0x7f4dd8038c50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800b010 tx=0x7f4f08020000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 msgr2=0x55917c8034e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f0fed5640 1 -- 172.21.15.133:0/369936768 reap_dead start 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c8034e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4ef808ceb0 tx=0x7f4ef808ded0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 shutdown_connections 2024-02-15T22:57:35.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 --2- 172.21.15.133:0/369936768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7fc510 0x55917c8034e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 >> 172.21.15.133:0/369936768 conn(0x55917c7f87e0 msgr2=0x55917c7f5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 shutdown_connections 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.418+0000 7f4f123d6800 1 -- 172.21.15.133:0/369936768 wait complete. 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/322164417 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4de80367e0 msgr2=0x7f4de8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 --2- 172.21.15.133:0/322164417 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4de80367e0 0x7f4de8038ca0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55917c7df590 tx=0x7f4f08005840 comp rx=0 tx=0).stop 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/322164417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7ef2a0 msgr2=0x55917c7ef6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 --2- 172.21.15.133:0/322164417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7ef2a0 0x55917c7ef6c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80447c0 tx=0x7f4ef8002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/322164417 shutdown_connections 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 --2- 172.21.15.133:0/322164417 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4de80367e0 0x7f4de8038ca0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 --2- 172.21.15.133:0/322164417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c7ef2a0 0x55917c7ef6c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/322164417 >> 172.21.15.133:0/322164417 conn(0x55917c7e3340 msgr2=0x55917c7e3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/322164417 shutdown_connections 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/322164417 wait complete. 2024-02-15T22:57:35.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55917c6e22b0 msgr2=0x55917c7de660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55917c6e22b0 0x55917c7de660 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4df8036790 msgr2=0x7f4df8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4df8036790 0x7f4df8038c50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8054000 tx=0x7f4ef804e000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 msgr2=0x55917c7d7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7d7880 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000c010 tx=0x7f4f00000bc0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 shutdown_connections 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55917c6e22b0 0x55917c7de660 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4df8036790 0x7f4df8038c50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 --2- 172.21.15.133:0/1286689937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55917c651140 0x55917c7d7880 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 >> 172.21.15.133:0/1286689937 conn(0x55917c6d84f0 msgr2=0x55917c7c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 shutdown_connections 2024-02-15T22:57:35.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.419+0000 7f4f123d6800 1 -- 172.21.15.133:0/1286689937 wait complete. 2024-02-15T22:57:35.430 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-15T22:57:35.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-15T22:57:35.430 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-15T22:57:35.472 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:35.472 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:35.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.471+0000 7f0e3eda2800 1 Processor -- start 2024-02-15T22:57:35.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.471+0000 7f0e3eda2800 1 -- start start 2024-02-15T22:57:35.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.471+0000 7f0e3eda2800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559f2e7e9590 0x559f2e7eb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.471+0000 7f0e3eda2800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559f2e72fbb0 con 0x559f2e7e5a80 2024-02-15T22:57:35.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.471+0000 7f0e3eda2800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x559f2e6e7450 con 0x559f2e7e9590 2024-02-15T22:57:35.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.471+0000 7f0e37fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559f2e7e9590 0x559f2e7eb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.471+0000 7f0e3c8a1640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x559f2e7e5a80 0x559f2e7e7e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41698/0 (socket says 172.21.15.133:41698) 2024-02-15T22:57:35.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.471+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/1048737551 learned_addr learned my addr 172.21.15.133:0/1048737551 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:35.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.472+0000 7f0e37fff640 1 -- 172.21.15.133:0/1048737551 >> v1:172.21.15.52:6789/0 conn(0x559f2e7e5a80 legacy=0x559f2e7e7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.472+0000 7f0e37fff640 1 -- 172.21.15.133:0/1048737551 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f2e7eced0 con 0x559f2e7e9590 2024-02-15T22:57:35.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.473+0000 7f0e37fff640 1 --2- 172.21.15.133:0/1048737551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e9590 0x559f2e7eb980 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800a470 tx=0x7f0e2801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8995c1d0677a1071 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.474+0000 7f0e377fe640 1 -- 172.21.15.133:0/1048737551 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e28052570 con 0x559f2e7e9590 2024-02-15T22:57:35.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.474+0000 7f0e377fe640 1 -- 172.21.15.133:0/1048737551 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e280526d0 con 0x559f2e7e9590 2024-02-15T22:57:35.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.474+0000 7f0e377fe640 1 -- 172.21.15.133:0/1048737551 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e28052990 con 0x559f2e7e9590 2024-02-15T22:57:35.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.474+0000 7f0e3eda2800 1 -- 172.21.15.133:0/1048737551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e9590 msgr2=0x559f2e7eb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.474+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/1048737551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e9590 0x559f2e7eb980 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800a470 tx=0x7f0e2801cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:35.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.474+0000 7f0e3eda2800 1 -- 172.21.15.133:0/1048737551 shutdown_connections 2024-02-15T22:57:35.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.474+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/1048737551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e9590 0x559f2e7eb980 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.474+0000 7f0e3eda2800 1 -- 172.21.15.133:0/1048737551 >> 172.21.15.133:0/1048737551 conn(0x559f2e7df4d0 msgr2=0x559f2e7e18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.474+0000 7f0e3eda2800 1 -- 172.21.15.133:0/1048737551 shutdown_connections 2024-02-15T22:57:35.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.474+0000 7f0e3eda2800 1 -- 172.21.15.133:0/1048737551 wait complete. 2024-02-15T22:57:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.486+0000 7f0e3eda2800 1 Processor -- start 2024-02-15T22:57:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.486+0000 7f0e3eda2800 1 -- start start 2024-02-15T22:57:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.486+0000 7f0e3eda2800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e7e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.486+0000 7f0e3eda2800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2e6e4980 con 0x559f2e7e5a80 2024-02-15T22:57:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.486+0000 7f0e3c8a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e7e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.486+0000 7f0e3c8a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e7e53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46004/0 (socket says 172.21.15.133:46004) 2024-02-15T22:57:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.486+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/492498500 learned_addr learned my addr 172.21.15.133:0/492498500 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.487+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/492498500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e28005d20 con 0x559f2e7e5a80 2024-02-15T22:57:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.487+0000 7f0e3c8a1640 1 --2- 172.21.15.133:0/492498500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e7e53c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0e30001bc0 tx=0x7f0e3000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ddcc6265b5e34b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.487+0000 7f0d2ae05640 1 -- 172.21.15.133:0/492498500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e3000e470 con 0x559f2e7e5a80 2024-02-15T22:57:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.487+0000 7f0d2ae05640 1 -- 172.21.15.133:0/492498500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000e5f0 con 0x559f2e7e5a80 2024-02-15T22:57:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.487+0000 7f0d2ae05640 1 -- 172.21.15.133:0/492498500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e3000e950 con 0x559f2e7e5a80 2024-02-15T22:57:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3eda2800 1 -- 172.21.15.133:0/492498500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 msgr2=0x559f2e7e53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/492498500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e7e53c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0e30001bc0 tx=0x7f0e3000b6c0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3eda2800 1 -- 172.21.15.133:0/492498500 shutdown_connections 2024-02-15T22:57:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/492498500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e7e53c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3eda2800 1 -- 172.21.15.133:0/492498500 >> 172.21.15.133:0/492498500 conn(0x559f2e7df4d0 msgr2=0x559f2e8d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3eda2800 1 -- 172.21.15.133:0/492498500 shutdown_connections 2024-02-15T22:57:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3eda2800 1 -- 172.21.15.133:0/492498500 wait complete. 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3eda2800 1 Processor -- start 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3eda2800 1 -- start start 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3eda2800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e8de840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3eda2800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2e6e0160 con 0x559f2e7e5a80 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3c8a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e8de840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3c8a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e8de840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46018/0 (socket says 172.21.15.133:46018) 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.488+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/514190566 learned_addr learned my addr 172.21.15.133:0/514190566 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.489+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/514190566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f2e72fbb0 con 0x559f2e7e5a80 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.489+0000 7f0e3c8a1640 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e8de840 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000c010 tx=0x7f0e30000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.489+0000 7f0d29602640 1 -- 172.21.15.133:0/514190566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e3001f070 con 0x559f2e7e5a80 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.489+0000 7f0d29602640 1 -- 172.21.15.133:0/514190566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300197c0 con 0x559f2e7e5a80 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.489+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f2e8ded80 con 0x559f2e7e5a80 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.489+0000 7f0d29602640 1 -- 172.21.15.133:0/514190566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e30019a60 con 0x559f2e7e5a80 2024-02-15T22:57:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.489+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f2e8df200 con 0x559f2e7e5a80 2024-02-15T22:57:35.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.490+0000 7f0d29602640 1 -- 172.21.15.133:0/514190566 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0e30019bc0 con 0x559f2e7e5a80 2024-02-15T22:57:35.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.490+0000 7f0d29602640 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d24036790 0x7f0d24038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.490+0000 7f0d29602640 1 -- 172.21.15.133:0/514190566 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f0e3004c580 con 0x559f2e7e5a80 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.490+0000 7f0e37fff640 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d24036790 0x7f0d24038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.490+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f2e7e9590 0x559f2e8e5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.490+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e8e5b40 con 0x559f2e7e9590 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.490+0000 7f0e3d0a2640 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f2e7e9590 0x559f2e8e5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.491+0000 7f0e37fff640 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d24036790 0x7f0d24038c50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0e28054000 tx=0x7f0e2804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.491+0000 7f0e3d0a2640 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f2e7e9590 0x559f2e8e5520 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.491+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/514190566 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e3800a4a0 con 0x559f2e7e9590 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.491+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e8e2c30 con 0x559f2e7e9590 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.491+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/514190566 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0e3800a4a0 con 0x559f2e7e9590 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.491+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e8e7870 con 0x559f2e7e9590 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.492+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/514190566 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0e3800a4a0 con 0x559f2e7e9590 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.492+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e8e6a70 con 0x559f2e7e9590 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.492+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/514190566 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0e3800a4a0 con 0x559f2e7e9590 2024-02-15T22:57:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.492+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e8e6e80 con 0x559f2e7e9590 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.492+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/514190566 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0e3800a4a0 con 0x559f2e7e9590 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.492+0000 7f0e3eda2800 1 Processor -- start 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.492+0000 7f0e3eda2800 1 -- start start 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.493+0000 7f0e3eda2800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e8f62f0 0x559f2e8f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.493+0000 7f0e3eda2800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2e682e80 con 0x559f2e8f62f0 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.493+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e8f62f0 0x559f2e8f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.493+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e8f62f0 0x559f2e8f6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46032/0 (socket says 172.21.15.133:46032) 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.493+0000 7f0e37fff640 1 -- 172.21.15.133:0/3251397387 learned_addr learned my addr 172.21.15.133:0/3251397387 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.493+0000 7f0e37fff640 1 -- 172.21.15.133:0/3251397387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f2e8f6c50 con 0x559f2e8f62f0 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.493+0000 7f0e37fff640 1 --2- 172.21.15.133:0/3251397387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e8f62f0 0x559f2e8f6710 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0e280447c0 tx=0x7f0e28002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.493+0000 7f0d227fc640 1 -- 172.21.15.133:0/3251397387 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e2805da40 con 0x559f2e8f62f0 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.493+0000 7f0d227fc640 1 -- 172.21.15.133:0/3251397387 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2805dba0 con 0x559f2e8f62f0 2024-02-15T22:57:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.493+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3251397387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f2e8f6e40 con 0x559f2e8f62f0 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.493+0000 7f0d227fc640 1 -- 172.21.15.133:0/3251397387 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e2805de40 con 0x559f2e8f62f0 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.494+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3251397387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f2e8f7990 con 0x559f2e8f62f0 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.494+0000 7f0d227fc640 1 -- 172.21.15.133:0/3251397387 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0e28066040 con 0x559f2e8f62f0 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.494+0000 7f0d227fc640 1 --2- 172.21.15.133:0/3251397387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d14036790 0x7f0d14038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.494+0000 7f0d227fc640 1 -- 172.21.15.133:0/3251397387 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f0e28063040 con 0x559f2e8f62f0 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.494+0000 7f0e3d0a2640 1 --2- 172.21.15.133:0/3251397387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d14036790 0x7f0d14038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.495+0000 7f0e3eda2800 1 Processor -- start 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.495+0000 7f0e3d0a2640 1 --2- 172.21.15.133:0/3251397387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d14036790 0x7f0d14038c50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x559f2e8e64b0 tx=0x7f0e38005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.495+0000 7f0e3eda2800 1 -- start start 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.495+0000 7f0e3eda2800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e903900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.495+0000 7f0e3eda2800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2e6585d0 con 0x559f2e9034e0 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.495+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e903900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.495+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e903900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46042/0 (socket says 172.21.15.133:46042) 2024-02-15T22:57:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.495+0000 7f0e37fff640 1 -- 172.21.15.133:0/1834260944 learned_addr learned my addr 172.21.15.133:0/1834260944 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0e37fff640 1 -- 172.21.15.133:0/1834260944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f2e903ed0 con 0x559f2e9034e0 2024-02-15T22:57:35.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0e37fff640 1 --2- 172.21.15.133:0/1834260944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e903900 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0e28006ef0 tx=0x7f0e280709a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfc93cf80a94b3c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0d13fff640 1 -- 172.21.15.133:0/1834260944 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e28068850 con 0x559f2e9034e0 2024-02-15T22:57:35.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0d13fff640 1 -- 172.21.15.133:0/1834260944 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e280689b0 con 0x559f2e9034e0 2024-02-15T22:57:35.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0d13fff640 1 -- 172.21.15.133:0/1834260944 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e2805c4d0 con 0x559f2e9034e0 2024-02-15T22:57:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0e3eda2800 1 -- 172.21.15.133:0/1834260944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 msgr2=0x559f2e903900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/1834260944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e903900 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0e28006ef0 tx=0x7f0e280709a0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0e3eda2800 1 -- 172.21.15.133:0/1834260944 shutdown_connections 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/1834260944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e903900 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0e3eda2800 1 -- 172.21.15.133:0/1834260944 >> 172.21.15.133:0/1834260944 conn(0x559f2e8ff840 msgr2=0x559f2e8fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0e3eda2800 1 -- 172.21.15.133:0/1834260944 shutdown_connections 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.496+0000 7f0e3eda2800 1 -- 172.21.15.133:0/1834260944 wait complete. 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.497+0000 7f0e3eda2800 1 Processor -- start 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.497+0000 7f0e3eda2800 1 -- start start 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.497+0000 7f0e3eda2800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e90a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.497+0000 7f0e3eda2800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2e90aa20 con 0x559f2e9034e0 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.497+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e90a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.497+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e90a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46044/0 (socket says 172.21.15.133:46044) 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.497+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 learned_addr learned my addr 172.21.15.133:0/3197767224 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.498+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f2e8f7990 con 0x559f2e9034e0 2024-02-15T22:57:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.498+0000 7f0e37fff640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e90a4e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0e28070e50 tx=0x7f0e2808df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.498+0000 7f0d127fc640 1 -- 172.21.15.133:0/3197767224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e280705c0 con 0x559f2e9034e0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.498+0000 7f0d127fc640 1 -- 172.21.15.133:0/3197767224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e28070720 con 0x559f2e9034e0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.498+0000 7f0d127fc640 1 -- 172.21.15.133:0/3197767224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e280066e0 con 0x559f2e9034e0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.498+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f2e90ac20 con 0x559f2e9034e0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.498+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f2e90b080 con 0x559f2e9034e0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.499+0000 7f0d127fc640 1 -- 172.21.15.133:0/3197767224 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0e28006840 con 0x559f2e9034e0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.499+0000 7f0d127fc640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d080367e0 0x7f0d08038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.499+0000 7f0d127fc640 1 -- 172.21.15.133:0/3197767224 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f0e28099c00 con 0x559f2e9034e0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.499+0000 7f0e3d0a2640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d080367e0 0x7f0d08038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.499+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.499+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f2e9160e0 0x559f2e9185a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.499+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e918cf0 con 0x559f2e9160e0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.499+0000 7f0e3c8a1640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f2e9160e0 0x559f2e9185a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.499+0000 7f0e3d0a2640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d080367e0 0x7f0d08038ca0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800b010 tx=0x7f0e38020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3c8a1640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f2e9160e0 0x559f2e9185a0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3eda2800 20 realm 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e9190c0 con 0x559f2e9160e0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3eda2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e919940 con 0x559f2e9160e0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.500+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e919ca0 con 0x559f2e9160e0 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.501+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.501+0000 7f0e3eda2800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.501+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.501+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e9195a0 con 0x559f2e9160e0 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.501+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.501+0000 7f0e3eda2800 20 rados_obj.operate() r=0 bl.length=875 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.501+0000 7f0e3eda2800 20 searching for the correct realm 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.501+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559f2e91c020 0x559f2e91e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.501+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e91c020 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.501+0000 7f0e37fff640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559f2e91c020 0x559f2e91e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.501+0000 7f0e37fff640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559f2e91c020 0x559f2e91e410 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.502+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.502+0000 7f0e37fff640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0e28098070 0x7f0e2806a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.502+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e28098070 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.502+0000 7f0e3d0a2640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0e28098070 0x7f0e2806a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.502+0000 7f0e3d0a2640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0e28098070 0x7f0e2806a8e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.502+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3800a4a0 con 0x7f0e28098070 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.502+0000 7f0e3d0a2640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f0e380141d0 0x7f0e38015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.502+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e380141d0 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.503+0000 7f0e3c8a1640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f0e380141d0 0x7f0e38015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.503+0000 7f0e3c8a1640 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f0e380141d0 0x7f0e38015940 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.503+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x7f0e380141d0 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.503+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e9160e0 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.503+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.503+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e9160e0 2024-02-15T22:57:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.504+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.504+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e380141d0 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.504+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x7f0e380141d0 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.504+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e380141d0 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.504+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x7f0e380141d0 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.504+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e28098070 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.504+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3800a4a0 con 0x7f0e28098070 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.504+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e91c020 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.505+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.505+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e9160e0 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.505+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.505+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e380141d0 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.505+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x7f0e380141d0 2024-02-15T22:57:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.505+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e9160e0 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.505+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.505+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e28098070 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.506+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0e3803a040 con 0x7f0e28098070 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.506+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e91c020 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.506+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.506+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e91c020 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.506+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.506+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e380141d0 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.507+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x7f0e380141d0 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.507+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e91c020 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.507+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.507+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e91c020 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.507+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.507+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e9160e0 2024-02-15T22:57:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.507+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.507+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e9160e0 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.508+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.508+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e380141d0 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.508+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x7f0e380141d0 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.508+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e91c020 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.508+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.508+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e28098070 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.508+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3803a040 con 0x7f0e28098070 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.508+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e9160e0 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.509+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0e3000d590 con 0x559f2e9160e0 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.509+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e380141d0 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.509+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3000d590 con 0x7f0e380141d0 2024-02-15T22:57:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.509+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e91c020 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.509+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.509+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e380141d0 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.509+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.509+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e28098070 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.510+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3803a040 con 0x7f0e28098070 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.510+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e91c020 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.510+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.510+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e380141d0 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.510+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.510+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x559f2e9160e0 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91eac0 con 0x7f0e28098070 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e3803a040 con 0x7f0e28098070 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91aac0 con 0x559f2e9160e0 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91a740 con 0x559f2e9160e0 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.511+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91b390 con 0x559f2e9160e0 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 20 rados_obj.operate() r=0 bl.length=398 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 20 zone default found 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 4 Realm: () 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 20 zonegroup default 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91b390 con 0x7f0e380141d0 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e920930 con 0x559f2e91c020 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.512+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e920c90 con 0x559f2e91c020 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.513+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.513+0000 7f0e3eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.513+0000 7f0e3eda2800 20 started sync module instance, tier type = 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.513+0000 7f0e3eda2800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.513+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e920210 con 0x7f0e28098070 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.514+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3803a040 con 0x7f0e28098070 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.514+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94142169480560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e921060 con 0x7f0e28098070 2024-02-15T22:57:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.514+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e921860 con 0x559f2e9160e0 2024-02-15T22:57:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.515+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94142169480560] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3803a040 con 0x7f0e28098070 2024-02-15T22:57:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.515+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.515+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94142169485408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e921c10 con 0x559f2e9160e0 2024-02-15T22:57:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.515+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e922410 con 0x559f2e91c020 2024-02-15T22:57:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.516+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.516+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94142169488704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e922c10 con 0x559f2e91c020 2024-02-15T22:57:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.516+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e9235c0 con 0x7f0e28098070 2024-02-15T22:57:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.516+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94142169485408] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.517+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94142169488704] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.517+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3803a040 con 0x7f0e28098070 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.517+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94142169491312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e9230e0 con 0x7f0e28098070 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.517+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e923f80 con 0x559f2e9160e0 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.518+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94142169491312] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3803a040 con 0x7f0e28098070 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.518+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.519+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94142169486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e923f80 con 0x559f2e9160e0 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.519+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e9248f0 con 0x7f0e380141d0 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.520+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94142169486464] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.520+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.520+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94142169499184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e923f80 con 0x7f0e380141d0 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.520+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e9252f0 con 0x7f0e380141d0 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.521+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94142169499184] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.521+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.521+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94142169501200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e923f80 con 0x7f0e380141d0 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.521+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e925cb0 con 0x7f0e380141d0 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.522+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94142169501200] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.522+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.522+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94142169496560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e925cb0 con 0x7f0e380141d0 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.522+0000 7f0e3eda2800 20 add_watcher() i=0 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.522+0000 7f0e3eda2800 20 add_watcher() i=1 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.522+0000 7f0e3eda2800 20 add_watcher() i=2 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.522+0000 7f0e3eda2800 20 add_watcher() i=3 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.522+0000 7f0e3eda2800 20 add_watcher() i=4 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.522+0000 7f0e3eda2800 20 add_watcher() i=5 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.522+0000 7f0e3eda2800 20 add_watcher() i=6 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.523+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94142169496560] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.523+0000 7f0e3eda2800 20 add_watcher() i=7 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.523+0000 7f0e3eda2800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.523+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e925c90 con 0x559f2e9160e0 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.523+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.523+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94142169505904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e926930 con 0x559f2e9160e0 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.524+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94142169505904] v32'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.524+0000 7f0cf2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.524+0000 7f0e3eda2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.524+0000 7f0e3eda2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.525+0000 7f0e3eda2800 5 note: GC not initialized 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.525+0000 7f0cf1fe3640 20 reqs_thread_entry: start 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.525+0000 7f0e3eda2800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.525+0000 7f0e3eda2800 20 Filter name: none 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.525+0000 7f0c637fe640 20 reqs_thread_entry: start 2024-02-15T22:57:35.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.525+0000 7f0e3eda2800 20 rados->read ofs=0 len=0 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.525+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e95aca0 con 0x559f2e9160e0 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.525+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.525+0000 7f0e3eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:could not fetch user info: no user info saved 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.526+0000 7f0cf2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.526+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94142169505904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e95ac60 con 0x559f2e9160e0 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.527+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94142169505904] v32'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.527+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94142169480560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e95ac60 con 0x7f0e28098070 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.528+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94142169480560] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3803a040 con 0x7f0e28098070 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.528+0000 7f0e3eda2800 20 remove_watcher() i=0 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.528+0000 7f0e3eda2800 2 removed watcher, disabling cache 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.528+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94142169485408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e95ac60 con 0x559f2e9160e0 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.529+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94142169485408] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.529+0000 7f0e3eda2800 20 remove_watcher() i=1 2024-02-15T22:57:35.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.529+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94142169488704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e95ac60 con 0x559f2e91c020 2024-02-15T22:57:35.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.530+0000 7f0e37fff640 1 -- 172.21.15.133:0/3197767224 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94142169488704] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2806e070 con 0x559f2e91c020 2024-02-15T22:57:35.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.530+0000 7f0e3eda2800 20 remove_watcher() i=2 2024-02-15T22:57:35.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.530+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94142169491312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91fd70 con 0x7f0e28098070 2024-02-15T22:57:35.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.531+0000 7f0e3d0a2640 1 -- 172.21.15.133:0/3197767224 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94142169491312] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3803a040 con 0x7f0e28098070 2024-02-15T22:57:35.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.531+0000 7f0e3eda2800 20 remove_watcher() i=3 2024-02-15T22:57:35.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.531+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94142169486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e921060 con 0x559f2e9160e0 2024-02-15T22:57:35.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.532+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94142169486464] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x559f2e9160e0 2024-02-15T22:57:35.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.532+0000 7f0e3eda2800 20 remove_watcher() i=4 2024-02-15T22:57:35.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.532+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94142169499184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e921d40 con 0x7f0e380141d0 2024-02-15T22:57:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.533+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94142169499184] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.533+0000 7f0e3eda2800 20 remove_watcher() i=5 2024-02-15T22:57:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.533+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94142169501200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e91fd70 con 0x7f0e380141d0 2024-02-15T22:57:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.534+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94142169501200] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.534+0000 7f0e3eda2800 20 remove_watcher() i=6 2024-02-15T22:57:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.534+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94142169496560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559f2e921d40 con 0x7f0e380141d0 2024-02-15T22:57:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94142169496560] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e3005c040 con 0x7f0e380141d0 2024-02-15T22:57:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 20 remove_watcher() i=7 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f0e380141d0 msgr2=0x7f0e38015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f0e380141d0 0x7f0e38015940 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f2e9160e0 msgr2=0x559f2e9185a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f2e9160e0 0x559f2e9185a0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0e28098070 msgr2=0x7f0e2806a8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f0e28098070 0x7f0e2806a8e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559f2e91c020 msgr2=0x559f2e91e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x559f2e91c020 0x559f2e91e410 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d080367e0 msgr2=0x7f0d08038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d080367e0 0x7f0d08038ca0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800b010 tx=0x7f0e38020000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3c8a1640 1 -- 172.21.15.133:0/3197767224 reap_dead start 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 msgr2=0x559f2e90a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e90a4e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0e28070e50 tx=0x7f0e2808df10 comp rx=0 tx=0).stop 2024-02-15T22:57:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 shutdown_connections 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3197767224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e9034e0 0x559f2e90a4e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.535+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 >> 172.21.15.133:0/3197767224 conn(0x559f2e8ff840 msgr2=0x559f2e8fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 shutdown_connections 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3197767224 wait complete. 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3251397387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d14036790 msgr2=0x7f0d14038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3251397387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d14036790 0x7f0d14038c50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x559f2e8e64b0 tx=0x7f0e38005840 comp rx=0 tx=0).stop 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3251397387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e8f62f0 msgr2=0x559f2e8f6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3251397387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e8f62f0 0x559f2e8f6710 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0e280447c0 tx=0x7f0e28002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3251397387 shutdown_connections 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3251397387 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d14036790 0x7f0d14038c50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/3251397387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e8f62f0 0x559f2e8f6710 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3251397387 >> 172.21.15.133:0/3251397387 conn(0x559f2e8ea390 msgr2=0x559f2e8ea790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3251397387 shutdown_connections 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/3251397387 wait complete. 2024-02-15T22:57:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f2e7e9590 msgr2=0x559f2e8e5520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f2e7e9590 0x559f2e8e5520 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d24036790 msgr2=0x7f0d24038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d24036790 0x7f0d24038c50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0e28054000 tx=0x7f0e2804e000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 msgr2=0x559f2e8de840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e8de840 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000c010 tx=0x7f0e30000bc0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 shutdown_connections 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x559f2e7e9590 0x559f2e8e5520 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f0d24036790 0x7f0d24038c50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 --2- 172.21.15.133:0/514190566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f2e7e5a80 0x559f2e8de840 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 >> 172.21.15.133:0/514190566 conn(0x559f2e7df4d0 msgr2=0x559f2e7e3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 shutdown_connections 2024-02-15T22:57:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.536+0000 7f0e3eda2800 1 -- 172.21.15.133:0/514190566 wait complete. 2024-02-15T22:57:35.548 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-15T22:57:35.548 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-02-15T22:57:35.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-02-15T22:57:35.549 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-02-15T22:57:35.629 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:35.630 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:35.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.628+0000 7fdc6efda800 1 Processor -- start 2024-02-15T22:57:35.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.628+0000 7fdc6efda800 1 -- start start 2024-02-15T22:57:35.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.628+0000 7fdc6efda800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556a03862b40 0x556a03864f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.628+0000 7fdc6efda800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556a037acbb0 con 0x556a03865470 2024-02-15T22:57:35.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.628+0000 7fdc6efda800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x556a03764450 con 0x556a03862b40 2024-02-15T22:57:35.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.628+0000 7fdc6cad9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556a03862b40 0x556a03864f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.628+0000 7fdc67fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x556a03865470 0x556a03867860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41706/0 (socket says 172.21.15.133:41706) 2024-02-15T22:57:35.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.628+0000 7fdc67fff640 1 -- 172.21.15.133:0/2377046001 learned_addr learned my addr 172.21.15.133:0/2377046001 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:35.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.629+0000 7fdc6cad9640 1 -- 172.21.15.133:0/2377046001 >> v1:172.21.15.52:6789/0 conn(0x556a03865470 legacy=0x556a03867860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.629+0000 7fdc6cad9640 1 -- 172.21.15.133:0/2377046001 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a03869f90 con 0x556a03862b40 2024-02-15T22:57:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.631+0000 7fdc6cad9640 1 --2- 172.21.15.133:0/2377046001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a03864f30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000a470 tx=0x7fdc6001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72e5dea4d794070 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.631+0000 7fdc677fe640 1 -- 172.21.15.133:0/2377046001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc60052570 con 0x556a03862b40 2024-02-15T22:57:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.631+0000 7fdc677fe640 1 -- 172.21.15.133:0/2377046001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc600526d0 con 0x556a03862b40 2024-02-15T22:57:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.631+0000 7fdc677fe640 1 -- 172.21.15.133:0/2377046001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc60052990 con 0x556a03862b40 2024-02-15T22:57:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.631+0000 7fdc6efda800 1 -- 172.21.15.133:0/2377046001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 msgr2=0x556a03864f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.631+0000 7fdc6efda800 1 --2- 172.21.15.133:0/2377046001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a03864f30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000a470 tx=0x7fdc6001cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.631+0000 7fdc6efda800 1 -- 172.21.15.133:0/2377046001 shutdown_connections 2024-02-15T22:57:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.631+0000 7fdc6efda800 1 --2- 172.21.15.133:0/2377046001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a03864f30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.631+0000 7fdc6efda800 1 -- 172.21.15.133:0/2377046001 >> 172.21.15.133:0/2377046001 conn(0x556a0385c570 msgr2=0x556a0385e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.631+0000 7fdc6efda800 1 -- 172.21.15.133:0/2377046001 shutdown_connections 2024-02-15T22:57:35.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.631+0000 7fdc6efda800 1 -- 172.21.15.133:0/2377046001 wait complete. 2024-02-15T22:57:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.643+0000 7fdc6efda800 1 Processor -- start 2024-02-15T22:57:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.643+0000 7fdc6efda800 1 -- start start 2024-02-15T22:57:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.643+0000 7fdc6efda800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a039520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.643+0000 7fdc6efda800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a03761980 con 0x556a03862b40 2024-02-15T22:57:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.643+0000 7fdc6cad9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a039520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.643+0000 7fdc6cad9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a039520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46056/0 (socket says 172.21.15.133:46056) 2024-02-15T22:57:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.643+0000 7fdc6cad9640 1 -- 172.21.15.133:0/1888810160 learned_addr learned my addr 172.21.15.133:0/1888810160 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.644+0000 7fdc6cad9640 1 -- 172.21.15.133:0/1888810160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc60005d20 con 0x556a03862b40 2024-02-15T22:57:35.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.644+0000 7fdc6cad9640 1 --2- 172.21.15.133:0/1888810160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a039520d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdc60055040 tx=0x7fdc6004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6db7dc12d06ccf server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.644+0000 7fdb5ae05640 1 -- 172.21.15.133:0/1888810160 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc6000a180 con 0x556a03862b40 2024-02-15T22:57:35.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.644+0000 7fdb5ae05640 1 -- 172.21.15.133:0/1888810160 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6000a2e0 con 0x556a03862b40 2024-02-15T22:57:35.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.644+0000 7fdb5ae05640 1 -- 172.21.15.133:0/1888810160 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc600529b0 con 0x556a03862b40 2024-02-15T22:57:35.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.645+0000 7fdc6efda800 1 -- 172.21.15.133:0/1888810160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 msgr2=0x556a039520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.645+0000 7fdc6efda800 1 --2- 172.21.15.133:0/1888810160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a039520d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdc60055040 tx=0x7fdc6004c000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.645+0000 7fdc6efda800 1 -- 172.21.15.133:0/1888810160 shutdown_connections 2024-02-15T22:57:35.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.645+0000 7fdc6efda800 1 --2- 172.21.15.133:0/1888810160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a039520d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.645+0000 7fdc6efda800 1 -- 172.21.15.133:0/1888810160 >> 172.21.15.133:0/1888810160 conn(0x556a0385c570 msgr2=0x556a0394d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.645+0000 7fdc6efda800 1 -- 172.21.15.133:0/1888810160 shutdown_connections 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.645+0000 7fdc6efda800 1 -- 172.21.15.133:0/1888810160 wait complete. 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.645+0000 7fdc6efda800 1 Processor -- start 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.645+0000 7fdc6efda800 1 -- start start 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.645+0000 7fdc6efda800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a03959660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.645+0000 7fdc6efda800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0375d160 con 0x556a03862b40 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.646+0000 7fdc6cad9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a03959660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.646+0000 7fdc6cad9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a03959660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46068/0 (socket says 172.21.15.133:46068) 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.646+0000 7fdc6cad9640 1 -- 172.21.15.133:0/2529676529 learned_addr learned my addr 172.21.15.133:0/2529676529 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.646+0000 7fdc6cad9640 1 -- 172.21.15.133:0/2529676529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a03869f90 con 0x556a03862b40 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.646+0000 7fdc6cad9640 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a03959660 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000a470 tx=0x7fdc60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.646+0000 7fdb59602640 1 -- 172.21.15.133:0/2529676529 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc6006a070 con 0x556a03862b40 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.646+0000 7fdb59602640 1 -- 172.21.15.133:0/2529676529 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6005d420 con 0x556a03862b40 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.646+0000 7fdc6efda800 1 -- 172.21.15.133:0/2529676529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a03959ba0 con 0x556a03862b40 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.646+0000 7fdb59602640 1 -- 172.21.15.133:0/2529676529 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc6005d5d0 con 0x556a03862b40 2024-02-15T22:57:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.646+0000 7fdc6efda800 1 -- 172.21.15.133:0/2529676529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a0395a080 con 0x556a03862b40 2024-02-15T22:57:35.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.647+0000 7fdc6efda800 1 Processor -- start 2024-02-15T22:57:35.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.647+0000 7fdc6efda800 1 -- start start 2024-02-15T22:57:35.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.647+0000 7fdc6efda800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a03966e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.647+0000 7fdc6efda800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a036ffe80 con 0x556a03966a10 2024-02-15T22:57:35.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.647+0000 7fdb59602640 1 -- 172.21.15.133:0/2529676529 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdc6005d730 con 0x556a03862b40 2024-02-15T22:57:35.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.647+0000 7fdb59602640 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb540367e0 0x7fdb54038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.648+0000 7fdb59602640 1 -- 172.21.15.133:0/2529676529 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fdc6008d9e0 con 0x556a03862b40 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.648+0000 7fdc6d2da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a03966e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.648+0000 7fdc6cad9640 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb540367e0 0x7fdb54038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.648+0000 7fdc6d2da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a03966e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46078/0 (socket says 172.21.15.133:46078) 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.648+0000 7fdc6d2da640 1 -- 172.21.15.133:0/1025299647 learned_addr learned my addr 172.21.15.133:0/1025299647 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.648+0000 7fdc6d2da640 1 -- 172.21.15.133:0/1025299647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a03967370 con 0x556a03966a10 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.648+0000 7fdc6cad9640 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb540367e0 0x7fdb54038ca0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdc6005cfd0 tx=0x7fdc60066f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.648+0000 7fdc6d2da640 1 --2- 172.21.15.133:0/1025299647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a03966e30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800a430 tx=0x7fdc6800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6923b65faaa74a32 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.648+0000 7fdb52ffd640 1 -- 172.21.15.133:0/1025299647 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc68001650 con 0x556a03966a10 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.648+0000 7fdb52ffd640 1 -- 172.21.15.133:0/1025299647 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc680017d0 con 0x556a03966a10 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.648+0000 7fdb52ffd640 1 -- 172.21.15.133:0/1025299647 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc68001ab0 con 0x556a03966a10 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6efda800 1 -- 172.21.15.133:0/1025299647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 msgr2=0x556a03966e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6efda800 1 --2- 172.21.15.133:0/1025299647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a03966e30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800a430 tx=0x7fdc6800a8f0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6efda800 1 -- 172.21.15.133:0/1025299647 shutdown_connections 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6efda800 1 --2- 172.21.15.133:0/1025299647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a03966e30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6efda800 1 -- 172.21.15.133:0/1025299647 >> 172.21.15.133:0/1025299647 conn(0x556a03865470 msgr2=0x556a039634b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6efda800 1 -- 172.21.15.133:0/1025299647 shutdown_connections 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6efda800 1 -- 172.21.15.133:0/1025299647 wait complete. 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6efda800 1 Processor -- start 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6efda800 1 -- start start 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6efda800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a0396daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6efda800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a036d55d0 con 0x556a03966a10 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6d2da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a0396daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6d2da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a0396daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46090/0 (socket says 172.21.15.133:46090) 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.649+0000 7fdc6d2da640 1 -- 172.21.15.133:0/3878850019 learned_addr learned my addr 172.21.15.133:0/3878850019 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.650+0000 7fdc6d2da640 1 -- 172.21.15.133:0/3878850019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6800a0e0 con 0x556a03966a10 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.650+0000 7fdc6d2da640 1 --2- 172.21.15.133:0/3878850019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a0396daa0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdc68000f80 tx=0x7fdc68003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.650+0000 7fdb517fa640 1 -- 172.21.15.133:0/3878850019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc68010a40 con 0x556a03966a10 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.650+0000 7fdb517fa640 1 -- 172.21.15.133:0/3878850019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc68010ba0 con 0x556a03966a10 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.650+0000 7fdc6efda800 1 -- 172.21.15.133:0/3878850019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a0396dfe0 con 0x556a03966a10 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.650+0000 7fdb517fa640 1 -- 172.21.15.133:0/3878850019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc68010e80 con 0x556a03966a10 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.650+0000 7fdc6efda800 1 -- 172.21.15.133:0/3878850019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a0396e440 con 0x556a03966a10 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.651+0000 7fdb517fa640 1 -- 172.21.15.133:0/3878850019 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdc68017070 con 0x556a03966a10 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.651+0000 7fdb517fa640 1 --2- 172.21.15.133:0/3878850019 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb440367e0 0x7fdb44038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.651+0000 7fdc6efda800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.651+0000 7fdc6efda800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.651+0000 7fdb517fa640 1 -- 172.21.15.133:0/3878850019 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fdc6804bda0 con 0x556a03966a10 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.651+0000 7fdc67fff640 1 --2- 172.21.15.133:0/3878850019 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb440367e0 0x7fdb44038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.651+0000 7fdc6efda800 1 Processor -- start 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.651+0000 7fdc6efda800 1 -- start start 2024-02-15T22:57:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.652+0000 7fdc67fff640 1 --2- 172.21.15.133:0/3878850019 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb440367e0 0x7fdb44038ca0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x556a03962930 tx=0x7fdc58001270 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.652+0000 7fdc6efda800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862700 0x556a03860b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.652+0000 7fdc6efda800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a038610b0 con 0x556a03862700 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.652+0000 7fdc6cad9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862700 0x556a03860b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.652+0000 7fdc6cad9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862700 0x556a03860b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46096/0 (socket says 172.21.15.133:46096) 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.652+0000 7fdc6cad9640 1 -- 172.21.15.133:0/88148216 learned_addr learned my addr 172.21.15.133:0/88148216 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.652+0000 7fdc6cad9640 1 -- 172.21.15.133:0/88148216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a038611f0 con 0x556a03862700 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.652+0000 7fdc6cad9640 1 --2- 172.21.15.133:0/88148216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862700 0x556a03860b70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdc6008beb0 tx=0x7fdc60065b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.652+0000 7fdb317e2640 1 -- 172.21.15.133:0/88148216 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc60077e00 con 0x556a03862700 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.653+0000 7fdb317e2640 1 -- 172.21.15.133:0/88148216 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc60089040 con 0x556a03862700 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.653+0000 7fdb317e2640 1 -- 172.21.15.133:0/88148216 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc6008d4d0 con 0x556a03862700 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.653+0000 7fdc6efda800 1 -- 172.21.15.133:0/88148216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a03861440 con 0x556a03862700 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.653+0000 7fdc6efda800 1 -- 172.21.15.133:0/88148216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a03861900 con 0x556a03862700 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.653+0000 7fdb317e2640 1 -- 172.21.15.133:0/88148216 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdc6008d630 con 0x556a03862700 2024-02-15T22:57:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.653+0000 7fdb317e2640 1 --2- 172.21.15.133:0/88148216 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdaa80367e0 0x7fdaa8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.654+0000 7fdb317e2640 1 -- 172.21.15.133:0/88148216 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fdc60097c00 con 0x556a03862700 2024-02-15T22:57:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.654+0000 7fdc67fff640 1 --2- 172.21.15.133:0/88148216 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdaa80367e0 0x7fdaa8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.654+0000 7fdc67fff640 1 --2- 172.21.15.133:0/88148216 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdaa80367e0 0x7fdaa8038ca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdc58004170 tx=0x7fdc5800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.654+0000 7fdab2ffd640 20 reqs_thread_entry: start 2024-02-15T22:57:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.654+0000 7fdc6efda800 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556a03996f60 0x556a03999350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.654+0000 7fdc6efda800 1 -- 172.21.15.133:0/2529676529 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a039999d0 con 0x556a03996f60 2024-02-15T22:57:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.654+0000 7fdc6d2da640 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556a03996f60 0x556a03999350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.654+0000 7fdc6d2da640 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556a03996f60 0x556a03999350 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.655+0000 7fdc6d2da640 1 -- 172.21.15.133:0/2529676529 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdc6801b390 con 0x556a03996f60 2024-02-15T22:57:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.655+0000 7fdc6efda800 1 -- 172.21.15.133:0/2529676529 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a0399b230 con 0x556a03996f60 2024-02-15T22:57:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.655+0000 7fdc6d2da640 1 -- 172.21.15.133:0/2529676529 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fdc6801b390 con 0x556a03996f60 2024-02-15T22:57:35.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/3878850019 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb440367e0 msgr2=0x7fdb44038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 --2- 172.21.15.133:0/3878850019 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb440367e0 0x7fdb44038ca0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x556a03962930 tx=0x7fdc58001270 comp rx=0 tx=0).stop 2024-02-15T22:57:35.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/3878850019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 msgr2=0x556a0396daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 --2- 172.21.15.133:0/3878850019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a0396daa0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdc68000f80 tx=0x7fdc68003370 comp rx=0 tx=0).stop 2024-02-15T22:57:35.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/3878850019 shutdown_connections 2024-02-15T22:57:35.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 --2- 172.21.15.133:0/3878850019 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb440367e0 0x7fdb44038ca0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 --2- 172.21.15.133:0/3878850019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03966a10 0x556a0396daa0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/3878850019 >> 172.21.15.133:0/3878850019 conn(0x556a03865470 msgr2=0x556a03960af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/3878850019 shutdown_connections 2024-02-15T22:57:35.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/3878850019 wait complete. 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/88148216 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdaa80367e0 msgr2=0x7fdaa8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 --2- 172.21.15.133:0/88148216 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdaa80367e0 0x7fdaa8038ca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdc58004170 tx=0x7fdc5800f000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/88148216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862700 msgr2=0x556a03860b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 --2- 172.21.15.133:0/88148216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862700 0x556a03860b70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdc6008beb0 tx=0x7fdc60065b30 comp rx=0 tx=0).stop 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/88148216 shutdown_connections 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 --2- 172.21.15.133:0/88148216 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdaa80367e0 0x7fdaa8038ca0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 --2- 172.21.15.133:0/88148216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862700 0x556a03860b70 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/88148216 >> 172.21.15.133:0/88148216 conn(0x556a0397cbb0 msgr2=0x556a0397d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/88148216 shutdown_connections 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/88148216 wait complete. 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556a03996f60 msgr2=0x556a03999350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556a03996f60 0x556a03999350 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb540367e0 msgr2=0x7fdb54038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb540367e0 0x7fdb54038ca0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdc6005cfd0 tx=0x7fdc60066f30 comp rx=0 tx=0).stop 2024-02-15T22:57:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 -- 172.21.15.133:0/2529676529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 msgr2=0x556a03959660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.656+0000 7fdc6efda800 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a03959660 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000a470 tx=0x7fdc60002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.657+0000 7fdc6efda800 1 -- 172.21.15.133:0/2529676529 shutdown_connections 2024-02-15T22:57:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.657+0000 7fdc6efda800 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x556a03996f60 0x556a03999350 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.657+0000 7fdc6efda800 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fdb540367e0 0x7fdb54038ca0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.657+0000 7fdc6efda800 1 --2- 172.21.15.133:0/2529676529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a03862b40 0x556a03959660 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.657+0000 7fdc6efda800 1 -- 172.21.15.133:0/2529676529 >> 172.21.15.133:0/2529676529 conn(0x556a0385c570 msgr2=0x556a03950ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.657+0000 7fdc6efda800 1 -- 172.21.15.133:0/2529676529 shutdown_connections 2024-02-15T22:57:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.657+0000 7fdc6efda800 1 -- 172.21.15.133:0/2529676529 wait complete. 2024-02-15T22:57:35.668 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T22:57:35.668 DEBUG:tasks.util.rgw: json result: {'id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T22:57:35.669 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-02-15T22:57:35.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-02-15T22:57:35.669 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-02-15T22:57:35.748 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:35.748 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:35.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5fb3f2d800 1 Processor -- start 2024-02-15T22:57:35.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5fb3f2d800 1 -- start start 2024-02-15T22:57:35.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5fb3f2d800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562698a52580 0x562698a54970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5fb3f2d800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562698998ba0 con 0x562698a4ea70 2024-02-15T22:57:35.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5fb3f2d800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x562698950450 con 0x562698a52580 2024-02-15T22:57:35.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5faf37c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562698a52580 0x562698a54970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5fafb7d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x562698a4ea70 0x562698a50e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41716/0 (socket says 172.21.15.133:41716) 2024-02-15T22:57:35.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5fafb7d640 1 -- 172.21.15.133:0/366136615 learned_addr learned my addr 172.21.15.133:0/366136615 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:35.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5faeb7b640 1 -- 172.21.15.133:0/366136615 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610861792 0 0) 0x562698998ba0 con 0x562698a4ea70 2024-02-15T22:57:35.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5faeb7b640 1 -- 172.21.15.133:0/366136615 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f98001e10 con 0x562698a4ea70 2024-02-15T22:57:35.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5faf37c640 1 -- 172.21.15.133:0/366136615 >> v1:172.21.15.52:6789/0 conn(0x562698a4ea70 legacy=0x562698a50e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.747+0000 7f5faf37c640 1 -- 172.21.15.133:0/366136615 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562698a55ec0 con 0x562698a52580 2024-02-15T22:57:35.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.749+0000 7f5faf37c640 1 --2- 172.21.15.133:0/366136615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a52580 0x562698a54970 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400a470 tx=0x7f5fa401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c14702ab34fe2e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.749+0000 7f5faeb7b640 1 -- 172.21.15.133:0/366136615 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa404ad60 con 0x562698a52580 2024-02-15T22:57:35.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.749+0000 7f5faeb7b640 1 -- 172.21.15.133:0/366136615 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa4052440 con 0x562698a52580 2024-02-15T22:57:35.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.749+0000 7f5faeb7b640 1 -- 172.21.15.133:0/366136615 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa40526e0 con 0x562698a52580 2024-02-15T22:57:35.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.750+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/366136615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a52580 msgr2=0x562698a54970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.750+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/366136615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a52580 0x562698a54970 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400a470 tx=0x7f5fa401cc80 comp rx=0 tx=0).stop 2024-02-15T22:57:35.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.750+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/366136615 shutdown_connections 2024-02-15T22:57:35.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.750+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/366136615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a52580 0x562698a54970 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.750+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/366136615 >> 172.21.15.133:0/366136615 conn(0x562698a484c0 msgr2=0x562698a4a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.750+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/366136615 shutdown_connections 2024-02-15T22:57:35.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.750+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/366136615 wait complete. 2024-02-15T22:57:35.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.761+0000 7f5fb3f2d800 1 Processor -- start 2024-02-15T22:57:35.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.761+0000 7f5fb3f2d800 1 -- start start 2024-02-15T22:57:35.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.762+0000 7f5fb3f2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 0x562698b3ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.762+0000 7f5fb3f2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269894d980 con 0x562698a4ea70 2024-02-15T22:57:35.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.762+0000 7f5fafb7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 0x562698b3ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.762+0000 7f5fafb7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 0x562698b3ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46112/0 (socket says 172.21.15.133:46112) 2024-02-15T22:57:35.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.762+0000 7f5fafb7d640 1 -- 172.21.15.133:0/930425619 learned_addr learned my addr 172.21.15.133:0/930425619 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.762+0000 7f5fafb7d640 1 -- 172.21.15.133:0/930425619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4005d20 con 0x562698a4ea70 2024-02-15T22:57:35.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.762+0000 7f5fafb7d640 1 --2- 172.21.15.133:0/930425619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 0x562698b3ded0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001bd0 tx=0x7f5fa000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db867b1945e8001 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.762+0000 7f5e9de0b640 1 -- 172.21.15.133:0/930425619 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa000e470 con 0x562698a4ea70 2024-02-15T22:57:35.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.763+0000 7f5e9de0b640 1 -- 172.21.15.133:0/930425619 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa000e5f0 con 0x562698a4ea70 2024-02-15T22:57:35.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.763+0000 7f5e9de0b640 1 -- 172.21.15.133:0/930425619 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa000e950 con 0x562698a4ea70 2024-02-15T22:57:35.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.763+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/930425619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 msgr2=0x562698b3ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.763+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/930425619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 0x562698b3ded0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001bd0 tx=0x7f5fa000b6c0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.763+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/930425619 shutdown_connections 2024-02-15T22:57:35.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.763+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/930425619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 0x562698b3ded0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.763+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/930425619 >> 172.21.15.133:0/930425619 conn(0x562698a484c0 msgr2=0x562698b396c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.763+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/930425619 shutdown_connections 2024-02-15T22:57:35.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.763+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/930425619 wait complete. 2024-02-15T22:57:35.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.764+0000 7f5fb3f2d800 1 Processor -- start 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.764+0000 7f5fb3f2d800 1 -- start start 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.764+0000 7f5fb3f2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 0x562698b454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.764+0000 7f5fb3f2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562698949160 con 0x562698a4ea70 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.764+0000 7f5fafb7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 0x562698b454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.764+0000 7f5fafb7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 0x562698b454f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46118/0 (socket says 172.21.15.133:46118) 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.764+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 learned_addr learned my addr 172.21.15.133:0/4010217220 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.764+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f98001e10 con 0x562698a4ea70 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.765+0000 7f5fafb7d640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 0x562698b454f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000b700 tx=0x7f5fa0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.765+0000 7f5e97fff640 1 -- 172.21.15.133:0/4010217220 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa001f070 con 0x562698a4ea70 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.765+0000 7f5e97fff640 1 -- 172.21.15.133:0/4010217220 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa0018640 con 0x562698a4ea70 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.765+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562698b45a30 con 0x562698a4ea70 2024-02-15T22:57:35.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.765+0000 7f5e97fff640 1 -- 172.21.15.133:0/4010217220 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa0018920 con 0x562698a4ea70 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.765+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562698b45f10 con 0x562698a4ea70 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.765+0000 7f5fb3f2d800 1 Processor -- start 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.765+0000 7f5fb3f2d800 1 -- start start 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5fb3f2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698a4ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5fb3f2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626988ebe80 con 0x562698a4e500 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5e97fff640 1 -- 172.21.15.133:0/4010217220 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5fa0018ad0 con 0x562698a4ea70 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5fb037e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698a4ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5fb037e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698a4ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46124/0 (socket says 172.21.15.133:46124) 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5fb037e640 1 -- 172.21.15.133:0/742931059 learned_addr learned my addr 172.21.15.133:0/742931059 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5e97fff640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5e98036790 0x7f5e98038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5fb037e640 1 -- 172.21.15.133:0/742931059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562698a4cf90 con 0x562698a4e500 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5e97fff640 1 -- 172.21.15.133:0/4010217220 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f5fa004c200 con 0x562698a4ea70 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5fafb7d640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5e98036790 0x7f5e98038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5fb037e640 1 --2- 172.21.15.133:0/742931059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698a4ca50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800a430 tx=0x7f5fa800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f098cc35c09f06 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5e95ffb640 1 -- 172.21.15.133:0/742931059 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa8001650 con 0x562698a4e500 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5e95ffb640 1 -- 172.21.15.133:0/742931059 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa80017d0 con 0x562698a4e500 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5fafb7d640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5e98036790 0x7f5e98038c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001720 tx=0x7f5fa002dee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.766+0000 7f5e95ffb640 1 -- 172.21.15.133:0/742931059 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa8001ab0 con 0x562698a4e500 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.767+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/742931059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 msgr2=0x562698a4ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.767+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/742931059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698a4ca50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800a430 tx=0x7f5fa800a8f0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.767+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/742931059 shutdown_connections 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.767+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/742931059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698a4ca50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.767+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/742931059 >> 172.21.15.133:0/742931059 conn(0x562698a52580 msgr2=0x562698b4f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.767+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/742931059 shutdown_connections 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.767+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/742931059 wait complete. 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.767+0000 7f5fb3f2d800 1 Processor -- start 2024-02-15T22:57:35.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.767+0000 7f5fb3f2d800 1 -- start start 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.767+0000 7f5fb3f2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698b5b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.767+0000 7f5fb3f2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626988c15d0 con 0x562698a4e500 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.768+0000 7f5fb037e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698b5b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.768+0000 7f5fb037e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698b5b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46136/0 (socket says 172.21.15.133:46136) 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.768+0000 7f5fb037e640 1 -- 172.21.15.133:0/1488596152 learned_addr learned my addr 172.21.15.133:0/1488596152 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.768+0000 7f5fb037e640 1 -- 172.21.15.133:0/1488596152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa800a0e0 con 0x562698a4e500 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.768+0000 7f5fb037e640 1 --2- 172.21.15.133:0/1488596152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698b5b9a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8013040 tx=0x7f5fa8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.768+0000 7f5e8ffff640 1 -- 172.21.15.133:0/1488596152 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa8010b10 con 0x562698a4e500 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.768+0000 7f5e8ffff640 1 -- 172.21.15.133:0/1488596152 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8010c70 con 0x562698a4e500 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.768+0000 7f5e8ffff640 1 -- 172.21.15.133:0/1488596152 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa801c400 con 0x562698a4e500 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.768+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/1488596152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562698b5bee0 con 0x562698a4e500 2024-02-15T22:57:35.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.768+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/1488596152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562698b5c340 con 0x562698a4e500 2024-02-15T22:57:35.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.769+0000 7f5e8ffff640 1 -- 172.21.15.133:0/1488596152 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5fa8017070 con 0x562698a4e500 2024-02-15T22:57:35.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.769+0000 7f5e8ffff640 1 --2- 172.21.15.133:0/1488596152 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5e88036790 0x7f5e88038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.769+0000 7f5e8ffff640 1 -- 172.21.15.133:0/1488596152 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f5fa804be80 con 0x562698a4e500 2024-02-15T22:57:35.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.769+0000 7f5faf37c640 1 --2- 172.21.15.133:0/1488596152 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5e88036790 0x7f5e88038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.769+0000 7f5fb3f2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.769+0000 7f5fb3f2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.770+0000 7f5fb3f2d800 1 Processor -- start 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.770+0000 7f5faf37c640 1 --2- 172.21.15.133:0/1488596152 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5e88036790 0x7f5e88038c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4054000 tx=0x7f5fa404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.770+0000 7f5fb3f2d800 1 -- start start 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.770+0000 7f5fb3f2d800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698b75e30 0x562698b76250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.770+0000 7f5fb3f2d800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562698b76790 con 0x562698b75e30 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.770+0000 7f5fafb7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698b75e30 0x562698b76250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.770+0000 7f5fafb7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698b75e30 0x562698b76250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46148/0 (socket says 172.21.15.133:46148) 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.770+0000 7f5fafb7d640 1 -- 172.21.15.133:0/3733589541 learned_addr learned my addr 172.21.15.133:0/3733589541 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.770+0000 7f5fafb7d640 1 -- 172.21.15.133:0/3733589541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562698b768d0 con 0x562698b75e30 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.771+0000 7f5fafb7d640 1 --2- 172.21.15.133:0/3733589541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698b75e30 0x562698b76250 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000efd0 tx=0x7f5fa0022940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.771+0000 7f5df7fff640 1 -- 172.21.15.133:0/3733589541 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa0016a20 con 0x562698b75e30 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.771+0000 7f5df7fff640 1 -- 172.21.15.133:0/3733589541 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa0016b80 con 0x562698b75e30 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.771+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/3733589541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562698b77200 con 0x562698b75e30 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.771+0000 7f5df7fff640 1 -- 172.21.15.133:0/3733589541 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fa004a160 con 0x562698b75e30 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.771+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/3733589541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562698b77200 con 0x562698b75e30 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.772+0000 7f5df7fff640 1 -- 172.21.15.133:0/3733589541 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5fa004a2c0 con 0x562698b75e30 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.772+0000 7f5df7fff640 1 --2- 172.21.15.133:0/3733589541 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5de80367e0 0x7f5de8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.772+0000 7f5df7fff640 1 -- 172.21.15.133:0/3733589541 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f5fa004dcc0 con 0x562698b75e30 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.772+0000 7f5faf37c640 1 --2- 172.21.15.133:0/3733589541 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5de80367e0 0x7f5de8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.772+0000 7f5df5ffb640 20 reqs_thread_entry: start 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.772+0000 7f5faf37c640 1 --2- 172.21.15.133:0/3733589541 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5de80367e0 0x7f5de8038ca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5626989c0590 tx=0x7f5fa4005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.772+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562698b82c00 0x562698b84ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.772+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b85530 con 0x562698b82c00 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.772+0000 7f5fb037e640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562698b82c00 0x562698b84ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.772+0000 7f5fb037e640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562698b82c00 0x562698b84ff0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.773+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5fa8018d80 con 0x562698b82c00 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.773+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b859a0 con 0x562698b82c00 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.773+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5fa8018d80 con 0x562698b82c00 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.773+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b82390 con 0x562698b82c00 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.773+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f5fa8018d80 con 0x562698b82c00 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.774+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b8d120 con 0x562698b82c00 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.774+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5fa8018d80 con 0x562698b82c00 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:NOTICE: set zone's realm_id= 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.774+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562698b93280 0x562698b8e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.774+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b93280 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.774+0000 7f5fafb7d640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562698b93280 0x562698b8e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.774+0000 7f5fafb7d640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562698b93280 0x562698b8e720 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.774+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa0014070 con 0x562698b93280 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.774+0000 7f5fafb7d640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5fa0017050 0x7f5fa004b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.774+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa0017050 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.775+0000 7f5faf37c640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5fa0017050 0x7f5fa004b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.775+0000 7f5faf37c640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5fa0017050 0x7f5fa004b7f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.775+0000 7f5faf37c640 1 -- 172.21.15.133:0/4010217220 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa4052b50 con 0x7f5fa0017050 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.775+0000 7f5faf37c640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5fa405c410 0x7f5fa405c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.775+0000 7f5faf37c640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa405c410 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.775+0000 7f5fb037e640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5fa405c410 0x7f5fa405c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.776+0000 7f5fb037e640 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5fa405c410 0x7f5fa405c850 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.776+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x7f5fa405c410 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.776+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b82c00 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.776+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x562698b82c00 2024-02-15T22:57:35.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.776+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b82c00 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.777+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x562698b82c00 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.777+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa405c410 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.777+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x7f5fa405c410 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.777+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa405c410 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.777+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x7f5fa405c410 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.777+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa0017050 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.777+0000 7f5faf37c640 1 -- 172.21.15.133:0/4010217220 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa4073040 con 0x7f5fa0017050 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.777+0000 7f5faf37c640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b93280 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.778+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa0014070 con 0x562698b93280 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.778+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b82c00 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.778+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x562698b82c00 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.778+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa405c410 2024-02-15T22:57:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.778+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x7f5fa405c410 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.778+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b82c00 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.778+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x562698b82c00 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.778+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa0017050 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.778+0000 7f5faf37c640 1 -- 172.21.15.133:0/4010217220 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(17 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5fa4073040 con 0x7f5fa0017050 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.778+0000 7f5faf37c640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b93280 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.779+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa0014070 con 0x562698b93280 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.779+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b93280 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.779+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa0014070 con 0x562698b93280 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.779+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa405c410 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.779+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x7f5fa405c410 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.779+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b93280 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.779+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa0014070 con 0x562698b93280 2024-02-15T22:57:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.779+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b93280 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.780+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa0014070 con 0x562698b93280 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.780+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b82c00 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.780+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x562698b82c00 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.780+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b82c00 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.780+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5fa8018d80 con 0x562698b82c00 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.780+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa405c410 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.780+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x7f5fa405c410 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.780+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b93280 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.781+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa0014070 con 0x562698b93280 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.781+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa0017050 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.781+0000 7f5faf37c640 1 -- 172.21.15.133:0/4010217220 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa4073040 con 0x7f5fa0017050 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.781+0000 7f5faf37c640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b82c00 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.781+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(28 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5fa8018d80 con 0x562698b82c00 2024-02-15T22:57:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.781+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa405c410 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.782+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x7f5fa405c410 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.782+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b93280 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.782+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa0014070 con 0x562698b93280 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.782+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa405c410 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.782+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x7f5fa405c410 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.782+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa0017050 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.782+0000 7f5faf37c640 1 -- 172.21.15.133:0/4010217220 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa4073040 con 0x7f5fa0017050 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.782+0000 7f5faf37c640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b93280 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.782+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa0014070 con 0x562698b93280 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.782+0000 7f5fafb7d640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa405c410 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.783+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa8018d80 con 0x7f5fa405c410 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.783+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x562698b82c00 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.783+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(35 [pgnls start_epoch 32 out=173b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7f5fa804d040 con 0x562698b82c00 2024-02-15T22:57:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.783+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b87970 con 0x7f5fa0017050 2024-02-15T22:57:35.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.783+0000 7f5faf37c640 1 -- 172.21.15.133:0/4010217220 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(36 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5fa4073040 con 0x7f5fa0017050 2024-02-15T22:57:35.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.783+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b91150 con 0x562698b82c00 2024-02-15T22:57:35.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.784+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5fa804d040 con 0x562698b82c00 2024-02-15T22:57:35.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.784+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b872e0 con 0x562698b82c00 2024-02-15T22:57:35.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.784+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f5fa804d040 con 0x562698b82c00 2024-02-15T22:57:35.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.784+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [create,call version.set in=58b,writefull 0~1037 in=1037b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b8c4e0 con 0x562698b82c00 2024-02-15T22:57:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.785+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [create,call,writefull 0~1037] v32'5 uv5 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5fa804d040 con 0x562698b82c00 2024-02-15T22:57:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.785+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b92b20 con 0x562698b82c00 2024-02-15T22:57:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.786+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'6 uv6 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f5fa804d040 con 0x562698b82c00 2024-02-15T22:57:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.786+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562698b92b20 con 0x562698b82c00 2024-02-15T22:57:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.789+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'2 uv1 ondisk = -17 ((17) File exists)) v8 ==== 199+0+0 (crc 0 0 0) 0x7f5fa804d040 con 0x562698b82c00 2024-02-15T22:57:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.789+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/1488596152 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5e88036790 msgr2=0x7f5e88038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.789+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/1488596152 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5e88036790 0x7f5e88038c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4054000 tx=0x7f5fa404e000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.789+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/1488596152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 msgr2=0x562698b5b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.789+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/1488596152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698b5b9a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8013040 tx=0x7f5fa8003370 comp rx=0 tx=0).stop 2024-02-15T22:57:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.789+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/1488596152 shutdown_connections 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.789+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/1488596152 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5e88036790 0x7f5e88038c50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.789+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/1488596152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4e500 0x562698b5b9a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.789+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/1488596152 >> 172.21.15.133:0/1488596152 conn(0x562698a52580 msgr2=0x562698b4c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/1488596152 shutdown_connections 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/1488596152 wait complete. 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/3733589541 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5de80367e0 msgr2=0x7f5de8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/3733589541 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5de80367e0 0x7f5de8038ca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5626989c0590 tx=0x7f5fa4005a00 comp rx=0 tx=0).stop 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/3733589541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698b75e30 msgr2=0x562698b76250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/3733589541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698b75e30 0x562698b76250 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000efd0 tx=0x7f5fa0022940 comp rx=0 tx=0).stop 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/3733589541 shutdown_connections 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/3733589541 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5de80367e0 0x7f5de8038ca0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/3733589541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698b75e30 0x562698b76250 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/3733589541 >> 172.21.15.133:0/3733589541 conn(0x562698b6aa60 msgr2=0x562698b6b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/3733589541 shutdown_connections 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/3733589541 wait complete. 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5fa405c410 msgr2=0x7f5fa405c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7f5fa405c410 0x7f5fa405c850 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562698b82c00 msgr2=0x562698b84ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x562698b82c00 0x562698b84ff0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5fa0017050 msgr2=0x7f5fa004b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7f5fa0017050 0x7f5fa004b7f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562698b93280 msgr2=0x562698b8e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x562698b93280 0x562698b8e720 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5e98036790 msgr2=0x7f5e98038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5e98036790 0x7f5e98038c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001720 tx=0x7f5fa002dee0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 msgr2=0x562698b454f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 --2- 172.21.15.133:0/4010217220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562698a4ea70 0x562698b454f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000b700 tx=0x7f5fa0000bc0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 reap_dead start 2024-02-15T22:57:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb037e640 1 -- 172.21.15.133:0/4010217220 reap_dead start 2024-02-15T22:57:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 shutdown_connections 2024-02-15T22:57:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.790+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 >> 172.21.15.133:0/4010217220 conn(0x562698a484c0 msgr2=0x562698b37f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.791+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 shutdown_connections 2024-02-15T22:57:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.791+0000 7f5fb3f2d800 1 -- 172.21.15.133:0/4010217220 wait complete. 2024-02-15T22:57:35.802 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T22:57:35.802 DEBUG:tasks.util.rgw: json result: {'id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T22:57:35.802 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-02-15T22:57:35.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-02-15T22:57:35.802 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-02-15T22:57:35.883 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:35.883 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.881+0000 7ff3c6575800 1 Processor -- start 2024-02-15T22:57:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.881+0000 7ff3c6575800 1 -- start start 2024-02-15T22:57:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.881+0000 7ff3c6575800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56447dbef2f0 0x56447dbf16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.881+0000 7ff3c6575800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56447db36ba0 con 0x56447dbeae60 2024-02-15T22:57:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.881+0000 7ff3c6575800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x56447daee450 con 0x56447dbef2f0 2024-02-15T22:57:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.882+0000 7ff3c387a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56447dbef2f0 0x56447dbf16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.882+0000 7ff3c407b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x56447dbeae60 0x56447dbeb280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41730/0 (socket says 172.21.15.133:41730) 2024-02-15T22:57:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.882+0000 7ff3c407b640 1 -- 172.21.15.133:0/3544638640 learned_addr learned my addr 172.21.15.133:0/3544638640 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.882+0000 7ff3c387a640 1 -- 172.21.15.133:0/3544638640 >> v1:172.21.15.52:6789/0 conn(0x56447dbeae60 legacy=0x56447dbeb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.882+0000 7ff3c387a640 1 -- 172.21.15.133:0/3544638640 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56447dbf2d10 con 0x56447dbef2f0 2024-02-15T22:57:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.884+0000 7ff3c387a640 1 --2- 172.21.15.133:0/3544638640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbef2f0 0x56447dbf16e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800a470 tx=0x7ff3b801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9e75f55a2e8164 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.884+0000 7ff3c3079640 1 -- 172.21.15.133:0/3544638640 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b8052570 con 0x56447dbef2f0 2024-02-15T22:57:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.884+0000 7ff3c3079640 1 -- 172.21.15.133:0/3544638640 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b80526d0 con 0x56447dbef2f0 2024-02-15T22:57:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.884+0000 7ff3c3079640 1 -- 172.21.15.133:0/3544638640 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b8052990 con 0x56447dbef2f0 2024-02-15T22:57:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.884+0000 7ff3c6575800 1 -- 172.21.15.133:0/3544638640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbef2f0 msgr2=0x56447dbf16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.884+0000 7ff3c6575800 1 --2- 172.21.15.133:0/3544638640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbef2f0 0x56447dbf16e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800a470 tx=0x7ff3b801cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.884+0000 7ff3c6575800 1 -- 172.21.15.133:0/3544638640 shutdown_connections 2024-02-15T22:57:35.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.884+0000 7ff3c6575800 1 --2- 172.21.15.133:0/3544638640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbef2f0 0x56447dbf16e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.884+0000 7ff3c6575800 1 -- 172.21.15.133:0/3544638640 >> 172.21.15.133:0/3544638640 conn(0x56447dbe64c0 msgr2=0x56447dbe88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.884+0000 7ff3c6575800 1 -- 172.21.15.133:0/3544638640 shutdown_connections 2024-02-15T22:57:35.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.885+0000 7ff3c6575800 1 -- 172.21.15.133:0/3544638640 wait complete. 2024-02-15T22:57:35.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.896+0000 7ff3c6575800 1 Processor -- start 2024-02-15T22:57:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.896+0000 7ff3c6575800 1 -- start start 2024-02-15T22:57:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.896+0000 7ff3c6575800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447db5ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.896+0000 7ff3c6575800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56447daeb980 con 0x56447dbeae60 2024-02-15T22:57:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.897+0000 7ff3c407b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447db5ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.897+0000 7ff3c407b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447db5ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46160/0 (socket says 172.21.15.133:46160) 2024-02-15T22:57:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.897+0000 7ff3c407b640 1 -- 172.21.15.133:0/1186440134 learned_addr learned my addr 172.21.15.133:0/1186440134 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.897+0000 7ff3c407b640 1 -- 172.21.15.133:0/1186440134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8005d20 con 0x56447dbeae60 2024-02-15T22:57:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.897+0000 7ff3c407b640 1 --2- 172.21.15.133:0/1186440134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447db5ef20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4001c80 tx=0x7ff3b400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2347f8e0872979e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.897+0000 7ff2b260c640 1 -- 172.21.15.133:0/1186440134 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b400e470 con 0x56447dbeae60 2024-02-15T22:57:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.897+0000 7ff2b260c640 1 -- 172.21.15.133:0/1186440134 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b400e5d0 con 0x56447dbeae60 2024-02-15T22:57:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.897+0000 7ff2b260c640 1 -- 172.21.15.133:0/1186440134 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b400e8d0 con 0x56447dbeae60 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.898+0000 7ff3c6575800 1 -- 172.21.15.133:0/1186440134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 msgr2=0x56447db5ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.898+0000 7ff3c6575800 1 --2- 172.21.15.133:0/1186440134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447db5ef20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4001c80 tx=0x7ff3b400b6c0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.898+0000 7ff3c6575800 1 -- 172.21.15.133:0/1186440134 shutdown_connections 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.898+0000 7ff3c6575800 1 --2- 172.21.15.133:0/1186440134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447db5ef20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.898+0000 7ff3c6575800 1 -- 172.21.15.133:0/1186440134 >> 172.21.15.133:0/1186440134 conn(0x56447dbe64c0 msgr2=0x56447dcd6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.898+0000 7ff3c6575800 1 -- 172.21.15.133:0/1186440134 shutdown_connections 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.898+0000 7ff3c6575800 1 -- 172.21.15.133:0/1186440134 wait complete. 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.898+0000 7ff3c6575800 1 Processor -- start 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.898+0000 7ff3c6575800 1 -- start start 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.898+0000 7ff3c6575800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447dcdc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.898+0000 7ff3c6575800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56447dae7160 con 0x56447dbeae60 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.899+0000 7ff3c407b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447dcdc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.899+0000 7ff3c407b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447dcdc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46162/0 (socket says 172.21.15.133:46162) 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.899+0000 7ff3c407b640 1 -- 172.21.15.133:0/4162170742 learned_addr learned my addr 172.21.15.133:0/4162170742 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.899+0000 7ff3c407b640 1 -- 172.21.15.133:0/4162170742 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56447db36ba0 con 0x56447dbeae60 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.899+0000 7ff3c407b640 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447dcdc640 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4001c80 tx=0x7ff3b4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.899+0000 7ff2b0e09640 1 -- 172.21.15.133:0/4162170742 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b401f070 con 0x56447dbeae60 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.899+0000 7ff2b0e09640 1 -- 172.21.15.133:0/4162170742 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b4018640 con 0x56447dbeae60 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.899+0000 7ff2b0e09640 1 -- 172.21.15.133:0/4162170742 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b40188e0 con 0x56447dbeae60 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.899+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56447dcdad30 con 0x56447dbeae60 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.900+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56447dcdb210 con 0x56447dbeae60 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.900+0000 7ff3c6575800 1 Processor -- start 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.900+0000 7ff3c6575800 1 -- start start 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.900+0000 7ff3c6575800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.900+0000 7ff3c6575800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56447da89e80 con 0x56447dcf2bf0 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.900+0000 7ff2b0e09640 1 -- 172.21.15.133:0/4162170742 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff3b4018b10 con 0x56447dbeae60 2024-02-15T22:57:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.900+0000 7ff3c487c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.900+0000 7ff3c487c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46164/0 (socket says 172.21.15.133:46164) 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.900+0000 7ff3c487c640 1 -- 172.21.15.133:0/585907743 learned_addr learned my addr 172.21.15.133:0/585907743 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.900+0000 7ff2b0e09640 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2ac036790 0x7ff2ac038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff2b0e09640 1 -- 172.21.15.133:0/4162170742 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7ff3b404c2e0 con 0x56447dbeae60 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff3c407b640 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2ac036790 0x7ff2ac038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff3c487c640 1 -- 172.21.15.133:0/585907743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56447dcf3550 con 0x56447dcf2bf0 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff3c487c640 1 --2- 172.21.15.133:0/585907743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf3010 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00a430 tx=0x7ff3bc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd781b667ae4fb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff3c407b640 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2ac036790 0x7ff2ac038c50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4022fd0 tx=0x7ff3b402df10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff2aa7fc640 1 -- 172.21.15.133:0/585907743 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3bc001650 con 0x56447dcf2bf0 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff2aa7fc640 1 -- 172.21.15.133:0/585907743 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc0017d0 con 0x56447dcf2bf0 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff2aa7fc640 1 -- 172.21.15.133:0/585907743 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3bc001ab0 con 0x56447dcf2bf0 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff3c6575800 1 -- 172.21.15.133:0/585907743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 msgr2=0x56447dcf3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff3c6575800 1 --2- 172.21.15.133:0/585907743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf3010 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00a430 tx=0x7ff3bc00a8f0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff3c6575800 1 -- 172.21.15.133:0/585907743 shutdown_connections 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff3c6575800 1 --2- 172.21.15.133:0/585907743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf3010 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.901+0000 7ff3c6575800 1 -- 172.21.15.133:0/585907743 >> 172.21.15.133:0/585907743 conn(0x56447dbef2f0 msgr2=0x56447dcef690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.902+0000 7ff3c6575800 1 -- 172.21.15.133:0/585907743 shutdown_connections 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.902+0000 7ff3c6575800 1 -- 172.21.15.133:0/585907743 wait complete. 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.902+0000 7ff3c6575800 1 Processor -- start 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.902+0000 7ff3c6575800 1 -- start start 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.902+0000 7ff3c6575800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.902+0000 7ff3c6575800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56447da5f5d0 con 0x56447dcf2bf0 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.902+0000 7ff3c487c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.902+0000 7ff3c487c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46176/0 (socket says 172.21.15.133:46176) 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.902+0000 7ff3c487c640 1 -- 172.21.15.133:0/794625871 learned_addr learned my addr 172.21.15.133:0/794625871 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.902+0000 7ff3c487c640 1 -- 172.21.15.133:0/794625871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc00a0e0 con 0x56447dcf2bf0 2024-02-15T22:57:35.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.903+0000 7ff3c487c640 1 --2- 172.21.15.133:0/794625871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf9cb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc000f80 tx=0x7ff3bc003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.903+0000 7ff2a8ff9640 1 -- 172.21.15.133:0/794625871 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3bc010a40 con 0x56447dcf2bf0 2024-02-15T22:57:35.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.903+0000 7ff2a8ff9640 1 -- 172.21.15.133:0/794625871 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc010ba0 con 0x56447dcf2bf0 2024-02-15T22:57:35.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.903+0000 7ff2a8ff9640 1 -- 172.21.15.133:0/794625871 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3bc010e80 con 0x56447dcf2bf0 2024-02-15T22:57:35.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.903+0000 7ff3c6575800 1 -- 172.21.15.133:0/794625871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56447dcfa1f0 con 0x56447dcf2bf0 2024-02-15T22:57:35.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.903+0000 7ff3c6575800 1 -- 172.21.15.133:0/794625871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56447dcfa650 con 0x56447dcf2bf0 2024-02-15T22:57:35.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.904+0000 7ff2a8ff9640 1 -- 172.21.15.133:0/794625871 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff3bc017070 con 0x56447dcf2bf0 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.904+0000 7ff2a8ff9640 1 --2- 172.21.15.133:0/794625871 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff29c036790 0x7ff29c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.904+0000 7ff2a8ff9640 1 -- 172.21.15.133:0/794625871 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7ff3bc04bdd0 con 0x56447dcf2bf0 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.904+0000 7ff3c6575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.904+0000 7ff3c6575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.904+0000 7ff3c387a640 1 --2- 172.21.15.133:0/794625871 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff29c036790 0x7ff29c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.904+0000 7ff3c6575800 1 Processor -- start 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.904+0000 7ff3c387a640 1 --2- 172.21.15.133:0/794625871 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff29c036790 0x7ff29c038c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8054000 tx=0x7ff3b804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.904+0000 7ff3c6575800 1 -- start start 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff3c6575800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dd140d0 0x56447dd144f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff3c6575800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56447dd14a30 con 0x56447dd140d0 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff3c407b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dd140d0 0x56447dd144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff3c407b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dd140d0 0x56447dd144f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46188/0 (socket says 172.21.15.133:46188) 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff3c407b640 1 -- 172.21.15.133:0/1032974018 learned_addr learned my addr 172.21.15.133:0/1032974018 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff3c407b640 1 -- 172.21.15.133:0/1032974018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56447dd14b70 con 0x56447dd140d0 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff3c407b640 1 --2- 172.21.15.133:0/1032974018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dd140d0 0x56447dd144f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400efb0 tx=0x7ff3b4017f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff288fe1640 1 -- 172.21.15.133:0/1032974018 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b4022740 con 0x56447dd140d0 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff288fe1640 1 -- 172.21.15.133:0/1032974018 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b40228a0 con 0x56447dd140d0 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff288fe1640 1 -- 172.21.15.133:0/1032974018 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b4022b40 con 0x56447dd140d0 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff3c6575800 1 -- 172.21.15.133:0/1032974018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56447dd154a0 con 0x56447dd140d0 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.905+0000 7ff3c6575800 1 -- 172.21.15.133:0/1032974018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56447dd15960 con 0x56447dd140d0 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.906+0000 7ff288fe1640 1 -- 172.21.15.133:0/1032974018 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff3b4047120 con 0x56447dd140d0 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.906+0000 7ff288fe1640 1 --2- 172.21.15.133:0/1032974018 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff1fc036790 0x7ff1fc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.906+0000 7ff288fe1640 1 -- 172.21.15.133:0/1032974018 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7ff3b403c040 con 0x56447dd140d0 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.906+0000 7ff3c387a640 1 --2- 172.21.15.133:0/1032974018 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff1fc036790 0x7ff1fc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.907+0000 7ff20a7fc640 20 reqs_thread_entry: start 2024-02-15T22:57:35.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.907+0000 7ff3c387a640 1 --2- 172.21.15.133:0/1032974018 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff1fc036790 0x7ff1fc038c50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff3b801cda0 tx=0x7ff3b8005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.907+0000 7ff3c6575800 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56447dd21010 0x56447dd23400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.907+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56447dd23940 con 0x56447dd21010 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.907+0000 7ff3c487c640 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56447dd21010 0x56447dd23400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.907+0000 7ff3c487c640 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56447dd21010 0x56447dd23400 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.907+0000 7ff3c487c640 1 -- 172.21.15.133:0/4162170742 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3bc01aaa0 con 0x56447dd21010 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.907+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56447dd20600 con 0x56447dd21010 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.908+0000 7ff3c487c640 1 -- 172.21.15.133:0/4162170742 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3bc01aaa0 con 0x56447dd21010 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.908+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56447dd23e10 con 0x56447dd21010 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.908+0000 7ff3c487c640 1 -- 172.21.15.133:0/4162170742 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~1037 out=1037b] v0'0 uv5 ondisk = 0) v8 ==== 232+0+1085 (crc 0 0 0) 0x7ff3bc01aaa0 con 0x56447dd21010 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.908+0000 7ff3c6575800 1 -- 172.21.15.133:0/794625871 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff29c036790 msgr2=0x7ff29c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.908+0000 7ff3c6575800 1 --2- 172.21.15.133:0/794625871 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff29c036790 0x7ff29c038c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8054000 tx=0x7ff3b804e000 comp rx=0 tx=0).stop 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.908+0000 7ff3c6575800 1 -- 172.21.15.133:0/794625871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 msgr2=0x56447dcf9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.908+0000 7ff3c6575800 1 --2- 172.21.15.133:0/794625871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf9cb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc000f80 tx=0x7ff3bc003370 comp rx=0 tx=0).stop 2024-02-15T22:57:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/794625871 shutdown_connections 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/794625871 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff29c036790 0x7ff29c038c50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/794625871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dcf2bf0 0x56447dcf9cb0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/794625871 >> 172.21.15.133:0/794625871 conn(0x56447dbef2f0 msgr2=0x56447dceccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/794625871 shutdown_connections 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/794625871 wait complete. 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/1032974018 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff1fc036790 msgr2=0x7ff1fc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/1032974018 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff1fc036790 0x7ff1fc038c50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff3b801cda0 tx=0x7ff3b8005a00 comp rx=0 tx=0).stop 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/1032974018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dd140d0 msgr2=0x56447dd144f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/1032974018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dd140d0 0x56447dd144f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400efb0 tx=0x7ff3b4017f90 comp rx=0 tx=0).stop 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/1032974018 shutdown_connections 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/1032974018 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff1fc036790 0x7ff1fc038c50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/1032974018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dd140d0 0x56447dd144f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/1032974018 >> 172.21.15.133:0/1032974018 conn(0x56447dd08ce0 msgr2=0x56447dd09750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/1032974018 shutdown_connections 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/1032974018 wait complete. 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56447dd21010 msgr2=0x56447dd23400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56447dd21010 0x56447dd23400 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2ac036790 msgr2=0x7ff2ac038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2ac036790 0x7ff2ac038c50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4022fd0 tx=0x7ff3b402df10 comp rx=0 tx=0).stop 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 msgr2=0x56447dcdc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447dcdc640 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4001c80 tx=0x7ff3b4000ed0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 shutdown_connections 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x56447dd21010 0x56447dd23400 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff2ac036790 0x7ff2ac038c50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 --2- 172.21.15.133:0/4162170742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56447dbeae60 0x56447dcdc640 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 >> 172.21.15.133:0/4162170742 conn(0x56447dbe64c0 msgr2=0x56447dcd5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 shutdown_connections 2024-02-15T22:57:35.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:35.909+0000 7ff3c6575800 1 -- 172.21.15.133:0/4162170742 wait complete. 2024-02-15T22:57:35.921 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T22:57:35.922 DEBUG:tasks.util.rgw: json result: {'id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T22:57:35.922 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-15T22:57:35.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-15T22:57:35.922 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-15T22:57:36.006 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:36.006 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:36.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.005+0000 7f60b0f30800 1 Processor -- start 2024-02-15T22:57:36.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.005+0000 7f60b0f30800 1 -- start start 2024-02-15T22:57:36.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.005+0000 7f60b0f30800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557b63142f10 0x557b63143330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.005+0000 7f60b0f30800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557b6308ec50 con 0x557b63144170 2024-02-15T22:57:36.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.005+0000 7f60b0f30800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x557b63046450 con 0x557b63142f10 2024-02-15T22:57:36.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.005+0000 7f60acbd6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557b63142f10 0x557b63143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.005+0000 7f60a7fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x557b63144170 0x557b631445f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41746/0 (socket says 172.21.15.133:41746) 2024-02-15T22:57:36.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.005+0000 7f60a7fff640 1 -- 172.21.15.133:0/3887752088 learned_addr learned my addr 172.21.15.133:0/3887752088 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:36.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.006+0000 7f60a77fe640 1 -- 172.21.15.133:0/3887752088 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256722594 0 0) 0x557b6308ec50 con 0x557b63144170 2024-02-15T22:57:36.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.006+0000 7f60a77fe640 1 -- 172.21.15.133:0/3887752088 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f609c001e10 con 0x557b63144170 2024-02-15T22:57:36.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.006+0000 7f60acbd6640 1 -- 172.21.15.133:0/3887752088 >> v1:172.21.15.52:6789/0 conn(0x557b63144170 legacy=0x557b631445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.006+0000 7f60acbd6640 1 -- 172.21.15.133:0/3887752088 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b63143a00 con 0x557b63142f10 2024-02-15T22:57:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.008+0000 7f60acbd6640 1 --2- 172.21.15.133:0/3887752088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b63143330 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f60a000a470 tx=0x7f60a001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab56e528fe88595 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.008+0000 7f60a77fe640 1 -- 172.21.15.133:0/3887752088 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a004ad60 con 0x557b63142f10 2024-02-15T22:57:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.008+0000 7f60a77fe640 1 -- 172.21.15.133:0/3887752088 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a0052440 con 0x557b63142f10 2024-02-15T22:57:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.008+0000 7f60a77fe640 1 -- 172.21.15.133:0/3887752088 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a0052700 con 0x557b63142f10 2024-02-15T22:57:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.008+0000 7f60b0f30800 1 -- 172.21.15.133:0/3887752088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 msgr2=0x557b63143330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.008+0000 7f60b0f30800 1 --2- 172.21.15.133:0/3887752088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b63143330 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f60a000a470 tx=0x7f60a001cc80 comp rx=0 tx=0).stop 2024-02-15T22:57:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.008+0000 7f60b0f30800 1 -- 172.21.15.133:0/3887752088 shutdown_connections 2024-02-15T22:57:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.008+0000 7f60b0f30800 1 --2- 172.21.15.133:0/3887752088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b63143330 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.008+0000 7f60b0f30800 1 -- 172.21.15.133:0/3887752088 >> 172.21.15.133:0/3887752088 conn(0x557b6313e590 msgr2=0x557b631409b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.008+0000 7f60b0f30800 1 -- 172.21.15.133:0/3887752088 shutdown_connections 2024-02-15T22:57:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.008+0000 7f60b0f30800 1 -- 172.21.15.133:0/3887752088 wait complete. 2024-02-15T22:57:36.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.020+0000 7f60b0f30800 1 Processor -- start 2024-02-15T22:57:36.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.020+0000 7f60b0f30800 1 -- start start 2024-02-15T22:57:36.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.020+0000 7f60b0f30800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b630b7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.020+0000 7f60b0f30800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63043980 con 0x557b63142f10 2024-02-15T22:57:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.020+0000 7f60acbd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b630b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.020+0000 7f60acbd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b630b7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46198/0 (socket says 172.21.15.133:46198) 2024-02-15T22:57:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.020+0000 7f60acbd6640 1 -- 172.21.15.133:0/2148319682 learned_addr learned my addr 172.21.15.133:0/2148319682 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.021+0000 7f60acbd6640 1 -- 172.21.15.133:0/2148319682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0005d20 con 0x557b63142f10 2024-02-15T22:57:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.021+0000 7f60acbd6640 1 --2- 172.21.15.133:0/2148319682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b630b7040 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f60a0055040 tx=0x7f60a004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d976841481e69e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.021+0000 7f5f9ae05640 1 -- 172.21.15.133:0/2148319682 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a000a040 con 0x557b63142f10 2024-02-15T22:57:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.021+0000 7f5f9ae05640 1 -- 172.21.15.133:0/2148319682 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a000a1a0 con 0x557b63142f10 2024-02-15T22:57:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.021+0000 7f5f9ae05640 1 -- 172.21.15.133:0/2148319682 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a00525b0 con 0x557b63142f10 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60b0f30800 1 -- 172.21.15.133:0/2148319682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 msgr2=0x557b630b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2148319682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b630b7040 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f60a0055040 tx=0x7f60a004c000 comp rx=0 tx=0).stop 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60b0f30800 1 -- 172.21.15.133:0/2148319682 shutdown_connections 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2148319682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b630b7040 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60b0f30800 1 -- 172.21.15.133:0/2148319682 >> 172.21.15.133:0/2148319682 conn(0x557b6313e590 msgr2=0x557b6322eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60b0f30800 1 -- 172.21.15.133:0/2148319682 shutdown_connections 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60b0f30800 1 -- 172.21.15.133:0/2148319682 wait complete. 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60b0f30800 1 Processor -- start 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60b0f30800 1 -- start start 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60b0f30800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b6323b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60b0f30800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b6303f160 con 0x557b63142f10 2024-02-15T22:57:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.022+0000 7f60acbd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b6323b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.023+0000 7f60acbd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b6323b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46208/0 (socket says 172.21.15.133:46208) 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.023+0000 7f60acbd6640 1 -- 172.21.15.133:0/2851770726 learned_addr learned my addr 172.21.15.133:0/2851770726 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.023+0000 7f60acbd6640 1 -- 172.21.15.133:0/2851770726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a004e070 con 0x557b63142f10 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.023+0000 7f60acbd6640 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b6323b850 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f60a0005870 tx=0x7f60a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.023+0000 7f5f99602640 1 -- 172.21.15.133:0/2851770726 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a006b070 con 0x557b63142f10 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.023+0000 7f5f99602640 1 -- 172.21.15.133:0/2851770726 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a0052ac0 con 0x557b63142f10 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.023+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b6323bd90 con 0x557b63142f10 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.023+0000 7f5f99602640 1 -- 172.21.15.133:0/2851770726 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a0052d80 con 0x557b63142f10 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.023+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b6323c2d0 con 0x557b63142f10 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.024+0000 7f60b0f30800 1 Processor -- start 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.024+0000 7f60b0f30800 1 -- start start 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.024+0000 7f5f99602640 1 -- 172.21.15.133:0/2851770726 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f60a0059050 con 0x557b63142f10 2024-02-15T22:57:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.024+0000 7f60b0f30800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b63249020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.024+0000 7f60b0f30800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b62fe1e80 con 0x557b63248c00 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.024+0000 7f5f99602640 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f94036790 0x7f5f94038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.024+0000 7f5f99602640 1 -- 172.21.15.133:0/2851770726 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f60a008ccb0 con 0x557b63142f10 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.024+0000 7f60ad3d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b63249020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.024+0000 7f60acbd6640 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f94036790 0x7f5f94038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.024+0000 7f60ad3d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b63249020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46218/0 (socket says 172.21.15.133:46218) 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.024+0000 7f60ad3d7640 1 -- 172.21.15.133:0/1957461392 learned_addr learned my addr 172.21.15.133:0/1957461392 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f60ad3d7640 1 -- 172.21.15.133:0/1957461392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b63249560 con 0x557b63248c00 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f60acbd6640 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f94036790 0x7f5f94038c50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f60a00053c0 tx=0x7f60a0005350 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f60ad3d7640 1 --2- 172.21.15.133:0/1957461392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b63249020 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f60a800a430 tx=0x7f60a800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f52833b87321b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f5f92ffd640 1 -- 172.21.15.133:0/1957461392 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a8001650 con 0x557b63248c00 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f5f92ffd640 1 -- 172.21.15.133:0/1957461392 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a80017d0 con 0x557b63248c00 2024-02-15T22:57:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f5f92ffd640 1 -- 172.21.15.133:0/1957461392 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a8001ab0 con 0x557b63248c00 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f60b0f30800 1 -- 172.21.15.133:0/1957461392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 msgr2=0x557b63249020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f60b0f30800 1 --2- 172.21.15.133:0/1957461392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b63249020 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f60a800a430 tx=0x7f60a800a8f0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f60b0f30800 1 -- 172.21.15.133:0/1957461392 shutdown_connections 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f60b0f30800 1 --2- 172.21.15.133:0/1957461392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b63249020 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f60b0f30800 1 -- 172.21.15.133:0/1957461392 >> 172.21.15.133:0/1957461392 conn(0x557b63144170 msgr2=0x557b632456a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f60b0f30800 1 -- 172.21.15.133:0/1957461392 shutdown_connections 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.025+0000 7f60b0f30800 1 -- 172.21.15.133:0/1957461392 wait complete. 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.026+0000 7f60b0f30800 1 Processor -- start 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.026+0000 7f60b0f30800 1 -- start start 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.026+0000 7f60b0f30800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b6324fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.026+0000 7f60b0f30800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b62fb75d0 con 0x557b63248c00 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.026+0000 7f60ad3d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b6324fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.026+0000 7f60ad3d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b6324fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46220/0 (socket says 172.21.15.133:46220) 2024-02-15T22:57:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.026+0000 7f60ad3d7640 1 -- 172.21.15.133:0/2783954067 learned_addr learned my addr 172.21.15.133:0/2783954067 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.026+0000 7f60ad3d7640 1 -- 172.21.15.133:0/2783954067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a800a0e0 con 0x557b63248c00 2024-02-15T22:57:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.027+0000 7f60ad3d7640 1 --2- 172.21.15.133:0/2783954067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b6324fa30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f60a8013040 tx=0x7f60a8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.027+0000 7f5f917fa640 1 -- 172.21.15.133:0/2783954067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a8010b10 con 0x557b63248c00 2024-02-15T22:57:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.027+0000 7f5f917fa640 1 -- 172.21.15.133:0/2783954067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a8010c70 con 0x557b63248c00 2024-02-15T22:57:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.027+0000 7f60b0f30800 1 -- 172.21.15.133:0/2783954067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b6324ff70 con 0x557b63248c00 2024-02-15T22:57:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.027+0000 7f5f917fa640 1 -- 172.21.15.133:0/2783954067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a801c400 con 0x557b63248c00 2024-02-15T22:57:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.027+0000 7f60b0f30800 1 -- 172.21.15.133:0/2783954067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b632503d0 con 0x557b63248c00 2024-02-15T22:57:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.027+0000 7f5f917fa640 1 -- 172.21.15.133:0/2783954067 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f60a8017070 con 0x557b63248c00 2024-02-15T22:57:36.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.028+0000 7f5f917fa640 1 --2- 172.21.15.133:0/2783954067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f840367e0 0x7f5f84038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.028+0000 7f5f917fa640 1 -- 172.21.15.133:0/2783954067 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f60a804bdf0 con 0x557b63248c00 2024-02-15T22:57:36.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.028+0000 7f60a7fff640 1 --2- 172.21.15.133:0/2783954067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f840367e0 0x7f5f84038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.028+0000 7f60b0f30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:36.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.028+0000 7f60b0f30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.028+0000 7f60a7fff640 1 --2- 172.21.15.133:0/2783954067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f840367e0 0x7f5f84038ca0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6098000f60 tx=0x7f60980010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.028+0000 7f60b0f30800 1 Processor -- start 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.028+0000 7f60b0f30800 1 -- start start 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.029+0000 7f60b0f30800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63269ed0 0x557b6326a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.029+0000 7f60b0f30800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b6326a830 con 0x557b63269ed0 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.029+0000 7f60acbd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63269ed0 0x557b6326a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.029+0000 7f60acbd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63269ed0 0x557b6326a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46230/0 (socket says 172.21.15.133:46230) 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.029+0000 7f60acbd6640 1 -- 172.21.15.133:0/2562449666 learned_addr learned my addr 172.21.15.133:0/2562449666 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.029+0000 7f60acbd6640 1 -- 172.21.15.133:0/2562449666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b6326a970 con 0x557b63269ed0 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.029+0000 7f60acbd6640 1 --2- 172.21.15.133:0/2562449666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63269ed0 0x557b6326a2f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f60a008b150 tx=0x7f60a006ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.029+0000 7f5f717e2640 1 -- 172.21.15.133:0/2562449666 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a00785f0 con 0x557b63269ed0 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.029+0000 7f5f717e2640 1 -- 172.21.15.133:0/2562449666 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a0078ec0 con 0x557b63269ed0 2024-02-15T22:57:36.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.029+0000 7f60b0f30800 1 -- 172.21.15.133:0/2562449666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b6326b2a0 con 0x557b63269ed0 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.029+0000 7f5f717e2640 1 -- 172.21.15.133:0/2562449666 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60a0078ab0 con 0x557b63269ed0 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.030+0000 7f60b0f30800 1 -- 172.21.15.133:0/2562449666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b6326b760 con 0x557b63269ed0 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.030+0000 7f5f717e2640 1 -- 172.21.15.133:0/2562449666 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f60a0054690 con 0x557b63269ed0 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.030+0000 7f5f717e2640 1 --2- 172.21.15.133:0/2562449666 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5ee8036740 0x7f5ee8038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.030+0000 7f5f717e2640 1 -- 172.21.15.133:0/2562449666 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f60a0095bb0 con 0x557b63269ed0 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.030+0000 7f60a7fff640 1 --2- 172.21.15.133:0/2562449666 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5ee8036740 0x7f5ee8038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.031+0000 7f5ef2ffd640 20 reqs_thread_entry: start 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.031+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557b63276f80 0x557b63279370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.031+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b632799a0 con 0x557b63276f80 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.031+0000 7f60a7fff640 1 --2- 172.21.15.133:0/2562449666 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5ee8036740 0x7f5ee8038c00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6098004170 tx=0x7f609800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.031+0000 7f60ad3d7640 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557b63276f80 0x557b63279370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.031+0000 7f60ad3d7640 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557b63276f80 0x557b63279370 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.031+0000 7f60ad3d7640 1 -- 172.21.15.133:0/2851770726 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f60a801c930 con 0x557b63276f80 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.031+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b6327b1b0 con 0x557b63276f80 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.032+0000 7f60ad3d7640 1 -- 172.21.15.133:0/2851770726 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~1037 out=1037b] v0'0 uv5 ondisk = 0) v8 ==== 232+0+1085 (crc 0 0 0) 0x7f60a801c930 con 0x557b63276f80 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.032+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~875 in=875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b6327ab80 con 0x557b63276f80 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.033+0000 7f60ad3d7640 1 -- 172.21.15.133:0/2851770726 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [stat,call,call,writefull 0~875] v32'7 uv7 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f60a801c930 con 0x557b63276f80 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2783954067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f840367e0 msgr2=0x7f5f84038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2783954067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f840367e0 0x7f5f84038ca0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6098000f60 tx=0x7f60980010a0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2783954067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 msgr2=0x557b6324fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2783954067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b6324fa30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f60a8013040 tx=0x7f60a8003370 comp rx=0 tx=0).stop 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2783954067 shutdown_connections 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2783954067 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f840367e0 0x7f5f84038ca0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2783954067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63248c00 0x557b6324fa30 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2783954067 >> 172.21.15.133:0/2783954067 conn(0x557b63144170 msgr2=0x557b63242ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2783954067 shutdown_connections 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2783954067 wait complete. 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2562449666 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5ee8036740 msgr2=0x7f5ee8038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2562449666 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5ee8036740 0x7f5ee8038c00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6098004170 tx=0x7f609800f000 comp rx=0 tx=0).stop 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2562449666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63269ed0 msgr2=0x557b6326a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2562449666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63269ed0 0x557b6326a2f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f60a008b150 tx=0x7f60a006ee50 comp rx=0 tx=0).stop 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2562449666 shutdown_connections 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2562449666 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5ee8036740 0x7f5ee8038c00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2562449666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63269ed0 0x557b6326a2f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2562449666 >> 172.21.15.133:0/2562449666 conn(0x557b6325eb00 msgr2=0x557b6325f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2562449666 shutdown_connections 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.034+0000 7f60b0f30800 1 -- 172.21.15.133:0/2562449666 wait complete. 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557b63276f80 msgr2=0x557b63279370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557b63276f80 0x557b63279370 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f94036790 msgr2=0x7f5f94038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f94036790 0x7f5f94038c50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f60a00053c0 tx=0x7f60a0005350 comp rx=0 tx=0).stop 2024-02-15T22:57:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 msgr2=0x557b6323b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b6323b850 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f60a0005870 tx=0x7f60a0002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 shutdown_connections 2024-02-15T22:57:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x557b63276f80 0x557b63279370 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5f94036790 0x7f5f94038c50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 --2- 172.21.15.133:0/2851770726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b63142f10 0x557b6323b850 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 >> 172.21.15.133:0/2851770726 conn(0x557b6313e590 msgr2=0x557b6322d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 shutdown_connections 2024-02-15T22:57:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.035+0000 7f60b0f30800 1 -- 172.21.15.133:0/2851770726 wait complete. 2024-02-15T22:57:36.045 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T22:57:36.045 DEBUG:tasks.util.rgw: json result: {'id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T22:57:36.046 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-02-15T22:57:36.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-02-15T22:57:36.046 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-02-15T22:57:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:36.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.084+0000 7f47c7f22800 1 Processor -- start 2024-02-15T22:57:36.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.084+0000 7f47c7f22800 1 -- start start 2024-02-15T22:57:36.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.084+0000 7f47c7f22800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55ed1d8f7e60 0x55ed1d8f8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.084+0000 7f47c7f22800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ed1d843ba0 con 0x55ed1d8f90c0 2024-02-15T22:57:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.084+0000 7f47c7f22800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ed1d7fb450 con 0x55ed1d8f7e60 2024-02-15T22:57:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.085+0000 7f47c3c26640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55ed1d8f7e60 0x55ed1d8f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.085+0000 7f47c3c26640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55ed1d8f7e60 0x55ed1d8f8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46238/0 (socket says 172.21.15.133:46238) 2024-02-15T22:57:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.085+0000 7f47bb425640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55ed1d8f90c0 0x55ed1d8f9540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41750/0 (socket says 172.21.15.133:41750) 2024-02-15T22:57:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.085+0000 7f47c3c26640 1 -- 172.21.15.133:0/895965600 learned_addr learned my addr 172.21.15.133:0/895965600 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.085+0000 7f47c3c26640 1 -- 172.21.15.133:0/895965600 >> v1:172.21.15.52:6789/0 conn(0x55ed1d8f90c0 legacy=0x55ed1d8f9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.085+0000 7f47c3c26640 1 -- 172.21.15.133:0/895965600 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed1d8f8950 con 0x55ed1d8f7e60 2024-02-15T22:57:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.087+0000 7f47c3c26640 1 --2- 172.21.15.133:0/895965600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d8f8280 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f47b400a520 tx=0x7f47b401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dc09309850251e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.087+0000 7f47c3425640 1 -- 172.21.15.133:0/895965600 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b4052570 con 0x55ed1d8f7e60 2024-02-15T22:57:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.087+0000 7f47c3425640 1 -- 172.21.15.133:0/895965600 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b40526d0 con 0x55ed1d8f7e60 2024-02-15T22:57:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.087+0000 7f47c3425640 1 -- 172.21.15.133:0/895965600 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b4052990 con 0x55ed1d8f7e60 2024-02-15T22:57:36.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.087+0000 7f47c7f22800 1 -- 172.21.15.133:0/895965600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 msgr2=0x55ed1d8f8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.087+0000 7f47c7f22800 1 --2- 172.21.15.133:0/895965600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d8f8280 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f47b400a520 tx=0x7f47b401cee0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.087+0000 7f47c7f22800 1 -- 172.21.15.133:0/895965600 shutdown_connections 2024-02-15T22:57:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.087+0000 7f47c7f22800 1 --2- 172.21.15.133:0/895965600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d8f8280 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.087+0000 7f47c7f22800 1 -- 172.21.15.133:0/895965600 >> 172.21.15.133:0/895965600 conn(0x55ed1d8f34c0 msgr2=0x55ed1d8f58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.087+0000 7f47c7f22800 1 -- 172.21.15.133:0/895965600 shutdown_connections 2024-02-15T22:57:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.087+0000 7f47c7f22800 1 -- 172.21.15.133:0/895965600 wait complete. 2024-02-15T22:57:36.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.099+0000 7f47c7f22800 1 Processor -- start 2024-02-15T22:57:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.099+0000 7f47c7f22800 1 -- start start 2024-02-15T22:57:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.099+0000 7f47c7f22800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d86bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.099+0000 7f47c7f22800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1d7f8980 con 0x55ed1d8f7e60 2024-02-15T22:57:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.100+0000 7f47c3c26640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d86bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.100+0000 7f47c3c26640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d86bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46254/0 (socket says 172.21.15.133:46254) 2024-02-15T22:57:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.100+0000 7f47c3c26640 1 -- 172.21.15.133:0/2904376333 learned_addr learned my addr 172.21.15.133:0/2904376333 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.100+0000 7f47c3c26640 1 -- 172.21.15.133:0/2904376333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4005de0 con 0x55ed1d8f7e60 2024-02-15T22:57:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.100+0000 7f47c3c26640 1 --2- 172.21.15.133:0/2904376333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d86bf20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f47b4055040 tx=0x7f47b404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50412f968e6f615 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.100+0000 7f46b1e0b640 1 -- 172.21.15.133:0/2904376333 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b4052840 con 0x55ed1d8f7e60 2024-02-15T22:57:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.100+0000 7f46b1e0b640 1 -- 172.21.15.133:0/2904376333 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b40529c0 con 0x55ed1d8f7e60 2024-02-15T22:57:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.100+0000 7f46b1e0b640 1 -- 172.21.15.133:0/2904376333 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b4052ca0 con 0x55ed1d8f7e60 2024-02-15T22:57:36.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.101+0000 7f47c7f22800 1 -- 172.21.15.133:0/2904376333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 msgr2=0x55ed1d86bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.101+0000 7f47c7f22800 1 --2- 172.21.15.133:0/2904376333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d86bf20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f47b4055040 tx=0x7f47b404c000 comp rx=0 tx=0).stop 2024-02-15T22:57:36.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.101+0000 7f47c7f22800 1 -- 172.21.15.133:0/2904376333 shutdown_connections 2024-02-15T22:57:36.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.101+0000 7f47c7f22800 1 --2- 172.21.15.133:0/2904376333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d86bf20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.101+0000 7f47c7f22800 1 -- 172.21.15.133:0/2904376333 >> 172.21.15.133:0/2904376333 conn(0x55ed1d8f34c0 msgr2=0x55ed1d9e3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.101+0000 7f47c7f22800 1 -- 172.21.15.133:0/2904376333 shutdown_connections 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.101+0000 7f47c7f22800 1 -- 172.21.15.133:0/2904376333 wait complete. 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.101+0000 7f47c7f22800 1 Processor -- start 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.101+0000 7f47c7f22800 1 -- start start 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.101+0000 7f47c7f22800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d9f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.102+0000 7f47c7f22800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1d7f4160 con 0x55ed1d8f7e60 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.102+0000 7f47c3c26640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d9f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.102+0000 7f47c3c26640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d9f0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46262/0 (socket says 172.21.15.133:46262) 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.102+0000 7f47c3c26640 1 -- 172.21.15.133:0/2826176305 learned_addr learned my addr 172.21.15.133:0/2826176305 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.102+0000 7f47c3c26640 1 -- 172.21.15.133:0/2826176305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b404e070 con 0x55ed1d8f7e60 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.102+0000 7f47c3c26640 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d9f0940 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f47b401ceb0 tx=0x7f47b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.102+0000 7f46abfff640 1 -- 172.21.15.133:0/2826176305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b406c070 con 0x55ed1d8f7e60 2024-02-15T22:57:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.102+0000 7f46abfff640 1 -- 172.21.15.133:0/2826176305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b405d480 con 0x55ed1d8f7e60 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.102+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ed1d9f0e80 con 0x55ed1d8f7e60 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.102+0000 7f46abfff640 1 -- 172.21.15.133:0/2826176305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b405d760 con 0x55ed1d8f7e60 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.103+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed1d9f13c0 con 0x55ed1d8f7e60 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.103+0000 7f47c7f22800 1 Processor -- start 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.103+0000 7f47c7f22800 1 -- start start 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.103+0000 7f46abfff640 1 -- 172.21.15.133:0/2826176305 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f47b4059040 con 0x55ed1d8f7e60 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.103+0000 7f47c7f22800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1d9e8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.103+0000 7f47c7f22800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1d796e80 con 0x55ed1d9e9b40 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.103+0000 7f46abfff640 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f46ac0367e0 0x7f46ac038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.104+0000 7f46abfff640 1 -- 172.21.15.133:0/2826176305 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f47b408d360 con 0x55ed1d8f7e60 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.104+0000 7f47c3c26640 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f46ac0367e0 0x7f46ac038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.104+0000 7f47c4427640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1d9e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.104+0000 7f47c4427640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1d9e8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46274/0 (socket says 172.21.15.133:46274) 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.104+0000 7f47c4427640 1 -- 172.21.15.133:0/2560754577 learned_addr learned my addr 172.21.15.133:0/2560754577 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.104+0000 7f47c4427640 1 -- 172.21.15.133:0/2560754577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed1d9e85d0 con 0x55ed1d9e9b40 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.104+0000 7f47c3c26640 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f46ac0367e0 0x7f46ac038ca0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005a60 tx=0x7f47b4052f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.104+0000 7f47c4427640 1 --2- 172.21.15.133:0/2560754577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1d9e8090 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00a430 tx=0x7f47bc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749680e43777ef63 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.104+0000 7f46a9ffb640 1 -- 172.21.15.133:0/2560754577 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47bc001650 con 0x55ed1d9e9b40 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.104+0000 7f46a9ffb640 1 -- 172.21.15.133:0/2560754577 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc0017d0 con 0x55ed1d9e9b40 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.104+0000 7f46a9ffb640 1 -- 172.21.15.133:0/2560754577 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47bc001ab0 con 0x55ed1d9e9b40 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c7f22800 1 -- 172.21.15.133:0/2560754577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 msgr2=0x55ed1d9e8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c7f22800 1 --2- 172.21.15.133:0/2560754577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1d9e8090 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00a430 tx=0x7f47bc00a8f0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c7f22800 1 -- 172.21.15.133:0/2560754577 shutdown_connections 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c7f22800 1 --2- 172.21.15.133:0/2560754577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1d9e8090 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c7f22800 1 -- 172.21.15.133:0/2560754577 >> 172.21.15.133:0/2560754577 conn(0x55ed1d8f90c0 msgr2=0x55ed1d9fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c7f22800 1 -- 172.21.15.133:0/2560754577 shutdown_connections 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c7f22800 1 -- 172.21.15.133:0/2560754577 wait complete. 2024-02-15T22:57:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c7f22800 1 Processor -- start 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c7f22800 1 -- start start 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c7f22800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1da06e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c7f22800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1d76c5d0 con 0x55ed1d9e9b40 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c4427640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1da06e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c4427640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1da06e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46290/0 (socket says 172.21.15.133:46290) 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.105+0000 7f47c4427640 1 -- 172.21.15.133:0/1466428736 learned_addr learned my addr 172.21.15.133:0/1466428736 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.106+0000 7f47c4427640 1 -- 172.21.15.133:0/1466428736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc00a0e0 con 0x55ed1d9e9b40 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.106+0000 7f47c4427640 1 --2- 172.21.15.133:0/1466428736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1da06e50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f47bc000f80 tx=0x7f47bc003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.106+0000 7f46a3fff640 1 -- 172.21.15.133:0/1466428736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47bc010a40 con 0x55ed1d9e9b40 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.106+0000 7f46a3fff640 1 -- 172.21.15.133:0/1466428736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc010ba0 con 0x55ed1d9e9b40 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.106+0000 7f47c7f22800 1 -- 172.21.15.133:0/1466428736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ed1da07390 con 0x55ed1d9e9b40 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.106+0000 7f46a3fff640 1 -- 172.21.15.133:0/1466428736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47bc010e80 con 0x55ed1d9e9b40 2024-02-15T22:57:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.106+0000 7f47c7f22800 1 -- 172.21.15.133:0/1466428736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed1da077f0 con 0x55ed1d9e9b40 2024-02-15T22:57:36.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.107+0000 7f46a3fff640 1 -- 172.21.15.133:0/1466428736 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f47bc017070 con 0x55ed1d9e9b40 2024-02-15T22:57:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.107+0000 7f46a3fff640 1 --2- 172.21.15.133:0/1466428736 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f469c0367e0 0x7f469c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.107+0000 7f47c7f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.107+0000 7f47c7f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.107+0000 7f46a3fff640 1 -- 172.21.15.133:0/1466428736 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f47bc04bd40 con 0x55ed1d9e9b40 2024-02-15T22:57:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.107+0000 7f47bb425640 1 --2- 172.21.15.133:0/1466428736 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f469c0367e0 0x7f469c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.108+0000 7f47c7f22800 1 Processor -- start 2024-02-15T22:57:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.108+0000 7f47c7f22800 1 -- start start 2024-02-15T22:57:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.108+0000 7f47c7f22800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1da212f0 0x55ed1da21710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.108+0000 7f47c7f22800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1da21c50 con 0x55ed1da212f0 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.108+0000 7f47bb425640 1 --2- 172.21.15.133:0/1466428736 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f469c0367e0 0x7f469c038ca0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55ed1d9f9c30 tx=0x7f47ac001320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.108+0000 7f47c3c26640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1da212f0 0x55ed1da21710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.108+0000 7f47c3c26640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1da212f0 0x55ed1da21710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46298/0 (socket says 172.21.15.133:46298) 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.108+0000 7f47c3c26640 1 -- 172.21.15.133:0/541376478 learned_addr learned my addr 172.21.15.133:0/541376478 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.108+0000 7f47c3c26640 1 -- 172.21.15.133:0/541376478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed1da21d90 con 0x55ed1da212f0 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.108+0000 7f47c3c26640 1 --2- 172.21.15.133:0/541376478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1da212f0 0x55ed1da21710 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f47b40784d0 tx=0x7f47b406f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.109+0000 7f4633fff640 1 -- 172.21.15.133:0/541376478 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b405cc30 con 0x55ed1da212f0 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.109+0000 7f4633fff640 1 -- 172.21.15.133:0/541376478 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b405c3e0 con 0x55ed1da212f0 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.109+0000 7f47c7f22800 1 -- 172.21.15.133:0/541376478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ed1da226c0 con 0x55ed1da212f0 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.109+0000 7f4633fff640 1 -- 172.21.15.133:0/541376478 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b408b260 con 0x55ed1da212f0 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.109+0000 7f47c7f22800 1 -- 172.21.15.133:0/541376478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed1da22b80 con 0x55ed1da212f0 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.109+0000 7f4633fff640 1 -- 172.21.15.133:0/541376478 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f47b408b3c0 con 0x55ed1da212f0 2024-02-15T22:57:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.109+0000 7f4633fff640 1 --2- 172.21.15.133:0/541376478 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f45fc0367e0 0x7f45fc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.110+0000 7f4633fff640 1 -- 172.21.15.133:0/541376478 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f47b4097bb0 con 0x55ed1da212f0 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.110+0000 7f47bb425640 1 --2- 172.21.15.133:0/541376478 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f45fc0367e0 0x7f45fc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.110+0000 7f4631ffb640 20 reqs_thread_entry: start 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.110+0000 7f47c7f22800 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ed1da2e3a0 0x55ed1da30790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.110+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ed1da30cd0 con 0x55ed1da2e3a0 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.110+0000 7f47bb425640 1 --2- 172.21.15.133:0/541376478 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f45fc0367e0 0x7f45fc038ca0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f47ac000f60 tx=0x7f47ac00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.110+0000 7f47c4427640 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ed1da2e3a0 0x55ed1da30790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.110+0000 7f47c4427640 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ed1da2e3a0 0x55ed1da30790 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.110+0000 7f47c4427640 1 -- 172.21.15.133:0/2826176305 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f47bc01b390 con 0x55ed1da2e3a0 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.111+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ed1da31130 con 0x55ed1da2e3a0 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.111+0000 7f47c4427640 1 -- 172.21.15.133:0/2826176305 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f47bc01b390 con 0x55ed1da2e3a0 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.111+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ed1da32680 con 0x55ed1da2e3a0 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.111+0000 7f47c4427640 1 -- 172.21.15.133:0/2826176305 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f47bc01b390 con 0x55ed1da2e3a0 2024-02-15T22:57:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/1466428736 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f469c0367e0 msgr2=0x7f469c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 --2- 172.21.15.133:0/1466428736 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f469c0367e0 0x7f469c038ca0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55ed1d9f9c30 tx=0x7f47ac001320 comp rx=0 tx=0).stop 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/1466428736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 msgr2=0x55ed1da06e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 --2- 172.21.15.133:0/1466428736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1da06e50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f47bc000f80 tx=0x7f47bc003370 comp rx=0 tx=0).stop 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/1466428736 shutdown_connections 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 --2- 172.21.15.133:0/1466428736 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f469c0367e0 0x7f469c038ca0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 --2- 172.21.15.133:0/1466428736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d9e9b40 0x55ed1da06e50 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/1466428736 >> 172.21.15.133:0/1466428736 conn(0x55ed1d8f90c0 msgr2=0x55ed1d9f7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/1466428736 shutdown_connections 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/1466428736 wait complete. 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/541376478 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f45fc0367e0 msgr2=0x7f45fc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 --2- 172.21.15.133:0/541376478 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f45fc0367e0 0x7f45fc038ca0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f47ac000f60 tx=0x7f47ac00f000 comp rx=0 tx=0).stop 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/541376478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1da212f0 msgr2=0x55ed1da21710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 --2- 172.21.15.133:0/541376478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1da212f0 0x55ed1da21710 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f47b40784d0 tx=0x7f47b406f900 comp rx=0 tx=0).stop 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/541376478 shutdown_connections 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 --2- 172.21.15.133:0/541376478 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f45fc0367e0 0x7f45fc038ca0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 --2- 172.21.15.133:0/541376478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1da212f0 0x55ed1da21710 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/541376478 >> 172.21.15.133:0/541376478 conn(0x55ed1da15f90 msgr2=0x55ed1da169a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/541376478 shutdown_connections 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/541376478 wait complete. 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.112+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ed1da2e3a0 msgr2=0x55ed1da30790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ed1da2e3a0 0x55ed1da30790 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f46ac0367e0 msgr2=0x7f46ac038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f46ac0367e0 0x7f46ac038ca0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005a60 tx=0x7f47b4052f70 comp rx=0 tx=0).stop 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 msgr2=0x55ed1d9f0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d9f0940 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f47b401ceb0 tx=0x7f47b4002fb0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 shutdown_connections 2024-02-15T22:57:36.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55ed1da2e3a0 0x55ed1da30790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f46ac0367e0 0x7f46ac038ca0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 --2- 172.21.15.133:0/2826176305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed1d8f7e60 0x55ed1d9f0940 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 >> 172.21.15.133:0/2826176305 conn(0x55ed1d8f34c0 msgr2=0x55ed1d9e2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 shutdown_connections 2024-02-15T22:57:36.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.113+0000 7f47c7f22800 1 -- 172.21.15.133:0/2826176305 wait complete. 2024-02-15T22:57:36.125 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"f2cd5859-7c57-45d7-89f3-01e23ceddfe0","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"b92e6ab7-703a-4505-95e4-c2a94e620f9c","zones":[{"id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2024-02-15T22:57:36.125 DEBUG:tasks.util.rgw: json result: {'id': 'f2cd5859-7c57-45d7-89f3-01e23ceddfe0', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c', 'zones': [{'id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['resharding']} 2024-02-15T22:57:36.125 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-15T22:57:36.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-15T22:57:36.126 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zonegroup default --placement-id default-placement --storage-class GLACIER 2024-02-15T22:57:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12cc52b800 1 Processor -- start 2024-02-15T22:57:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12cc52b800 1 -- start start 2024-02-15T22:57:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12cc52b800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5627536d5650 0x5627536d7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12cc52b800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56275361bbc0 con 0x5627536d1b40 2024-02-15T22:57:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12cc52b800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x5627535d3450 con 0x5627536d5650 2024-02-15T22:57:36.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12bf956640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5627536d5650 0x5627536d7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12bf956640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5627536d5650 0x5627536d7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46306/0 (socket says 172.21.15.133:46306) 2024-02-15T22:57:36.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12bf956640 1 -- 172.21.15.133:0/3966788136 learned_addr learned my addr 172.21.15.133:0/3966788136 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12c8157640 1 --1- 172.21.15.133:0/3966788136 >> v1:172.21.15.52:6789/0 conn(0x5627536d1b40 0x5627536d3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41752/0 (socket says 172.21.15.133:41752) 2024-02-15T22:57:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12bf956640 1 -- 172.21.15.133:0/3966788136 >> v1:172.21.15.52:6789/0 conn(0x5627536d1b40 legacy=0x5627536d3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12bf956640 1 -- 172.21.15.133:0/3966788136 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627536d8f90 con 0x5627536d5650 2024-02-15T22:57:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.210+0000 7f12c7956640 1 -- 172.21.15.133:0/3966788136 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172825533 0 0) 0x56275361bbc0 con 0x5627536d1b40 2024-02-15T22:57:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.212+0000 7f12bf956640 1 --2- 172.21.15.133:0/3966788136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d5650 0x5627536d7a40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f12b000a520 tx=0x7f12b001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904a5dec43918b6a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.212+0000 7f12c7956640 1 -- 172.21.15.133:0/3966788136 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12b0052570 con 0x5627536d5650 2024-02-15T22:57:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.213+0000 7f12c7956640 1 -- 172.21.15.133:0/3966788136 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b00526d0 con 0x5627536d5650 2024-02-15T22:57:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.213+0000 7f12c7956640 1 -- 172.21.15.133:0/3966788136 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12b0052990 con 0x5627536d5650 2024-02-15T22:57:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.213+0000 7f12cc52b800 1 -- 172.21.15.133:0/3966788136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d5650 msgr2=0x5627536d7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.213+0000 7f12cc52b800 1 --2- 172.21.15.133:0/3966788136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d5650 0x5627536d7a40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f12b000a520 tx=0x7f12b001cee0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.213+0000 7f12cc52b800 1 -- 172.21.15.133:0/3966788136 shutdown_connections 2024-02-15T22:57:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.213+0000 7f12cc52b800 1 --2- 172.21.15.133:0/3966788136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d5650 0x5627536d7a40 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.213+0000 7f12cc52b800 1 -- 172.21.15.133:0/3966788136 >> 172.21.15.133:0/3966788136 conn(0x5627536cb5b0 msgr2=0x5627536cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.213+0000 7f12cc52b800 1 -- 172.21.15.133:0/3966788136 shutdown_connections 2024-02-15T22:57:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.213+0000 7f12cc52b800 1 -- 172.21.15.133:0/3966788136 wait complete. 2024-02-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.225+0000 7f12cc52b800 1 Processor -- start 2024-02-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.225+0000 7f12cc52b800 1 -- start start 2024-02-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.225+0000 7f12cc52b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.225+0000 7f12cc52b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627535d0980 con 0x5627536d1b40 2024-02-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.225+0000 7f12c8157640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.225+0000 7f12c8157640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46312/0 (socket says 172.21.15.133:46312) 2024-02-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.225+0000 7f12c8157640 1 -- 172.21.15.133:0/1152925359 learned_addr learned my addr 172.21.15.133:0/1152925359 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.225+0000 7f12c8157640 1 -- 172.21.15.133:0/1152925359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b0005de0 con 0x5627536d1b40 2024-02-15T22:57:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.226+0000 7f12c8157640 1 --2- 172.21.15.133:0/1152925359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c0f10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f12b800b210 tx=0x7f12b800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af8c9e2fb3c621 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.226+0000 7f11b660c640 1 -- 172.21.15.133:0/1152925359 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12b8014070 con 0x5627536d1b40 2024-02-15T22:57:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.226+0000 7f11b660c640 1 -- 172.21.15.133:0/1152925359 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b800d500 con 0x5627536d1b40 2024-02-15T22:57:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.226+0000 7f11b660c640 1 -- 172.21.15.133:0/1152925359 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12b800d800 con 0x5627536d1b40 2024-02-15T22:57:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.226+0000 7f12cc52b800 1 -- 172.21.15.133:0/1152925359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 msgr2=0x5627537c0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.226+0000 7f12cc52b800 1 --2- 172.21.15.133:0/1152925359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c0f10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f12b800b210 tx=0x7f12b800b6d0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12cc52b800 1 -- 172.21.15.133:0/1152925359 shutdown_connections 2024-02-15T22:57:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12cc52b800 1 --2- 172.21.15.133:0/1152925359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c0f10 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12cc52b800 1 -- 172.21.15.133:0/1152925359 >> 172.21.15.133:0/1152925359 conn(0x5627536cb5b0 msgr2=0x5627537bc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12cc52b800 1 -- 172.21.15.133:0/1152925359 shutdown_connections 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12cc52b800 1 -- 172.21.15.133:0/1152925359 wait complete. 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12cc52b800 1 Processor -- start 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12cc52b800 1 -- start start 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12cc52b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12cc52b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627535cc160 con 0x5627536d1b40 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12c8157640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12c8157640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46314/0 (socket says 172.21.15.133:46314) 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.227+0000 7f12c8157640 1 -- 172.21.15.133:0/1809917931 learned_addr learned my addr 172.21.15.133:0/1809917931 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.228+0000 7f12c8157640 1 -- 172.21.15.133:0/1809917931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8001b70 con 0x5627536d1b40 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.228+0000 7f12c8157640 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c8690 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f12b800b210 tx=0x7f12b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.228+0000 7f11b4e09640 1 -- 172.21.15.133:0/1809917931 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12b800f950 con 0x5627536d1b40 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.228+0000 7f11b4e09640 1 -- 172.21.15.133:0/1809917931 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b8020070 con 0x5627536d1b40 2024-02-15T22:57:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.228+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627537c8bd0 con 0x5627536d1b40 2024-02-15T22:57:36.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.228+0000 7f11b4e09640 1 -- 172.21.15.133:0/1809917931 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12b800fc20 con 0x5627536d1b40 2024-02-15T22:57:36.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.228+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627537c90b0 con 0x5627536d1b40 2024-02-15T22:57:36.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f12cc52b800 1 Processor -- start 2024-02-15T22:57:36.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f12cc52b800 1 -- start start 2024-02-15T22:57:36.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f12cc52b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627537d5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f12cc52b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275356ee80 con 0x5627537d59d0 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f11b4e09640 1 -- 172.21.15.133:0/1809917931 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f12b800d040 con 0x5627536d1b40 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f11b4e09640 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11b0036790 0x7f11b0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f12c8958640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627537d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f12c8958640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627537d5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46330/0 (socket says 172.21.15.133:46330) 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f12c8958640 1 -- 172.21.15.133:0/2288665855 learned_addr learned my addr 172.21.15.133:0/2288665855 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f11b4e09640 1 -- 172.21.15.133:0/1809917931 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f12b800a040 con 0x5627536d1b40 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f12c8157640 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11b0036790 0x7f11b0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.229+0000 7f12c8958640 1 -- 172.21.15.133:0/2288665855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627537d6330 con 0x5627537d59d0 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f12c8157640 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11b0036790 0x7f11b0038c50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f12b800fdf0 tx=0x7f12b800fd80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f12c8958640 1 --2- 172.21.15.133:0/2288665855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627537d5df0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f12c000a430 tx=0x7f12c000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4698dfeaa5a224 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f11ae7fc640 1 -- 172.21.15.133:0/2288665855 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c0001650 con 0x5627537d59d0 2024-02-15T22:57:36.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f11ae7fc640 1 -- 172.21.15.133:0/2288665855 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c00017d0 con 0x5627537d59d0 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f11ae7fc640 1 -- 172.21.15.133:0/2288665855 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c0001ab0 con 0x5627537d59d0 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f12cc52b800 1 -- 172.21.15.133:0/2288665855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 msgr2=0x5627537d5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f12cc52b800 1 --2- 172.21.15.133:0/2288665855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627537d5df0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f12c000a430 tx=0x7f12c000a8f0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f12cc52b800 1 -- 172.21.15.133:0/2288665855 shutdown_connections 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f12cc52b800 1 --2- 172.21.15.133:0/2288665855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627537d5df0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f12cc52b800 1 -- 172.21.15.133:0/2288665855 >> 172.21.15.133:0/2288665855 conn(0x5627536d5650 msgr2=0x5627537d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f12cc52b800 1 -- 172.21.15.133:0/2288665855 shutdown_connections 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f12cc52b800 1 -- 172.21.15.133:0/2288665855 wait complete. 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.230+0000 7f12cc52b800 1 Processor -- start 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f12cc52b800 1 -- start start 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f12cc52b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627536d1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f12cc52b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627535445d0 con 0x5627537d59d0 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f12c8958640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627536d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f12c8958640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627536d1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46334/0 (socket says 172.21.15.133:46334) 2024-02-15T22:57:36.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f12c8958640 1 -- 172.21.15.133:0/446661523 learned_addr learned my addr 172.21.15.133:0/446661523 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f12c8958640 1 -- 172.21.15.133:0/446661523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c000a0e0 con 0x5627537d59d0 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f12c8958640 1 --2- 172.21.15.133:0/446661523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627536d1480 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f12c0013040 tx=0x7f12c0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f11acff9640 1 -- 172.21.15.133:0/446661523 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c0010b10 con 0x5627537d59d0 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f11acff9640 1 -- 172.21.15.133:0/446661523 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c0010c70 con 0x5627537d59d0 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f12cc52b800 1 -- 172.21.15.133:0/446661523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627536cfb70 con 0x5627537d59d0 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.231+0000 7f11acff9640 1 -- 172.21.15.133:0/446661523 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c001c400 con 0x5627537d59d0 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.232+0000 7f12cc52b800 1 -- 172.21.15.133:0/446661523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627536cffd0 con 0x5627537d59d0 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.232+0000 7f11acff9640 1 -- 172.21.15.133:0/446661523 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f12c0017070 con 0x5627537d59d0 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.232+0000 7f12cc52b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.232+0000 7f12cc52b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.232+0000 7f11acff9640 1 --2- 172.21.15.133:0/446661523 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11a00367e0 0x7f11a0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.233+0000 7f11acff9640 1 -- 172.21.15.133:0/446661523 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f12c004bdf0 con 0x5627537d59d0 2024-02-15T22:57:36.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.233+0000 7f12bf956640 1 --2- 172.21.15.133:0/446661523 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11a00367e0 0x7f11a0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.233+0000 7f12cc52b800 1 Processor -- start 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.233+0000 7f12cc52b800 1 -- start start 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.233+0000 7f12cc52b800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537f9010 0x5627537f9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.233+0000 7f12cc52b800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627537f9950 con 0x5627537f9010 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.233+0000 7f12bf956640 1 --2- 172.21.15.133:0/446661523 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11a00367e0 0x7f11a0038ca0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f12b0054000 tx=0x7f12b004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.233+0000 7f12c8157640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537f9010 0x5627537f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.233+0000 7f12c8157640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537f9010 0x5627537f9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46338/0 (socket says 172.21.15.133:46338) 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.233+0000 7f12c8157640 1 -- 172.21.15.133:0/425397926 learned_addr learned my addr 172.21.15.133:0/425397926 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.233+0000 7f12c8157640 1 -- 172.21.15.133:0/425397926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627537f9a90 con 0x5627537f9010 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.234+0000 7f12c8157640 1 --2- 172.21.15.133:0/425397926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537f9010 0x5627537f9410 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f12b80017b0 tx=0x7f12b8019f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.234+0000 7f118cfe1640 1 -- 172.21.15.133:0/425397926 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12b8036070 con 0x5627537f9010 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.234+0000 7f118cfe1640 1 -- 172.21.15.133:0/425397926 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b8041070 con 0x5627537f9010 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.234+0000 7f12cc52b800 1 -- 172.21.15.133:0/425397926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627537fa3e0 con 0x5627537f9010 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.234+0000 7f118cfe1640 1 -- 172.21.15.133:0/425397926 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12b801c660 con 0x5627537f9010 2024-02-15T22:57:36.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.234+0000 7f12cc52b800 1 -- 172.21.15.133:0/425397926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627537fa8a0 con 0x5627537f9010 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.235+0000 7f118cfe1640 1 -- 172.21.15.133:0/425397926 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f12b8018b60 con 0x5627537f9010 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.235+0000 7f118cfe1640 1 --2- 172.21.15.133:0/425397926 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1100036790 0x7f1100038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.235+0000 7f118cfe1640 1 -- 172.21.15.133:0/425397926 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f12b8048be0 con 0x5627537f9010 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.235+0000 7f12bf956640 1 --2- 172.21.15.133:0/425397926 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1100036790 0x7f1100038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.235+0000 7f11267fc640 20 reqs_thread_entry: start 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.235+0000 7f12bf956640 1 --2- 172.21.15.133:0/425397926 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1100036790 0x7f1100038c50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f12b001cf20 tx=0x7f12b0005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.235+0000 7f12cc52b800 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5627538060c0 0x5627538084b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.235+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562753808a30 con 0x5627538060c0 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.235+0000 7f12c8958640 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5627538060c0 0x5627538084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.236+0000 7f12c8958640 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5627538060c0 0x5627538084b0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.236+0000 7f12c8958640 1 -- 172.21.15.133:0/1809917931 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f12c001c930 con 0x5627538060c0 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.236+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56275380a240 con 0x5627538060c0 2024-02-15T22:57:36.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.236+0000 7f12c8958640 1 -- 172.21.15.133:0/1809917931 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f12c001c930 con 0x5627538060c0 2024-02-15T22:57:36.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.236+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~421 in=421b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56275380eb30 con 0x5627538060c0 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.238+0000 7f12c8958640 1 -- 172.21.15.133:0/1809917931 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [stat,call,call,writefull 0~421] v32'2 uv2 ondisk = 0) v8 ==== 321+0+0 (crc 0 0 0) 0x7f12c001c930 con 0x5627538060c0 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/446661523 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11a00367e0 msgr2=0x7f11a0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 --2- 172.21.15.133:0/446661523 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11a00367e0 0x7f11a0038ca0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f12b0054000 tx=0x7f12b004e000 comp rx=0 tx=0).stop 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/446661523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 msgr2=0x5627536d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 --2- 172.21.15.133:0/446661523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627536d1480 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f12c0013040 tx=0x7f12c0003370 comp rx=0 tx=0).stop 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/446661523 shutdown_connections 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 --2- 172.21.15.133:0/446661523 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11a00367e0 0x7f11a0038ca0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 --2- 172.21.15.133:0/446661523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537d59d0 0x5627536d1480 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/446661523 >> 172.21.15.133:0/446661523 conn(0x5627536d5650 msgr2=0x5627537cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/446661523 shutdown_connections 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/446661523 wait complete. 2024-02-15T22:57:36.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/425397926 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1100036790 msgr2=0x7f1100038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 --2- 172.21.15.133:0/425397926 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1100036790 0x7f1100038c50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f12b001cf20 tx=0x7f12b0005ac0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/425397926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537f9010 msgr2=0x5627537f9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 --2- 172.21.15.133:0/425397926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537f9010 0x5627537f9410 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f12b80017b0 tx=0x7f12b8019f80 comp rx=0 tx=0).stop 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/425397926 shutdown_connections 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 --2- 172.21.15.133:0/425397926 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1100036790 0x7f1100038c50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 --2- 172.21.15.133:0/425397926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627537f9010 0x5627537f9410 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/425397926 >> 172.21.15.133:0/425397926 conn(0x5627537edc90 msgr2=0x5627537ee6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/425397926 shutdown_connections 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/425397926 wait complete. 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5627538060c0 msgr2=0x5627538084b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5627538060c0 0x5627538084b0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11b0036790 msgr2=0x7f11b0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11b0036790 0x7f11b0038c50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f12b800fdf0 tx=0x7f12b800fd80 comp rx=0 tx=0).stop 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 msgr2=0x5627537c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c8690 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f12b800b210 tx=0x7f12b8000ed0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.239+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 shutdown_connections 2024-02-15T22:57:36.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.240+0000 7f12cc52b800 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5627538060c0 0x5627538084b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.240+0000 7f12cc52b800 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f11b0036790 0x7f11b0038c50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.240+0000 7f12cc52b800 1 --2- 172.21.15.133:0/1809917931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627536d1b40 0x5627537c8690 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.240+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 >> 172.21.15.133:0/1809917931 conn(0x5627536cb5b0 msgr2=0x5627537bb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.240+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 shutdown_connections 2024-02-15T22:57:36.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.240+0000 7f12cc52b800 1 -- 172.21.15.133:0/1809917931 wait complete. 2024-02-15T22:57:36.250 INFO:teuthology.orchestra.run.smithi133.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["GLACIER","STANDARD"]}}] 2024-02-15T22:57:36.250 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['GLACIER', 'STANDARD']}}] 2024-02-15T22:57:36.250 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-15T22:57:36.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-15T22:57:36.251 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class GLACIER --data-pool .rgw.buckets.2 2024-02-15T22:57:36.299 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:36.299 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:36.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.297+0000 7f77b628c800 1 Processor -- start 2024-02-15T22:57:36.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.297+0000 7f77b628c800 1 -- start start 2024-02-15T22:57:36.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.297+0000 7f77b628c800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55be4e153350 0x55be4e155810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.297+0000 7f77b628c800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55be4e099bd0 con 0x55be4e0c2240 2024-02-15T22:57:36.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.297+0000 7f77b628c800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55be4e051450 con 0x55be4e153350 2024-02-15T22:57:36.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.298+0000 7f77ab58a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55be4e153350 0x55be4e155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.298+0000 7f77b3d8b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55be4e0c2240 0x55be4e151c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41762/0 (socket says 172.21.15.133:41762) 2024-02-15T22:57:36.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.298+0000 7f77b3d8b640 1 -- 172.21.15.133:0/1107954370 learned_addr learned my addr 172.21.15.133:0/1107954370 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-02-15T22:57:36.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.298+0000 7f77ab58a640 1 -- 172.21.15.133:0/1107954370 >> v1:172.21.15.52:6789/0 conn(0x55be4e0c2240 legacy=0x55be4e151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.298+0000 7f77b358a640 1 -- 172.21.15.133:0/1107954370 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586638881 0 0) 0x55be4e099bd0 con 0x55be4e0c2240 2024-02-15T22:57:36.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.298+0000 7f77ab58a640 1 -- 172.21.15.133:0/1107954370 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4e156f20 con 0x55be4e153350 2024-02-15T22:57:36.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.300+0000 7f77ab58a640 1 --2- 172.21.15.133:0/1107954370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e153350 0x55be4e155810 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f779c00a470 tx=0x7f779c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edf5abfb800dcd2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.300+0000 7f77b358a640 1 -- 172.21.15.133:0/1107954370 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f779c052570 con 0x55be4e153350 2024-02-15T22:57:36.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.300+0000 7f77b358a640 1 -- 172.21.15.133:0/1107954370 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c0526d0 con 0x55be4e153350 2024-02-15T22:57:36.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.300+0000 7f77b358a640 1 -- 172.21.15.133:0/1107954370 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f779c052990 con 0x55be4e153350 2024-02-15T22:57:36.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.300+0000 7f77b628c800 1 -- 172.21.15.133:0/1107954370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e153350 msgr2=0x55be4e155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.300+0000 7f77b628c800 1 --2- 172.21.15.133:0/1107954370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e153350 0x55be4e155810 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f779c00a470 tx=0x7f779c01cd60 comp rx=0 tx=0).stop 2024-02-15T22:57:36.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.301+0000 7f77b628c800 1 -- 172.21.15.133:0/1107954370 shutdown_connections 2024-02-15T22:57:36.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.301+0000 7f77b628c800 1 --2- 172.21.15.133:0/1107954370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e153350 0x55be4e155810 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.301+0000 7f77b628c800 1 -- 172.21.15.133:0/1107954370 >> 172.21.15.133:0/1107954370 conn(0x55be4e1495c0 msgr2=0x55be4e14b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.301+0000 7f77b628c800 1 -- 172.21.15.133:0/1107954370 shutdown_connections 2024-02-15T22:57:36.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.301+0000 7f77b628c800 1 -- 172.21.15.133:0/1107954370 wait complete. 2024-02-15T22:57:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.312+0000 7f77b628c800 1 Processor -- start 2024-02-15T22:57:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.312+0000 7f77b628c800 1 -- start start 2024-02-15T22:57:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.312+0000 7f77b628c800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e23ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.312+0000 7f77b628c800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4e04e980 con 0x55be4e0c2240 2024-02-15T22:57:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.313+0000 7f77b3d8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e23ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.313+0000 7f77b3d8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e23ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46360/0 (socket says 172.21.15.133:46360) 2024-02-15T22:57:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.313+0000 7f77b3d8b640 1 -- 172.21.15.133:0/4173029850 learned_addr learned my addr 172.21.15.133:0/4173029850 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.313+0000 7f77b3d8b640 1 -- 172.21.15.133:0/4173029850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c005d20 con 0x55be4e0c2240 2024-02-15T22:57:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.313+0000 7f77b3d8b640 1 --2- 172.21.15.133:0/4173029850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e23ef00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f77a400b210 tx=0x7f77a400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be710e50e70466f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.313+0000 7f76a1e0b640 1 -- 172.21.15.133:0/4173029850 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77a4014070 con 0x55be4e0c2240 2024-02-15T22:57:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.313+0000 7f76a1e0b640 1 -- 172.21.15.133:0/4173029850 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a400d500 con 0x55be4e0c2240 2024-02-15T22:57:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.313+0000 7f76a1e0b640 1 -- 172.21.15.133:0/4173029850 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77a400d800 con 0x55be4e0c2240 2024-02-15T22:57:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.314+0000 7f77b628c800 1 -- 172.21.15.133:0/4173029850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 msgr2=0x55be4e23ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.314+0000 7f77b628c800 1 --2- 172.21.15.133:0/4173029850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e23ef00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f77a400b210 tx=0x7f77a400b6d0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.314+0000 7f77b628c800 1 -- 172.21.15.133:0/4173029850 shutdown_connections 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.314+0000 7f77b628c800 1 --2- 172.21.15.133:0/4173029850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e23ef00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.314+0000 7f77b628c800 1 -- 172.21.15.133:0/4173029850 >> 172.21.15.133:0/4173029850 conn(0x55be4e1495c0 msgr2=0x55be4e23a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.314+0000 7f77b628c800 1 -- 172.21.15.133:0/4173029850 shutdown_connections 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.314+0000 7f77b628c800 1 -- 172.21.15.133:0/4173029850 wait complete. 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.314+0000 7f77b628c800 1 Processor -- start 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.314+0000 7f77b628c800 1 -- start start 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.314+0000 7f77b628c800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.314+0000 7f77b628c800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4e04a160 con 0x55be4e0c2240 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.315+0000 7f77b3d8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.315+0000 7f77b3d8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e14f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46376/0 (socket says 172.21.15.133:46376) 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.315+0000 7f77b3d8b640 1 -- 172.21.15.133:0/641545954 learned_addr learned my addr 172.21.15.133:0/641545954 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.315+0000 7f77b3d8b640 1 -- 172.21.15.133:0/641545954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4001b70 con 0x55be4e0c2240 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.315+0000 7f77b3d8b640 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e14f530 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f77a4001e60 tx=0x7f77a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.315+0000 7f769bfff640 1 -- 172.21.15.133:0/641545954 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77a401c890 con 0x55be4e0c2240 2024-02-15T22:57:36.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.315+0000 7f769bfff640 1 -- 172.21.15.133:0/641545954 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a4020070 con 0x55be4e0c2240 2024-02-15T22:57:36.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.315+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be4e14dc20 con 0x55be4e0c2240 2024-02-15T22:57:36.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.315+0000 7f769bfff640 1 -- 172.21.15.133:0/641545954 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77a401cb20 con 0x55be4e0c2240 2024-02-15T22:57:36.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.316+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be4e14e0a0 con 0x55be4e0c2240 2024-02-15T22:57:36.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.316+0000 7f77b628c800 1 Processor -- start 2024-02-15T22:57:36.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.316+0000 7f77b628c800 1 -- start start 2024-02-15T22:57:36.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.316+0000 7f769bfff640 1 -- 172.21.15.133:0/641545954 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f77a400d040 con 0x55be4e0c2240 2024-02-15T22:57:36.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.316+0000 7f77b628c800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e255f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.316+0000 7f77b628c800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4dfece80 con 0x55be4e255b40 2024-02-15T22:57:36.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f769bfff640 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f769c036790 0x7f769c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f769bfff640 1 -- 172.21.15.133:0/641545954 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f77a400a040 con 0x55be4e0c2240 2024-02-15T22:57:36.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f77b458c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e255f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f77b458c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e255f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46378/0 (socket says 172.21.15.133:46378) 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f77b458c640 1 -- 172.21.15.133:0/3739752654 learned_addr learned my addr 172.21.15.133:0/3739752654 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f77b3d8b640 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f769c036790 0x7f769c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f77b458c640 1 -- 172.21.15.133:0/3739752654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4e2564a0 con 0x55be4e255b40 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f77b3d8b640 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f769c036790 0x7f769c038c50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f77a401afd0 tx=0x7f77a4034040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f77b458c640 1 --2- 172.21.15.133:0/3739752654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e255f60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00a430 tx=0x7f77ac00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92788cd306eb0fc7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f7699ffb640 1 -- 172.21.15.133:0/3739752654 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac001650 con 0x55be4e255b40 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f7699ffb640 1 -- 172.21.15.133:0/3739752654 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac0017d0 con 0x55be4e255b40 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.317+0000 7f7699ffb640 1 -- 172.21.15.133:0/3739752654 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac001ab0 con 0x55be4e255b40 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b628c800 1 -- 172.21.15.133:0/3739752654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 msgr2=0x55be4e255f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b628c800 1 --2- 172.21.15.133:0/3739752654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e255f60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00a430 tx=0x7f77ac00a8f0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b628c800 1 -- 172.21.15.133:0/3739752654 shutdown_connections 2024-02-15T22:57:36.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b628c800 1 --2- 172.21.15.133:0/3739752654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e255f60 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b628c800 1 -- 172.21.15.133:0/3739752654 >> 172.21.15.133:0/3739752654 conn(0x55be4e153350 msgr2=0x55be4e2525e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b628c800 1 -- 172.21.15.133:0/3739752654 shutdown_connections 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b628c800 1 -- 172.21.15.133:0/3739752654 wait complete. 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b628c800 1 Processor -- start 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b628c800 1 -- start start 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b628c800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e25cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b628c800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4dfc25d0 con 0x55be4e255b40 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b458c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e25cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b458c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e25cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46384/0 (socket says 172.21.15.133:46384) 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.318+0000 7f77b458c640 1 -- 172.21.15.133:0/1771795630 learned_addr learned my addr 172.21.15.133:0/1771795630 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.319+0000 7f77b458c640 1 -- 172.21.15.133:0/1771795630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac00a0e0 con 0x55be4e255b40 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.319+0000 7f77b458c640 1 --2- 172.21.15.133:0/1771795630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e25cad0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f77ac013040 tx=0x7f77ac003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.319+0000 7f7693fff640 1 -- 172.21.15.133:0/1771795630 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac010b10 con 0x55be4e255b40 2024-02-15T22:57:36.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.319+0000 7f7693fff640 1 -- 172.21.15.133:0/1771795630 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac010c70 con 0x55be4e255b40 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.319+0000 7f77b628c800 1 -- 172.21.15.133:0/1771795630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be4e25d010 con 0x55be4e255b40 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.319+0000 7f7693fff640 1 -- 172.21.15.133:0/1771795630 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac01c400 con 0x55be4e255b40 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.319+0000 7f77b628c800 1 -- 172.21.15.133:0/1771795630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be4e25d470 con 0x55be4e255b40 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.320+0000 7f7693fff640 1 -- 172.21.15.133:0/1771795630 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f77ac017070 con 0x55be4e255b40 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.320+0000 7f7693fff640 1 --2- 172.21.15.133:0/1771795630 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f768c036790 0x7f768c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.320+0000 7f77b628c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.320+0000 7f77b628c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.320+0000 7f7693fff640 1 -- 172.21.15.133:0/1771795630 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f77ac04bf00 con 0x55be4e255b40 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.320+0000 7f77ab58a640 1 --2- 172.21.15.133:0/1771795630 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f768c036790 0x7f768c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.320+0000 7f77b628c800 1 Processor -- start 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.321+0000 7f77b628c800 1 -- start start 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.321+0000 7f77ab58a640 1 --2- 172.21.15.133:0/1771795630 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f768c036790 0x7f768c038c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f779c054000 tx=0x7f779c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.321+0000 7f77b628c800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e276ff0 0x55be4e277410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.321+0000 7f77b628c800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4e277950 con 0x55be4e276ff0 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.321+0000 7f77b3d8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e276ff0 0x55be4e277410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.321+0000 7f77b3d8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e276ff0 0x55be4e277410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46394/0 (socket says 172.21.15.133:46394) 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.321+0000 7f77b3d8b640 1 -- 172.21.15.133:0/722134225 learned_addr learned my addr 172.21.15.133:0/722134225 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.321+0000 7f77b3d8b640 1 -- 172.21.15.133:0/722134225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4e277a90 con 0x55be4e276ff0 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.321+0000 7f77b3d8b640 1 --2- 172.21.15.133:0/722134225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e276ff0 0x55be4e277410 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f77a404aa10 tx=0x7f77a404bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.322+0000 7f7603fff640 1 -- 172.21.15.133:0/722134225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77a4019920 con 0x55be4e276ff0 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.322+0000 7f7603fff640 1 -- 172.21.15.133:0/722134225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a401a3c0 con 0x55be4e276ff0 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.322+0000 7f77b628c800 1 -- 172.21.15.133:0/722134225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be4e2783c0 con 0x55be4e276ff0 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.322+0000 7f7603fff640 1 -- 172.21.15.133:0/722134225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77a401bc60 con 0x55be4e276ff0 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.322+0000 7f77b628c800 1 -- 172.21.15.133:0/722134225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be4e278880 con 0x55be4e276ff0 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.322+0000 7f7603fff640 1 -- 172.21.15.133:0/722134225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f77a404c6c0 con 0x55be4e276ff0 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.323+0000 7f7603fff640 1 --2- 172.21.15.133:0/722134225 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f75ec036790 0x7f75ec038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.323+0000 7f7603fff640 1 -- 172.21.15.133:0/722134225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f77a4014070 con 0x55be4e276ff0 2024-02-15T22:57:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.323+0000 7f77ab58a640 1 --2- 172.21.15.133:0/722134225 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f75ec036790 0x7f75ec038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.323+0000 7f7601ffb640 20 reqs_thread_entry: start 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.323+0000 7f77ab58a640 1 --2- 172.21.15.133:0/722134225 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f75ec036790 0x7f75ec038c50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f779c000c00 tx=0x7f779c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.323+0000 7f77b628c800 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be4e2840a0 0x55be4e286490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.323+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be4e286a30 con 0x55be4e2840a0 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.323+0000 7f77b458c640 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be4e2840a0 0x55be4e286490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.323+0000 7f77b458c640 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be4e2840a0 0x55be4e286490 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.324+0000 7f77b458c640 1 -- 172.21.15.133:0/641545954 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f77ac01c9f0 con 0x55be4e2840a0 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.324+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be4e288240 con 0x55be4e2840a0 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.324+0000 7f77b458c640 1 -- 172.21.15.133:0/641545954 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~875 out=875b] v0'0 uv7 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f77ac01c9f0 con 0x55be4e2840a0 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.324+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be4e287490 con 0x55be4e2840a0 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.324+0000 7f77b458c640 1 -- 172.21.15.133:0/641545954 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f77ac01c9f0 con 0x55be4e2840a0 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.324+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be4e287840 con 0x55be4e2840a0 2024-02-15T22:57:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.325+0000 7f77b458c640 1 -- 172.21.15.133:0/641545954 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f77ac01c9f0 con 0x55be4e2840a0 2024-02-15T22:57:36.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.325+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be4e287c50 con 0x55be4e2840a0 2024-02-15T22:57:36.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.325+0000 7f77b458c640 1 -- 172.21.15.133:0/641545954 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7f77ac01c9f0 con 0x55be4e2840a0 2024-02-15T22:57:36.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.325+0000 7f77b628c800 1 -- 172.21.15.133:0/1771795630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55be4e283410 con 0x55be4e255b40 2024-02-15T22:57:36.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.325+0000 7f7693fff640 1 -- 172.21.15.133:0/1771795630 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77ac04a460 con 0x55be4e255b40 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.325+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:6 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~922 in=922b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55be4e28ddc0 con 0x55be4e2840a0 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.327+0000 7f77b458c640 1 -- 172.21.15.133:0/641545954 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(6 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [stat,call,call,writefull 0~922] v32'8 uv8 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f77ac01c9f0 con 0x55be4e2840a0 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.327+0000 7f77b628c800 1 -- 172.21.15.133:0/1771795630 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f768c036790 msgr2=0x7f768c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.327+0000 7f77b628c800 1 --2- 172.21.15.133:0/1771795630 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f768c036790 0x7f768c038c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f779c054000 tx=0x7f779c04e000 comp rx=0 tx=0).stop 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.327+0000 7f77b628c800 1 -- 172.21.15.133:0/1771795630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 msgr2=0x55be4e25cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.327+0000 7f77b628c800 1 --2- 172.21.15.133:0/1771795630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e25cad0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f77ac013040 tx=0x7f77ac003370 comp rx=0 tx=0).stop 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.327+0000 7f77b628c800 1 -- 172.21.15.133:0/1771795630 shutdown_connections 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.327+0000 7f77b628c800 1 --2- 172.21.15.133:0/1771795630 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f768c036790 0x7f768c038c50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.327+0000 7f77b628c800 1 --2- 172.21.15.133:0/1771795630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e255b40 0x55be4e25cad0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.327+0000 7f77b628c800 1 -- 172.21.15.133:0/1771795630 >> 172.21.15.133:0/1771795630 conn(0x55be4e153350 msgr2=0x55be4e24fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/1771795630 shutdown_connections 2024-02-15T22:57:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/1771795630 wait complete. 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/722134225 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f75ec036790 msgr2=0x7f75ec038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 --2- 172.21.15.133:0/722134225 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f75ec036790 0x7f75ec038c50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f779c000c00 tx=0x7f779c005a00 comp rx=0 tx=0).stop 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/722134225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e276ff0 msgr2=0x55be4e277410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 --2- 172.21.15.133:0/722134225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e276ff0 0x55be4e277410 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f77a404aa10 tx=0x7f77a404bf30 comp rx=0 tx=0).stop 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/722134225 shutdown_connections 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 --2- 172.21.15.133:0/722134225 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f75ec036790 0x7f75ec038c50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 --2- 172.21.15.133:0/722134225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e276ff0 0x55be4e277410 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/722134225 >> 172.21.15.133:0/722134225 conn(0x55be4e26bc40 msgr2=0x55be4e26c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/722134225 shutdown_connections 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/722134225 wait complete. 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be4e2840a0 msgr2=0x55be4e286490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be4e2840a0 0x55be4e286490 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f769c036790 msgr2=0x7f769c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f769c036790 0x7f769c038c50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f77a401afd0 tx=0x7f77a4034040 comp rx=0 tx=0).stop 2024-02-15T22:57:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 msgr2=0x55be4e14f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e14f530 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f77a4001e60 tx=0x7f77a4000ed0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 shutdown_connections 2024-02-15T22:57:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x55be4e2840a0 0x55be4e286490 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f769c036790 0x7f769c038c50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 --2- 172.21.15.133:0/641545954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be4e0c2240 0x55be4e14f530 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 >> 172.21.15.133:0/641545954 conn(0x55be4e1495c0 msgr2=0x55be4e2390e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 shutdown_connections 2024-02-15T22:57:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:36.328+0000 7f77b628c800 1 -- 172.21.15.133:0/641545954 wait complete. 2024-02-15T22:57:36.339 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"b92e6ab7-703a-4505-95e4-c2a94e620f9c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"GLACIER":{"data_pool":".rgw.buckets.2"},"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-15T22:57:36.339 DEBUG:tasks.util.rgw: json result: {'id': 'b92e6ab7-703a-4505-95e4-c2a94e620f9c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'GLACIER': {'data_pool': '.rgw.buckets.2'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-15T22:57:36.342 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000841df1718337325e-0065ce96e0-4222-default4222-default-default 2024-02-15T22:57:36.634 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=005f6a929c6447bf94f77b8b4cf3deaa Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000841df1718337325e-0065ce96e0-4222-default4222-default-default 2024-02-15T22:57:36.636 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-02-15T22:57:36.646 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-02-15T22:57:36.647 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T22:57:36.650 INFO:tasks.rgw.client.0.smithi133.stdout:2024-02-15T22:57:36.645+0000 7f3b62785640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 36967) UID: 0 2024-02-15T22:57:36.650 INFO:tasks.rgw.client.0.smithi133.stdout:2024-02-15T22:57:36.645+0000 7f3b65fde880 -1 shutting down 2024-02-15T22:57:42.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-02-15T22:57:42.748 INFO:tasks.rgw.client.0:Stopped 2024-02-15T22:57:42.749 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-02-15T22:57:42.767 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /etc/ceph/vault-root-token 2024-02-15T22:57:42.838 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-02-15T22:57:42.907 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-02-15T22:57:42.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-02-15T22:57:42.908 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-02-15T22:57:42.992 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-02-15T22:57:42.992 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-02-15T22:57:42.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.990+0000 7ff63b72f800 1 Processor -- start 2024-02-15T22:57:42.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.990+0000 7ff63b72f800 1 -- start start 2024-02-15T22:57:42.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.990+0000 7ff63b72f800 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556485316e70 0x556485317290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:42.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.990+0000 7ff63b72f800 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556485262bb0 con 0x5564853180d0 2024-02-15T22:57:42.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.990+0000 7ff63b72f800 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x55648521a450 con 0x556485316e70 2024-02-15T22:57:42.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.991+0000 7ff6373b3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556485316e70 0x556485317290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:42.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.991+0000 7ff6373b3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556485316e70 0x556485317290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46408/0 (socket says 172.21.15.133:46408) 2024-02-15T22:57:42.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.991+0000 7ff6373b3640 1 -- 172.21.15.133:0/2744864311 learned_addr learned my addr 172.21.15.133:0/2744864311 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:42.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.991+0000 7ff636bb2640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5564853180d0 0x556485318550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.133:41764/0 (socket says 172.21.15.133:41764) 2024-02-15T22:57:42.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.991+0000 7ff6373b3640 1 -- 172.21.15.133:0/2744864311 >> v1:172.21.15.52:6789/0 conn(0x5564853180d0 legacy=0x556485318550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:42.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.991+0000 7ff6373b3640 1 -- 172.21.15.133:0/2744864311 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556485317960 con 0x556485316e70 2024-02-15T22:57:42.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.993+0000 7ff6373b3640 1 --2- 172.21.15.133:0/2744864311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x556485317290 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff628005fd0 tx=0x7ff62801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37ca24389132d7e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:42.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.993+0000 7ff6363b1640 1 -- 172.21.15.133:0/2744864311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff628052540 con 0x556485316e70 2024-02-15T22:57:42.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.993+0000 7ff6363b1640 1 -- 172.21.15.133:0/2744864311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6280526a0 con 0x556485316e70 2024-02-15T22:57:42.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.993+0000 7ff6363b1640 1 -- 172.21.15.133:0/2744864311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6280529c0 con 0x556485316e70 2024-02-15T22:57:42.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.994+0000 7ff63b72f800 1 -- 172.21.15.133:0/2744864311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 msgr2=0x556485317290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:42.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.994+0000 7ff63b72f800 1 --2- 172.21.15.133:0/2744864311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x556485317290 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff628005fd0 tx=0x7ff62801cc50 comp rx=0 tx=0).stop 2024-02-15T22:57:42.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.994+0000 7ff63b72f800 1 -- 172.21.15.133:0/2744864311 shutdown_connections 2024-02-15T22:57:42.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.994+0000 7ff63b72f800 1 --2- 172.21.15.133:0/2744864311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x556485317290 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:42.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.994+0000 7ff63b72f800 1 -- 172.21.15.133:0/2744864311 >> 172.21.15.133:0/2744864311 conn(0x5564853124d0 msgr2=0x5564853148f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:42.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.994+0000 7ff63b72f800 1 -- 172.21.15.133:0/2744864311 shutdown_connections 2024-02-15T22:57:42.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:42.994+0000 7ff63b72f800 1 -- 172.21.15.133:0/2744864311 wait complete. 2024-02-15T22:57:43.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.006+0000 7ff63b72f800 1 Processor -- start 2024-02-15T22:57:43.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.006+0000 7ff63b72f800 1 -- start start 2024-02-15T22:57:43.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.006+0000 7ff63b72f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x556485407220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.006+0000 7ff63b72f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556485217980 con 0x556485316e70 2024-02-15T22:57:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.007+0000 7ff6373b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x556485407220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.007+0000 7ff6373b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x556485407220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46418/0 (socket says 172.21.15.133:46418) 2024-02-15T22:57:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.007+0000 7ff6373b3640 1 -- 172.21.15.133:0/3781123976 learned_addr learned my addr 172.21.15.133:0/3781123976 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:43.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.007+0000 7ff6373b3640 1 -- 172.21.15.133:0/3781123976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62800a1c0 con 0x556485316e70 2024-02-15T22:57:43.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.007+0000 7ff6373b3640 1 --2- 172.21.15.133:0/3781123976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x556485407220 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff628007000 tx=0x7ff62804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596b52284411db87 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.008+0000 7ff52560a640 1 -- 172.21.15.133:0/3781123976 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff628061070 con 0x556485316e70 2024-02-15T22:57:43.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.008+0000 7ff52560a640 1 -- 172.21.15.133:0/3781123976 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff628052a00 con 0x556485316e70 2024-02-15T22:57:43.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.008+0000 7ff52560a640 1 -- 172.21.15.133:0/3781123976 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff628052cc0 con 0x556485316e70 2024-02-15T22:57:43.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.008+0000 7ff63b72f800 1 -- 172.21.15.133:0/3781123976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 msgr2=0x556485407220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.008+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3781123976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x556485407220 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff628007000 tx=0x7ff62804c000 comp rx=0 tx=0).stop 2024-02-15T22:57:43.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.008+0000 7ff63b72f800 1 -- 172.21.15.133:0/3781123976 shutdown_connections 2024-02-15T22:57:43.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.008+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3781123976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x556485407220 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.008+0000 7ff63b72f800 1 -- 172.21.15.133:0/3781123976 >> 172.21.15.133:0/3781123976 conn(0x5564853124d0 msgr2=0x556485402b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:43.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.008+0000 7ff63b72f800 1 -- 172.21.15.133:0/3781123976 shutdown_connections 2024-02-15T22:57:43.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.008+0000 7ff63b72f800 1 -- 172.21.15.133:0/3781123976 wait complete. 2024-02-15T22:57:43.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.009+0000 7ff63b72f800 1 Processor -- start 2024-02-15T22:57:43.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.009+0000 7ff63b72f800 1 -- start start 2024-02-15T22:57:43.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.009+0000 7ff63b72f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x55648540e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.009+0000 7ff63b72f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556485213160 con 0x556485316e70 2024-02-15T22:57:43.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.009+0000 7ff6373b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x55648540e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.009+0000 7ff6373b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x55648540e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46432/0 (socket says 172.21.15.133:46432) 2024-02-15T22:57:43.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.009+0000 7ff6373b3640 1 -- 172.21.15.133:0/3936738130 learned_addr learned my addr 172.21.15.133:0/3936738130 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:43.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.009+0000 7ff6373b3640 1 -- 172.21.15.133:0/3936738130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55648540ed90 con 0x556485316e70 2024-02-15T22:57:43.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.009+0000 7ff6373b3640 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x55648540e850 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff62805f040 tx=0x7ff628003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.010+0000 7ff523e07640 1 -- 172.21.15.133:0/3936738130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff628061040 con 0x556485316e70 2024-02-15T22:57:43.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.010+0000 7ff523e07640 1 -- 172.21.15.133:0/3936738130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62805d760 con 0x556485316e70 2024-02-15T22:57:43.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.010+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55648540efe0 con 0x556485316e70 2024-02-15T22:57:43.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.010+0000 7ff523e07640 1 -- 172.21.15.133:0/3936738130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff62805da40 con 0x556485316e70 2024-02-15T22:57:43.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.010+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556485411cd0 con 0x556485316e70 2024-02-15T22:57:43.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.011+0000 7ff523e07640 1 -- 172.21.15.133:0/3936738130 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff62805dbf0 con 0x556485316e70 2024-02-15T22:57:43.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.011+0000 7ff523e07640 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff51c036790 0x7ff51c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.011+0000 7ff523e07640 1 -- 172.21.15.133:0/3936738130 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7ff62808d680 con 0x556485316e70 2024-02-15T22:57:43.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.011+0000 7ff636bb2640 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff51c036790 0x7ff51c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.011+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5564853180d0 0x5564854156a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.011+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485415be0 con 0x5564853180d0 2024-02-15T22:57:43.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.011+0000 7ff637bb4640 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5564853180d0 0x5564854156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.011+0000 7ff636bb2640 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff51c036790 0x7ff51c038c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff62c001e40 tx=0x7ff62c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.011+0000 7ff637bb4640 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5564853180d0 0x5564854156a0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.012+0000 7ff637bb4640 1 -- 172.21.15.133:0/3936738130 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff6300083e0 con 0x5564853180d0 2024-02-15T22:57:43.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.012+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485415fd0 con 0x5564853180d0 2024-02-15T22:57:43.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.012+0000 7ff637bb4640 1 -- 172.21.15.133:0/3936738130 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff6300083e0 con 0x5564853180d0 2024-02-15T22:57:43.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.012+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485417880 con 0x5564853180d0 2024-02-15T22:57:43.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.012+0000 7ff637bb4640 1 -- 172.21.15.133:0/3936738130 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [call out=48b,read 0~922 out=922b] v0'0 uv8 ondisk = 0) v8 ==== 232+0+970 (crc 0 0 0) 0x7ff6300083e0 con 0x5564853180d0 2024-02-15T22:57:43.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.012+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485416b90 con 0x5564853180d0 2024-02-15T22:57:43.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.012+0000 7ff637bb4640 1 -- 172.21.15.133:0/3936738130 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff6300083e0 con 0x5564853180d0 2024-02-15T22:57:43.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.012+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485416fa0 con 0x5564853180d0 2024-02-15T22:57:43.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.013+0000 7ff637bb4640 1 -- 172.21.15.133:0/3936738130 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7ff630012040 con 0x5564853180d0 2024-02-15T22:57:43.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.013+0000 7ff63b72f800 1 Processor -- start 2024-02-15T22:57:43.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.013+0000 7ff63b72f800 1 -- start start 2024-02-15T22:57:43.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.013+0000 7ff63b72f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485427cd0 0x55648542a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.013+0000 7ff63b72f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564851b5e80 con 0x556485427cd0 2024-02-15T22:57:43.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.014+0000 7ff636bb2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485427cd0 0x55648542a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.014+0000 7ff636bb2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485427cd0 0x55648542a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46444/0 (socket says 172.21.15.133:46444) 2024-02-15T22:57:43.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.014+0000 7ff636bb2640 1 -- 172.21.15.133:0/3826907708 learned_addr learned my addr 172.21.15.133:0/3826907708 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:43.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.014+0000 7ff636bb2640 1 -- 172.21.15.133:0/3826907708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55648528b1f0 con 0x556485427cd0 2024-02-15T22:57:43.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.014+0000 7ff636bb2640 1 --2- 172.21.15.133:0/3826907708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485427cd0 0x55648542a0c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00e630 tx=0x7ff62c00ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.014+0000 7ff521602640 1 -- 172.21.15.133:0/3826907708 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff62c00bec0 con 0x556485427cd0 2024-02-15T22:57:43.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.014+0000 7ff521602640 1 -- 172.21.15.133:0/3826907708 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c00d520 con 0x556485427cd0 2024-02-15T22:57:43.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.014+0000 7ff63b72f800 1 -- 172.21.15.133:0/3826907708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55648542a600 con 0x556485427cd0 2024-02-15T22:57:43.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.014+0000 7ff521602640 1 -- 172.21.15.133:0/3826907708 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff62c00d7e0 con 0x556485427cd0 2024-02-15T22:57:43.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.014+0000 7ff63b72f800 1 -- 172.21.15.133:0/3826907708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55648542aa60 con 0x556485427cd0 2024-02-15T22:57:43.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.015+0000 7ff521602640 1 -- 172.21.15.133:0/3826907708 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff62c01a070 con 0x556485427cd0 2024-02-15T22:57:43.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.015+0000 7ff521602640 1 --2- 172.21.15.133:0/3826907708 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff510036790 0x7ff510038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.015+0000 7ff521602640 1 -- 172.21.15.133:0/3826907708 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7ff62c017050 con 0x556485427cd0 2024-02-15T22:57:43.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.015+0000 7ff637bb4640 1 --2- 172.21.15.133:0/3826907708 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff510036790 0x7ff510038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.016+0000 7ff63b72f800 1 Processor -- start 2024-02-15T22:57:43.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.016+0000 7ff63b72f800 1 -- start start 2024-02-15T22:57:43.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.016+0000 7ff637bb4640 1 --2- 172.21.15.133:0/3826907708 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff510036790 0x7ff510038c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x556485416510 tx=0x7ff630000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.016+0000 7ff63b72f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x556485425ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.016+0000 7ff63b72f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55648518b5d0 con 0x5564854273d0 2024-02-15T22:57:43.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.016+0000 7ff636bb2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x556485425ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.016+0000 7ff636bb2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x556485425ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46446/0 (socket says 172.21.15.133:46446) 2024-02-15T22:57:43.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.016+0000 7ff636bb2640 1 -- 172.21.15.133:0/3107795761 learned_addr learned my addr 172.21.15.133:0/3107795761 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:43.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.016+0000 7ff636bb2640 1 -- 172.21.15.133:0/3107795761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556485427840 con 0x5564854273d0 2024-02-15T22:57:43.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.016+0000 7ff636bb2640 1 --2- 172.21.15.133:0/3107795761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x556485425ac0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff62c024a20 tx=0x7ff62c024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a2db517f4ed87a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff51affd640 1 -- 172.21.15.133:0/3107795761 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff62c00dcc0 con 0x5564854273d0 2024-02-15T22:57:43.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff51affd640 1 -- 172.21.15.133:0/3107795761 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c00de20 con 0x5564854273d0 2024-02-15T22:57:43.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff51affd640 1 -- 172.21.15.133:0/3107795761 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff62c01a320 con 0x5564854273d0 2024-02-15T22:57:43.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff63b72f800 1 -- 172.21.15.133:0/3107795761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 msgr2=0x556485425ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3107795761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x556485425ac0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff62c024a20 tx=0x7ff62c024eb0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff63b72f800 1 -- 172.21.15.133:0/3107795761 shutdown_connections 2024-02-15T22:57:43.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3107795761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x556485425ac0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff63b72f800 1 -- 172.21.15.133:0/3107795761 >> 172.21.15.133:0/3107795761 conn(0x556485430710 msgr2=0x55648542e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:43.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff63b72f800 1 -- 172.21.15.133:0/3107795761 shutdown_connections 2024-02-15T22:57:43.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff63b72f800 1 -- 172.21.15.133:0/3107795761 wait complete. 2024-02-15T22:57:43.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff63b72f800 1 Processor -- start 2024-02-15T22:57:43.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.017+0000 7ff63b72f800 1 -- start start 2024-02-15T22:57:43.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.018+0000 7ff63b72f800 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x55648543d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.018+0000 7ff63b72f800 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55648543daf0 con 0x5564854273d0 2024-02-15T22:57:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.018+0000 7ff636bb2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x55648543d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.018+0000 7ff636bb2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x55648543d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.133:46462/0 (socket says 172.21.15.133:46462) 2024-02-15T22:57:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.018+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 learned_addr learned my addr 172.21.15.133:0/2661805151 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T22:57:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.018+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55648542aa60 con 0x5564854273d0 2024-02-15T22:57:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.018+0000 7ff636bb2640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x55648543d5b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0267b0 tx=0x7ff62c04ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.018+0000 7ff5197fa640 1 -- 172.21.15.133:0/2661805151 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff62c04d320 con 0x5564854273d0 2024-02-15T22:57:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.018+0000 7ff5197fa640 1 -- 172.21.15.133:0/2661805151 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c04d4a0 con 0x5564854273d0 2024-02-15T22:57:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.018+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55648543dcf0 con 0x5564854273d0 2024-02-15T22:57:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.018+0000 7ff5197fa640 1 -- 172.21.15.133:0/2661805151 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff62c025b70 con 0x5564854273d0 2024-02-15T22:57:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.019+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55648543e1b0 con 0x5564854273d0 2024-02-15T22:57:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.019+0000 7ff5197fa640 1 -- 172.21.15.133:0/2661805151 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff62c044040 con 0x5564854273d0 2024-02-15T22:57:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.019+0000 7ff5197fa640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff500036790 0x7ff500038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.020+0000 7ff5197fa640 1 -- 172.21.15.133:0/2661805151 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7ff62c01e020 con 0x5564854273d0 2024-02-15T22:57:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.020+0000 7ff637bb4640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff500036790 0x7ff500038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.020+0000 7ff63b72f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.020+0000 7ff63b72f800 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5564854491b0 0x55648544b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.020+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55648544bdc0 con 0x5564854491b0 2024-02-15T22:57:43.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.020+0000 7ff637bb4640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff500036790 0x7ff500038c50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff63000f010 tx=0x7ff63000c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.020+0000 7ff6373b3640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5564854491b0 0x55648544b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.020+0000 7ff6373b3640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5564854491b0 0x55648544b670 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff62804f070 con 0x5564854491b0 2024-02-15T22:57:43.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:43.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 20 realm 2024-02-15T22:57:43.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:43.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55648544c190 con 0x5564854491b0 2024-02-15T22:57:43.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff62804f070 con 0x5564854491b0 2024-02-15T22:57:43.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:43.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-15T22:57:43.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:43.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55648544ca10 con 0x5564854491b0 2024-02-15T22:57:43.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff62804f070 con 0x5564854491b0 2024-02-15T22:57:43.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:43.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:43.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55648544cd70 con 0x5564854491b0 2024-02-15T22:57:43.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff62804f070 con 0x5564854491b0 2024-02-15T22:57:43.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:43.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:43.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.021+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:5 5.f 5:f4d2422e:::zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55648544d570 con 0x5564854491b0 2024-02-15T22:57:43.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.022+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 5 ==== osd_op_reply(5 zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c [read 0~922 out=922b] v0'0 uv8 ondisk = 0) v8 ==== 190+0+922 (crc 0 0 0) 0x7ff62804f070 con 0x5564854491b0 2024-02-15T22:57:43.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.022+0000 7ff63b72f800 20 rados_obj.operate() r=0 bl.length=922 2024-02-15T22:57:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.022+0000 7ff63b72f800 20 searching for the correct realm 2024-02-15T22:57:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.022+0000 7ff63b72f800 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55648544f4f0 0x5564854519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.022+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x55648544f4f0 2024-02-15T22:57:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.022+0000 7ff636bb2640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55648544f4f0 0x5564854519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.022+0000 7ff636bb2640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55648544f4f0 0x5564854519b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.022+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.022+0000 7ff636bb2640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ff62c027060 0x7ff62c03c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.022+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff62c027060 2024-02-15T22:57:43.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.022+0000 7ff637bb4640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ff62c027060 0x7ff62c03c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.023+0000 7ff637bb4640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ff62c027060 0x7ff62c03c840 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.023+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff63002c040 con 0x7ff62c027060 2024-02-15T22:57:43.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.023+0000 7ff637bb4640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ff630027940 0x7ff6300333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.023+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff630027940 2024-02-15T22:57:43.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.023+0000 7ff6373b3640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ff630027940 0x7ff6300333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.024+0000 7ff6373b3640 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ff630027940 0x7ff6300333c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.024+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62804f070 con 0x7ff630027940 2024-02-15T22:57:43.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.024+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x5564854491b0 2024-02-15T22:57:43.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.024+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62804f070 con 0x5564854491b0 2024-02-15T22:57:43.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.024+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x5564854491b0 2024-02-15T22:57:43.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.025+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62804f070 con 0x5564854491b0 2024-02-15T22:57:43.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.025+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff630027940 2024-02-15T22:57:43.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.025+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62804f070 con 0x7ff630027940 2024-02-15T22:57:43.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.025+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff630027940 2024-02-15T22:57:43.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.025+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62804f070 con 0x7ff630027940 2024-02-15T22:57:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.025+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff62c027060 2024-02-15T22:57:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.025+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff63002c040 con 0x7ff62c027060 2024-02-15T22:57:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.025+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x55648544f4f0 2024-02-15T22:57:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.026+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.026+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x5564854491b0 2024-02-15T22:57:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.026+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62804f070 con 0x5564854491b0 2024-02-15T22:57:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.026+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff630027940 2024-02-15T22:57:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.026+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62804f070 con 0x7ff630027940 2024-02-15T22:57:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.026+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x5564854491b0 2024-02-15T22:57:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.027+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62804f070 con 0x5564854491b0 2024-02-15T22:57:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.027+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff62c027060 2024-02-15T22:57:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.027+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff63002c040 con 0x7ff62c027060 2024-02-15T22:57:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.027+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x55648544f4f0 2024-02-15T22:57:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.027+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.027+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x55648544f4f0 2024-02-15T22:57:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.027+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.027+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff630027940 2024-02-15T22:57:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.028+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62804f070 con 0x7ff630027940 2024-02-15T22:57:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.028+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x55648544f4f0 2024-02-15T22:57:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.028+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.028+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x55648544f4f0 2024-02-15T22:57:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.028+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.028+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x5564854491b0 2024-02-15T22:57:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.028+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62804f070 con 0x5564854491b0 2024-02-15T22:57:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.028+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x5564854491b0 2024-02-15T22:57:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.029+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff62804f070 con 0x5564854491b0 2024-02-15T22:57:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.029+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff630027940 2024-02-15T22:57:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.029+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.029+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x55648544f4f0 2024-02-15T22:57:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.029+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.029+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff62c027060 2024-02-15T22:57:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.029+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff63002c040 con 0x7ff62c027060 2024-02-15T22:57:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.029+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x5564854491b0 2024-02-15T22:57:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.030+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.030+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff630027940 2024-02-15T22:57:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.030+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.030+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x55648544f4f0 2024-02-15T22:57:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.030+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.030+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff630027940 2024-02-15T22:57:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.031+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.031+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff62c027060 2024-02-15T22:57:43.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.031+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff63002c040 con 0x7ff62c027060 2024-02-15T22:57:43.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.031+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x55648544f4f0 2024-02-15T22:57:43.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.031+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.031+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff630027940 2024-02-15T22:57:43.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x5564854491b0 2024-02-15T22:57:43.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=173b] v32'8 uv8 ondisk = 1) v8 ==== 144+0+173 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485452080 con 0x7ff62c027060 2024-02-15T22:57:43.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff63002c040 con 0x7ff62c027060 2024-02-15T22:57:43.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff63b72f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-15T22:57:43.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff63b72f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-15T22:57:43.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff63b72f800 20 RGWRados::pool_iterate: got zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 2024-02-15T22:57:43.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff63b72f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-15T22:57:43.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff63b72f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-15T22:57:43.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff63b72f800 20 RGWRados::pool_iterate: got zone_info.b92e6ab7-703a-4505-95e4-c2a94e620f9c 2024-02-15T22:57:43.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff63b72f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55648544de30 con 0x5564854491b0 2024-02-15T22:57:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff63b72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff63b72f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.032+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55648544e1e0 con 0x5564854491b0 2024-02-15T22:57:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-15T22:57:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:40 5.1d 5:bfd62a54:::zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55648544e5c0 con 0x5564854491b0 2024-02-15T22:57:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 16 ==== osd_op_reply(40 zonegroup_info.f2cd5859-7c57-45d7-89f3-01e23ceddfe0 [read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+421 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 20 rados_obj.operate() r=0 bl.length=421 2024-02-15T22:57:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 20 zone default found 2024-02-15T22:57:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 4 Realm: () 2024-02-15T22:57:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 4 ZoneGroup: default (f2cd5859-7c57-45d7-89f3-01e23ceddfe0) 2024-02-15T22:57:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 4 Zone: default (b92e6ab7-703a-4505-95e4-c2a94e620f9c) 2024-02-15T22:57:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-15T22:57:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 20 zonegroup default 2024-02-15T22:57:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564854524c0 con 0x7ff630027940 2024-02-15T22:57:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485454250 con 0x55648544f4f0 2024-02-15T22:57:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.033+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.034+0000 7ff63b72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.034+0000 7ff63b72f800 20 rados->read ofs=0 len=0 2024-02-15T22:57:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.034+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564854545b0 con 0x55648544f4f0 2024-02-15T22:57:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.034+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.034+0000 7ff63b72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-15T22:57:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.034+0000 7ff63b72f800 20 started sync module instance, tier type = 2024-02-15T22:57:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.034+0000 7ff63b72f800 20 started zone id=b92e6ab7-703a-4505-95e4-c2a94e620f9c (name=default) with tier type = 2024-02-15T22:57:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.034+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485453b30 con 0x7ff62c027060 2024-02-15T22:57:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.035+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 7 ==== osd_op_reply(44 notify.0 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.035+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93890220996240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485453ab0 con 0x7ff62c027060 2024-02-15T22:57:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.035+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564854552e0 con 0x5564854491b0 2024-02-15T22:57:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.036+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93890220996240] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.037+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 17 ==== osd_op_reply(46 notify.1 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.037+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93890221001120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485455260 con 0x5564854491b0 2024-02-15T22:57:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.037+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485455c10 con 0x55648544f4f0 2024-02-15T22:57:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.038+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93890221001120] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.038+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 12 ==== osd_op_reply(48 notify.2 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.038+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93890221002176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564854551e0 con 0x55648544f4f0 2024-02-15T22:57:43.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.038+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485456a70 con 0x7ff62c027060 2024-02-15T22:57:43.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.039+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 9 ==== osd_op_reply(50 notify.3 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.039+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93890221008816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485457210 con 0x7ff62c027060 2024-02-15T22:57:43.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.039+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485457a90 con 0x5564854491b0 2024-02-15T22:57:43.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.039+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93890221002176] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.040+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93890221008816] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.040+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 19 ==== osd_op_reply(52 notify.4 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.040+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93890221010032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485457a90 con 0x5564854491b0 2024-02-15T22:57:43.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.040+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485458290 con 0x7ff630027940 2024-02-15T22:57:43.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.041+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93890221010032] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.041+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 11 ==== osd_op_reply(54 notify.5 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.041+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93890221012736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485458140 con 0x7ff630027940 2024-02-15T22:57:43.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.041+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485458be0 con 0x7ff630027940 2024-02-15T22:57:43.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.043+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 12 ==== osd_op_reply(56 notify.6 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.043+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93890221016768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485459040 con 0x7ff630027940 2024-02-15T22:57:43.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.043+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485459b10 con 0x7ff630027940 2024-02-15T22:57:43.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.043+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93890221012736] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.044+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 14 ==== osd_op_reply(58 notify.7 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.044+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93890221020656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485459ad0 con 0x7ff630027940 2024-02-15T22:57:43.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.044+0000 7ff63b72f800 20 add_watcher() i=0 2024-02-15T22:57:43.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.044+0000 7ff63b72f800 20 add_watcher() i=1 2024-02-15T22:57:43.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.044+0000 7ff63b72f800 20 add_watcher() i=2 2024-02-15T22:57:43.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.044+0000 7ff63b72f800 20 add_watcher() i=3 2024-02-15T22:57:43.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.044+0000 7ff63b72f800 20 add_watcher() i=4 2024-02-15T22:57:43.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.044+0000 7ff63b72f800 20 add_watcher() i=5 2024-02-15T22:57:43.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.044+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93890221016768] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.044+0000 7ff63b72f800 20 add_watcher() i=6 2024-02-15T22:57:43.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.045+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93890221020656] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.045+0000 7ff63b72f800 20 add_watcher() i=7 2024-02-15T22:57:43.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.045+0000 7ff63b72f800 2 all 8 watchers are set, enabling cache 2024-02-15T22:57:43.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.045+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485458c90 con 0x5564854491b0 2024-02-15T22:57:43.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.045+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.045+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93890221013920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485458c90 con 0x5564854491b0 2024-02-15T22:57:43.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.046+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93890221013920] v32'240 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.046+0000 7ff4edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:43.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.046+0000 7ff63b72f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-15T22:57:43.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.046+0000 7ff63b72f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-15T22:57:43.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.046+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564854656e0 con 0x5564854491b0 2024-02-15T22:57:43.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.048+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.048+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485465cf0 con 0x7ff630027940 2024-02-15T22:57:43.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.049+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'30 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.049+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485466220 con 0x55648544f4f0 2024-02-15T22:57:43.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.050+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.050+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485466bf0 con 0x5564854491b0 2024-02-15T22:57:43.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.051+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'241 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.051+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485466bf0 con 0x7ff62c027060 2024-02-15T22:57:43.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.052+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'77 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.052+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485467120 con 0x55648544f4f0 2024-02-15T22:57:43.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.053+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'51 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.053+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485467af0 con 0x5564854491b0 2024-02-15T22:57:43.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.054+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.054+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485467af0 con 0x7ff630027940 2024-02-15T22:57:43.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.055+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'51 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.055+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485467af0 con 0x7ff62c027060 2024-02-15T22:57:43.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.056+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.056+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485468020 con 0x55648544f4f0 2024-02-15T22:57:43.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.057+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.057+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564854684c0 con 0x7ff62c027060 2024-02-15T22:57:43.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.058+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'78 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.058+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461340 con 0x7ff630027940 2024-02-15T22:57:43.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.059+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'35 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.059+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x7ff62c027060 2024-02-15T22:57:43.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.060+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.060+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x7ff630027940 2024-02-15T22:57:43.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.061+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'57 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.061+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x5564854491b0 2024-02-15T22:57:43.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.062+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'242 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.062+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x55648544f4f0 2024-02-15T22:57:43.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.064+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'71 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.064+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x7ff62c027060 2024-02-15T22:57:43.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.065+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'79 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.065+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x55648544f4f0 2024-02-15T22:57:43.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.066+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.066+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x5564854491b0 2024-02-15T22:57:43.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.067+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.067+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x5564854491b0 2024-02-15T22:57:43.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.068+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'243 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.068+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x55648544f4f0 2024-02-15T22:57:43.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.069+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'72 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.069+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x7ff62c027060 2024-02-15T22:57:43.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.070+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'39 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.070+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x55648544f4f0 2024-02-15T22:57:43.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.071+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.071+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x55648544f4f0 2024-02-15T22:57:43.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.072+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.072+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x55648544f4f0 2024-02-15T22:57:43.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.073+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'27 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.073+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x55648544f4f0 2024-02-15T22:57:43.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.074+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'52 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.074+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x7ff630027940 2024-02-15T22:57:43.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.075+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.075+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x55648544f4f0 2024-02-15T22:57:43.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.076+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.076+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x7ff630027940 2024-02-15T22:57:43.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.077+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'52 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.077+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x55648544f4f0 2024-02-15T22:57:43.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.078+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'73 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.078+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x7ff630027940 2024-02-15T22:57:43.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.079+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'58 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.079+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485461930 con 0x7ff62c027060 2024-02-15T22:57:43.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.080+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'36 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.081+0000 7ff4ecfe1640 20 reqs_thread_entry: start 2024-02-15T22:57:43.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.081+0000 7ff63b72f800 20 init_complete bucket index max shards: 11 2024-02-15T22:57:43.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.081+0000 7ff63b72f800 20 Filter name: none 2024-02-15T22:57:43.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.081+0000 7ff4667fc640 20 reqs_thread_entry: start 2024-02-15T22:57:43.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.081+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-02-15T22:57:43.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.081+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:94 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.082+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 24 ==== osd_op_reply(94 gc.7 [call] v32'53 uv53 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.082+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:95 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.082+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 25 ==== osd_op_reply(95 gc.7 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.082+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.082+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:96 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff630027940 2024-02-15T22:57:43.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.083+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 26 ==== osd_op_reply(96 gc.7 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.083+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:97 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.083+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 27 ==== osd_op_reply(97 gc.7 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.083+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.083+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:98 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.083+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 28 ==== osd_op_reply(98 gc.7 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.083+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.083+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:99 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.084+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 29 ==== osd_op_reply(99 gc.7 [call] v32'54 uv54 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.084+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-02-15T22:57:43.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.084+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:100 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.085+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 18 ==== osd_op_reply(100 gc.8 [call] v32'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.085+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:101 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.086+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 19 ==== osd_op_reply(101 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.086+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.086+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:102 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff62c027060 2024-02-15T22:57:43.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.086+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 20 ==== osd_op_reply(102 gc.8 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.086+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:103 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.086+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 21 ==== osd_op_reply(103 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.086+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.086+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:104 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.086+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 22 ==== osd_op_reply(104 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.086+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.086+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:105 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.088+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 23 ==== osd_op_reply(105 gc.8 [call] v32'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.088+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-02-15T22:57:43.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.088+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:106 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.089+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 26 ==== osd_op_reply(106 gc.9 [call] v32'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.089+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:107 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.089+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 27 ==== osd_op_reply(107 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.089+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.089+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:108 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.089+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 28 ==== osd_op_reply(108 gc.9 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.089+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:109 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.090+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 29 ==== osd_op_reply(109 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.090+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.090+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:110 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.090+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 30 ==== osd_op_reply(110 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.090+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.090+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:111 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.091+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 31 ==== osd_op_reply(111 gc.9 [call] v32'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.091+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-02-15T22:57:43.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.091+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:112 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.092+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 24 ==== osd_op_reply(112 gc.10 [call] v32'80 uv80 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.092+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:113 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.092+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 25 ==== osd_op_reply(113 gc.10 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.092+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.092+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:114 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff62c027060 2024-02-15T22:57:43.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.092+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 26 ==== osd_op_reply(114 gc.10 [call out=24b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.092+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:115 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.092+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 27 ==== osd_op_reply(115 gc.10 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.092+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.092+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:116 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.093+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 28 ==== osd_op_reply(116 gc.10 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.093+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.093+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:117 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.094+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 29 ==== osd_op_reply(117 gc.10 [call] v32'81 uv81 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.094+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-02-15T22:57:43.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.094+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:118 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.095+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 30 ==== osd_op_reply(118 gc.11 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.095+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:119 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.095+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 31 ==== osd_op_reply(119 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.095+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.095+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:120 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff630027940 2024-02-15T22:57:43.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.095+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 32 ==== osd_op_reply(120 gc.11 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.095+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:121 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.096+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 33 ==== osd_op_reply(121 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.096+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.096+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:122 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.096+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 34 ==== osd_op_reply(122 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.096+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.096+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:123 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.097+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 35 ==== osd_op_reply(123 gc.11 [call] v32'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.097+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-02-15T22:57:43.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.097+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:124 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.098+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 30 ==== osd_op_reply(124 gc.12 [call] v32'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.098+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:125 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.098+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 31 ==== osd_op_reply(125 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.098+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.098+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:126 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff62c027060 2024-02-15T22:57:43.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.098+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 32 ==== osd_op_reply(126 gc.12 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.098+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:127 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.098+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 33 ==== osd_op_reply(127 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.098+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.099+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:128 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.099+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 34 ==== osd_op_reply(128 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.099+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.099+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:129 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.100+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 35 ==== osd_op_reply(129 gc.12 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.100+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-02-15T22:57:43.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.100+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:130 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.101+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 36 ==== osd_op_reply(130 gc.13 [call] v32'59 uv59 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.101+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:131 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.101+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 37 ==== osd_op_reply(131 gc.13 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.101+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.101+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:132 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff630027940 2024-02-15T22:57:43.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.102+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 38 ==== osd_op_reply(132 gc.13 [call out=24b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.102+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.102+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 39 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.102+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.102+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.102+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 40 ==== osd_op_reply(134 gc.13 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.102+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.102+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.104+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 41 ==== osd_op_reply(135 gc.13 [call] v32'60 uv60 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.104+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-02-15T22:57:43.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.104+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.105+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 29 ==== osd_op_reply(136 gc.14 [call] v32'244 uv244 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.105+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.105+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 30 ==== osd_op_reply(137 gc.14 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.105+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.105+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x5564854491b0 2024-02-15T22:57:43.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.105+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 31 ==== osd_op_reply(138 gc.14 [call out=24b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.105+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:139 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.106+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 32 ==== osd_op_reply(139 gc.14 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.106+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.106+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:140 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.106+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 33 ==== osd_op_reply(140 gc.14 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.106+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.106+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:141 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.107+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 34 ==== osd_op_reply(141 gc.14 [call] v32'245 uv245 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.107+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-02-15T22:57:43.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.107+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:142 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.108+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 32 ==== osd_op_reply(142 gc.15 [call] v32'74 uv74 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.108+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:143 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.108+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 33 ==== osd_op_reply(143 gc.15 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.108+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.109+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:144 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.109+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 34 ==== osd_op_reply(144 gc.15 [call out=24b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.109+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:145 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.109+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 35 ==== osd_op_reply(145 gc.15 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.109+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.109+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:146 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.109+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 36 ==== osd_op_reply(146 gc.15 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.109+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.109+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:147 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.110+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 37 ==== osd_op_reply(147 gc.15 [call] v32'75 uv75 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.110+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-02-15T22:57:43.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.111+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:148 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.111+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 36 ==== osd_op_reply(148 gc.16 [call] v32'82 uv82 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.111+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:149 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.112+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 37 ==== osd_op_reply(149 gc.16 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.112+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.112+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:150 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff62c027060 2024-02-15T22:57:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.112+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 38 ==== osd_op_reply(150 gc.16 [call out=24b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.112+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:151 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.112+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 39 ==== osd_op_reply(151 gc.16 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.112+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.112+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:152 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.112+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 40 ==== osd_op_reply(152 gc.16 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.112+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.112+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:153 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.113+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 41 ==== osd_op_reply(153 gc.16 [call] v32'83 uv83 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.113+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-02-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.113+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:154 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.114+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 38 ==== osd_op_reply(154 gc.17 [call] v32'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.114+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:155 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.114+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 39 ==== osd_op_reply(155 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.115+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.115+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:156 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.115+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 40 ==== osd_op_reply(156 gc.17 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.115+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:157 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.115+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 41 ==== osd_op_reply(157 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.115+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.115+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:158 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.115+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 42 ==== osd_op_reply(158 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.115+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.115+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:159 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.116+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 43 ==== osd_op_reply(159 gc.17 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.116+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-02-15T22:57:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.116+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:160 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.117+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 35 ==== osd_op_reply(160 gc.18 [call] v32'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.117+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:161 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.118+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 36 ==== osd_op_reply(161 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.118+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.118+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:162 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x5564854491b0 2024-02-15T22:57:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.118+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 37 ==== osd_op_reply(162 gc.18 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.118+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:163 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.118+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 38 ==== osd_op_reply(163 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.118+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.118+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:164 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.118+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 39 ==== osd_op_reply(164 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.118+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.118+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:165 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.119+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 40 ==== osd_op_reply(165 gc.18 [call] v32'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.119+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-02-15T22:57:43.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.119+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:166 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.120+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 41 ==== osd_op_reply(166 gc.19 [call] v32'246 uv246 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.120+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:167 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.120+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 42 ==== osd_op_reply(167 gc.19 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.120+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.121+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:168 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x5564854491b0 2024-02-15T22:57:43.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.121+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 43 ==== osd_op_reply(168 gc.19 [call out=24b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.121+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:169 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.121+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 44 ==== osd_op_reply(169 gc.19 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.121+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.121+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:170 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.121+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 45 ==== osd_op_reply(170 gc.19 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.121+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.121+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:171 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.122+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 46 ==== osd_op_reply(171 gc.19 [call] v32'247 uv247 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.122+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-02-15T22:57:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.122+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:172 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.123+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 44 ==== osd_op_reply(172 gc.20 [call] v32'76 uv76 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.123+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:173 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.124+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 45 ==== osd_op_reply(173 gc.20 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.124+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.124+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:174 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.124+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 46 ==== osd_op_reply(174 gc.20 [call out=24b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.124+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:175 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.124+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 47 ==== osd_op_reply(175 gc.20 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.124+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.124+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:176 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.124+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 48 ==== osd_op_reply(176 gc.20 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.124+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.124+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:177 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.126+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 49 ==== osd_op_reply(177 gc.20 [call] v32'77 uv77 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.126+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-02-15T22:57:43.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.126+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:178 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.127+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 42 ==== osd_op_reply(178 gc.21 [call] v32'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.127+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:179 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.127+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 43 ==== osd_op_reply(179 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.127+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.127+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:180 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff62c027060 2024-02-15T22:57:43.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.127+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 44 ==== osd_op_reply(180 gc.21 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.127+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:181 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.128+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 45 ==== osd_op_reply(181 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.128+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.128+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:182 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.128+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 46 ==== osd_op_reply(182 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.128+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.128+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:183 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.129+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 47 ==== osd_op_reply(183 gc.21 [call] v32'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.129+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-02-15T22:57:43.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.129+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:184 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.130+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 50 ==== osd_op_reply(184 gc.22 [call] v32'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.130+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:185 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.130+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 51 ==== osd_op_reply(185 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.130+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.130+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:186 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.130+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 52 ==== osd_op_reply(186 gc.22 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.130+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:187 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.131+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 53 ==== osd_op_reply(187 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.131+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.131+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:188 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.131+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 54 ==== osd_op_reply(188 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.131+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.131+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:189 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.132+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 55 ==== osd_op_reply(189 gc.22 [call] v32'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.132+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-02-15T22:57:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.132+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:190 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.133+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 56 ==== osd_op_reply(190 gc.23 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.133+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:191 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.133+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 57 ==== osd_op_reply(191 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.133+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.133+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:192 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.133+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 58 ==== osd_op_reply(192 gc.23 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.133+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:193 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.133+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 59 ==== osd_op_reply(193 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.133+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.133+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:194 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.134+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 60 ==== osd_op_reply(194 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.134+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.134+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:195 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.134+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 61 ==== osd_op_reply(195 gc.23 [call] v32'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.134+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-02-15T22:57:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.134+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:196 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.135+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 62 ==== osd_op_reply(196 gc.24 [call] v32'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.135+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:197 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.136+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 63 ==== osd_op_reply(197 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.136+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.136+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:198 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.136+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 64 ==== osd_op_reply(198 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.136+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:199 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.136+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 65 ==== osd_op_reply(199 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.136+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.136+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:200 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.136+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 66 ==== osd_op_reply(200 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.136+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.136+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:201 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.137+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 67 ==== osd_op_reply(201 gc.24 [call] v32'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.137+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-02-15T22:57:43.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.137+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:202 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.138+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 68 ==== osd_op_reply(202 gc.25 [call] v32'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.138+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:203 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.139+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 69 ==== osd_op_reply(203 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.139+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.139+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:204 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.139+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 70 ==== osd_op_reply(204 gc.25 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.139+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:205 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.139+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 71 ==== osd_op_reply(205 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.139+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.139+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:206 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.139+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 72 ==== osd_op_reply(206 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.139+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.139+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:207 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.140+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 73 ==== osd_op_reply(207 gc.25 [call] v32'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.140+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-02-15T22:57:43.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.140+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:208 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.141+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 42 ==== osd_op_reply(208 gc.26 [call] v32'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.141+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:209 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.141+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 43 ==== osd_op_reply(209 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.141+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.141+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:210 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff630027940 2024-02-15T22:57:43.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.142+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 44 ==== osd_op_reply(210 gc.26 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.142+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:211 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.142+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 45 ==== osd_op_reply(211 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.142+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.142+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:212 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.142+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 46 ==== osd_op_reply(212 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.142+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.142+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:213 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.143+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 47 ==== osd_op_reply(213 gc.26 [call] v32'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.143+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-02-15T22:57:43.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.143+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:214 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.144+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 74 ==== osd_op_reply(214 gc.27 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.144+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:215 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.144+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 75 ==== osd_op_reply(215 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.144+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.144+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:216 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.145+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 76 ==== osd_op_reply(216 gc.27 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.145+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:217 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.145+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 77 ==== osd_op_reply(217 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.145+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.145+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:218 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.145+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 78 ==== osd_op_reply(218 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.145+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.145+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:219 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.146+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 79 ==== osd_op_reply(219 gc.27 [call] v32'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.146+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-02-15T22:57:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.146+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:220 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.147+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 48 ==== osd_op_reply(220 gc.28 [call] v32'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.147+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:221 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.148+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 49 ==== osd_op_reply(221 gc.28 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.148+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.148+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:222 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff630027940 2024-02-15T22:57:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.148+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 50 ==== osd_op_reply(222 gc.28 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.148+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:223 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.148+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 51 ==== osd_op_reply(223 gc.28 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.148+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.148+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:224 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.148+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 52 ==== osd_op_reply(224 gc.28 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.148+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.148+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:225 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.149+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 53 ==== osd_op_reply(225 gc.28 [call] v32'56 uv56 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.149+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-02-15T22:57:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.149+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:226 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.150+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 80 ==== osd_op_reply(226 gc.29 [call] v32'78 uv78 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.150+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:227 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.150+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 81 ==== osd_op_reply(227 gc.29 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.150+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.150+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:228 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.151+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 82 ==== osd_op_reply(228 gc.29 [call out=24b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.151+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:229 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.151+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 83 ==== osd_op_reply(229 gc.29 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.151+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.151+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:230 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.151+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 84 ==== osd_op_reply(230 gc.29 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.151+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.151+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:231 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.152+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 85 ==== osd_op_reply(231 gc.29 [call] v32'79 uv79 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.152+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-02-15T22:57:43.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.152+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:232 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.153+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 54 ==== osd_op_reply(232 gc.30 [call] v32'61 uv61 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.153+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:233 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.154+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 55 ==== osd_op_reply(233 gc.30 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.154+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.154+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:234 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff630027940 2024-02-15T22:57:43.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.154+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 56 ==== osd_op_reply(234 gc.30 [call out=24b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.154+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:235 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.154+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 57 ==== osd_op_reply(235 gc.30 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.154+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.154+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:236 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.155+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 58 ==== osd_op_reply(236 gc.30 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.155+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.155+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:237 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.156+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 59 ==== osd_op_reply(237 gc.30 [call] v32'62 uv62 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.156+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-02-15T22:57:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.156+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:238 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.157+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 48 ==== osd_op_reply(238 gc.31 [call] v32'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.157+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:239 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.157+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 49 ==== osd_op_reply(239 gc.31 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.157+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.157+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:240 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff62c027060 2024-02-15T22:57:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.157+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 50 ==== osd_op_reply(240 gc.31 [call out=24b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.157+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:241 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.157+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 51 ==== osd_op_reply(241 gc.31 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.157+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.157+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:242 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.158+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 52 ==== osd_op_reply(242 gc.31 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.158+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.158+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:243 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.159+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 53 ==== osd_op_reply(243 gc.31 [call] v32'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.159+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-02-15T22:57:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.159+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:244 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.160+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 47 ==== osd_op_reply(244 gc.0 [call] v32'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.160+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:245 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.160+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 48 ==== osd_op_reply(245 gc.0 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.160+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.160+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:246 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x5564854491b0 2024-02-15T22:57:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.160+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 49 ==== osd_op_reply(246 gc.0 [call out=24b] v0'0 uv37 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.160+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:247 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.160+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 50 ==== osd_op_reply(247 gc.0 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.160+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.160+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:248 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.161+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 51 ==== osd_op_reply(248 gc.0 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.161+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.161+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:249 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.162+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 52 ==== osd_op_reply(249 gc.0 [call] v32'38 uv38 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.162+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-02-15T22:57:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.162+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:250 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.163+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 60 ==== osd_op_reply(250 gc.1 [call] v32'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.163+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:251 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.163+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 61 ==== osd_op_reply(251 gc.1 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.163+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.163+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:252 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff630027940 2024-02-15T22:57:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.163+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 62 ==== osd_op_reply(252 gc.1 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.163+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:253 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.163+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 63 ==== osd_op_reply(253 gc.1 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.163+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.163+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:254 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.164+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 64 ==== osd_op_reply(254 gc.1 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.164+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.164+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:255 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff630027940 2024-02-15T22:57:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.165+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 65 ==== osd_op_reply(255 gc.1 [call] v32'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.165+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-02-15T22:57:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.165+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:256 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.165+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 86 ==== osd_op_reply(256 gc.2 [call] v32'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.165+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:257 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.166+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 87 ==== osd_op_reply(257 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.166+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.166+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:258 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.166+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 88 ==== osd_op_reply(258 gc.2 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.166+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:259 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.166+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 89 ==== osd_op_reply(259 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.166+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.166+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:260 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.166+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 90 ==== osd_op_reply(260 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.166+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.166+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:261 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.167+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 91 ==== osd_op_reply(261 gc.2 [call] v32'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.167+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-02-15T22:57:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.167+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:262 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.168+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 53 ==== osd_op_reply(262 gc.3 [call] v32'248 uv248 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.168+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:263 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.168+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 54 ==== osd_op_reply(263 gc.3 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.169+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.169+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:264 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x5564854491b0 2024-02-15T22:57:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.169+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 55 ==== osd_op_reply(264 gc.3 [call out=24b] v0'0 uv248 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.169+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:265 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.169+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 56 ==== osd_op_reply(265 gc.3 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.169+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.169+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:266 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.169+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 57 ==== osd_op_reply(266 gc.3 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.169+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.169+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:267 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.170+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 58 ==== osd_op_reply(267 gc.3 [call] v32'249 uv249 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.170+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-02-15T22:57:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.170+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:268 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.171+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 54 ==== osd_op_reply(268 gc.4 [call] v32'84 uv84 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.171+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:269 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.171+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 55 ==== osd_op_reply(269 gc.4 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.171+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.171+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:270 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x7ff62c027060 2024-02-15T22:57:43.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.172+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 56 ==== osd_op_reply(270 gc.4 [call out=24b] v0'0 uv84 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.172+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:271 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.172+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 57 ==== osd_op_reply(271 gc.4 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.172+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.172+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:272 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.172+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 58 ==== osd_op_reply(272 gc.4 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.172+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.172+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:273 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x7ff62c027060 2024-02-15T22:57:43.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.173+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 59 ==== osd_op_reply(273 gc.4 [call] v32'85 uv85 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.173+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-02-15T22:57:43.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.173+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:274 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.174+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 92 ==== osd_op_reply(274 gc.5 [call] v32'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.174+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:275 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.174+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 93 ==== osd_op_reply(275 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.174+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.174+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:276 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x55648544f4f0 2024-02-15T22:57:43.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.175+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 94 ==== osd_op_reply(276 gc.5 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.175+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:277 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.175+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 95 ==== osd_op_reply(277 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.175+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.175+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:278 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.175+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 96 ==== osd_op_reply(278 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.175+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.175+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:279 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x55648544f4f0 2024-02-15T22:57:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.176+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 97 ==== osd_op_reply(279 gc.5 [call] v32'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.176+0000 7ff63b72f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-02-15T22:57:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.176+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:280 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.177+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 59 ==== osd_op_reply(280 gc.6 [call] v32'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.177+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:281 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.177+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 60 ==== osd_op_reply(281 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.177+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.177+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:282 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485492ef0 con 0x5564854491b0 2024-02-15T22:57:43.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.178+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 61 ==== osd_op_reply(282 gc.6 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.178+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:283 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.178+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 62 ==== osd_op_reply(283 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.178+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-15T22:57:43.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.178+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:284 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.178+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 63 ==== osd_op_reply(284 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.178+0000 7ff63b72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-15T22:57:43.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.178+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:285 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485493f00 con 0x5564854491b0 2024-02-15T22:57:43.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.179+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 64 ==== osd_op_reply(285 gc.6 [call] v32'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.180+0000 7ff4edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-15T22:57:43.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.180+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:286 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93890221013920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55648545c760 con 0x5564854491b0 2024-02-15T22:57:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.181+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 65 ==== osd_op_reply(286 data_loggenerations_metadata [watch unwatch cookie 93890221013920] v32'250 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.181+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:287 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93890220996240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485457ba0 con 0x7ff62c027060 2024-02-15T22:57:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.182+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 60 ==== osd_op_reply(287 notify.0 [watch unwatch cookie 93890220996240] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.182+0000 7ff63b72f800 20 remove_watcher() i=0 2024-02-15T22:57:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.182+0000 7ff63b72f800 2 removed watcher, disabling cache 2024-02-15T22:57:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.182+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:288 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93890221001120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485453690 con 0x5564854491b0 2024-02-15T22:57:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.183+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 66 ==== osd_op_reply(288 notify.1 [watch unwatch cookie 93890221001120] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.183+0000 7ff63b72f800 20 remove_watcher() i=1 2024-02-15T22:57:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.183+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- osd_op(unknown.0.0:289 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93890221002176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485453690 con 0x55648544f4f0 2024-02-15T22:57:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.184+0000 7ff636bb2640 1 -- 172.21.15.133:0/2661805151 <== osd.3 v2:172.21.15.133:6816/1065500544 98 ==== osd_op_reply(289 notify.2 [watch unwatch cookie 93890221002176] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff62c02d040 con 0x55648544f4f0 2024-02-15T22:57:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.184+0000 7ff63b72f800 20 remove_watcher() i=2 2024-02-15T22:57:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.184+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- osd_op(unknown.0.0:290 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93890221008816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485454e40 con 0x7ff62c027060 2024-02-15T22:57:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.185+0000 7ff637bb4640 1 -- 172.21.15.133:0/2661805151 <== osd.2 v2:172.21.15.133:6800/2073628168 61 ==== osd_op_reply(290 notify.3 [watch unwatch cookie 93890221008816] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff63003f040 con 0x7ff62c027060 2024-02-15T22:57:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.185+0000 7ff63b72f800 20 remove_watcher() i=3 2024-02-15T22:57:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.185+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- osd_op(unknown.0.0:291 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93890221010032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485454e40 con 0x5564854491b0 2024-02-15T22:57:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.186+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.1 v2:172.21.15.133:6808/2671624067 67 ==== osd_op_reply(291 notify.4 [watch unwatch cookie 93890221010032] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x5564854491b0 2024-02-15T22:57:43.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.186+0000 7ff63b72f800 20 remove_watcher() i=4 2024-02-15T22:57:43.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.186+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:292 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93890221012736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556485454e40 con 0x7ff630027940 2024-02-15T22:57:43.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.187+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 66 ==== osd_op_reply(292 notify.5 [watch unwatch cookie 93890221012736] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.187+0000 7ff63b72f800 20 remove_watcher() i=5 2024-02-15T22:57:43.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.187+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:293 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93890221016768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564854567b0 con 0x7ff630027940 2024-02-15T22:57:43.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.188+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 67 ==== osd_op_reply(293 notify.6 [watch unwatch cookie 93890221016768] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.188+0000 7ff63b72f800 20 remove_watcher() i=6 2024-02-15T22:57:43.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.188+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- osd_op(unknown.0.0:294 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93890221020656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564854567b0 con 0x7ff630027940 2024-02-15T22:57:43.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 <== osd.0 v2:172.21.15.52:6800/431200118 68 ==== osd_op_reply(294 notify.7 [watch unwatch cookie 93890221020656] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff628093040 con 0x7ff630027940 2024-02-15T22:57:43.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 20 remove_watcher() i=7 2024-02-15T22:57:43.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ff630027940 msgr2=0x7ff6300333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7ff630027940 0x7ff6300333c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5564854491b0 msgr2=0x55648544b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5564854491b0 0x55648544b670 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ff62c027060 msgr2=0x7ff62c03c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7ff62c027060 0x7ff62c03c840 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55648544f4f0 msgr2=0x5564854519b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x55648544f4f0 0x5564854519b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff500036790 msgr2=0x7ff500038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff500036790 0x7ff500038c50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff63000f010 tx=0x7ff63000c040 comp rx=0 tx=0).stop 2024-02-15T22:57:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff6373b3640 1 -- 172.21.15.133:0/2661805151 reap_dead start 2024-02-15T22:57:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 msgr2=0x55648543d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x55648543d5b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0267b0 tx=0x7ff62c04ba90 comp rx=0 tx=0).stop 2024-02-15T22:57:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.189+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 shutdown_connections 2024-02-15T22:57:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 --2- 172.21.15.133:0/2661805151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5564854273d0 0x55648543d5b0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 >> 172.21.15.133:0/2661805151 conn(0x556485430710 msgr2=0x55648542dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:43.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 shutdown_connections 2024-02-15T22:57:43.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/2661805151 wait complete. 2024-02-15T22:57:43.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3826907708 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff510036790 msgr2=0x7ff510038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3826907708 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff510036790 0x7ff510038c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x556485416510 tx=0x7ff630000f90 comp rx=0 tx=0).stop 2024-02-15T22:57:43.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3826907708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485427cd0 msgr2=0x55648542a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3826907708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485427cd0 0x55648542a0c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00e630 tx=0x7ff62c00ea30 comp rx=0 tx=0).stop 2024-02-15T22:57:43.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3826907708 shutdown_connections 2024-02-15T22:57:43.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3826907708 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff510036790 0x7ff510038c50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3826907708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485427cd0 0x55648542a0c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3826907708 >> 172.21.15.133:0/3826907708 conn(0x7ff63000e000 msgr2=0x55648541a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:43.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3826907708 shutdown_connections 2024-02-15T22:57:43.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3826907708 wait complete. 2024-02-15T22:57:43.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5564853180d0 msgr2=0x5564854156a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5564853180d0 0x5564854156a0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff51c036790 msgr2=0x7ff51c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff51c036790 0x7ff51c038c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff62c001e40 tx=0x7ff62c0013a0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 msgr2=0x55648540e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x55648540e850 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff62805f040 tx=0x7ff628003330 comp rx=0 tx=0).stop 2024-02-15T22:57:43.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 shutdown_connections 2024-02-15T22:57:43.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x5564853180d0 0x5564854156a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff51c036790 0x7ff51c038c50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 --2- 172.21.15.133:0/3936738130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556485316e70 0x55648540e850 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 >> 172.21.15.133:0/3936738130 conn(0x5564853124d0 msgr2=0x5564854013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:43.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.190+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 shutdown_connections 2024-02-15T22:57:43.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T22:57:43.191+0000 7ff63b72f800 1 -- 172.21.15.133:0/3936738130 wait complete. 2024-02-15T22:57:43.223 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-15T22:57:43.232 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-15T22:57:43.232 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T22:57:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.333+0000 7f85033c6640 1 Processor -- start 2024-02-15T22:57:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.333+0000 7f85033c6640 1 -- start start 2024-02-15T22:57:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.334+0000 7f85033c6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84fc096ac0 0x7f84fc06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.334+0000 7f85033c6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc06ecc0 con 0x7f84fc06e110 2024-02-15T22:57:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.334+0000 7f85033c6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc067100 con 0x7f84fc096ac0 2024-02-15T22:57:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.334+0000 7f8501162640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84fc096ac0 0x7f84fc06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.334+0000 7f8500961640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f84fc06e110 0x7f84fc06d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34756/0 (socket says 172.21.15.52:34756) 2024-02-15T22:57:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.334+0000 7f8500961640 1 -- 172.21.15.52:0/3840272909 learned_addr learned my addr 172.21.15.52:0/3840272909 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.334+0000 7f8501162640 1 -- 172.21.15.52:0/3840272909 >> v1:172.21.15.52:6789/0 conn(0x7f84fc06e110 legacy=0x7f84fc06d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.334+0000 7f8501162640 1 -- 172.21.15.52:0/3840272909 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc066b50 con 0x7f84fc096ac0 2024-02-15T22:57:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.335+0000 7f8501162640 1 --2- 172.21.15.52:0/3840272909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84fc096ac0 0x7f84fc06ce00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009720 tx=0x7f84f802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a713fb1d8553eb3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.335+0000 7f84f3fff640 1 -- 172.21.15.52:0/3840272909 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84f802e070 con 0x7f84fc096ac0 2024-02-15T22:57:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.335+0000 7f84f3fff640 1 -- 172.21.15.52:0/3840272909 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f80316d0 con 0x7f84fc096ac0 2024-02-15T22:57:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.335+0000 7f84f3fff640 1 -- 172.21.15.52:0/3840272909 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84f8031990 con 0x7f84fc096ac0 2024-02-15T22:57:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.336+0000 7f85033c6640 1 -- 172.21.15.52:0/3840272909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84fc096ac0 msgr2=0x7f84fc06ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.336+0000 7f85033c6640 1 --2- 172.21.15.52:0/3840272909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84fc096ac0 0x7f84fc06ce00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009720 tx=0x7f84f802b840 comp rx=0 tx=0).stop 2024-02-15T22:57:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.336+0000 7f85033c6640 1 -- 172.21.15.52:0/3840272909 shutdown_connections 2024-02-15T22:57:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.336+0000 7f85033c6640 1 --2- 172.21.15.52:0/3840272909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84fc096ac0 0x7f84fc06ce00 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.336+0000 7f85033c6640 1 -- 172.21.15.52:0/3840272909 >> 172.21.15.52:0/3840272909 conn(0x7f84fc0974b0 msgr2=0x7f84fc0978c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.336+0000 7f85033c6640 1 -- 172.21.15.52:0/3840272909 shutdown_connections 2024-02-15T22:57:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.336+0000 7f85033c6640 1 -- 172.21.15.52:0/3840272909 wait complete. 2024-02-15T22:57:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.337+0000 7f85033c6640 1 Processor -- start 2024-02-15T22:57:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.337+0000 7f85033c6640 1 -- start start 2024-02-15T22:57:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.337+0000 7f85033c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84fc06e110 0x7f84fc0920f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.337+0000 7f85033c6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc095900 con 0x7f84fc06e110 2024-02-15T22:57:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.337+0000 7f8501162640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84fc06e110 0x7f84fc0920f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.337+0000 7f8501162640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84fc06e110 0x7f84fc0920f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33208/0 (socket says 172.21.15.52:33208) 2024-02-15T22:57:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.337+0000 7f8501162640 1 -- 172.21.15.52:0/880777485 learned_addr learned my addr 172.21.15.52:0/880777485 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.337+0000 7f8501162640 1 -- 172.21.15.52:0/880777485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f8009400 con 0x7f84fc06e110 2024-02-15T22:57:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.337+0000 7f8501162640 1 --2- 172.21.15.52:0/880777485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84fc06e110 0x7f84fc0920f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009840 tx=0x7f84f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.337+0000 7f84f1ffb640 1 -- 172.21.15.52:0/880777485 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84f80328b0 con 0x7f84fc06e110 2024-02-15T22:57:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.338+0000 7f84f1ffb640 1 -- 172.21.15.52:0/880777485 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8032a10 con 0x7f84fc06e110 2024-02-15T22:57:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.338+0000 7f85033c6640 1 -- 172.21.15.52:0/880777485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc094940 con 0x7f84fc06e110 2024-02-15T22:57:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.338+0000 7f84f1ffb640 1 -- 172.21.15.52:0/880777485 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84f8032cf0 con 0x7f84fc06e110 2024-02-15T22:57:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.338+0000 7f85033c6640 1 -- 172.21.15.52:0/880777485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc095c10 con 0x7f84fc06e110 2024-02-15T22:57:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.338+0000 7f84f1ffb640 1 -- 172.21.15.52:0/880777485 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f84f804d3f0 con 0x7f84fc06e110 2024-02-15T22:57:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.339+0000 7f84f1ffb640 1 --2- 172.21.15.52:0/880777485 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84e0037ef0 0x7f84e003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.339+0000 7f85033c6640 1 -- 172.21.15.52:0/880777485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc0627b0 con 0x7f84fc06e110 2024-02-15T22:57:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.339+0000 7f84f1ffb640 1 -- 172.21.15.52:0/880777485 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f84f806d270 con 0x7f84fc06e110 2024-02-15T22:57:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.339+0000 7f8500961640 1 --2- 172.21.15.52:0/880777485 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84e0037ef0 0x7f84e003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.339+0000 7f8500961640 1 --2- 172.21.15.52:0/880777485 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84e0037ef0 0x7f84e003a3b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f84ec007fd0 tx=0x7f84ec007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.344+0000 7f84f1ffb640 1 -- 172.21.15.52:0/880777485 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f84f80308e0 con 0x7f84fc06e110 2024-02-15T22:57:43.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.518+0000 7f85033c6640 1 -- 172.21.15.52:0/880777485 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84fc09b770 con 0x7f84e0037ef0 2024-02-15T22:57:43.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.535+0000 7f84f1ffb640 1 -- 172.21.15.52:0/880777485 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673027 (secure 0 0 0) 0x7f84fc09b770 con 0x7f84e0037ef0 2024-02-15T22:57:43.545 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:57:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-02-15T22:57:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.539+0000 7f85033c6640 1 -- 172.21.15.52:0/880777485 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84e0037ef0 msgr2=0x7f84e003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.539+0000 7f85033c6640 1 --2- 172.21.15.52:0/880777485 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84e0037ef0 0x7f84e003a3b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f84ec007fd0 tx=0x7f84ec007ac0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.539+0000 7f85033c6640 1 -- 172.21.15.52:0/880777485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84fc06e110 msgr2=0x7f84fc0920f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.539+0000 7f85033c6640 1 --2- 172.21.15.52:0/880777485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84fc06e110 0x7f84fc0920f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009840 tx=0x7f84f80046c0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.539+0000 7f85033c6640 1 -- 172.21.15.52:0/880777485 shutdown_connections 2024-02-15T22:57:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.539+0000 7f85033c6640 1 --2- 172.21.15.52:0/880777485 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f84e0037ef0 0x7f84e003a3b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.539+0000 7f85033c6640 1 --2- 172.21.15.52:0/880777485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84fc06e110 0x7f84fc0920f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.539+0000 7f85033c6640 1 -- 172.21.15.52:0/880777485 >> 172.21.15.52:0/880777485 conn(0x7f84fc0974b0 msgr2=0x7f84fc130e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.539+0000 7f85033c6640 1 -- 172.21.15.52:0/880777485 shutdown_connections 2024-02-15T22:57:43.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.539+0000 7f85033c6640 1 -- 172.21.15.52:0/880777485 wait complete. 2024-02-15T22:57:43.556 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-02-15T22:57:42.832792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3806,"num_read_kb":3453,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135792,"kb_used_data":2768,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351568,"statfs":{"total":386547056640,"available":386408005632,"internally_reserved":0,"allocated":2834432,"data_stored":1715324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1348,"num_objects":-27,"num_object_clones":0,"num_object_copies":-54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":270,"num_read_kb":261,"num_write":97,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003970"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887013+0000","last_change":"2024-02-15T22:56:03.700271+0000","last_active":"2024-02-15T22:56:45.887013+0000","last_peered":"2024-02-15T22:56:45.887013+0000","last_clean":"2024-02-15T22:56:45.887013+0000","last_became_active":"2024-02-15T22:56:03.699163+0000","last_became_peered":"2024-02-15T22:56:03.699163+0000","last_unstale":"2024-02-15T22:56:45.887013+0000","last_undegraded":"2024-02-15T22:56:45.887013+0000","last_fullsized":"2024-02-15T22:56:45.887013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391099+0000","last_change":"2024-02-15T22:56:05.708737+0000","last_active":"2024-02-15T22:57:35.391099+0000","last_peered":"2024-02-15T22:57:35.391099+0000","last_clean":"2024-02-15T22:57:35.391099+0000","last_became_active":"2024-02-15T22:56:05.708415+0000","last_became_peered":"2024-02-15T22:56:05.708415+0000","last_unstale":"2024-02-15T22:57:35.391099+0000","last_undegraded":"2024-02-15T22:57:35.391099+0000","last_fullsized":"2024-02-15T22:57:35.391099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:08.839506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881047+0000","last_change":"2024-02-15T22:56:03.704350+0000","last_active":"2024-02-15T22:56:45.881047+0000","last_peered":"2024-02-15T22:56:45.881047+0000","last_clean":"2024-02-15T22:56:45.881047+0000","last_became_active":"2024-02-15T22:56:03.704043+0000","last_became_peered":"2024-02-15T22:56:03.704043+0000","last_unstale":"2024-02-15T22:56:45.881047+0000","last_undegraded":"2024-02-15T22:56:45.881047+0000","last_fullsized":"2024-02-15T22:56:45.881047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:27.186561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882461+0000","last_change":"2024-02-15T22:56:05.703860+0000","last_active":"2024-02-15T22:56:45.882461+0000","last_peered":"2024-02-15T22:56:45.882461+0000","last_clean":"2024-02-15T22:56:45.882461+0000","last_became_active":"2024-02-15T22:56:05.703587+0000","last_became_peered":"2024-02-15T22:56:05.703587+0000","last_unstale":"2024-02-15T22:56:45.882461+0000","last_undegraded":"2024-02-15T22:56:45.882461+0000","last_fullsized":"2024-02-15T22:56:45.882461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:18.837089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884271+0000","last_change":"2024-02-15T22:56:03.703994+0000","last_active":"2024-02-15T22:56:45.884271+0000","last_peered":"2024-02-15T22:56:45.884271+0000","last_clean":"2024-02-15T22:56:45.884271+0000","last_became_active":"2024-02-15T22:56:03.703702+0000","last_became_peered":"2024-02-15T22:56:03.703702+0000","last_unstale":"2024-02-15T22:56:45.884271+0000","last_undegraded":"2024-02-15T22:56:45.884271+0000","last_fullsized":"2024-02-15T22:56:45.884271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:44.096887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883441+0000","last_change":"2024-02-15T22:56:05.709355+0000","last_active":"2024-02-15T22:57:29.883441+0000","last_peered":"2024-02-15T22:57:29.883441+0000","last_clean":"2024-02-15T22:57:29.883441+0000","last_became_active":"2024-02-15T22:56:05.709003+0000","last_became_peered":"2024-02-15T22:56:05.709003+0000","last_unstale":"2024-02-15T22:57:29.883441+0000","last_undegraded":"2024-02-15T22:57:29.883441+0000","last_fullsized":"2024-02-15T22:57:29.883441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:26:24.526593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885342+0000","last_change":"2024-02-15T22:56:03.692040+0000","last_active":"2024-02-15T22:56:45.885342+0000","last_peered":"2024-02-15T22:56:45.885342+0000","last_clean":"2024-02-15T22:56:45.885342+0000","last_became_active":"2024-02-15T22:56:03.691753+0000","last_became_peered":"2024-02-15T22:56:03.691753+0000","last_unstale":"2024-02-15T22:56:45.885342+0000","last_undegraded":"2024-02-15T22:56:45.885342+0000","last_fullsized":"2024-02-15T22:56:45.885342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214184+0000","last_change":"2024-02-15T22:56:05.703818+0000","last_active":"2024-02-15T22:57:29.214184+0000","last_peered":"2024-02-15T22:57:29.214184+0000","last_clean":"2024-02-15T22:57:29.214184+0000","last_became_active":"2024-02-15T22:56:05.703541+0000","last_became_peered":"2024-02-15T22:56:05.703541+0000","last_unstale":"2024-02-15T22:57:29.214184+0000","last_undegraded":"2024-02-15T22:57:29.214184+0000","last_fullsized":"2024-02-15T22:57:29.214184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:49.366897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881533+0000","last_change":"2024-02-15T22:56:03.694830+0000","last_active":"2024-02-15T22:56:45.881533+0000","last_peered":"2024-02-15T22:56:45.881533+0000","last_clean":"2024-02-15T22:56:45.881533+0000","last_became_active":"2024-02-15T22:56:03.694522+0000","last_became_peered":"2024-02-15T22:56:03.694522+0000","last_unstale":"2024-02-15T22:56:45.881533+0000","last_undegraded":"2024-02-15T22:56:45.881533+0000","last_fullsized":"2024-02-15T22:56:45.881533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:51.289434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.875000+0000","last_change":"2024-02-15T22:56:05.705402+0000","last_active":"2024-02-15T22:56:46.875000+0000","last_peered":"2024-02-15T22:56:46.875000+0000","last_clean":"2024-02-15T22:56:46.875000+0000","last_became_active":"2024-02-15T22:56:05.704411+0000","last_became_peered":"2024-02-15T22:56:05.704411+0000","last_unstale":"2024-02-15T22:56:46.875000+0000","last_undegraded":"2024-02-15T22:56:46.875000+0000","last_fullsized":"2024-02-15T22:56:46.875000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:12.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882213+0000","last_change":"2024-02-15T22:56:03.692633+0000","last_active":"2024-02-15T22:56:45.882213+0000","last_peered":"2024-02-15T22:56:45.882213+0000","last_clean":"2024-02-15T22:56:45.882213+0000","last_became_active":"2024-02-15T22:56:03.692316+0000","last_became_peered":"2024-02-15T22:56:03.692316+0000","last_unstale":"2024-02-15T22:56:45.882213+0000","last_undegraded":"2024-02-15T22:56:45.882213+0000","last_fullsized":"2024-02-15T22:56:45.882213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:26.885390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.214550+0000","last_change":"2024-02-15T22:56:05.715708+0000","last_active":"2024-02-15T22:56:47.214550+0000","last_peered":"2024-02-15T22:56:47.214550+0000","last_clean":"2024-02-15T22:56:47.214550+0000","last_became_active":"2024-02-15T22:56:05.715460+0000","last_became_peered":"2024-02-15T22:56:05.715460+0000","last_unstale":"2024-02-15T22:56:47.214550+0000","last_undegraded":"2024-02-15T22:56:47.214550+0000","last_fullsized":"2024-02-15T22:56:47.214550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:27.899628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.858213+0000","last_change":"2024-02-15T22:56:03.701184+0000","last_active":"2024-02-15T22:56:46.858213+0000","last_peered":"2024-02-15T22:56:46.858213+0000","last_clean":"2024-02-15T22:56:46.858213+0000","last_became_active":"2024-02-15T22:56:03.700908+0000","last_became_peered":"2024-02-15T22:56:03.700908+0000","last_unstale":"2024-02-15T22:56:46.858213+0000","last_undegraded":"2024-02-15T22:56:46.858213+0000","last_fullsized":"2024-02-15T22:56:46.858213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:10.798077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883471+0000","last_change":"2024-02-15T22:56:05.706807+0000","last_active":"2024-02-15T22:57:29.883471+0000","last_peered":"2024-02-15T22:57:29.883471+0000","last_clean":"2024-02-15T22:57:29.883471+0000","last_became_active":"2024-02-15T22:56:05.706078+0000","last_became_peered":"2024-02-15T22:56:05.706078+0000","last_unstale":"2024-02-15T22:57:29.883471+0000","last_undegraded":"2024-02-15T22:57:29.883471+0000","last_fullsized":"2024-02-15T22:57:29.883471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879163+0000","last_change":"2024-02-15T22:56:03.697612+0000","last_active":"2024-02-15T22:56:45.879163+0000","last_peered":"2024-02-15T22:56:45.879163+0000","last_clean":"2024-02-15T22:56:45.879163+0000","last_became_active":"2024-02-15T22:56:03.697327+0000","last_became_peered":"2024-02-15T22:56:03.697327+0000","last_unstale":"2024-02-15T22:56:45.879163+0000","last_undegraded":"2024-02-15T22:56:45.879163+0000","last_fullsized":"2024-02-15T22:56:45.879163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886735+0000","last_change":"2024-02-15T22:56:05.705497+0000","last_active":"2024-02-15T22:56:45.886735+0000","last_peered":"2024-02-15T22:56:45.886735+0000","last_clean":"2024-02-15T22:56:45.886735+0000","last_became_active":"2024-02-15T22:56:05.705173+0000","last_became_peered":"2024-02-15T22:56:05.705173+0000","last_unstale":"2024-02-15T22:56:45.886735+0000","last_undegraded":"2024-02-15T22:56:45.886735+0000","last_fullsized":"2024-02-15T22:56:45.886735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:12.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.214944+0000","last_change":"2024-02-15T22:56:05.704020+0000","last_active":"2024-02-15T22:56:47.214944+0000","last_peered":"2024-02-15T22:56:47.214944+0000","last_clean":"2024-02-15T22:56:47.214944+0000","last_became_active":"2024-02-15T22:56:05.703708+0000","last_became_peered":"2024-02-15T22:56:05.703708+0000","last_unstale":"2024-02-15T22:56:47.214944+0000","last_undegraded":"2024-02-15T22:56:47.214944+0000","last_fullsized":"2024-02-15T22:56:47.214944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:55.285758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880443+0000","last_change":"2024-02-15T22:56:03.697488+0000","last_active":"2024-02-15T22:56:45.880443+0000","last_peered":"2024-02-15T22:56:45.880443+0000","last_clean":"2024-02-15T22:56:45.880443+0000","last_became_active":"2024-02-15T22:56:03.696959+0000","last_became_peered":"2024-02-15T22:56:03.696959+0000","last_unstale":"2024-02-15T22:56:45.880443+0000","last_undegraded":"2024-02-15T22:56:45.880443+0000","last_fullsized":"2024-02-15T22:56:45.880443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883271+0000","last_change":"2024-02-15T22:56:05.700345+0000","last_active":"2024-02-15T22:57:29.883271+0000","last_peered":"2024-02-15T22:57:29.883271+0000","last_clean":"2024-02-15T22:57:29.883271+0000","last_became_active":"2024-02-15T22:56:05.700071+0000","last_became_peered":"2024-02-15T22:56:05.700071+0000","last_unstale":"2024-02-15T22:57:29.883271+0000","last_undegraded":"2024-02-15T22:57:29.883271+0000","last_fullsized":"2024-02-15T22:57:29.883271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887112+0000","last_change":"2024-02-15T22:56:03.700009+0000","last_active":"2024-02-15T22:56:45.887112+0000","last_peered":"2024-02-15T22:56:45.887112+0000","last_clean":"2024-02-15T22:56:45.887112+0000","last_became_active":"2024-02-15T22:56:03.699574+0000","last_became_peered":"2024-02-15T22:56:03.699574+0000","last_unstale":"2024-02-15T22:56:45.887112+0000","last_undegraded":"2024-02-15T22:56:45.887112+0000","last_fullsized":"2024-02-15T22:56:45.887112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391273+0000","last_change":"2024-02-15T22:56:05.702837+0000","last_active":"2024-02-15T22:57:35.391273+0000","last_peered":"2024-02-15T22:57:35.391273+0000","last_clean":"2024-02-15T22:57:35.391273+0000","last_became_active":"2024-02-15T22:56:05.702488+0000","last_became_peered":"2024-02-15T22:56:05.702488+0000","last_unstale":"2024-02-15T22:57:35.391273+0000","last_undegraded":"2024-02-15T22:57:35.391273+0000","last_fullsized":"2024-02-15T22:57:35.391273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:38.755197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886045+0000","last_change":"2024-02-15T22:56:45.886045+0000","last_active":"2024-02-15T22:56:45.886045+0000","last_peered":"2024-02-15T22:56:45.886045+0000","last_clean":"2024-02-15T22:56:45.886045+0000","last_became_active":"2024-02-15T22:56:45.885555+0000","last_became_peered":"2024-02-15T22:56:45.885555+0000","last_unstale":"2024-02-15T22:56:45.886045+0000","last_undegraded":"2024-02-15T22:56:45.886045+0000","last_fullsized":"2024-02-15T22:56:45.886045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:17.695860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214283+0000","last_change":"2024-02-15T22:56:05.706693+0000","last_active":"2024-02-15T22:57:29.214283+0000","last_peered":"2024-02-15T22:57:29.214283+0000","last_clean":"2024-02-15T22:57:29.214283+0000","last_became_active":"2024-02-15T22:56:05.705386+0000","last_became_peered":"2024-02-15T22:56:05.705386+0000","last_unstale":"2024-02-15T22:57:29.214283+0000","last_undegraded":"2024-02-15T22:57:29.214283+0000","last_fullsized":"2024-02-15T22:57:29.214283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879821+0000","last_change":"2024-02-15T22:56:03.693697+0000","last_active":"2024-02-15T22:56:45.879821+0000","last_peered":"2024-02-15T22:56:45.879821+0000","last_clean":"2024-02-15T22:56:45.879821+0000","last_became_active":"2024-02-15T22:56:03.693329+0000","last_became_peered":"2024-02-15T22:56:03.693329+0000","last_unstale":"2024-02-15T22:56:45.879821+0000","last_undegraded":"2024-02-15T22:56:45.879821+0000","last_fullsized":"2024-02-15T22:56:45.879821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214299+0000","last_change":"2024-02-15T22:56:05.705032+0000","last_active":"2024-02-15T22:57:29.214299+0000","last_peered":"2024-02-15T22:57:29.214299+0000","last_clean":"2024-02-15T22:57:29.214299+0000","last_became_active":"2024-02-15T22:56:05.704729+0000","last_became_peered":"2024-02-15T22:56:05.704729+0000","last_unstale":"2024-02-15T22:57:29.214299+0000","last_undegraded":"2024-02-15T22:57:29.214299+0000","last_fullsized":"2024-02-15T22:57:29.214299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:13.582581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880416+0000","last_change":"2024-02-15T22:56:03.704183+0000","last_active":"2024-02-15T22:56:45.880416+0000","last_peered":"2024-02-15T22:56:45.880416+0000","last_clean":"2024-02-15T22:56:45.880416+0000","last_became_active":"2024-02-15T22:56:03.703885+0000","last_became_peered":"2024-02-15T22:56:03.703885+0000","last_unstale":"2024-02-15T22:56:45.880416+0000","last_undegraded":"2024-02-15T22:56:45.880416+0000","last_fullsized":"2024-02-15T22:56:45.880416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214309+0000","last_change":"2024-02-15T22:56:05.698851+0000","last_active":"2024-02-15T22:57:29.214309+0000","last_peered":"2024-02-15T22:57:29.214309+0000","last_clean":"2024-02-15T22:57:29.214309+0000","last_became_active":"2024-02-15T22:56:05.698553+0000","last_became_peered":"2024-02-15T22:56:05.698553+0000","last_unstale":"2024-02-15T22:57:29.214309+0000","last_undegraded":"2024-02-15T22:57:29.214309+0000","last_fullsized":"2024-02-15T22:57:29.214309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:59.069745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883379+0000","last_change":"2024-02-15T22:56:03.702268+0000","last_active":"2024-02-15T22:56:45.883379+0000","last_peered":"2024-02-15T22:56:45.883379+0000","last_clean":"2024-02-15T22:56:45.883379+0000","last_became_active":"2024-02-15T22:56:03.701819+0000","last_became_peered":"2024-02-15T22:56:03.701819+0000","last_unstale":"2024-02-15T22:56:45.883379+0000","last_undegraded":"2024-02-15T22:56:45.883379+0000","last_fullsized":"2024-02-15T22:56:45.883379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:24:36.815216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.380518+0000","last_change":"2024-02-15T22:56:13.731342+0000","last_active":"2024-02-15T22:57:35.380518+0000","last_peered":"2024-02-15T22:57:35.380518+0000","last_clean":"2024-02-15T22:57:35.380518+0000","last_became_active":"2024-02-15T22:56:13.730499+0000","last_became_peered":"2024-02-15T22:56:13.730499+0000","last_unstale":"2024-02-15T22:57:35.380518+0000","last_undegraded":"2024-02-15T22:57:35.380518+0000","last_fullsized":"2024-02-15T22:57:35.380518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:14:37.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.877218+0000","last_change":"2024-02-15T22:56:05.700054+0000","last_active":"2024-02-15T22:56:46.877218+0000","last_peered":"2024-02-15T22:56:46.877218+0000","last_clean":"2024-02-15T22:56:46.877218+0000","last_became_active":"2024-02-15T22:56:05.699821+0000","last_became_peered":"2024-02-15T22:56:05.699821+0000","last_unstale":"2024-02-15T22:56:46.877218+0000","last_undegraded":"2024-02-15T22:56:46.877218+0000","last_fullsized":"2024-02-15T22:56:46.877218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:38.452610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880655+0000","last_change":"2024-02-15T22:56:03.706199+0000","last_active":"2024-02-15T22:56:45.880655+0000","last_peered":"2024-02-15T22:56:45.880655+0000","last_clean":"2024-02-15T22:56:45.880655+0000","last_became_active":"2024-02-15T22:56:03.705881+0000","last_became_peered":"2024-02-15T22:56:03.705881+0000","last_unstale":"2024-02-15T22:56:45.880655+0000","last_undegraded":"2024-02-15T22:56:45.880655+0000","last_fullsized":"2024-02-15T22:56:45.880655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:08:53.948179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.893437+0000","last_change":"2024-02-15T22:56:45.893437+0000","last_active":"2024-02-15T22:56:45.893437+0000","last_peered":"2024-02-15T22:56:45.893437+0000","last_clean":"2024-02-15T22:56:45.893437+0000","last_became_active":"2024-02-15T22:56:45.893067+0000","last_became_peered":"2024-02-15T22:56:45.893067+0000","last_unstale":"2024-02-15T22:56:45.893437+0000","last_undegraded":"2024-02-15T22:56:45.893437+0000","last_fullsized":"2024-02-15T22:56:45.893437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:56:05.709507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.857479+0000","last_change":"2024-02-15T22:56:09.715523+0000","last_active":"2024-02-15T22:57:29.857479+0000","last_peered":"2024-02-15T22:57:29.857479+0000","last_clean":"2024-02-15T22:57:29.857479+0000","last_became_active":"2024-02-15T22:56:09.714201+0000","last_became_peered":"2024-02-15T22:56:09.714201+0000","last_unstale":"2024-02-15T22:57:29.857479+0000","last_undegraded":"2024-02-15T22:57:29.857479+0000","last_fullsized":"2024-02-15T22:57:29.857479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:23.715629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879512+0000","last_change":"2024-02-15T22:56:11.722548+0000","last_active":"2024-02-15T22:56:45.879512+0000","last_peered":"2024-02-15T22:56:45.879512+0000","last_clean":"2024-02-15T22:56:45.879512+0000","last_became_active":"2024-02-15T22:56:11.722257+0000","last_became_peered":"2024-02-15T22:56:11.722257+0000","last_unstale":"2024-02-15T22:56:45.879512+0000","last_undegraded":"2024-02-15T22:56:45.879512+0000","last_fullsized":"2024-02-15T22:56:45.879512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:57.504579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:24.174259+0000","last_change":"2024-02-15T22:56:13.729349+0000","last_active":"2024-02-15T22:57:24.174259+0000","last_peered":"2024-02-15T22:57:24.174259+0000","last_clean":"2024-02-15T22:57:24.174259+0000","last_became_active":"2024-02-15T22:56:13.729067+0000","last_became_peered":"2024-02-15T22:56:13.729067+0000","last_unstale":"2024-02-15T22:57:24.174259+0000","last_undegraded":"2024-02-15T22:57:24.174259+0000","last_fullsized":"2024-02-15T22:57:24.174259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:09.223558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427054+0000","last_change":"2024-02-15T22:56:05.709930+0000","last_active":"2024-02-15T22:56:47.427054+0000","last_peered":"2024-02-15T22:56:47.427054+0000","last_clean":"2024-02-15T22:56:47.427054+0000","last_became_active":"2024-02-15T22:56:05.709632+0000","last_became_peered":"2024-02-15T22:56:05.709632+0000","last_unstale":"2024-02-15T22:56:47.427054+0000","last_undegraded":"2024-02-15T22:56:47.427054+0000","last_fullsized":"2024-02-15T22:56:47.427054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:36.590473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882363+0000","last_change":"2024-02-15T22:56:03.699568+0000","last_active":"2024-02-15T22:56:45.882363+0000","last_peered":"2024-02-15T22:56:45.882363+0000","last_clean":"2024-02-15T22:56:45.882363+0000","last_became_active":"2024-02-15T22:56:03.699250+0000","last_became_peered":"2024-02-15T22:56:03.699250+0000","last_unstale":"2024-02-15T22:56:45.882363+0000","last_undegraded":"2024-02-15T22:56:45.882363+0000","last_fullsized":"2024-02-15T22:56:45.882363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880140+0000","last_change":"2024-02-15T22:56:07.706255+0000","last_active":"2024-02-15T22:56:45.880140+0000","last_peered":"2024-02-15T22:56:45.880140+0000","last_clean":"2024-02-15T22:56:45.880140+0000","last_became_active":"2024-02-15T22:56:07.705828+0000","last_became_peered":"2024-02-15T22:56:07.705828+0000","last_unstale":"2024-02-15T22:56:45.880140+0000","last_undegraded":"2024-02-15T22:56:45.880140+0000","last_fullsized":"2024-02-15T22:56:45.880140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:08.004261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883166+0000","last_change":"2024-02-15T22:56:09.713098+0000","last_active":"2024-02-15T22:56:45.883166+0000","last_peered":"2024-02-15T22:56:45.883166+0000","last_clean":"2024-02-15T22:56:45.883166+0000","last_became_active":"2024-02-15T22:56:09.712812+0000","last_became_peered":"2024-02-15T22:56:09.712812+0000","last_unstale":"2024-02-15T22:56:45.883166+0000","last_undegraded":"2024-02-15T22:56:45.883166+0000","last_fullsized":"2024-02-15T22:56:45.883166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:02:23.375846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879318+0000","last_change":"2024-02-15T22:56:11.721942+0000","last_active":"2024-02-15T22:56:45.879318+0000","last_peered":"2024-02-15T22:56:45.879318+0000","last_clean":"2024-02-15T22:56:45.879318+0000","last_became_active":"2024-02-15T22:56:11.721486+0000","last_became_peered":"2024-02-15T22:56:11.721486+0000","last_unstale":"2024-02-15T22:56:45.879318+0000","last_undegraded":"2024-02-15T22:56:45.879318+0000","last_fullsized":"2024-02-15T22:56:45.879318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:14.822800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879113+0000","last_change":"2024-02-15T22:56:13.734756+0000","last_active":"2024-02-15T22:56:45.879113+0000","last_peered":"2024-02-15T22:56:45.879113+0000","last_clean":"2024-02-15T22:56:45.879113+0000","last_became_active":"2024-02-15T22:56:13.734418+0000","last_became_peered":"2024-02-15T22:56:13.734418+0000","last_unstale":"2024-02-15T22:56:45.879113+0000","last_undegraded":"2024-02-15T22:56:45.879113+0000","last_fullsized":"2024-02-15T22:56:45.879113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:52.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391181+0000","last_change":"2024-02-15T22:56:05.700314+0000","last_active":"2024-02-15T22:57:35.391181+0000","last_peered":"2024-02-15T22:57:35.391181+0000","last_clean":"2024-02-15T22:57:35.391181+0000","last_became_active":"2024-02-15T22:56:05.699398+0000","last_became_peered":"2024-02-15T22:56:05.699398+0000","last_unstale":"2024-02-15T22:57:35.391181+0000","last_undegraded":"2024-02-15T22:57:35.391181+0000","last_fullsized":"2024-02-15T22:57:35.391181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:02.515595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881993+0000","last_change":"2024-02-15T22:56:03.707100+0000","last_active":"2024-02-15T22:56:45.881993+0000","last_peered":"2024-02-15T22:56:45.881993+0000","last_clean":"2024-02-15T22:56:45.881993+0000","last_became_active":"2024-02-15T22:56:03.706818+0000","last_became_peered":"2024-02-15T22:56:03.706818+0000","last_unstale":"2024-02-15T22:56:45.881993+0000","last_undegraded":"2024-02-15T22:56:45.881993+0000","last_fullsized":"2024-02-15T22:56:45.881993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:48.000599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882317+0000","last_change":"2024-02-15T22:56:07.704992+0000","last_active":"2024-02-15T22:56:45.882317+0000","last_peered":"2024-02-15T22:56:45.882317+0000","last_clean":"2024-02-15T22:56:45.882317+0000","last_became_active":"2024-02-15T22:56:07.704168+0000","last_became_peered":"2024-02-15T22:56:07.704168+0000","last_unstale":"2024-02-15T22:56:45.882317+0000","last_undegraded":"2024-02-15T22:56:45.882317+0000","last_fullsized":"2024-02-15T22:56:45.882317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:37.486705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885836+0000","last_change":"2024-02-15T22:56:09.718644+0000","last_active":"2024-02-15T22:56:45.885836+0000","last_peered":"2024-02-15T22:56:45.885836+0000","last_clean":"2024-02-15T22:56:45.885836+0000","last_became_active":"2024-02-15T22:56:09.718326+0000","last_became_peered":"2024-02-15T22:56:09.718326+0000","last_unstale":"2024-02-15T22:56:45.885836+0000","last_undegraded":"2024-02-15T22:56:45.885836+0000","last_fullsized":"2024-02-15T22:56:45.885836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:39.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'240","reported_seq":301,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.531415+0000","last_change":"2024-02-15T22:56:11.726498+0000","last_active":"2024-02-15T22:57:35.531415+0000","last_peered":"2024-02-15T22:57:35.531415+0000","last_clean":"2024-02-15T22:57:35.531415+0000","last_became_active":"2024-02-15T22:56:11.724138+0000","last_became_peered":"2024-02-15T22:56:11.724138+0000","last_unstale":"2024-02-15T22:57:35.531415+0000","last_undegraded":"2024-02-15T22:57:35.531415+0000","last_fullsized":"2024-02-15T22:57:35.531415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:55.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882299+0000","last_change":"2024-02-15T22:56:13.733123+0000","last_active":"2024-02-15T22:56:45.882299+0000","last_peered":"2024-02-15T22:56:45.882299+0000","last_clean":"2024-02-15T22:56:45.882299+0000","last_became_active":"2024-02-15T22:56:13.732762+0000","last_became_peered":"2024-02-15T22:56:13.732762+0000","last_unstale":"2024-02-15T22:56:45.882299+0000","last_undegraded":"2024-02-15T22:56:45.882299+0000","last_fullsized":"2024-02-15T22:56:45.882299+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:33.418832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215492+0000","last_change":"2024-02-15T22:56:05.705807+0000","last_active":"2024-02-15T22:56:47.215492+0000","last_peered":"2024-02-15T22:56:47.215492+0000","last_clean":"2024-02-15T22:56:47.215492+0000","last_became_active":"2024-02-15T22:56:05.705360+0000","last_became_peered":"2024-02-15T22:56:05.705360+0000","last_unstale":"2024-02-15T22:56:47.215492+0000","last_undegraded":"2024-02-15T22:56:47.215492+0000","last_fullsized":"2024-02-15T22:56:47.215492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:43.641211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.877537+0000","last_change":"2024-02-15T22:56:03.698653+0000","last_active":"2024-02-15T22:56:45.877537+0000","last_peered":"2024-02-15T22:56:45.877537+0000","last_clean":"2024-02-15T22:56:45.877537+0000","last_became_active":"2024-02-15T22:56:03.698225+0000","last_became_peered":"2024-02-15T22:56:03.698225+0000","last_unstale":"2024-02-15T22:56:45.877537+0000","last_undegraded":"2024-02-15T22:56:45.877537+0000","last_fullsized":"2024-02-15T22:56:45.877537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:08.872314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883033+0000","last_change":"2024-02-15T22:56:07.709503+0000","last_active":"2024-02-15T22:56:45.883033+0000","last_peered":"2024-02-15T22:56:45.883033+0000","last_clean":"2024-02-15T22:56:45.883033+0000","last_became_active":"2024-02-15T22:56:07.709236+0000","last_became_peered":"2024-02-15T22:56:07.709236+0000","last_unstale":"2024-02-15T22:56:45.883033+0000","last_undegraded":"2024-02-15T22:56:45.883033+0000","last_fullsized":"2024-02-15T22:56:45.883033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:01.415728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.852327+0000","last_change":"2024-02-15T22:56:09.729856+0000","last_active":"2024-02-15T22:57:29.852327+0000","last_peered":"2024-02-15T22:57:29.852327+0000","last_clean":"2024-02-15T22:57:29.852327+0000","last_became_active":"2024-02-15T22:56:09.729556+0000","last_became_peered":"2024-02-15T22:56:09.729556+0000","last_unstale":"2024-02-15T22:57:29.852327+0000","last_undegraded":"2024-02-15T22:57:29.852327+0000","last_fullsized":"2024-02-15T22:57:29.852327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:22.850275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'240","reported_seq":329,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.535608+0000","last_change":"2024-02-15T22:56:11.719971+0000","last_active":"2024-02-15T22:57:35.535608+0000","last_peered":"2024-02-15T22:57:35.535608+0000","last_clean":"2024-02-15T22:57:35.535608+0000","last_became_active":"2024-02-15T22:56:11.719588+0000","last_became_peered":"2024-02-15T22:56:11.719588+0000","last_unstale":"2024-02-15T22:57:35.535608+0000","last_undegraded":"2024-02-15T22:57:35.535608+0000","last_fullsized":"2024-02-15T22:57:35.535608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:49.146038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881166+0000","last_change":"2024-02-15T22:56:05.711111+0000","last_active":"2024-02-15T22:56:45.881166+0000","last_peered":"2024-02-15T22:56:45.881166+0000","last_clean":"2024-02-15T22:56:45.881166+0000","last_became_active":"2024-02-15T22:56:05.710578+0000","last_became_peered":"2024-02-15T22:56:05.710578+0000","last_unstale":"2024-02-15T22:56:45.881166+0000","last_undegraded":"2024-02-15T22:56:45.881166+0000","last_fullsized":"2024-02-15T22:56:45.881166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:33.216881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887207+0000","last_change":"2024-02-15T22:56:03.702464+0000","last_active":"2024-02-15T22:56:45.887207+0000","last_peered":"2024-02-15T22:56:45.887207+0000","last_clean":"2024-02-15T22:56:45.887207+0000","last_became_active":"2024-02-15T22:56:03.702187+0000","last_became_peered":"2024-02-15T22:56:03.702187+0000","last_unstale":"2024-02-15T22:56:45.887207+0000","last_undegraded":"2024-02-15T22:56:45.887207+0000","last_fullsized":"2024-02-15T22:56:45.887207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878050+0000","last_change":"2024-02-15T22:56:07.707641+0000","last_active":"2024-02-15T22:56:45.878050+0000","last_peered":"2024-02-15T22:56:45.878050+0000","last_clean":"2024-02-15T22:56:45.878050+0000","last_became_active":"2024-02-15T22:56:07.707328+0000","last_became_peered":"2024-02-15T22:56:07.707328+0000","last_unstale":"2024-02-15T22:56:45.878050+0000","last_undegraded":"2024-02-15T22:56:45.878050+0000","last_fullsized":"2024-02-15T22:56:45.878050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:20.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.861400+0000","last_change":"2024-02-15T22:56:09.715469+0000","last_active":"2024-02-15T22:57:29.861400+0000","last_peered":"2024-02-15T22:57:29.861400+0000","last_clean":"2024-02-15T22:57:29.861400+0000","last_became_active":"2024-02-15T22:56:09.715019+0000","last_became_peered":"2024-02-15T22:56:09.715019+0000","last_unstale":"2024-02-15T22:57:29.861400+0000","last_undegraded":"2024-02-15T22:57:29.861400+0000","last_fullsized":"2024-02-15T22:57:29.861400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:48.218723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879445+0000","last_change":"2024-02-15T22:56:11.720307+0000","last_active":"2024-02-15T22:56:45.879445+0000","last_peered":"2024-02-15T22:56:45.879445+0000","last_clean":"2024-02-15T22:56:45.879445+0000","last_became_active":"2024-02-15T22:56:11.719845+0000","last_became_peered":"2024-02-15T22:56:11.719845+0000","last_unstale":"2024-02-15T22:56:45.879445+0000","last_undegraded":"2024-02-15T22:56:45.879445+0000","last_fullsized":"2024-02-15T22:56:45.879445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:18:58.882768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.675724+0000","last_change":"2024-02-15T22:56:13.732667+0000","last_active":"2024-02-15T22:57:29.675724+0000","last_peered":"2024-02-15T22:57:29.675724+0000","last_clean":"2024-02-15T22:57:29.675724+0000","last_became_active":"2024-02-15T22:56:13.732321+0000","last_became_peered":"2024-02-15T22:56:13.732321+0000","last_unstale":"2024-02-15T22:57:29.675724+0000","last_undegraded":"2024-02-15T22:57:29.675724+0000","last_fullsized":"2024-02-15T22:57:29.675724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:10.109926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427434+0000","last_change":"2024-02-15T22:56:05.698607+0000","last_active":"2024-02-15T22:56:47.427434+0000","last_peered":"2024-02-15T22:56:47.427434+0000","last_clean":"2024-02-15T22:56:47.427434+0000","last_became_active":"2024-02-15T22:56:05.697834+0000","last_became_peered":"2024-02-15T22:56:05.697834+0000","last_unstale":"2024-02-15T22:56:47.427434+0000","last_undegraded":"2024-02-15T22:56:47.427434+0000","last_fullsized":"2024-02-15T22:56:47.427434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:13:53.631177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887539+0000","last_change":"2024-02-15T22:56:03.702616+0000","last_active":"2024-02-15T22:56:45.887539+0000","last_peered":"2024-02-15T22:56:45.887539+0000","last_clean":"2024-02-15T22:56:45.887539+0000","last_became_active":"2024-02-15T22:56:03.702353+0000","last_became_peered":"2024-02-15T22:56:03.702353+0000","last_unstale":"2024-02-15T22:56:45.887539+0000","last_undegraded":"2024-02-15T22:56:45.887539+0000","last_fullsized":"2024-02-15T22:56:45.887539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:27.186561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879943+0000","last_change":"2024-02-15T22:56:07.707046+0000","last_active":"2024-02-15T22:56:45.879943+0000","last_peered":"2024-02-15T22:56:45.879943+0000","last_clean":"2024-02-15T22:56:45.879943+0000","last_became_active":"2024-02-15T22:56:07.706656+0000","last_became_peered":"2024-02-15T22:56:07.706656+0000","last_unstale":"2024-02-15T22:56:45.879943+0000","last_undegraded":"2024-02-15T22:56:45.879943+0000","last_fullsized":"2024-02-15T22:56:45.879943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:21:30.878763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.842589+0000","last_change":"2024-02-15T22:56:09.717310+0000","last_active":"2024-02-15T22:57:29.842589+0000","last_peered":"2024-02-15T22:57:29.842589+0000","last_clean":"2024-02-15T22:57:29.842589+0000","last_became_active":"2024-02-15T22:56:09.716138+0000","last_became_peered":"2024-02-15T22:56:09.716138+0000","last_unstale":"2024-02-15T22:57:29.842589+0000","last_undegraded":"2024-02-15T22:57:29.842589+0000","last_fullsized":"2024-02-15T22:57:29.842589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:05:17.903871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879203+0000","last_change":"2024-02-15T22:56:11.724665+0000","last_active":"2024-02-15T22:56:45.879203+0000","last_peered":"2024-02-15T22:56:45.879203+0000","last_clean":"2024-02-15T22:56:45.879203+0000","last_became_active":"2024-02-15T22:56:11.724317+0000","last_became_peered":"2024-02-15T22:56:11.724317+0000","last_unstale":"2024-02-15T22:56:45.879203+0000","last_undegraded":"2024-02-15T22:56:45.879203+0000","last_fullsized":"2024-02-15T22:56:45.879203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:06:03.302828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.874077+0000","last_change":"2024-02-15T22:56:13.733414+0000","last_active":"2024-02-15T22:57:29.874077+0000","last_peered":"2024-02-15T22:57:29.874077+0000","last_clean":"2024-02-15T22:57:29.874077+0000","last_became_active":"2024-02-15T22:56:13.733118+0000","last_became_peered":"2024-02-15T22:56:13.733118+0000","last_unstale":"2024-02-15T22:57:29.874077+0000","last_undegraded":"2024-02-15T22:57:29.874077+0000","last_fullsized":"2024-02-15T22:57:29.874077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:38.491982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'20","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427488+0000","last_change":"2024-02-15T22:56:45.891684+0000","last_active":"2024-02-15T22:56:47.427488+0000","last_peered":"2024-02-15T22:56:47.427488+0000","last_clean":"2024-02-15T22:56:47.427488+0000","last_became_active":"2024-02-15T22:56:45.886248+0000","last_became_peered":"2024-02-15T22:56:45.886248+0000","last_unstale":"2024-02-15T22:56:47.427488+0000","last_undegraded":"2024-02-15T22:56:47.427488+0000","last_fullsized":"2024-02-15T22:56:47.427488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:01.197599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883087+0000","last_change":"2024-02-15T22:56:03.700436+0000","last_active":"2024-02-15T22:56:45.883087+0000","last_peered":"2024-02-15T22:56:45.883087+0000","last_clean":"2024-02-15T22:56:45.883087+0000","last_became_active":"2024-02-15T22:56:03.700087+0000","last_became_peered":"2024-02-15T22:56:03.700087+0000","last_unstale":"2024-02-15T22:56:45.883087+0000","last_undegraded":"2024-02-15T22:56:45.883087+0000","last_fullsized":"2024-02-15T22:56:45.883087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:00.883899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881488+0000","last_change":"2024-02-15T22:56:07.705816+0000","last_active":"2024-02-15T22:56:45.881488+0000","last_peered":"2024-02-15T22:56:45.881488+0000","last_clean":"2024-02-15T22:56:45.881488+0000","last_became_active":"2024-02-15T22:56:07.704502+0000","last_became_peered":"2024-02-15T22:56:07.704502+0000","last_unstale":"2024-02-15T22:56:45.881488+0000","last_undegraded":"2024-02-15T22:56:45.881488+0000","last_fullsized":"2024-02-15T22:56:45.881488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:50.097695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.863329+0000","last_change":"2024-02-15T22:56:09.719447+0000","last_active":"2024-02-15T22:57:29.863329+0000","last_peered":"2024-02-15T22:57:29.863329+0000","last_clean":"2024-02-15T22:57:29.863329+0000","last_became_active":"2024-02-15T22:56:09.717174+0000","last_became_peered":"2024-02-15T22:56:09.717174+0000","last_unstale":"2024-02-15T22:57:29.863329+0000","last_undegraded":"2024-02-15T22:57:29.863329+0000","last_fullsized":"2024-02-15T22:57:29.863329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:00:15.334493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'240","reported_seq":300,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.536541+0000","last_change":"2024-02-15T22:56:11.724657+0000","last_active":"2024-02-15T22:57:35.536541+0000","last_peered":"2024-02-15T22:57:35.536541+0000","last_clean":"2024-02-15T22:57:35.536541+0000","last_became_active":"2024-02-15T22:56:11.724273+0000","last_became_peered":"2024-02-15T22:56:11.724273+0000","last_unstale":"2024-02-15T22:57:35.536541+0000","last_undegraded":"2024-02-15T22:57:35.536541+0000","last_fullsized":"2024-02-15T22:57:35.536541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:26.704898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880623+0000","last_change":"2024-02-15T22:56:13.727119+0000","last_active":"2024-02-15T22:56:45.880623+0000","last_peered":"2024-02-15T22:56:45.880623+0000","last_clean":"2024-02-15T22:56:45.880623+0000","last_became_active":"2024-02-15T22:56:13.726858+0000","last_became_peered":"2024-02-15T22:56:13.726858+0000","last_unstale":"2024-02-15T22:56:45.880623+0000","last_undegraded":"2024-02-15T22:56:45.880623+0000","last_fullsized":"2024-02-15T22:56:45.880623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:04:07.015848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391133+0000","last_change":"2024-02-15T22:56:05.702296+0000","last_active":"2024-02-15T22:57:35.391133+0000","last_peered":"2024-02-15T22:57:35.391133+0000","last_clean":"2024-02-15T22:57:35.391133+0000","last_became_active":"2024-02-15T22:56:05.701568+0000","last_became_peered":"2024-02-15T22:56:05.701568+0000","last_unstale":"2024-02-15T22:57:35.391133+0000","last_undegraded":"2024-02-15T22:57:35.391133+0000","last_fullsized":"2024-02-15T22:57:35.391133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882522+0000","last_change":"2024-02-15T22:56:03.695726+0000","last_active":"2024-02-15T22:56:45.882522+0000","last_peered":"2024-02-15T22:56:45.882522+0000","last_clean":"2024-02-15T22:56:45.882522+0000","last_became_active":"2024-02-15T22:56:03.694668+0000","last_became_peered":"2024-02-15T22:56:03.694668+0000","last_unstale":"2024-02-15T22:56:45.882522+0000","last_undegraded":"2024-02-15T22:56:45.882522+0000","last_fullsized":"2024-02-15T22:56:45.882522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:14:39.799194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879866+0000","last_change":"2024-02-15T22:56:07.705196+0000","last_active":"2024-02-15T22:56:45.879866+0000","last_peered":"2024-02-15T22:56:45.879866+0000","last_clean":"2024-02-15T22:56:45.879866+0000","last_became_active":"2024-02-15T22:56:07.704054+0000","last_became_peered":"2024-02-15T22:56:07.704054+0000","last_unstale":"2024-02-15T22:56:45.879866+0000","last_undegraded":"2024-02-15T22:56:45.879866+0000","last_fullsized":"2024-02-15T22:56:45.879866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:27:50.211880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.351610+0000","last_change":"2024-02-15T22:56:09.719365+0000","last_active":"2024-02-15T22:57:35.351610+0000","last_peered":"2024-02-15T22:57:35.351610+0000","last_clean":"2024-02-15T22:57:35.351610+0000","last_became_active":"2024-02-15T22:56:09.717264+0000","last_became_peered":"2024-02-15T22:56:09.717264+0000","last_unstale":"2024-02-15T22:57:35.351610+0000","last_undegraded":"2024-02-15T22:57:35.351610+0000","last_fullsized":"2024-02-15T22:57:35.351610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:35:46.384248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879496+0000","last_change":"2024-02-15T22:56:11.720901+0000","last_active":"2024-02-15T22:56:45.879496+0000","last_peered":"2024-02-15T22:56:45.879496+0000","last_clean":"2024-02-15T22:56:45.879496+0000","last_became_active":"2024-02-15T22:56:11.720616+0000","last_became_peered":"2024-02-15T22:56:11.720616+0000","last_unstale":"2024-02-15T22:56:45.879496+0000","last_undegraded":"2024-02-15T22:56:45.879496+0000","last_fullsized":"2024-02-15T22:56:45.879496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:05.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.431962+0000","last_change":"2024-02-15T22:56:13.729263+0000","last_active":"2024-02-15T22:56:47.431962+0000","last_peered":"2024-02-15T22:56:47.431962+0000","last_clean":"2024-02-15T22:56:47.431962+0000","last_became_active":"2024-02-15T22:56:13.729015+0000","last_became_peered":"2024-02-15T22:56:13.729015+0000","last_unstale":"2024-02-15T22:56:47.431962+0000","last_undegraded":"2024-02-15T22:56:47.431962+0000","last_fullsized":"2024-02-15T22:56:47.431962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:14:21.943618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.882591+0000","last_change":"2024-02-15T22:56:45.898518+0000","last_active":"2024-02-15T22:56:46.882591+0000","last_peered":"2024-02-15T22:56:46.882591+0000","last_clean":"2024-02-15T22:56:46.882591+0000","last_became_active":"2024-02-15T22:56:45.893017+0000","last_became_peered":"2024-02-15T22:56:45.893017+0000","last_unstale":"2024-02-15T22:56:46.882591+0000","last_undegraded":"2024-02-15T22:56:46.882591+0000","last_fullsized":"2024-02-15T22:56:46.882591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:30.466023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886880+0000","last_change":"2024-02-15T22:56:45.886880+0000","last_active":"2024-02-15T22:56:45.886880+0000","last_peered":"2024-02-15T22:56:45.886880+0000","last_clean":"2024-02-15T22:56:45.886880+0000","last_became_active":"2024-02-15T22:56:45.886530+0000","last_became_peered":"2024-02-15T22:56:45.886530+0000","last_unstale":"2024-02-15T22:56:45.886880+0000","last_undegraded":"2024-02-15T22:56:45.886880+0000","last_fullsized":"2024-02-15T22:56:45.886880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:28.547710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885865+0000","last_change":"2024-02-15T22:56:07.707514+0000","last_active":"2024-02-15T22:56:45.885865+0000","last_peered":"2024-02-15T22:56:45.885865+0000","last_clean":"2024-02-15T22:56:45.885865+0000","last_became_active":"2024-02-15T22:56:07.707207+0000","last_became_peered":"2024-02-15T22:56:07.707207+0000","last_unstale":"2024-02-15T22:56:45.885865+0000","last_undegraded":"2024-02-15T22:56:45.885865+0000","last_fullsized":"2024-02-15T22:56:45.885865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:04:07.685154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.846704+0000","last_change":"2024-02-15T22:56:09.714917+0000","last_active":"2024-02-15T22:57:29.846704+0000","last_peered":"2024-02-15T22:57:29.846704+0000","last_clean":"2024-02-15T22:57:29.846704+0000","last_became_active":"2024-02-15T22:56:09.714592+0000","last_became_peered":"2024-02-15T22:56:09.714592+0000","last_unstale":"2024-02-15T22:57:29.846704+0000","last_undegraded":"2024-02-15T22:57:29.846704+0000","last_fullsized":"2024-02-15T22:57:29.846704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:41.601789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883307+0000","last_change":"2024-02-15T22:56:11.723908+0000","last_active":"2024-02-15T22:56:45.883307+0000","last_peered":"2024-02-15T22:56:45.883307+0000","last_clean":"2024-02-15T22:56:45.883307+0000","last_became_active":"2024-02-15T22:56:11.723557+0000","last_became_peered":"2024-02-15T22:56:11.723557+0000","last_unstale":"2024-02-15T22:56:45.883307+0000","last_undegraded":"2024-02-15T22:56:45.883307+0000","last_fullsized":"2024-02-15T22:56:45.883307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:11:50.121452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879474+0000","last_change":"2024-02-15T22:56:13.727205+0000","last_active":"2024-02-15T22:56:45.879474+0000","last_peered":"2024-02-15T22:56:45.879474+0000","last_clean":"2024-02-15T22:56:45.879474+0000","last_became_active":"2024-02-15T22:56:13.726586+0000","last_became_peered":"2024-02-15T22:56:13.726586+0000","last_unstale":"2024-02-15T22:56:45.879474+0000","last_undegraded":"2024-02-15T22:56:45.879474+0000","last_fullsized":"2024-02-15T22:56:45.879474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:34:15.904436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884445+0000","last_change":"2024-02-15T22:56:05.717008+0000","last_active":"2024-02-15T22:56:45.884445+0000","last_peered":"2024-02-15T22:56:45.884445+0000","last_clean":"2024-02-15T22:56:45.884445+0000","last_became_active":"2024-02-15T22:56:05.716590+0000","last_became_peered":"2024-02-15T22:56:05.716590+0000","last_unstale":"2024-02-15T22:56:45.884445+0000","last_undegraded":"2024-02-15T22:56:45.884445+0000","last_fullsized":"2024-02-15T22:56:45.884445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:02:19.362660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884747+0000","last_change":"2024-02-15T22:56:03.703244+0000","last_active":"2024-02-15T22:56:45.884747+0000","last_peered":"2024-02-15T22:56:45.884747+0000","last_clean":"2024-02-15T22:56:45.884747+0000","last_became_active":"2024-02-15T22:56:03.702875+0000","last_became_peered":"2024-02-15T22:56:03.702875+0000","last_unstale":"2024-02-15T22:56:45.884747+0000","last_undegraded":"2024-02-15T22:56:45.884747+0000","last_fullsized":"2024-02-15T22:56:45.884747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:09.868485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881664+0000","last_change":"2024-02-15T22:56:07.704747+0000","last_active":"2024-02-15T22:56:45.881664+0000","last_peered":"2024-02-15T22:56:45.881664+0000","last_clean":"2024-02-15T22:56:45.881664+0000","last_became_active":"2024-02-15T22:56:07.704058+0000","last_became_peered":"2024-02-15T22:56:07.704058+0000","last_unstale":"2024-02-15T22:56:45.881664+0000","last_undegraded":"2024-02-15T22:56:45.881664+0000","last_fullsized":"2024-02-15T22:56:45.881664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:47.729859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'35","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.871829+0000","last_change":"2024-02-15T22:56:09.712396+0000","last_active":"2024-02-15T22:57:29.871829+0000","last_peered":"2024-02-15T22:57:29.871829+0000","last_clean":"2024-02-15T22:57:29.871829+0000","last_became_active":"2024-02-15T22:56:09.712113+0000","last_became_peered":"2024-02-15T22:56:09.712113+0000","last_unstale":"2024-02-15T22:57:29.871829+0000","last_undegraded":"2024-02-15T22:57:29.871829+0000","last_fullsized":"2024-02-15T22:57:29.871829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:37.230068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'240","reported_seq":331,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.532382+0000","last_change":"2024-02-15T22:56:11.720788+0000","last_active":"2024-02-15T22:57:35.532382+0000","last_peered":"2024-02-15T22:57:35.532382+0000","last_clean":"2024-02-15T22:57:35.532382+0000","last_became_active":"2024-02-15T22:56:11.720390+0000","last_became_peered":"2024-02-15T22:56:11.720390+0000","last_unstale":"2024-02-15T22:57:35.532382+0000","last_undegraded":"2024-02-15T22:57:35.532382+0000","last_fullsized":"2024-02-15T22:57:35.532382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:37.820803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.895237+0000","last_change":"2024-02-15T22:56:13.734537+0000","last_active":"2024-02-15T22:57:29.895237+0000","last_peered":"2024-02-15T22:57:29.895237+0000","last_clean":"2024-02-15T22:57:29.895237+0000","last_became_active":"2024-02-15T22:56:13.734227+0000","last_became_peered":"2024-02-15T22:56:13.734227+0000","last_unstale":"2024-02-15T22:57:29.895237+0000","last_undegraded":"2024-02-15T22:57:29.895237+0000","last_fullsized":"2024-02-15T22:57:29.895237+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:14.942284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887843+0000","last_change":"2024-02-15T22:56:05.706339+0000","last_active":"2024-02-15T22:56:45.887843+0000","last_peered":"2024-02-15T22:56:45.887843+0000","last_clean":"2024-02-15T22:56:45.887843+0000","last_became_active":"2024-02-15T22:56:05.705551+0000","last_became_peered":"2024-02-15T22:56:05.705551+0000","last_unstale":"2024-02-15T22:56:45.887843+0000","last_undegraded":"2024-02-15T22:56:45.887843+0000","last_fullsized":"2024-02-15T22:56:45.887843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.420706+0000","last_change":"2024-02-15T22:56:03.704800+0000","last_active":"2024-02-15T22:56:47.420706+0000","last_peered":"2024-02-15T22:56:47.420706+0000","last_clean":"2024-02-15T22:56:47.420706+0000","last_became_active":"2024-02-15T22:56:03.704526+0000","last_became_peered":"2024-02-15T22:56:03.704526+0000","last_unstale":"2024-02-15T22:56:47.420706+0000","last_undegraded":"2024-02-15T22:56:47.420706+0000","last_fullsized":"2024-02-15T22:56:47.420706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:08:44.767171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'8","reported_seq":530,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:36.326084+0000","last_change":"2024-02-15T22:56:07.704570+0000","last_active":"2024-02-15T22:57:36.326084+0000","last_peered":"2024-02-15T22:57:36.326084+0000","last_clean":"2024-02-15T22:57:36.326084+0000","last_became_active":"2024-02-15T22:56:07.704281+0000","last_became_peered":"2024-02-15T22:56:07.704281+0000","last_unstale":"2024-02-15T22:57:36.326084+0000","last_undegraded":"2024-02-15T22:57:36.326084+0000","last_fullsized":"2024-02-15T22:57:36.326084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:48:03.804538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":588,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882855+0000","last_change":"2024-02-15T22:56:09.719243+0000","last_active":"2024-02-15T22:56:45.882855+0000","last_peered":"2024-02-15T22:56:45.882855+0000","last_clean":"2024-02-15T22:56:45.882855+0000","last_became_active":"2024-02-15T22:56:09.717735+0000","last_became_peered":"2024-02-15T22:56:09.717735+0000","last_unstale":"2024-02-15T22:56:45.882855+0000","last_undegraded":"2024-02-15T22:56:45.882855+0000","last_fullsized":"2024-02-15T22:56:45.882855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:28:54.383976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'240","reported_seq":374,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.533562+0000","last_change":"2024-02-15T22:56:11.717718+0000","last_active":"2024-02-15T22:57:35.533562+0000","last_peered":"2024-02-15T22:57:35.533562+0000","last_clean":"2024-02-15T22:57:35.533562+0000","last_became_active":"2024-02-15T22:56:11.717380+0000","last_became_peered":"2024-02-15T22:56:11.717380+0000","last_unstale":"2024-02-15T22:57:35.533562+0000","last_undegraded":"2024-02-15T22:57:35.533562+0000","last_fullsized":"2024-02-15T22:57:35.533562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:49.146038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.381482+0000","last_change":"2024-02-15T22:56:13.729765+0000","last_active":"2024-02-15T22:57:35.381482+0000","last_peered":"2024-02-15T22:57:35.381482+0000","last_clean":"2024-02-15T22:57:35.381482+0000","last_became_active":"2024-02-15T22:56:13.729467+0000","last_became_peered":"2024-02-15T22:56:13.729467+0000","last_unstale":"2024-02-15T22:57:35.381482+0000","last_undegraded":"2024-02-15T22:57:35.381482+0000","last_fullsized":"2024-02-15T22:57:35.381482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:37.969353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"30'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.901891+0000","last_change":"2024-02-15T22:56:45.901463+0000","last_active":"2024-02-15T22:56:45.901891+0000","last_peered":"2024-02-15T22:56:45.901891+0000","last_clean":"2024-02-15T22:56:45.901891+0000","last_became_active":"2024-02-15T22:56:45.892949+0000","last_became_peered":"2024-02-15T22:56:45.892949+0000","last_unstale":"2024-02-15T22:56:45.901891+0000","last_undegraded":"2024-02-15T22:56:45.901891+0000","last_fullsized":"2024-02-15T22:56:45.901891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:07:27.041414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879850+0000","last_change":"2024-02-15T22:56:03.702334+0000","last_active":"2024-02-15T22:56:45.879850+0000","last_peered":"2024-02-15T22:56:45.879850+0000","last_clean":"2024-02-15T22:56:45.879850+0000","last_became_active":"2024-02-15T22:56:03.702035+0000","last_became_peered":"2024-02-15T22:56:03.702035+0000","last_unstale":"2024-02-15T22:56:45.879850+0000","last_undegraded":"2024-02-15T22:56:45.879850+0000","last_fullsized":"2024-02-15T22:56:45.879850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:00.410598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883534+0000","last_change":"2024-02-15T22:56:07.706890+0000","last_active":"2024-02-15T22:56:45.883534+0000","last_peered":"2024-02-15T22:56:45.883534+0000","last_clean":"2024-02-15T22:56:45.883534+0000","last_became_active":"2024-02-15T22:56:07.706615+0000","last_became_peered":"2024-02-15T22:56:07.706615+0000","last_unstale":"2024-02-15T22:56:45.883534+0000","last_undegraded":"2024-02-15T22:56:45.883534+0000","last_fullsized":"2024-02-15T22:56:45.883534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:00.323059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.858464+0000","last_change":"2024-02-15T22:56:09.714286+0000","last_active":"2024-02-15T22:57:29.858464+0000","last_peered":"2024-02-15T22:57:29.858464+0000","last_clean":"2024-02-15T22:57:29.858464+0000","last_became_active":"2024-02-15T22:56:09.713660+0000","last_became_peered":"2024-02-15T22:56:09.713660+0000","last_unstale":"2024-02-15T22:57:29.858464+0000","last_undegraded":"2024-02-15T22:57:29.858464+0000","last_fullsized":"2024-02-15T22:57:29.858464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:40.603660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885416+0000","last_change":"2024-02-15T22:56:11.724920+0000","last_active":"2024-02-15T22:56:45.885416+0000","last_peered":"2024-02-15T22:56:45.885416+0000","last_clean":"2024-02-15T22:56:45.885416+0000","last_became_active":"2024-02-15T22:56:11.724575+0000","last_became_peered":"2024-02-15T22:56:11.724575+0000","last_unstale":"2024-02-15T22:56:45.885416+0000","last_undegraded":"2024-02-15T22:56:45.885416+0000","last_fullsized":"2024-02-15T22:56:45.885416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:32.467517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878828+0000","last_change":"2024-02-15T22:56:13.722807+0000","last_active":"2024-02-15T22:56:45.878828+0000","last_peered":"2024-02-15T22:56:45.878828+0000","last_clean":"2024-02-15T22:56:45.878828+0000","last_became_active":"2024-02-15T22:56:13.722550+0000","last_became_peered":"2024-02-15T22:56:13.722550+0000","last_unstale":"2024-02-15T22:56:45.878828+0000","last_undegraded":"2024-02-15T22:56:45.878828+0000","last_fullsized":"2024-02-15T22:56:45.878828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:07:35.067373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883476+0000","last_change":"2024-02-15T22:56:05.715752+0000","last_active":"2024-02-15T22:56:45.883476+0000","last_peered":"2024-02-15T22:56:45.883476+0000","last_clean":"2024-02-15T22:56:45.883476+0000","last_became_active":"2024-02-15T22:56:05.715513+0000","last_became_peered":"2024-02-15T22:56:05.715513+0000","last_unstale":"2024-02-15T22:56:45.883476+0000","last_undegraded":"2024-02-15T22:56:45.883476+0000","last_fullsized":"2024-02-15T22:56:45.883476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:26.448260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":198,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.877414+0000","last_change":"2024-02-15T22:55:52.658778+0000","last_active":"2024-02-15T22:56:45.877414+0000","last_peered":"2024-02-15T22:56:45.877414+0000","last_clean":"2024-02-15T22:56:45.877414+0000","last_became_active":"2024-02-15T22:55:52.657750+0000","last_became_peered":"2024-02-15T22:55:52.657750+0000","last_unstale":"2024-02-15T22:56:45.877414+0000","last_undegraded":"2024-02-15T22:56:45.877414+0000","last_fullsized":"2024-02-15T22:56:45.877414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_clean_scrub_stamp":"2024-02-15T22:55:51.648340+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:26.306952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880599+0000","last_change":"2024-02-15T22:55:57.672733+0000","last_active":"2024-02-15T22:56:45.880599+0000","last_peered":"2024-02-15T22:56:45.880599+0000","last_clean":"2024-02-15T22:56:45.880599+0000","last_became_active":"2024-02-15T22:55:57.672281+0000","last_became_peered":"2024-02-15T22:55:57.672281+0000","last_unstale":"2024-02-15T22:56:45.880599+0000","last_undegraded":"2024-02-15T22:56:45.880599+0000","last_fullsized":"2024-02-15T22:56:45.880599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:16:13.571164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881021+0000","last_change":"2024-02-15T22:56:03.707343+0000","last_active":"2024-02-15T22:56:45.881021+0000","last_peered":"2024-02-15T22:56:45.881021+0000","last_clean":"2024-02-15T22:56:45.881021+0000","last_became_active":"2024-02-15T22:56:03.706721+0000","last_became_peered":"2024-02-15T22:56:03.706721+0000","last_unstale":"2024-02-15T22:56:45.881021+0000","last_undegraded":"2024-02-15T22:56:45.881021+0000","last_fullsized":"2024-02-15T22:56:45.881021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:35.787671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887614+0000","last_change":"2024-02-15T22:56:45.887614+0000","last_active":"2024-02-15T22:56:45.887614+0000","last_peered":"2024-02-15T22:56:45.887614+0000","last_clean":"2024-02-15T22:56:45.887614+0000","last_became_active":"2024-02-15T22:56:45.887260+0000","last_became_peered":"2024-02-15T22:56:45.887260+0000","last_unstale":"2024-02-15T22:56:45.887614+0000","last_undegraded":"2024-02-15T22:56:45.887614+0000","last_fullsized":"2024-02-15T22:56:45.887614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:00:13.328033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'70","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.368277+0000","last_change":"2024-02-15T22:56:09.717520+0000","last_active":"2024-02-15T22:57:35.368277+0000","last_peered":"2024-02-15T22:57:35.368277+0000","last_clean":"2024-02-15T22:57:35.368277+0000","last_became_active":"2024-02-15T22:56:09.716109+0000","last_became_peered":"2024-02-15T22:56:09.716109+0000","last_unstale":"2024-02-15T22:57:35.368277+0000","last_undegraded":"2024-02-15T22:57:35.368277+0000","last_fullsized":"2024-02-15T22:57:35.368277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:43:27.838853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881677+0000","last_change":"2024-02-15T22:56:11.722725+0000","last_active":"2024-02-15T22:56:45.881677+0000","last_peered":"2024-02-15T22:56:45.881677+0000","last_clean":"2024-02-15T22:56:45.881677+0000","last_became_active":"2024-02-15T22:56:11.722390+0000","last_became_peered":"2024-02-15T22:56:11.722390+0000","last_unstale":"2024-02-15T22:56:45.881677+0000","last_undegraded":"2024-02-15T22:56:45.881677+0000","last_fullsized":"2024-02-15T22:56:45.881677+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:01.453104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.402200+0000","last_change":"2024-02-15T22:56:13.732746+0000","last_active":"2024-02-15T22:57:35.402200+0000","last_peered":"2024-02-15T22:57:35.402200+0000","last_clean":"2024-02-15T22:57:35.402200+0000","last_became_active":"2024-02-15T22:56:13.732437+0000","last_became_peered":"2024-02-15T22:56:13.732437+0000","last_unstale":"2024-02-15T22:57:35.402200+0000","last_undegraded":"2024-02-15T22:57:35.402200+0000","last_fullsized":"2024-02-15T22:57:35.402200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:19:49.186383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883640+0000","last_change":"2024-02-15T22:56:05.700559+0000","last_active":"2024-02-15T22:56:45.883640+0000","last_peered":"2024-02-15T22:56:45.883640+0000","last_clean":"2024-02-15T22:56:45.883640+0000","last_became_active":"2024-02-15T22:56:05.699679+0000","last_became_peered":"2024-02-15T22:56:05.699679+0000","last_unstale":"2024-02-15T22:56:45.883640+0000","last_undegraded":"2024-02-15T22:56:45.883640+0000","last_fullsized":"2024-02-15T22:56:45.883640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:31.801546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879712+0000","last_change":"2024-02-15T22:55:57.673021+0000","last_active":"2024-02-15T22:56:45.879712+0000","last_peered":"2024-02-15T22:56:45.879712+0000","last_clean":"2024-02-15T22:56:45.879712+0000","last_became_active":"2024-02-15T22:55:57.672705+0000","last_became_peered":"2024-02-15T22:55:57.672705+0000","last_unstale":"2024-02-15T22:56:45.879712+0000","last_undegraded":"2024-02-15T22:56:45.879712+0000","last_fullsized":"2024-02-15T22:56:45.879712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:51.539454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879585+0000","last_change":"2024-02-15T22:56:03.700496+0000","last_active":"2024-02-15T22:56:45.879585+0000","last_peered":"2024-02-15T22:56:45.879585+0000","last_clean":"2024-02-15T22:56:45.879585+0000","last_became_active":"2024-02-15T22:56:03.699864+0000","last_became_peered":"2024-02-15T22:56:03.699864+0000","last_unstale":"2024-02-15T22:56:45.879585+0000","last_undegraded":"2024-02-15T22:56:45.879585+0000","last_fullsized":"2024-02-15T22:56:45.879585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884516+0000","last_change":"2024-02-15T22:56:07.707939+0000","last_active":"2024-02-15T22:56:45.884516+0000","last_peered":"2024-02-15T22:56:45.884516+0000","last_clean":"2024-02-15T22:56:45.884516+0000","last_became_active":"2024-02-15T22:56:07.707620+0000","last_became_peered":"2024-02-15T22:56:07.707620+0000","last_unstale":"2024-02-15T22:56:45.884516+0000","last_undegraded":"2024-02-15T22:56:45.884516+0000","last_fullsized":"2024-02-15T22:56:45.884516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:53.492048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'239","reported_seq":407,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.528301+0000","last_change":"2024-02-15T22:56:09.718681+0000","last_active":"2024-02-15T22:57:35.528301+0000","last_peered":"2024-02-15T22:57:35.528301+0000","last_clean":"2024-02-15T22:57:35.528301+0000","last_became_active":"2024-02-15T22:56:09.718396+0000","last_became_peered":"2024-02-15T22:56:09.718396+0000","last_unstale":"2024-02-15T22:57:35.528301+0000","last_undegraded":"2024-02-15T22:57:35.528301+0000","last_fullsized":"2024-02-15T22:57:35.528301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:24.765590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880720+0000","last_change":"2024-02-15T22:56:11.725286+0000","last_active":"2024-02-15T22:56:45.880720+0000","last_peered":"2024-02-15T22:56:45.880720+0000","last_clean":"2024-02-15T22:56:45.880720+0000","last_became_active":"2024-02-15T22:56:11.725005+0000","last_became_peered":"2024-02-15T22:56:11.725005+0000","last_unstale":"2024-02-15T22:56:45.880720+0000","last_undegraded":"2024-02-15T22:56:45.880720+0000","last_fullsized":"2024-02-15T22:56:45.880720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:29.599168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:24.184779+0000","last_change":"2024-02-15T22:56:13.734036+0000","last_active":"2024-02-15T22:57:24.184779+0000","last_peered":"2024-02-15T22:57:24.184779+0000","last_clean":"2024-02-15T22:57:24.184779+0000","last_became_active":"2024-02-15T22:56:13.733760+0000","last_became_peered":"2024-02-15T22:56:13.733760+0000","last_unstale":"2024-02-15T22:57:24.184779+0000","last_undegraded":"2024-02-15T22:57:24.184779+0000","last_fullsized":"2024-02-15T22:57:24.184779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:52.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881842+0000","last_change":"2024-02-15T22:56:05.706098+0000","last_active":"2024-02-15T22:56:45.881842+0000","last_peered":"2024-02-15T22:56:45.881842+0000","last_clean":"2024-02-15T22:56:45.881842+0000","last_became_active":"2024-02-15T22:56:05.704953+0000","last_became_peered":"2024-02-15T22:56:05.704953+0000","last_unstale":"2024-02-15T22:56:45.881842+0000","last_undegraded":"2024-02-15T22:56:45.881842+0000","last_fullsized":"2024-02-15T22:56:45.881842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:08.839506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881265+0000","last_change":"2024-02-15T22:55:57.671425+0000","last_active":"2024-02-15T22:56:45.881265+0000","last_peered":"2024-02-15T22:56:45.881265+0000","last_clean":"2024-02-15T22:56:45.881265+0000","last_became_active":"2024-02-15T22:55:57.671130+0000","last_became_peered":"2024-02-15T22:55:57.671130+0000","last_unstale":"2024-02-15T22:56:45.881265+0000","last_undegraded":"2024-02-15T22:56:45.881265+0000","last_fullsized":"2024-02-15T22:56:45.881265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:07:19.263513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878991+0000","last_change":"2024-02-15T22:56:03.700250+0000","last_active":"2024-02-15T22:56:45.878991+0000","last_peered":"2024-02-15T22:56:45.878991+0000","last_clean":"2024-02-15T22:56:45.878991+0000","last_became_active":"2024-02-15T22:56:03.699598+0000","last_became_peered":"2024-02-15T22:56:03.699598+0000","last_unstale":"2024-02-15T22:56:45.878991+0000","last_undegraded":"2024-02-15T22:56:45.878991+0000","last_fullsized":"2024-02-15T22:56:45.878991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887215+0000","last_change":"2024-02-15T22:56:07.704552+0000","last_active":"2024-02-15T22:56:45.887215+0000","last_peered":"2024-02-15T22:56:45.887215+0000","last_clean":"2024-02-15T22:56:45.887215+0000","last_became_active":"2024-02-15T22:56:07.704107+0000","last_became_peered":"2024-02-15T22:56:07.704107+0000","last_unstale":"2024-02-15T22:56:45.887215+0000","last_undegraded":"2024-02-15T22:56:45.887215+0000","last_fullsized":"2024-02-15T22:56:45.887215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:40.761923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.400847+0000","last_change":"2024-02-15T22:56:09.711955+0000","last_active":"2024-02-15T22:57:35.400847+0000","last_peered":"2024-02-15T22:57:35.400847+0000","last_clean":"2024-02-15T22:57:35.400847+0000","last_became_active":"2024-02-15T22:56:09.711494+0000","last_became_peered":"2024-02-15T22:56:09.711494+0000","last_unstale":"2024-02-15T22:57:35.400847+0000","last_undegraded":"2024-02-15T22:57:35.400847+0000","last_fullsized":"2024-02-15T22:57:35.400847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:59.298944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880617+0000","last_change":"2024-02-15T22:56:11.722621+0000","last_active":"2024-02-15T22:56:45.880617+0000","last_peered":"2024-02-15T22:56:45.880617+0000","last_clean":"2024-02-15T22:56:45.880617+0000","last_became_active":"2024-02-15T22:56:11.722277+0000","last_became_peered":"2024-02-15T22:56:11.722277+0000","last_unstale":"2024-02-15T22:56:45.880617+0000","last_undegraded":"2024-02-15T22:56:45.880617+0000","last_fullsized":"2024-02-15T22:56:45.880617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:26.041161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880049+0000","last_change":"2024-02-15T22:56:13.726439+0000","last_active":"2024-02-15T22:56:45.880049+0000","last_peered":"2024-02-15T22:56:45.880049+0000","last_clean":"2024-02-15T22:56:45.880049+0000","last_became_active":"2024-02-15T22:56:13.726165+0000","last_became_peered":"2024-02-15T22:56:13.726165+0000","last_unstale":"2024-02-15T22:56:45.880049+0000","last_undegraded":"2024-02-15T22:56:45.880049+0000","last_fullsized":"2024-02-15T22:56:45.880049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:04.405292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'7","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214367+0000","last_change":"2024-02-15T22:56:05.707494+0000","last_active":"2024-02-15T22:57:29.214367+0000","last_peered":"2024-02-15T22:57:29.214367+0000","last_clean":"2024-02-15T22:57:29.214367+0000","last_became_active":"2024-02-15T22:56:05.707171+0000","last_became_peered":"2024-02-15T22:56:05.707171+0000","last_unstale":"2024-02-15T22:57:29.214367+0000","last_undegraded":"2024-02-15T22:57:29.214367+0000","last_fullsized":"2024-02-15T22:57:29.214367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:27:41.335097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880918+0000","last_change":"2024-02-15T22:55:57.672717+0000","last_active":"2024-02-15T22:56:45.880918+0000","last_peered":"2024-02-15T22:56:45.880918+0000","last_clean":"2024-02-15T22:56:45.880918+0000","last_became_active":"2024-02-15T22:55:57.672268+0000","last_became_peered":"2024-02-15T22:55:57.672268+0000","last_unstale":"2024-02-15T22:56:45.880918+0000","last_undegraded":"2024-02-15T22:56:45.880918+0000","last_fullsized":"2024-02-15T22:56:45.880918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:32.276372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882540+0000","last_change":"2024-02-15T22:56:03.697249+0000","last_active":"2024-02-15T22:56:45.882540+0000","last_peered":"2024-02-15T22:56:45.882540+0000","last_clean":"2024-02-15T22:56:45.882540+0000","last_became_active":"2024-02-15T22:56:03.693487+0000","last_became_peered":"2024-02-15T22:56:03.693487+0000","last_unstale":"2024-02-15T22:56:45.882540+0000","last_undegraded":"2024-02-15T22:56:45.882540+0000","last_fullsized":"2024-02-15T22:56:45.882540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:50.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880819+0000","last_change":"2024-02-15T22:56:07.707628+0000","last_active":"2024-02-15T22:56:45.880819+0000","last_peered":"2024-02-15T22:56:45.880819+0000","last_clean":"2024-02-15T22:56:45.880819+0000","last_became_active":"2024-02-15T22:56:07.707227+0000","last_became_peered":"2024-02-15T22:56:07.707227+0000","last_unstale":"2024-02-15T22:56:45.880819+0000","last_undegraded":"2024-02-15T22:56:45.880819+0000","last_fullsized":"2024-02-15T22:56:45.880819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:41:38.827598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884038+0000","last_change":"2024-02-15T22:56:09.720954+0000","last_active":"2024-02-15T22:56:45.884038+0000","last_peered":"2024-02-15T22:56:45.884038+0000","last_clean":"2024-02-15T22:56:45.884038+0000","last_became_active":"2024-02-15T22:56:09.719999+0000","last_became_peered":"2024-02-15T22:56:09.719999+0000","last_unstale":"2024-02-15T22:56:45.884038+0000","last_undegraded":"2024-02-15T22:56:45.884038+0000","last_fullsized":"2024-02-15T22:56:45.884038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:57.194342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883698+0000","last_change":"2024-02-15T22:56:11.724029+0000","last_active":"2024-02-15T22:56:45.883698+0000","last_peered":"2024-02-15T22:56:45.883698+0000","last_clean":"2024-02-15T22:56:45.883698+0000","last_became_active":"2024-02-15T22:56:11.723718+0000","last_became_peered":"2024-02-15T22:56:11.723718+0000","last_unstale":"2024-02-15T22:56:45.883698+0000","last_undegraded":"2024-02-15T22:56:45.883698+0000","last_fullsized":"2024-02-15T22:56:45.883698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:43:01.476474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878038+0000","last_change":"2024-02-15T22:56:13.731187+0000","last_active":"2024-02-15T22:56:45.878038+0000","last_peered":"2024-02-15T22:56:45.878038+0000","last_clean":"2024-02-15T22:56:45.878038+0000","last_became_active":"2024-02-15T22:56:13.730551+0000","last_became_peered":"2024-02-15T22:56:13.730551+0000","last_unstale":"2024-02-15T22:56:45.878038+0000","last_undegraded":"2024-02-15T22:56:45.878038+0000","last_fullsized":"2024-02-15T22:56:45.878038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:00.259943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907683+0000","last_change":"2024-02-15T22:56:05.714866+0000","last_active":"2024-02-15T22:56:47.907683+0000","last_peered":"2024-02-15T22:56:47.907683+0000","last_clean":"2024-02-15T22:56:47.907683+0000","last_became_active":"2024-02-15T22:56:05.714389+0000","last_became_peered":"2024-02-15T22:56:05.714389+0000","last_unstale":"2024-02-15T22:56:47.907683+0000","last_undegraded":"2024-02-15T22:56:47.907683+0000","last_fullsized":"2024-02-15T22:56:47.907683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:02.890481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886225+0000","last_change":"2024-02-15T22:56:03.693895+0000","last_active":"2024-02-15T22:56:45.886225+0000","last_peered":"2024-02-15T22:56:45.886225+0000","last_clean":"2024-02-15T22:56:45.886225+0000","last_became_active":"2024-02-15T22:56:03.693005+0000","last_became_peered":"2024-02-15T22:56:03.693005+0000","last_unstale":"2024-02-15T22:56:45.886225+0000","last_undegraded":"2024-02-15T22:56:45.886225+0000","last_fullsized":"2024-02-15T22:56:45.886225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880275+0000","last_change":"2024-02-15T22:55:57.671879+0000","last_active":"2024-02-15T22:56:45.880275+0000","last_peered":"2024-02-15T22:56:45.880275+0000","last_clean":"2024-02-15T22:56:45.880275+0000","last_became_active":"2024-02-15T22:55:57.671524+0000","last_became_peered":"2024-02-15T22:55:57.671524+0000","last_unstale":"2024-02-15T22:56:45.880275+0000","last_undegraded":"2024-02-15T22:56:45.880275+0000","last_fullsized":"2024-02-15T22:56:45.880275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:09:17.624102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880296+0000","last_change":"2024-02-15T22:56:07.707991+0000","last_active":"2024-02-15T22:56:45.880296+0000","last_peered":"2024-02-15T22:56:45.880296+0000","last_clean":"2024-02-15T22:56:45.880296+0000","last_became_active":"2024-02-15T22:56:07.707281+0000","last_became_peered":"2024-02-15T22:56:07.707281+0000","last_unstale":"2024-02-15T22:56:45.880296+0000","last_undegraded":"2024-02-15T22:56:45.880296+0000","last_fullsized":"2024-02-15T22:56:45.880296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:33:01.136377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'56","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.360300+0000","last_change":"2024-02-15T22:56:09.717947+0000","last_active":"2024-02-15T22:57:35.360300+0000","last_peered":"2024-02-15T22:57:35.360300+0000","last_clean":"2024-02-15T22:57:35.360300+0000","last_became_active":"2024-02-15T22:56:09.717692+0000","last_became_peered":"2024-02-15T22:56:09.717692+0000","last_unstale":"2024-02-15T22:57:35.360300+0000","last_undegraded":"2024-02-15T22:57:35.360300+0000","last_fullsized":"2024-02-15T22:57:35.360300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:32.340996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881741+0000","last_change":"2024-02-15T22:56:11.718632+0000","last_active":"2024-02-15T22:56:45.881741+0000","last_peered":"2024-02-15T22:56:45.881741+0000","last_clean":"2024-02-15T22:56:45.881741+0000","last_became_active":"2024-02-15T22:56:11.718332+0000","last_became_peered":"2024-02-15T22:56:11.718332+0000","last_unstale":"2024-02-15T22:56:45.881741+0000","last_undegraded":"2024-02-15T22:56:45.881741+0000","last_fullsized":"2024-02-15T22:56:45.881741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:38.078071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.872820+0000","last_change":"2024-02-15T22:56:13.723843+0000","last_active":"2024-02-15T22:57:29.872820+0000","last_peered":"2024-02-15T22:57:29.872820+0000","last_clean":"2024-02-15T22:57:29.872820+0000","last_became_active":"2024-02-15T22:56:13.723512+0000","last_became_peered":"2024-02-15T22:56:13.723512+0000","last_unstale":"2024-02-15T22:57:29.872820+0000","last_undegraded":"2024-02-15T22:57:29.872820+0000","last_fullsized":"2024-02-15T22:57:29.872820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:05:21.916643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.906030+0000","last_change":"2024-02-15T22:56:05.713346+0000","last_active":"2024-02-15T22:56:47.906030+0000","last_peered":"2024-02-15T22:56:47.906030+0000","last_clean":"2024-02-15T22:56:47.906030+0000","last_became_active":"2024-02-15T22:56:05.713036+0000","last_became_peered":"2024-02-15T22:56:05.713036+0000","last_unstale":"2024-02-15T22:56:47.906030+0000","last_undegraded":"2024-02-15T22:56:47.906030+0000","last_fullsized":"2024-02-15T22:56:47.906030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:53.786957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880599+0000","last_change":"2024-02-15T22:56:03.699990+0000","last_active":"2024-02-15T22:56:45.880599+0000","last_peered":"2024-02-15T22:56:45.880599+0000","last_clean":"2024-02-15T22:56:45.880599+0000","last_became_active":"2024-02-15T22:56:03.699564+0000","last_became_peered":"2024-02-15T22:56:03.699564+0000","last_unstale":"2024-02-15T22:56:45.880599+0000","last_undegraded":"2024-02-15T22:56:45.880599+0000","last_fullsized":"2024-02-15T22:56:45.880599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:50.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882944+0000","last_change":"2024-02-15T22:55:57.672438+0000","last_active":"2024-02-15T22:56:45.882944+0000","last_peered":"2024-02-15T22:56:45.882944+0000","last_clean":"2024-02-15T22:56:45.882944+0000","last_became_active":"2024-02-15T22:55:57.672053+0000","last_became_peered":"2024-02-15T22:55:57.672053+0000","last_unstale":"2024-02-15T22:56:45.882944+0000","last_undegraded":"2024-02-15T22:56:45.882944+0000","last_fullsized":"2024-02-15T22:56:45.882944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:01.363343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.893645+0000","last_change":"2024-02-15T22:56:45.893645+0000","last_active":"2024-02-15T22:56:45.893645+0000","last_peered":"2024-02-15T22:56:45.893645+0000","last_clean":"2024-02-15T22:56:45.893645+0000","last_became_active":"2024-02-15T22:56:45.893109+0000","last_became_peered":"2024-02-15T22:56:45.893109+0000","last_unstale":"2024-02-15T22:56:45.893645+0000","last_undegraded":"2024-02-15T22:56:45.893645+0000","last_fullsized":"2024-02-15T22:56:45.893645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:43:22.299794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878306+0000","last_change":"2024-02-15T22:56:09.721473+0000","last_active":"2024-02-15T22:56:45.878306+0000","last_peered":"2024-02-15T22:56:45.878306+0000","last_clean":"2024-02-15T22:56:45.878306+0000","last_became_active":"2024-02-15T22:56:09.721140+0000","last_became_peered":"2024-02-15T22:56:09.721140+0000","last_unstale":"2024-02-15T22:56:45.878306+0000","last_undegraded":"2024-02-15T22:56:45.878306+0000","last_fullsized":"2024-02-15T22:56:45.878306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:35.814733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'240","reported_seq":277,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.530512+0000","last_change":"2024-02-15T22:56:11.717865+0000","last_active":"2024-02-15T22:57:35.530512+0000","last_peered":"2024-02-15T22:57:35.530512+0000","last_clean":"2024-02-15T22:57:35.530512+0000","last_became_active":"2024-02-15T22:56:11.717544+0000","last_became_peered":"2024-02-15T22:56:11.717544+0000","last_unstale":"2024-02-15T22:57:35.530512+0000","last_undegraded":"2024-02-15T22:57:35.530512+0000","last_fullsized":"2024-02-15T22:57:35.530512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:08.103224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883381+0000","last_change":"2024-02-15T22:56:13.728952+0000","last_active":"2024-02-15T22:56:45.883381+0000","last_peered":"2024-02-15T22:56:45.883381+0000","last_clean":"2024-02-15T22:56:45.883381+0000","last_became_active":"2024-02-15T22:56:13.728228+0000","last_became_peered":"2024-02-15T22:56:13.728228+0000","last_unstale":"2024-02-15T22:56:45.883381+0000","last_undegraded":"2024-02-15T22:56:45.883381+0000","last_fullsized":"2024-02-15T22:56:45.883381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:28.350108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907892+0000","last_change":"2024-02-15T22:56:05.711219+0000","last_active":"2024-02-15T22:56:47.907892+0000","last_peered":"2024-02-15T22:56:47.907892+0000","last_clean":"2024-02-15T22:56:47.907892+0000","last_became_active":"2024-02-15T22:56:05.710924+0000","last_became_peered":"2024-02-15T22:56:05.710924+0000","last_unstale":"2024-02-15T22:56:47.907892+0000","last_undegraded":"2024-02-15T22:56:47.907892+0000","last_fullsized":"2024-02-15T22:56:47.907892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:00.260239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884070+0000","last_change":"2024-02-15T22:56:03.696202+0000","last_active":"2024-02-15T22:56:45.884070+0000","last_peered":"2024-02-15T22:56:45.884070+0000","last_clean":"2024-02-15T22:56:45.884070+0000","last_became_active":"2024-02-15T22:56:03.695921+0000","last_became_peered":"2024-02-15T22:56:03.695921+0000","last_unstale":"2024-02-15T22:56:45.884070+0000","last_undegraded":"2024-02-15T22:56:45.884070+0000","last_fullsized":"2024-02-15T22:56:45.884070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:10.975589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880782+0000","last_change":"2024-02-15T22:55:57.671686+0000","last_active":"2024-02-15T22:56:45.880782+0000","last_peered":"2024-02-15T22:56:45.880782+0000","last_clean":"2024-02-15T22:56:45.880782+0000","last_became_active":"2024-02-15T22:55:57.671257+0000","last_became_peered":"2024-02-15T22:55:57.671257+0000","last_unstale":"2024-02-15T22:56:45.880782+0000","last_undegraded":"2024-02-15T22:56:45.880782+0000","last_fullsized":"2024-02-15T22:56:45.880782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:04.954542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882599+0000","last_change":"2024-02-15T22:56:07.705589+0000","last_active":"2024-02-15T22:56:45.882599+0000","last_peered":"2024-02-15T22:56:45.882599+0000","last_clean":"2024-02-15T22:56:45.882599+0000","last_became_active":"2024-02-15T22:56:07.705323+0000","last_became_peered":"2024-02-15T22:56:07.705323+0000","last_unstale":"2024-02-15T22:56:45.882599+0000","last_undegraded":"2024-02-15T22:56:45.882599+0000","last_fullsized":"2024-02-15T22:56:45.882599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:10.810269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'11","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884687+0000","last_change":"2024-02-15T22:56:09.729641+0000","last_active":"2024-02-15T22:56:45.884687+0000","last_peered":"2024-02-15T22:56:45.884687+0000","last_clean":"2024-02-15T22:56:45.884687+0000","last_became_active":"2024-02-15T22:56:09.729131+0000","last_became_peered":"2024-02-15T22:56:09.729131+0000","last_unstale":"2024-02-15T22:56:45.884687+0000","last_undegraded":"2024-02-15T22:56:45.884687+0000","last_fullsized":"2024-02-15T22:56:45.884687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:25:53.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'240","reported_seq":310,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.534634+0000","last_change":"2024-02-15T22:56:11.720224+0000","last_active":"2024-02-15T22:57:35.534634+0000","last_peered":"2024-02-15T22:57:35.534634+0000","last_clean":"2024-02-15T22:57:35.534634+0000","last_became_active":"2024-02-15T22:56:11.719685+0000","last_became_peered":"2024-02-15T22:56:11.719685+0000","last_unstale":"2024-02-15T22:57:35.534634+0000","last_undegraded":"2024-02-15T22:57:35.534634+0000","last_fullsized":"2024-02-15T22:57:35.534634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:04.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879177+0000","last_change":"2024-02-15T22:56:13.730782+0000","last_active":"2024-02-15T22:56:45.879177+0000","last_peered":"2024-02-15T22:56:45.879177+0000","last_clean":"2024-02-15T22:56:45.879177+0000","last_became_active":"2024-02-15T22:56:13.730494+0000","last_became_peered":"2024-02-15T22:56:13.730494+0000","last_unstale":"2024-02-15T22:56:45.879177+0000","last_undegraded":"2024-02-15T22:56:45.879177+0000","last_fullsized":"2024-02-15T22:56:45.879177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:06:36.344805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'5","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214087+0000","last_change":"2024-02-15T22:56:05.706030+0000","last_active":"2024-02-15T22:57:29.214087+0000","last_peered":"2024-02-15T22:57:29.214087+0000","last_clean":"2024-02-15T22:57:29.214087+0000","last_became_active":"2024-02-15T22:56:05.705764+0000","last_became_peered":"2024-02-15T22:56:05.705764+0000","last_unstale":"2024-02-15T22:57:29.214087+0000","last_undegraded":"2024-02-15T22:57:29.214087+0000","last_fullsized":"2024-02-15T22:57:29.214087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:49.756184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879958+0000","last_change":"2024-02-15T22:56:03.706073+0000","last_active":"2024-02-15T22:56:45.879958+0000","last_peered":"2024-02-15T22:56:45.879958+0000","last_clean":"2024-02-15T22:56:45.879958+0000","last_became_active":"2024-02-15T22:56:03.705783+0000","last_became_peered":"2024-02-15T22:56:03.705783+0000","last_unstale":"2024-02-15T22:56:45.879958+0000","last_undegraded":"2024-02-15T22:56:45.879958+0000","last_fullsized":"2024-02-15T22:56:45.879958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883785+0000","last_change":"2024-02-15T22:55:57.854108+0000","last_active":"2024-02-15T22:56:45.883785+0000","last_peered":"2024-02-15T22:56:45.883785+0000","last_clean":"2024-02-15T22:56:45.883785+0000","last_became_active":"2024-02-15T22:55:57.853714+0000","last_became_peered":"2024-02-15T22:55:57.853714+0000","last_unstale":"2024-02-15T22:56:45.883785+0000","last_undegraded":"2024-02-15T22:56:45.883785+0000","last_fullsized":"2024-02-15T22:56:45.883785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:25:37.860937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881722+0000","last_change":"2024-02-15T22:56:07.705348+0000","last_active":"2024-02-15T22:56:45.881722+0000","last_peered":"2024-02-15T22:56:45.881722+0000","last_clean":"2024-02-15T22:56:45.881722+0000","last_became_active":"2024-02-15T22:56:07.705013+0000","last_became_peered":"2024-02-15T22:56:07.705013+0000","last_unstale":"2024-02-15T22:56:45.881722+0000","last_undegraded":"2024-02-15T22:56:45.881722+0000","last_fullsized":"2024-02-15T22:56:45.881722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:18:54.870237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'76","reported_seq":147,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.357077+0000","last_change":"2024-02-15T22:56:09.720229+0000","last_active":"2024-02-15T22:57:35.357077+0000","last_peered":"2024-02-15T22:57:35.357077+0000","last_clean":"2024-02-15T22:57:35.357077+0000","last_became_active":"2024-02-15T22:56:09.719916+0000","last_became_peered":"2024-02-15T22:56:09.719916+0000","last_unstale":"2024-02-15T22:57:35.357077+0000","last_undegraded":"2024-02-15T22:57:35.357077+0000","last_fullsized":"2024-02-15T22:57:35.357077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:49.736320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879563+0000","last_change":"2024-02-15T22:56:11.718006+0000","last_active":"2024-02-15T22:56:45.879563+0000","last_peered":"2024-02-15T22:56:45.879563+0000","last_clean":"2024-02-15T22:56:45.879563+0000","last_became_active":"2024-02-15T22:56:11.717758+0000","last_became_peered":"2024-02-15T22:56:11.717758+0000","last_unstale":"2024-02-15T22:56:45.879563+0000","last_undegraded":"2024-02-15T22:56:45.879563+0000","last_fullsized":"2024-02-15T22:56:45.879563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:14.822800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885412+0000","last_change":"2024-02-15T22:56:13.732654+0000","last_active":"2024-02-15T22:56:45.885412+0000","last_peered":"2024-02-15T22:56:45.885412+0000","last_clean":"2024-02-15T22:56:45.885412+0000","last_became_active":"2024-02-15T22:56:13.732325+0000","last_became_peered":"2024-02-15T22:56:13.732325+0000","last_unstale":"2024-02-15T22:56:45.885412+0000","last_undegraded":"2024-02-15T22:56:45.885412+0000","last_fullsized":"2024-02-15T22:56:45.885412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:28.711600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886278+0000","last_change":"2024-02-15T22:56:13.732647+0000","last_active":"2024-02-15T22:56:45.886278+0000","last_peered":"2024-02-15T22:56:45.886278+0000","last_clean":"2024-02-15T22:56:45.886278+0000","last_became_active":"2024-02-15T22:56:13.732216+0000","last_became_peered":"2024-02-15T22:56:13.732216+0000","last_unstale":"2024-02-15T22:56:45.886278+0000","last_undegraded":"2024-02-15T22:56:45.886278+0000","last_fullsized":"2024-02-15T22:56:45.886278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:16.829502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882801+0000","last_change":"2024-02-15T22:56:05.705497+0000","last_active":"2024-02-15T22:56:45.882801+0000","last_peered":"2024-02-15T22:56:45.882801+0000","last_clean":"2024-02-15T22:56:45.882801+0000","last_became_active":"2024-02-15T22:56:05.704959+0000","last_became_peered":"2024-02-15T22:56:05.704959+0000","last_unstale":"2024-02-15T22:56:45.882801+0000","last_undegraded":"2024-02-15T22:56:45.882801+0000","last_fullsized":"2024-02-15T22:56:45.882801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882619+0000","last_change":"2024-02-15T22:56:03.705460+0000","last_active":"2024-02-15T22:56:45.882619+0000","last_peered":"2024-02-15T22:56:45.882619+0000","last_clean":"2024-02-15T22:56:45.882619+0000","last_became_active":"2024-02-15T22:56:03.705176+0000","last_became_peered":"2024-02-15T22:56:03.705176+0000","last_unstale":"2024-02-15T22:56:45.882619+0000","last_undegraded":"2024-02-15T22:56:45.882619+0000","last_fullsized":"2024-02-15T22:56:45.882619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:05:19.142672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878857+0000","last_change":"2024-02-15T22:56:07.703334+0000","last_active":"2024-02-15T22:56:45.878857+0000","last_peered":"2024-02-15T22:56:45.878857+0000","last_clean":"2024-02-15T22:56:45.878857+0000","last_became_active":"2024-02-15T22:56:07.703060+0000","last_became_peered":"2024-02-15T22:56:07.703060+0000","last_unstale":"2024-02-15T22:56:45.878857+0000","last_undegraded":"2024-02-15T22:56:45.878857+0000","last_fullsized":"2024-02-15T22:56:45.878857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:26:26.533319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.862444+0000","last_change":"2024-02-15T22:56:09.720950+0000","last_active":"2024-02-15T22:57:29.862444+0000","last_peered":"2024-02-15T22:57:29.862444+0000","last_clean":"2024-02-15T22:57:29.862444+0000","last_became_active":"2024-02-15T22:56:09.720627+0000","last_became_peered":"2024-02-15T22:56:09.720627+0000","last_unstale":"2024-02-15T22:57:29.862444+0000","last_undegraded":"2024-02-15T22:57:29.862444+0000","last_fullsized":"2024-02-15T22:57:29.862444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:22.567556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881531+0000","last_change":"2024-02-15T22:56:11.724993+0000","last_active":"2024-02-15T22:56:45.881531+0000","last_peered":"2024-02-15T22:56:45.881531+0000","last_clean":"2024-02-15T22:56:45.881531+0000","last_became_active":"2024-02-15T22:56:11.724592+0000","last_became_peered":"2024-02-15T22:56:11.724592+0000","last_unstale":"2024-02-15T22:56:45.881531+0000","last_undegraded":"2024-02-15T22:56:45.881531+0000","last_fullsized":"2024-02-15T22:56:45.881531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:15:05.960640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880472+0000","last_change":"2024-02-15T22:56:13.730249+0000","last_active":"2024-02-15T22:56:45.880472+0000","last_peered":"2024-02-15T22:56:45.880472+0000","last_clean":"2024-02-15T22:56:45.880472+0000","last_became_active":"2024-02-15T22:56:13.729931+0000","last_became_peered":"2024-02-15T22:56:13.729931+0000","last_unstale":"2024-02-15T22:56:45.880472+0000","last_undegraded":"2024-02-15T22:56:45.880472+0000","last_fullsized":"2024-02-15T22:56:45.880472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:56.680543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879015+0000","last_change":"2024-02-15T22:56:05.714662+0000","last_active":"2024-02-15T22:56:45.879015+0000","last_peered":"2024-02-15T22:56:45.879015+0000","last_clean":"2024-02-15T22:56:45.879015+0000","last_became_active":"2024-02-15T22:56:05.714024+0000","last_became_peered":"2024-02-15T22:56:05.714024+0000","last_unstale":"2024-02-15T22:56:45.879015+0000","last_undegraded":"2024-02-15T22:56:45.879015+0000","last_fullsized":"2024-02-15T22:56:45.879015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:27:41.335097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886118+0000","last_change":"2024-02-15T22:56:03.698629+0000","last_active":"2024-02-15T22:56:45.886118+0000","last_peered":"2024-02-15T22:56:45.886118+0000","last_clean":"2024-02-15T22:56:45.886118+0000","last_became_active":"2024-02-15T22:56:03.695339+0000","last_became_peered":"2024-02-15T22:56:03.695339+0000","last_unstale":"2024-02-15T22:56:45.886118+0000","last_undegraded":"2024-02-15T22:56:45.886118+0000","last_fullsized":"2024-02-15T22:56:45.886118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882093+0000","last_change":"2024-02-15T22:56:07.708960+0000","last_active":"2024-02-15T22:56:45.882093+0000","last_peered":"2024-02-15T22:56:45.882093+0000","last_clean":"2024-02-15T22:56:45.882093+0000","last_became_active":"2024-02-15T22:56:07.708692+0000","last_became_peered":"2024-02-15T22:56:07.708692+0000","last_unstale":"2024-02-15T22:56:45.882093+0000","last_undegraded":"2024-02-15T22:56:45.882093+0000","last_fullsized":"2024-02-15T22:56:45.882093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:22.028630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"30'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:23.077273+0000","last_change":"2024-02-15T22:56:09.711326+0000","last_active":"2024-02-15T22:57:23.077273+0000","last_peered":"2024-02-15T22:57:23.077273+0000","last_clean":"2024-02-15T22:57:23.077273+0000","last_became_active":"2024-02-15T22:56:09.710942+0000","last_became_peered":"2024-02-15T22:56:09.710942+0000","last_unstale":"2024-02-15T22:57:23.077273+0000","last_undegraded":"2024-02-15T22:57:23.077273+0000","last_fullsized":"2024-02-15T22:57:23.077273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:53.380084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881415+0000","last_change":"2024-02-15T22:56:11.724852+0000","last_active":"2024-02-15T22:56:45.881415+0000","last_peered":"2024-02-15T22:56:45.881415+0000","last_clean":"2024-02-15T22:56:45.881415+0000","last_became_active":"2024-02-15T22:56:11.724533+0000","last_became_peered":"2024-02-15T22:56:11.724533+0000","last_unstale":"2024-02-15T22:56:45.881415+0000","last_undegraded":"2024-02-15T22:56:45.881415+0000","last_fullsized":"2024-02-15T22:56:45.881415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:34.347066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.216560+0000","last_change":"2024-02-15T22:56:13.734719+0000","last_active":"2024-02-15T22:56:47.216560+0000","last_peered":"2024-02-15T22:56:47.216560+0000","last_clean":"2024-02-15T22:56:47.216560+0000","last_became_active":"2024-02-15T22:56:13.734428+0000","last_became_peered":"2024-02-15T22:56:13.734428+0000","last_unstale":"2024-02-15T22:56:47.216560+0000","last_undegraded":"2024-02-15T22:56:47.216560+0000","last_fullsized":"2024-02-15T22:56:47.216560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:26:47.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883407+0000","last_change":"2024-02-15T22:56:05.706212+0000","last_active":"2024-02-15T22:57:29.883407+0000","last_peered":"2024-02-15T22:57:29.883407+0000","last_clean":"2024-02-15T22:57:29.883407+0000","last_became_active":"2024-02-15T22:56:05.705385+0000","last_became_peered":"2024-02-15T22:56:05.705385+0000","last_unstale":"2024-02-15T22:57:29.883407+0000","last_undegraded":"2024-02-15T22:57:29.883407+0000","last_fullsized":"2024-02-15T22:57:29.883407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:11.875068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886682+0000","last_change":"2024-02-15T22:56:03.700283+0000","last_active":"2024-02-15T22:56:45.886682+0000","last_peered":"2024-02-15T22:56:45.886682+0000","last_clean":"2024-02-15T22:56:45.886682+0000","last_became_active":"2024-02-15T22:56:03.699626+0000","last_became_peered":"2024-02-15T22:56:03.699626+0000","last_unstale":"2024-02-15T22:56:45.886682+0000","last_undegraded":"2024-02-15T22:56:45.886682+0000","last_fullsized":"2024-02-15T22:56:45.886682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880040+0000","last_change":"2024-02-15T22:56:07.706016+0000","last_active":"2024-02-15T22:56:45.880040+0000","last_peered":"2024-02-15T22:56:45.880040+0000","last_clean":"2024-02-15T22:56:45.880040+0000","last_became_active":"2024-02-15T22:56:07.705705+0000","last_became_peered":"2024-02-15T22:56:07.705705+0000","last_unstale":"2024-02-15T22:56:45.880040+0000","last_undegraded":"2024-02-15T22:56:45.880040+0000","last_fullsized":"2024-02-15T22:56:45.880040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:23:10.160782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'34","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.183999+0000","last_change":"2024-02-15T22:56:09.712570+0000","last_active":"2024-02-15T22:57:35.183999+0000","last_peered":"2024-02-15T22:57:35.183999+0000","last_clean":"2024-02-15T22:57:35.183999+0000","last_became_active":"2024-02-15T22:56:09.712337+0000","last_became_peered":"2024-02-15T22:56:09.712337+0000","last_unstale":"2024-02-15T22:57:35.183999+0000","last_undegraded":"2024-02-15T22:57:35.183999+0000","last_fullsized":"2024-02-15T22:57:35.183999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:42.465797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878361+0000","last_change":"2024-02-15T22:56:11.715966+0000","last_active":"2024-02-15T22:56:45.878361+0000","last_peered":"2024-02-15T22:56:45.878361+0000","last_clean":"2024-02-15T22:56:45.878361+0000","last_became_active":"2024-02-15T22:56:11.715697+0000","last_became_peered":"2024-02-15T22:56:11.715697+0000","last_unstale":"2024-02-15T22:56:45.878361+0000","last_undegraded":"2024-02-15T22:56:45.878361+0000","last_fullsized":"2024-02-15T22:56:45.878361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:26.704898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880177+0000","last_change":"2024-02-15T22:56:13.734867+0000","last_active":"2024-02-15T22:56:45.880177+0000","last_peered":"2024-02-15T22:56:45.880177+0000","last_clean":"2024-02-15T22:56:45.880177+0000","last_became_active":"2024-02-15T22:56:13.734565+0000","last_became_peered":"2024-02-15T22:56:13.734565+0000","last_unstale":"2024-02-15T22:56:45.880177+0000","last_undegraded":"2024-02-15T22:56:45.880177+0000","last_fullsized":"2024-02-15T22:56:45.880177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:44:28.581885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'9","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883753+0000","last_change":"2024-02-15T22:56:05.710863+0000","last_active":"2024-02-15T22:57:29.883753+0000","last_peered":"2024-02-15T22:57:29.883753+0000","last_clean":"2024-02-15T22:57:29.883753+0000","last_became_active":"2024-02-15T22:56:05.710562+0000","last_became_peered":"2024-02-15T22:56:05.710562+0000","last_unstale":"2024-02-15T22:57:29.883753+0000","last_undegraded":"2024-02-15T22:57:29.883753+0000","last_fullsized":"2024-02-15T22:57:29.883753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880178+0000","last_change":"2024-02-15T22:56:03.697251+0000","last_active":"2024-02-15T22:56:45.880178+0000","last_peered":"2024-02-15T22:56:45.880178+0000","last_clean":"2024-02-15T22:56:45.880178+0000","last_became_active":"2024-02-15T22:56:03.696590+0000","last_became_peered":"2024-02-15T22:56:03.696590+0000","last_unstale":"2024-02-15T22:56:45.880178+0000","last_undegraded":"2024-02-15T22:56:45.880178+0000","last_fullsized":"2024-02-15T22:56:45.880178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882678+0000","last_change":"2024-02-15T22:56:07.705557+0000","last_active":"2024-02-15T22:56:45.882678+0000","last_peered":"2024-02-15T22:56:45.882678+0000","last_clean":"2024-02-15T22:56:45.882678+0000","last_became_active":"2024-02-15T22:56:07.705239+0000","last_became_peered":"2024-02-15T22:56:07.705239+0000","last_unstale":"2024-02-15T22:56:45.882678+0000","last_undegraded":"2024-02-15T22:56:45.882678+0000","last_fullsized":"2024-02-15T22:56:45.882678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:45.133507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.848608+0000","last_change":"2024-02-15T22:56:09.710915+0000","last_active":"2024-02-15T22:57:29.848608+0000","last_peered":"2024-02-15T22:57:29.848608+0000","last_clean":"2024-02-15T22:57:29.848608+0000","last_became_active":"2024-02-15T22:56:09.710616+0000","last_became_peered":"2024-02-15T22:56:09.710616+0000","last_unstale":"2024-02-15T22:57:29.848608+0000","last_undegraded":"2024-02-15T22:57:29.848608+0000","last_fullsized":"2024-02-15T22:57:29.848608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:52.104156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883516+0000","last_change":"2024-02-15T22:56:11.719273+0000","last_active":"2024-02-15T22:56:45.883516+0000","last_peered":"2024-02-15T22:56:45.883516+0000","last_clean":"2024-02-15T22:56:45.883516+0000","last_became_active":"2024-02-15T22:56:11.718995+0000","last_became_peered":"2024-02-15T22:56:11.718995+0000","last_unstale":"2024-02-15T22:56:45.883516+0000","last_undegraded":"2024-02-15T22:56:45.883516+0000","last_fullsized":"2024-02-15T22:56:45.883516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:42.609730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391474+0000","last_change":"2024-02-15T22:56:05.699435+0000","last_active":"2024-02-15T22:57:35.391474+0000","last_peered":"2024-02-15T22:57:35.391474+0000","last_clean":"2024-02-15T22:57:35.391474+0000","last_became_active":"2024-02-15T22:56:05.699196+0000","last_became_peered":"2024-02-15T22:56:05.699196+0000","last_unstale":"2024-02-15T22:57:35.391474+0000","last_undegraded":"2024-02-15T22:57:35.391474+0000","last_fullsized":"2024-02-15T22:57:35.391474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:28.327809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.216627+0000","last_change":"2024-02-15T22:56:03.702280+0000","last_active":"2024-02-15T22:57:29.216627+0000","last_peered":"2024-02-15T22:57:29.216627+0000","last_clean":"2024-02-15T22:57:29.216627+0000","last_became_active":"2024-02-15T22:56:03.702007+0000","last_became_peered":"2024-02-15T22:56:03.702007+0000","last_unstale":"2024-02-15T22:57:29.216627+0000","last_undegraded":"2024-02-15T22:57:29.216627+0000","last_fullsized":"2024-02-15T22:57:29.216627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:17:47.733980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881599+0000","last_change":"2024-02-15T22:56:07.707669+0000","last_active":"2024-02-15T22:56:45.881599+0000","last_peered":"2024-02-15T22:56:45.881599+0000","last_clean":"2024-02-15T22:56:45.881599+0000","last_became_active":"2024-02-15T22:56:07.707124+0000","last_became_peered":"2024-02-15T22:56:07.707124+0000","last_unstale":"2024-02-15T22:56:45.881599+0000","last_undegraded":"2024-02-15T22:56:45.881599+0000","last_fullsized":"2024-02-15T22:56:45.881599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:46.212262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.354113+0000","last_change":"2024-02-15T22:56:09.713405+0000","last_active":"2024-02-15T22:57:35.354113+0000","last_peered":"2024-02-15T22:57:35.354113+0000","last_clean":"2024-02-15T22:57:35.354113+0000","last_became_active":"2024-02-15T22:56:09.713076+0000","last_became_peered":"2024-02-15T22:56:09.713076+0000","last_unstale":"2024-02-15T22:57:35.354113+0000","last_undegraded":"2024-02-15T22:57:35.354113+0000","last_fullsized":"2024-02-15T22:57:35.354113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:36.072001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885912+0000","last_change":"2024-02-15T22:56:11.718389+0000","last_active":"2024-02-15T22:56:45.885912+0000","last_peered":"2024-02-15T22:56:45.885912+0000","last_clean":"2024-02-15T22:56:45.885912+0000","last_became_active":"2024-02-15T22:56:11.718102+0000","last_became_peered":"2024-02-15T22:56:11.718102+0000","last_unstale":"2024-02-15T22:56:45.885912+0000","last_undegraded":"2024-02-15T22:56:45.885912+0000","last_fullsized":"2024-02-15T22:56:45.885912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:26.771661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.339922+0000","last_change":"2024-02-15T22:56:13.734724+0000","last_active":"2024-02-15T22:57:29.339922+0000","last_peered":"2024-02-15T22:57:29.339922+0000","last_clean":"2024-02-15T22:57:29.339922+0000","last_became_active":"2024-02-15T22:56:13.734372+0000","last_became_peered":"2024-02-15T22:56:13.734372+0000","last_unstale":"2024-02-15T22:57:29.339922+0000","last_undegraded":"2024-02-15T22:57:29.339922+0000","last_fullsized":"2024-02-15T22:57:29.339922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:39.885870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391646+0000","last_change":"2024-02-15T22:56:05.705862+0000","last_active":"2024-02-15T22:57:35.391646+0000","last_peered":"2024-02-15T22:57:35.391646+0000","last_clean":"2024-02-15T22:57:35.391646+0000","last_became_active":"2024-02-15T22:56:05.705473+0000","last_became_peered":"2024-02-15T22:56:05.705473+0000","last_unstale":"2024-02-15T22:57:35.391646+0000","last_undegraded":"2024-02-15T22:57:35.391646+0000","last_fullsized":"2024-02-15T22:57:35.391646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:08.053314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.418196+0000","last_change":"2024-02-15T22:56:03.698010+0000","last_active":"2024-02-15T22:56:47.418196+0000","last_peered":"2024-02-15T22:56:47.418196+0000","last_clean":"2024-02-15T22:56:47.418196+0000","last_became_active":"2024-02-15T22:56:03.697691+0000","last_became_peered":"2024-02-15T22:56:03.697691+0000","last_unstale":"2024-02-15T22:56:47.418196+0000","last_undegraded":"2024-02-15T22:56:47.418196+0000","last_fullsized":"2024-02-15T22:56:47.418196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886468+0000","last_change":"2024-02-15T22:56:07.704334+0000","last_active":"2024-02-15T22:56:45.886468+0000","last_peered":"2024-02-15T22:56:45.886468+0000","last_clean":"2024-02-15T22:56:45.886468+0000","last_became_active":"2024-02-15T22:56:07.704018+0000","last_became_peered":"2024-02-15T22:56:07.704018+0000","last_unstale":"2024-02-15T22:56:45.886468+0000","last_undegraded":"2024-02-15T22:56:45.886468+0000","last_fullsized":"2024-02-15T22:56:45.886468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:59.601424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.849508+0000","last_change":"2024-02-15T22:56:09.717626+0000","last_active":"2024-02-15T22:57:29.849508+0000","last_peered":"2024-02-15T22:57:29.849508+0000","last_clean":"2024-02-15T22:57:29.849508+0000","last_became_active":"2024-02-15T22:56:09.717105+0000","last_became_peered":"2024-02-15T22:56:09.717105+0000","last_unstale":"2024-02-15T22:57:29.849508+0000","last_undegraded":"2024-02-15T22:57:29.849508+0000","last_fullsized":"2024-02-15T22:57:29.849508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:04:03.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882499+0000","last_change":"2024-02-15T22:56:11.723141+0000","last_active":"2024-02-15T22:56:45.882499+0000","last_peered":"2024-02-15T22:56:45.882499+0000","last_clean":"2024-02-15T22:56:45.882499+0000","last_became_active":"2024-02-15T22:56:11.722865+0000","last_became_peered":"2024-02-15T22:56:11.722865+0000","last_unstale":"2024-02-15T22:56:45.882499+0000","last_undegraded":"2024-02-15T22:56:45.882499+0000","last_fullsized":"2024-02-15T22:56:45.882499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:05.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879845+0000","last_change":"2024-02-15T22:56:13.727435+0000","last_active":"2024-02-15T22:56:45.879845+0000","last_peered":"2024-02-15T22:56:45.879845+0000","last_clean":"2024-02-15T22:56:45.879845+0000","last_became_active":"2024-02-15T22:56:13.726748+0000","last_became_peered":"2024-02-15T22:56:13.726748+0000","last_unstale":"2024-02-15T22:56:45.879845+0000","last_undegraded":"2024-02-15T22:56:45.879845+0000","last_fullsized":"2024-02-15T22:56:45.879845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:41:50.659346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883279+0000","last_change":"2024-02-15T22:56:05.716925+0000","last_active":"2024-02-15T22:57:29.883279+0000","last_peered":"2024-02-15T22:57:29.883279+0000","last_clean":"2024-02-15T22:57:29.883279+0000","last_became_active":"2024-02-15T22:56:05.716677+0000","last_became_peered":"2024-02-15T22:56:05.716677+0000","last_unstale":"2024-02-15T22:57:29.883279+0000","last_undegraded":"2024-02-15T22:57:29.883279+0000","last_fullsized":"2024-02-15T22:57:29.883279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:37.588602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878559+0000","last_change":"2024-02-15T22:56:03.692964+0000","last_active":"2024-02-15T22:56:45.878559+0000","last_peered":"2024-02-15T22:56:45.878559+0000","last_clean":"2024-02-15T22:56:45.878559+0000","last_became_active":"2024-02-15T22:56:03.692632+0000","last_became_peered":"2024-02-15T22:56:03.692632+0000","last_unstale":"2024-02-15T22:56:45.878559+0000","last_undegraded":"2024-02-15T22:56:45.878559+0000","last_fullsized":"2024-02-15T22:56:45.878559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:26.885390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885768+0000","last_change":"2024-02-15T22:56:07.704513+0000","last_active":"2024-02-15T22:56:45.885768+0000","last_peered":"2024-02-15T22:56:45.885768+0000","last_clean":"2024-02-15T22:56:45.885768+0000","last_became_active":"2024-02-15T22:56:07.704208+0000","last_became_peered":"2024-02-15T22:56:07.704208+0000","last_unstale":"2024-02-15T22:56:45.885768+0000","last_undegraded":"2024-02-15T22:56:45.885768+0000","last_fullsized":"2024-02-15T22:56:45.885768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:13:55.637902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.894297+0000","last_change":"2024-02-15T22:56:09.717007+0000","last_active":"2024-02-15T22:57:29.894297+0000","last_peered":"2024-02-15T22:57:29.894297+0000","last_clean":"2024-02-15T22:57:29.894297+0000","last_became_active":"2024-02-15T22:56:09.716753+0000","last_became_peered":"2024-02-15T22:56:09.716753+0000","last_unstale":"2024-02-15T22:57:29.894297+0000","last_undegraded":"2024-02-15T22:57:29.894297+0000","last_fullsized":"2024-02-15T22:57:29.894297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:06.528782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880705+0000","last_change":"2024-02-15T22:56:11.722996+0000","last_active":"2024-02-15T22:56:45.880705+0000","last_peered":"2024-02-15T22:56:45.880705+0000","last_clean":"2024-02-15T22:56:45.880705+0000","last_became_active":"2024-02-15T22:56:11.722738+0000","last_became_peered":"2024-02-15T22:56:11.722738+0000","last_unstale":"2024-02-15T22:56:45.880705+0000","last_undegraded":"2024-02-15T22:56:45.880705+0000","last_fullsized":"2024-02-15T22:56:45.880705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:45.887455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880053+0000","last_change":"2024-02-15T22:56:13.727522+0000","last_active":"2024-02-15T22:56:45.880053+0000","last_peered":"2024-02-15T22:56:45.880053+0000","last_clean":"2024-02-15T22:56:45.880053+0000","last_became_active":"2024-02-15T22:56:13.727216+0000","last_became_peered":"2024-02-15T22:56:13.727216+0000","last_unstale":"2024-02-15T22:56:45.880053+0000","last_undegraded":"2024-02-15T22:56:45.880053+0000","last_fullsized":"2024-02-15T22:56:45.880053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:39:14.707814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881181+0000","last_change":"2024-02-15T22:56:05.707488+0000","last_active":"2024-02-15T22:56:45.881181+0000","last_peered":"2024-02-15T22:56:45.881181+0000","last_clean":"2024-02-15T22:56:45.881181+0000","last_became_active":"2024-02-15T22:56:05.707154+0000","last_became_peered":"2024-02-15T22:56:05.707154+0000","last_unstale":"2024-02-15T22:56:45.881181+0000","last_undegraded":"2024-02-15T22:56:45.881181+0000","last_fullsized":"2024-02-15T22:56:45.881181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881248+0000","last_change":"2024-02-15T22:56:03.700157+0000","last_active":"2024-02-15T22:56:45.881248+0000","last_peered":"2024-02-15T22:56:45.881248+0000","last_clean":"2024-02-15T22:56:45.881248+0000","last_became_active":"2024-02-15T22:56:03.699843+0000","last_became_peered":"2024-02-15T22:56:03.699843+0000","last_unstale":"2024-02-15T22:56:45.881248+0000","last_undegraded":"2024-02-15T22:56:45.881248+0000","last_fullsized":"2024-02-15T22:56:45.881248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:47.749601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:36.239355+0000","last_change":"2024-02-15T22:56:07.702631+0000","last_active":"2024-02-15T22:57:36.239355+0000","last_peered":"2024-02-15T22:57:36.239355+0000","last_clean":"2024-02-15T22:57:36.239355+0000","last_became_active":"2024-02-15T22:56:07.702014+0000","last_became_peered":"2024-02-15T22:56:07.702014+0000","last_unstale":"2024-02-15T22:57:36.239355+0000","last_undegraded":"2024-02-15T22:57:36.239355+0000","last_fullsized":"2024-02-15T22:57:36.239355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:02.266965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883138+0000","last_change":"2024-02-15T22:56:09.717362+0000","last_active":"2024-02-15T22:56:45.883138+0000","last_peered":"2024-02-15T22:56:45.883138+0000","last_clean":"2024-02-15T22:56:45.883138+0000","last_became_active":"2024-02-15T22:56:09.715996+0000","last_became_peered":"2024-02-15T22:56:09.715996+0000","last_unstale":"2024-02-15T22:56:45.883138+0000","last_undegraded":"2024-02-15T22:56:45.883138+0000","last_fullsized":"2024-02-15T22:56:45.883138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:10.389319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'240","reported_seq":289,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.529299+0000","last_change":"2024-02-15T22:56:11.725698+0000","last_active":"2024-02-15T22:57:35.529299+0000","last_peered":"2024-02-15T22:57:35.529299+0000","last_clean":"2024-02-15T22:57:35.529299+0000","last_became_active":"2024-02-15T22:56:11.724520+0000","last_became_peered":"2024-02-15T22:56:11.724520+0000","last_unstale":"2024-02-15T22:57:35.529299+0000","last_undegraded":"2024-02-15T22:57:35.529299+0000","last_fullsized":"2024-02-15T22:57:35.529299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:08.534852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879365+0000","last_change":"2024-02-15T22:56:13.731954+0000","last_active":"2024-02-15T22:56:45.879365+0000","last_peered":"2024-02-15T22:56:45.879365+0000","last_clean":"2024-02-15T22:56:45.879365+0000","last_became_active":"2024-02-15T22:56:13.731683+0000","last_became_peered":"2024-02-15T22:56:13.731683+0000","last_unstale":"2024-02-15T22:56:45.879365+0000","last_undegraded":"2024-02-15T22:56:45.879365+0000","last_fullsized":"2024-02-15T22:56:45.879365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:12:05.571855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882882+0000","last_change":"2024-02-15T22:56:05.701652+0000","last_active":"2024-02-15T22:56:45.882882+0000","last_peered":"2024-02-15T22:56:45.882882+0000","last_clean":"2024-02-15T22:56:45.882882+0000","last_became_active":"2024-02-15T22:56:05.700922+0000","last_became_peered":"2024-02-15T22:56:05.700922+0000","last_unstale":"2024-02-15T22:56:45.882882+0000","last_undegraded":"2024-02-15T22:56:45.882882+0000","last_fullsized":"2024-02-15T22:56:45.882882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:11.875068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883283+0000","last_change":"2024-02-15T22:56:03.697064+0000","last_active":"2024-02-15T22:56:45.883283+0000","last_peered":"2024-02-15T22:56:45.883283+0000","last_clean":"2024-02-15T22:56:45.883283+0000","last_became_active":"2024-02-15T22:56:03.696168+0000","last_became_peered":"2024-02-15T22:56:03.696168+0000","last_unstale":"2024-02-15T22:56:45.883283+0000","last_undegraded":"2024-02-15T22:56:45.883283+0000","last_fullsized":"2024-02-15T22:56:45.883283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879369+0000","last_change":"2024-02-15T22:56:07.702419+0000","last_active":"2024-02-15T22:56:45.879369+0000","last_peered":"2024-02-15T22:56:45.879369+0000","last_clean":"2024-02-15T22:56:45.879369+0000","last_became_active":"2024-02-15T22:56:07.701777+0000","last_became_peered":"2024-02-15T22:56:07.701777+0000","last_unstale":"2024-02-15T22:56:45.879369+0000","last_undegraded":"2024-02-15T22:56:45.879369+0000","last_fullsized":"2024-02-15T22:56:45.879369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:35.223607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'35","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.840610+0000","last_change":"2024-02-15T22:56:09.713897+0000","last_active":"2024-02-15T22:57:29.840610+0000","last_peered":"2024-02-15T22:57:29.840610+0000","last_clean":"2024-02-15T22:57:29.840610+0000","last_became_active":"2024-02-15T22:56:09.713636+0000","last_became_peered":"2024-02-15T22:56:09.713636+0000","last_unstale":"2024-02-15T22:57:29.840610+0000","last_undegraded":"2024-02-15T22:57:29.840610+0000","last_fullsized":"2024-02-15T22:57:29.840610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:30.461447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878819+0000","last_change":"2024-02-15T22:56:11.722701+0000","last_active":"2024-02-15T22:56:45.878819+0000","last_peered":"2024-02-15T22:56:45.878819+0000","last_clean":"2024-02-15T22:56:45.878819+0000","last_became_active":"2024-02-15T22:56:11.722374+0000","last_became_peered":"2024-02-15T22:56:11.722374+0000","last_unstale":"2024-02-15T22:56:45.878819+0000","last_undegraded":"2024-02-15T22:56:45.878819+0000","last_fullsized":"2024-02-15T22:56:45.878819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:08.103224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879392+0000","last_change":"2024-02-15T22:56:13.733861+0000","last_active":"2024-02-15T22:56:45.879392+0000","last_peered":"2024-02-15T22:56:45.879392+0000","last_clean":"2024-02-15T22:56:45.879392+0000","last_became_active":"2024-02-15T22:56:13.733576+0000","last_became_peered":"2024-02-15T22:56:13.733576+0000","last_unstale":"2024-02-15T22:56:45.879392+0000","last_undegraded":"2024-02-15T22:56:45.879392+0000","last_fullsized":"2024-02-15T22:56:45.879392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:06.977567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.426850+0000","last_change":"2024-02-15T22:56:05.701307+0000","last_active":"2024-02-15T22:56:47.426850+0000","last_peered":"2024-02-15T22:56:47.426850+0000","last_clean":"2024-02-15T22:56:47.426850+0000","last_became_active":"2024-02-15T22:56:05.701026+0000","last_became_peered":"2024-02-15T22:56:05.701026+0000","last_unstale":"2024-02-15T22:56:47.426850+0000","last_undegraded":"2024-02-15T22:56:47.426850+0000","last_fullsized":"2024-02-15T22:56:47.426850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:08:46.773754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883580+0000","last_change":"2024-02-15T22:56:03.706706+0000","last_active":"2024-02-15T22:56:45.883580+0000","last_peered":"2024-02-15T22:56:45.883580+0000","last_clean":"2024-02-15T22:56:45.883580+0000","last_became_active":"2024-02-15T22:56:03.706422+0000","last_became_peered":"2024-02-15T22:56:03.706422+0000","last_unstale":"2024-02-15T22:56:45.883580+0000","last_undegraded":"2024-02-15T22:56:45.883580+0000","last_fullsized":"2024-02-15T22:56:45.883580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:53.983428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883428+0000","last_change":"2024-02-15T22:56:07.707525+0000","last_active":"2024-02-15T22:56:45.883428+0000","last_peered":"2024-02-15T22:56:45.883428+0000","last_clean":"2024-02-15T22:56:45.883428+0000","last_became_active":"2024-02-15T22:56:07.707265+0000","last_became_peered":"2024-02-15T22:56:07.707265+0000","last_unstale":"2024-02-15T22:56:45.883428+0000","last_undegraded":"2024-02-15T22:56:45.883428+0000","last_fullsized":"2024-02-15T22:56:45.883428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:05:01.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.841622+0000","last_change":"2024-02-15T22:56:09.717128+0000","last_active":"2024-02-15T22:57:29.841622+0000","last_peered":"2024-02-15T22:57:29.841622+0000","last_clean":"2024-02-15T22:57:29.841622+0000","last_became_active":"2024-02-15T22:56:09.716749+0000","last_became_peered":"2024-02-15T22:56:09.716749+0000","last_unstale":"2024-02-15T22:57:29.841622+0000","last_undegraded":"2024-02-15T22:57:29.841622+0000","last_fullsized":"2024-02-15T22:57:29.841622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:31.912815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880224+0000","last_change":"2024-02-15T22:56:11.726028+0000","last_active":"2024-02-15T22:56:45.880224+0000","last_peered":"2024-02-15T22:56:45.880224+0000","last_clean":"2024-02-15T22:56:45.880224+0000","last_became_active":"2024-02-15T22:56:11.725667+0000","last_became_peered":"2024-02-15T22:56:11.725667+0000","last_unstale":"2024-02-15T22:56:45.880224+0000","last_undegraded":"2024-02-15T22:56:45.880224+0000","last_fullsized":"2024-02-15T22:56:45.880224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:33.489028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'8","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881143+0000","last_change":"2024-02-15T22:56:13.729381+0000","last_active":"2024-02-15T22:56:45.881143+0000","last_peered":"2024-02-15T22:56:45.881143+0000","last_clean":"2024-02-15T22:56:45.881143+0000","last_became_active":"2024-02-15T22:56:13.728844+0000","last_became_peered":"2024-02-15T22:56:13.728844+0000","last_unstale":"2024-02-15T22:56:45.881143+0000","last_undegraded":"2024-02-15T22:56:45.881143+0000","last_fullsized":"2024-02-15T22:56:45.881143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:08.247734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214122+0000","last_change":"2024-02-15T22:56:05.701351+0000","last_active":"2024-02-15T22:57:29.214122+0000","last_peered":"2024-02-15T22:57:29.214122+0000","last_clean":"2024-02-15T22:57:29.214122+0000","last_became_active":"2024-02-15T22:56:05.700908+0000","last_became_peered":"2024-02-15T22:56:05.700908+0000","last_unstale":"2024-02-15T22:57:29.214122+0000","last_undegraded":"2024-02-15T22:57:29.214122+0000","last_fullsized":"2024-02-15T22:57:29.214122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:41:03.587630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881194+0000","last_change":"2024-02-15T22:56:03.704371+0000","last_active":"2024-02-15T22:56:45.881194+0000","last_peered":"2024-02-15T22:56:45.881194+0000","last_clean":"2024-02-15T22:56:45.881194+0000","last_became_active":"2024-02-15T22:56:03.704081+0000","last_became_peered":"2024-02-15T22:56:03.704081+0000","last_unstale":"2024-02-15T22:56:45.881194+0000","last_undegraded":"2024-02-15T22:56:45.881194+0000","last_fullsized":"2024-02-15T22:56:45.881194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:52.903955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878100+0000","last_change":"2024-02-15T22:56:07.708809+0000","last_active":"2024-02-15T22:56:45.878100+0000","last_peered":"2024-02-15T22:56:45.878100+0000","last_clean":"2024-02-15T22:56:45.878100+0000","last_became_active":"2024-02-15T22:56:07.708530+0000","last_became_peered":"2024-02-15T22:56:07.708530+0000","last_unstale":"2024-02-15T22:56:45.878100+0000","last_undegraded":"2024-02-15T22:56:45.878100+0000","last_fullsized":"2024-02-15T22:56:45.878100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:57.292484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.864140+0000","last_change":"2024-02-15T22:56:09.717300+0000","last_active":"2024-02-15T22:57:29.864140+0000","last_peered":"2024-02-15T22:57:29.864140+0000","last_clean":"2024-02-15T22:57:29.864140+0000","last_became_active":"2024-02-15T22:56:09.716134+0000","last_became_peered":"2024-02-15T22:56:09.716134+0000","last_unstale":"2024-02-15T22:57:29.864140+0000","last_undegraded":"2024-02-15T22:57:29.864140+0000","last_fullsized":"2024-02-15T22:57:29.864140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:52.667771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":40,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880819+0000","last_change":"2024-02-15T22:56:11.725615+0000","last_active":"2024-02-15T22:56:45.880819+0000","last_peered":"2024-02-15T22:56:45.880819+0000","last_clean":"2024-02-15T22:56:45.880819+0000","last_became_active":"2024-02-15T22:56:11.725271+0000","last_became_peered":"2024-02-15T22:56:11.725271+0000","last_unstale":"2024-02-15T22:56:45.880819+0000","last_undegraded":"2024-02-15T22:56:45.880819+0000","last_fullsized":"2024-02-15T22:56:45.880819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:13.922809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880951+0000","last_change":"2024-02-15T22:56:13.735140+0000","last_active":"2024-02-15T22:56:45.880951+0000","last_peered":"2024-02-15T22:56:45.880951+0000","last_clean":"2024-02-15T22:56:45.880951+0000","last_became_active":"2024-02-15T22:56:13.734871+0000","last_became_peered":"2024-02-15T22:56:13.734871+0000","last_unstale":"2024-02-15T22:56:45.880951+0000","last_undegraded":"2024-02-15T22:56:45.880951+0000","last_fullsized":"2024-02-15T22:56:45.880951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:23:54.224082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'15","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214442+0000","last_change":"2024-02-15T22:56:05.700345+0000","last_active":"2024-02-15T22:57:29.214442+0000","last_peered":"2024-02-15T22:57:29.214442+0000","last_clean":"2024-02-15T22:57:29.214442+0000","last_became_active":"2024-02-15T22:56:05.700066+0000","last_became_peered":"2024-02-15T22:56:05.700066+0000","last_unstale":"2024-02-15T22:57:29.214442+0000","last_undegraded":"2024-02-15T22:57:29.214442+0000","last_fullsized":"2024-02-15T22:57:29.214442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:53.296017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880320+0000","last_change":"2024-02-15T22:56:03.694391+0000","last_active":"2024-02-15T22:56:45.880320+0000","last_peered":"2024-02-15T22:56:45.880320+0000","last_clean":"2024-02-15T22:56:45.880320+0000","last_became_active":"2024-02-15T22:56:03.693300+0000","last_became_peered":"2024-02-15T22:56:03.693300+0000","last_unstale":"2024-02-15T22:56:45.880320+0000","last_undegraded":"2024-02-15T22:56:45.880320+0000","last_fullsized":"2024-02-15T22:56:45.880320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878222+0000","last_change":"2024-02-15T22:56:07.709035+0000","last_active":"2024-02-15T22:56:45.878222+0000","last_peered":"2024-02-15T22:56:45.878222+0000","last_clean":"2024-02-15T22:56:45.878222+0000","last_became_active":"2024-02-15T22:56:07.708720+0000","last_became_peered":"2024-02-15T22:56:07.708720+0000","last_unstale":"2024-02-15T22:56:45.878222+0000","last_undegraded":"2024-02-15T22:56:45.878222+0000","last_fullsized":"2024-02-15T22:56:45.878222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:37.486705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.374757+0000","last_change":"2024-02-15T22:56:09.720664+0000","last_active":"2024-02-15T22:57:35.374757+0000","last_peered":"2024-02-15T22:57:35.374757+0000","last_clean":"2024-02-15T22:57:35.374757+0000","last_became_active":"2024-02-15T22:56:09.717846+0000","last_became_peered":"2024-02-15T22:56:09.717846+0000","last_unstale":"2024-02-15T22:57:35.374757+0000","last_undegraded":"2024-02-15T22:57:35.374757+0000","last_fullsized":"2024-02-15T22:57:35.374757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:14:17.930845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879414+0000","last_change":"2024-02-15T22:56:11.722731+0000","last_active":"2024-02-15T22:56:45.879414+0000","last_peered":"2024-02-15T22:56:45.879414+0000","last_clean":"2024-02-15T22:56:45.879414+0000","last_became_active":"2024-02-15T22:56:11.722402+0000","last_became_peered":"2024-02-15T22:56:11.722402+0000","last_unstale":"2024-02-15T22:56:45.879414+0000","last_undegraded":"2024-02-15T22:56:45.879414+0000","last_fullsized":"2024-02-15T22:56:45.879414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:57.504579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882258+0000","last_change":"2024-02-15T22:56:13.733552+0000","last_active":"2024-02-15T22:56:45.882258+0000","last_peered":"2024-02-15T22:56:45.882258+0000","last_clean":"2024-02-15T22:56:45.882258+0000","last_became_active":"2024-02-15T22:56:13.733285+0000","last_became_peered":"2024-02-15T22:56:13.733285+0000","last_unstale":"2024-02-15T22:56:45.882258+0000","last_undegraded":"2024-02-15T22:56:45.882258+0000","last_fullsized":"2024-02-15T22:56:45.882258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:52:36.091970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391114+0000","last_change":"2024-02-15T22:56:05.715894+0000","last_active":"2024-02-15T22:57:35.391114+0000","last_peered":"2024-02-15T22:57:35.391114+0000","last_clean":"2024-02-15T22:57:35.391114+0000","last_became_active":"2024-02-15T22:56:05.715609+0000","last_became_peered":"2024-02-15T22:56:05.715609+0000","last_unstale":"2024-02-15T22:57:35.391114+0000","last_undegraded":"2024-02-15T22:57:35.391114+0000","last_fullsized":"2024-02-15T22:57:35.391114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:59:43.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880575+0000","last_change":"2024-02-15T22:56:03.694275+0000","last_active":"2024-02-15T22:56:45.880575+0000","last_peered":"2024-02-15T22:56:45.880575+0000","last_clean":"2024-02-15T22:56:45.880575+0000","last_became_active":"2024-02-15T22:56:03.691266+0000","last_became_peered":"2024-02-15T22:56:03.691266+0000","last_unstale":"2024-02-15T22:56:45.880575+0000","last_undegraded":"2024-02-15T22:56:45.880575+0000","last_fullsized":"2024-02-15T22:56:45.880575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:27.775050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215026+0000","last_change":"2024-02-15T22:56:05.707825+0000","last_active":"2024-02-15T22:56:47.215026+0000","last_peered":"2024-02-15T22:56:47.215026+0000","last_clean":"2024-02-15T22:56:47.215026+0000","last_became_active":"2024-02-15T22:56:05.707492+0000","last_became_peered":"2024-02-15T22:56:05.707492+0000","last_unstale":"2024-02-15T22:56:47.215026+0000","last_undegraded":"2024-02-15T22:56:47.215026+0000","last_fullsized":"2024-02-15T22:56:47.215026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:53.786957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879050+0000","last_change":"2024-02-15T22:56:03.693256+0000","last_active":"2024-02-15T22:56:45.879050+0000","last_peered":"2024-02-15T22:56:45.879050+0000","last_clean":"2024-02-15T22:56:45.879050+0000","last_became_active":"2024-02-15T22:56:03.692909+0000","last_became_peered":"2024-02-15T22:56:03.692909+0000","last_unstale":"2024-02-15T22:56:45.879050+0000","last_undegraded":"2024-02-15T22:56:45.879050+0000","last_fullsized":"2024-02-15T22:56:45.879050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215219+0000","last_change":"2024-02-15T22:56:05.710347+0000","last_active":"2024-02-15T22:56:47.215219+0000","last_peered":"2024-02-15T22:56:47.215219+0000","last_clean":"2024-02-15T22:56:47.215219+0000","last_became_active":"2024-02-15T22:56:05.710095+0000","last_became_peered":"2024-02-15T22:56:05.710095+0000","last_unstale":"2024-02-15T22:56:47.215219+0000","last_undegraded":"2024-02-15T22:56:47.215219+0000","last_fullsized":"2024-02-15T22:56:47.215219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:20.752404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884346+0000","last_change":"2024-02-15T22:56:03.695701+0000","last_active":"2024-02-15T22:56:45.884346+0000","last_peered":"2024-02-15T22:56:45.884346+0000","last_clean":"2024-02-15T22:56:45.884346+0000","last_became_active":"2024-02-15T22:56:03.695362+0000","last_became_peered":"2024-02-15T22:56:03.695362+0000","last_unstale":"2024-02-15T22:56:45.884346+0000","last_undegraded":"2024-02-15T22:56:45.884346+0000","last_fullsized":"2024-02-15T22:56:45.884346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:11.575998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391183+0000","last_change":"2024-02-15T22:56:05.701633+0000","last_active":"2024-02-15T22:57:35.391183+0000","last_peered":"2024-02-15T22:57:35.391183+0000","last_clean":"2024-02-15T22:57:35.391183+0000","last_became_active":"2024-02-15T22:56:05.701253+0000","last_became_peered":"2024-02-15T22:56:05.701253+0000","last_unstale":"2024-02-15T22:57:35.391183+0000","last_undegraded":"2024-02-15T22:57:35.391183+0000","last_fullsized":"2024-02-15T22:57:35.391183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880157+0000","last_change":"2024-02-15T22:56:03.700366+0000","last_active":"2024-02-15T22:56:45.880157+0000","last_peered":"2024-02-15T22:56:45.880157+0000","last_clean":"2024-02-15T22:56:45.880157+0000","last_became_active":"2024-02-15T22:56:03.699881+0000","last_became_peered":"2024-02-15T22:56:03.699881+0000","last_unstale":"2024-02-15T22:56:45.880157+0000","last_undegraded":"2024-02-15T22:56:45.880157+0000","last_fullsized":"2024-02-15T22:56:45.880157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887346+0000","last_change":"2024-02-15T22:56:45.887346+0000","last_active":"2024-02-15T22:56:45.887346+0000","last_peered":"2024-02-15T22:56:45.887346+0000","last_clean":"2024-02-15T22:56:45.887346+0000","last_became_active":"2024-02-15T22:56:45.886976+0000","last_became_peered":"2024-02-15T22:56:45.886976+0000","last_unstale":"2024-02-15T22:56:45.887346+0000","last_undegraded":"2024-02-15T22:56:45.887346+0000","last_fullsized":"2024-02-15T22:56:45.887346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:43.710640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.878637+0000","last_change":"2024-02-15T22:56:03.693265+0000","last_active":"2024-02-15T22:57:29.878637+0000","last_peered":"2024-02-15T22:57:29.878637+0000","last_clean":"2024-02-15T22:57:29.878637+0000","last_became_active":"2024-02-15T22:56:03.692939+0000","last_became_peered":"2024-02-15T22:56:03.692939+0000","last_unstale":"2024-02-15T22:57:29.878637+0000","last_undegraded":"2024-02-15T22:57:29.878637+0000","last_fullsized":"2024-02-15T22:57:29.878637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878893+0000","last_change":"2024-02-15T22:56:05.714686+0000","last_active":"2024-02-15T22:56:45.878893+0000","last_peered":"2024-02-15T22:56:45.878893+0000","last_clean":"2024-02-15T22:56:45.878893+0000","last_became_active":"2024-02-15T22:56:05.713670+0000","last_became_peered":"2024-02-15T22:56:05.713670+0000","last_unstale":"2024-02-15T22:56:45.878893+0000","last_undegraded":"2024-02-15T22:56:45.878893+0000","last_fullsized":"2024-02-15T22:56:45.878893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:57.594699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882088+0000","last_change":"2024-02-15T22:56:03.697544+0000","last_active":"2024-02-15T22:56:45.882088+0000","last_peered":"2024-02-15T22:56:45.882088+0000","last_clean":"2024-02-15T22:56:45.882088+0000","last_became_active":"2024-02-15T22:56:03.696174+0000","last_became_peered":"2024-02-15T22:56:03.696174+0000","last_unstale":"2024-02-15T22:56:45.882088+0000","last_undegraded":"2024-02-15T22:56:45.882088+0000","last_fullsized":"2024-02-15T22:56:45.882088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.426942+0000","last_change":"2024-02-15T22:56:05.703501+0000","last_active":"2024-02-15T22:56:47.426942+0000","last_peered":"2024-02-15T22:56:47.426942+0000","last_clean":"2024-02-15T22:56:47.426942+0000","last_became_active":"2024-02-15T22:56:05.703183+0000","last_became_peered":"2024-02-15T22:56:05.703183+0000","last_unstale":"2024-02-15T22:56:47.426942+0000","last_undegraded":"2024-02-15T22:56:47.426942+0000","last_fullsized":"2024-02-15T22:56:47.426942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:08:55.954762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.415547+0000","last_change":"2024-02-15T22:56:03.700841+0000","last_active":"2024-02-15T22:56:47.415547+0000","last_peered":"2024-02-15T22:56:47.415547+0000","last_clean":"2024-02-15T22:56:47.415547+0000","last_became_active":"2024-02-15T22:56:03.699989+0000","last_became_peered":"2024-02-15T22:56:03.699989+0000","last_unstale":"2024-02-15T22:56:47.415547+0000","last_undegraded":"2024-02-15T22:56:47.415547+0000","last_fullsized":"2024-02-15T22:56:47.415547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:24:52.527970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883377+0000","last_change":"2024-02-15T22:56:05.701522+0000","last_active":"2024-02-15T22:57:29.883377+0000","last_peered":"2024-02-15T22:57:29.883377+0000","last_clean":"2024-02-15T22:57:29.883377+0000","last_became_active":"2024-02-15T22:56:05.701193+0000","last_became_peered":"2024-02-15T22:56:05.701193+0000","last_unstale":"2024-02-15T22:57:29.883377+0000","last_undegraded":"2024-02-15T22:57:29.883377+0000","last_fullsized":"2024-02-15T22:57:29.883377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:25:28.743304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881646+0000","last_change":"2024-02-15T22:56:03.693252+0000","last_active":"2024-02-15T22:56:45.881646+0000","last_peered":"2024-02-15T22:56:45.881646+0000","last_clean":"2024-02-15T22:56:45.881646+0000","last_became_active":"2024-02-15T22:56:03.692902+0000","last_became_peered":"2024-02-15T22:56:03.692902+0000","last_unstale":"2024-02-15T22:56:45.881646+0000","last_undegraded":"2024-02-15T22:56:45.881646+0000","last_fullsized":"2024-02-15T22:56:45.881646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:05:12.685609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505930+0000","last_change":"2024-02-15T22:56:05.702770+0000","last_active":"2024-02-15T22:57:29.505930+0000","last_peered":"2024-02-15T22:57:29.505930+0000","last_clean":"2024-02-15T22:57:29.505930+0000","last_became_active":"2024-02-15T22:56:05.702455+0000","last_became_peered":"2024-02-15T22:56:05.702455+0000","last_unstale":"2024-02-15T22:57:29.505930+0000","last_undegraded":"2024-02-15T22:57:29.505930+0000","last_fullsized":"2024-02-15T22:57:29.505930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:31.736198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880494+0000","last_change":"2024-02-15T22:56:03.695480+0000","last_active":"2024-02-15T22:56:45.880494+0000","last_peered":"2024-02-15T22:56:45.880494+0000","last_clean":"2024-02-15T22:56:45.880494+0000","last_became_active":"2024-02-15T22:56:03.695149+0000","last_became_peered":"2024-02-15T22:56:03.695149+0000","last_unstale":"2024-02-15T22:56:45.880494+0000","last_undegraded":"2024-02-15T22:56:45.880494+0000","last_fullsized":"2024-02-15T22:56:45.880494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:25:29.596967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883783+0000","last_change":"2024-02-15T22:56:05.704460+0000","last_active":"2024-02-15T22:56:45.883783+0000","last_peered":"2024-02-15T22:56:45.883783+0000","last_clean":"2024-02-15T22:56:45.883783+0000","last_became_active":"2024-02-15T22:56:05.704211+0000","last_became_peered":"2024-02-15T22:56:05.704211+0000","last_unstale":"2024-02-15T22:56:45.883783+0000","last_undegraded":"2024-02-15T22:56:45.883783+0000","last_fullsized":"2024-02-15T22:56:45.883783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:32.058815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.412910+0000","last_change":"2024-02-15T22:56:03.700242+0000","last_active":"2024-02-15T22:56:47.412910+0000","last_peered":"2024-02-15T22:56:47.412910+0000","last_clean":"2024-02-15T22:56:47.412910+0000","last_became_active":"2024-02-15T22:56:03.699419+0000","last_became_peered":"2024-02-15T22:56:03.699419+0000","last_unstale":"2024-02-15T22:56:47.412910+0000","last_undegraded":"2024-02-15T22:56:47.412910+0000","last_fullsized":"2024-02-15T22:56:47.412910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880395+0000","last_change":"2024-02-15T22:56:05.711089+0000","last_active":"2024-02-15T22:56:45.880395+0000","last_peered":"2024-02-15T22:56:45.880395+0000","last_clean":"2024-02-15T22:56:45.880395+0000","last_became_active":"2024-02-15T22:56:05.710665+0000","last_became_peered":"2024-02-15T22:56:05.710665+0000","last_unstale":"2024-02-15T22:56:45.880395+0000","last_undegraded":"2024-02-15T22:56:45.880395+0000","last_fullsized":"2024-02-15T22:56:45.880395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878725+0000","last_change":"2024-02-15T22:56:03.706180+0000","last_active":"2024-02-15T22:56:45.878725+0000","last_peered":"2024-02-15T22:56:45.878725+0000","last_clean":"2024-02-15T22:56:45.878725+0000","last_became_active":"2024-02-15T22:56:03.705871+0000","last_became_peered":"2024-02-15T22:56:03.705871+0000","last_unstale":"2024-02-15T22:56:45.878725+0000","last_undegraded":"2024-02-15T22:56:45.878725+0000","last_fullsized":"2024-02-15T22:56:45.878725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:27.775050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907691+0000","last_change":"2024-02-15T22:56:05.705174+0000","last_active":"2024-02-15T22:56:47.907691+0000","last_peered":"2024-02-15T22:56:47.907691+0000","last_clean":"2024-02-15T22:56:47.907691+0000","last_became_active":"2024-02-15T22:56:05.704505+0000","last_became_peered":"2024-02-15T22:56:05.704505+0000","last_unstale":"2024-02-15T22:56:47.907691+0000","last_undegraded":"2024-02-15T22:56:47.907691+0000","last_fullsized":"2024-02-15T22:56:47.907691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:43.641211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878881+0000","last_change":"2024-02-15T22:56:03.706212+0000","last_active":"2024-02-15T22:56:45.878881+0000","last_peered":"2024-02-15T22:56:45.878881+0000","last_clean":"2024-02-15T22:56:45.878881+0000","last_became_active":"2024-02-15T22:56:03.705904+0000","last_became_peered":"2024-02-15T22:56:03.705904+0000","last_unstale":"2024-02-15T22:56:45.878881+0000","last_undegraded":"2024-02-15T22:56:45.878881+0000","last_fullsized":"2024-02-15T22:56:45.878881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878616+0000","last_change":"2024-02-15T22:56:05.713346+0000","last_active":"2024-02-15T22:56:45.878616+0000","last_peered":"2024-02-15T22:56:45.878616+0000","last_clean":"2024-02-15T22:56:45.878616+0000","last_became_active":"2024-02-15T22:56:05.713035+0000","last_became_peered":"2024-02-15T22:56:05.713035+0000","last_unstale":"2024-02-15T22:56:45.878616+0000","last_undegraded":"2024-02-15T22:56:45.878616+0000","last_fullsized":"2024-02-15T22:56:45.878616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883260+0000","last_change":"2024-02-15T22:56:03.696317+0000","last_active":"2024-02-15T22:56:45.883260+0000","last_peered":"2024-02-15T22:56:45.883260+0000","last_clean":"2024-02-15T22:56:45.883260+0000","last_became_active":"2024-02-15T22:56:03.696045+0000","last_became_peered":"2024-02-15T22:56:03.696045+0000","last_unstale":"2024-02-15T22:56:45.883260+0000","last_undegraded":"2024-02-15T22:56:45.883260+0000","last_fullsized":"2024-02-15T22:56:45.883260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:41:52.854353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391060+0000","last_change":"2024-02-15T22:56:05.705005+0000","last_active":"2024-02-15T22:57:35.391060+0000","last_peered":"2024-02-15T22:57:35.391060+0000","last_clean":"2024-02-15T22:57:35.391060+0000","last_became_active":"2024-02-15T22:56:05.704733+0000","last_became_peered":"2024-02-15T22:56:05.704733+0000","last_unstale":"2024-02-15T22:57:35.391060+0000","last_undegraded":"2024-02-15T22:57:35.391060+0000","last_fullsized":"2024-02-15T22:57:35.391060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883670+0000","last_change":"2024-02-15T22:56:03.695753+0000","last_active":"2024-02-15T22:56:45.883670+0000","last_peered":"2024-02-15T22:56:45.883670+0000","last_clean":"2024-02-15T22:56:45.883670+0000","last_became_active":"2024-02-15T22:56:03.695454+0000","last_became_peered":"2024-02-15T22:56:03.695454+0000","last_unstale":"2024-02-15T22:56:45.883670+0000","last_undegraded":"2024-02-15T22:56:45.883670+0000","last_fullsized":"2024-02-15T22:56:45.883670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:51.780374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391086+0000","last_change":"2024-02-15T22:56:05.707756+0000","last_active":"2024-02-15T22:57:35.391086+0000","last_peered":"2024-02-15T22:57:35.391086+0000","last_clean":"2024-02-15T22:57:35.391086+0000","last_became_active":"2024-02-15T22:56:05.707464+0000","last_became_peered":"2024-02-15T22:56:05.707464+0000","last_unstale":"2024-02-15T22:57:35.391086+0000","last_undegraded":"2024-02-15T22:57:35.391086+0000","last_fullsized":"2024-02-15T22:57:35.391086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:48:01.797813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.386901+0000","last_change":"2024-02-15T22:56:03.696562+0000","last_active":"2024-02-15T22:57:35.386901+0000","last_peered":"2024-02-15T22:57:35.386901+0000","last_clean":"2024-02-15T22:57:35.386901+0000","last_became_active":"2024-02-15T22:56:03.696267+0000","last_became_peered":"2024-02-15T22:56:03.696267+0000","last_unstale":"2024-02-15T22:57:35.386901+0000","last_undegraded":"2024-02-15T22:57:35.386901+0000","last_fullsized":"2024-02-15T22:57:35.386901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907693+0000","last_change":"2024-02-15T22:56:05.705880+0000","last_active":"2024-02-15T22:56:47.907693+0000","last_peered":"2024-02-15T22:56:47.907693+0000","last_clean":"2024-02-15T22:56:47.907693+0000","last_became_active":"2024-02-15T22:56:05.705496+0000","last_became_peered":"2024-02-15T22:56:05.705496+0000","last_unstale":"2024-02-15T22:56:47.907693+0000","last_undegraded":"2024-02-15T22:56:47.907693+0000","last_fullsized":"2024-02-15T22:56:47.907693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.375500+0000","last_change":"2024-02-15T22:56:03.707531+0000","last_active":"2024-02-15T22:56:46.375500+0000","last_peered":"2024-02-15T22:56:46.375500+0000","last_clean":"2024-02-15T22:56:46.375500+0000","last_became_active":"2024-02-15T22:56:03.707033+0000","last_became_peered":"2024-02-15T22:56:03.707033+0000","last_unstale":"2024-02-15T22:56:46.375500+0000","last_undegraded":"2024-02-15T22:56:46.375500+0000","last_fullsized":"2024-02-15T22:56:46.375500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:06.046731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881067+0000","last_change":"2024-02-15T22:56:03.706143+0000","last_active":"2024-02-15T22:56:45.881067+0000","last_peered":"2024-02-15T22:56:45.881067+0000","last_clean":"2024-02-15T22:56:45.881067+0000","last_became_active":"2024-02-15T22:56:03.705853+0000","last_became_peered":"2024-02-15T22:56:03.705853+0000","last_unstale":"2024-02-15T22:56:45.881067+0000","last_undegraded":"2024-02-15T22:56:45.881067+0000","last_fullsized":"2024-02-15T22:56:45.881067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:01.198670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391176+0000","last_change":"2024-02-15T22:56:05.699396+0000","last_active":"2024-02-15T22:57:35.391176+0000","last_peered":"2024-02-15T22:57:35.391176+0000","last_clean":"2024-02-15T22:57:35.391176+0000","last_became_active":"2024-02-15T22:56:05.699141+0000","last_became_peered":"2024-02-15T22:56:05.699141+0000","last_unstale":"2024-02-15T22:57:35.391176+0000","last_undegraded":"2024-02-15T22:57:35.391176+0000","last_fullsized":"2024-02-15T22:57:35.391176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:02.890481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879188+0000","last_change":"2024-02-15T22:56:03.700573+0000","last_active":"2024-02-15T22:56:45.879188+0000","last_peered":"2024-02-15T22:56:45.879188+0000","last_clean":"2024-02-15T22:56:45.879188+0000","last_became_active":"2024-02-15T22:56:03.700107+0000","last_became_peered":"2024-02-15T22:56:03.700107+0000","last_unstale":"2024-02-15T22:56:45.879188+0000","last_undegraded":"2024-02-15T22:56:45.879188+0000","last_fullsized":"2024-02-15T22:56:45.879188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879724+0000","last_change":"2024-02-15T22:56:05.713543+0000","last_active":"2024-02-15T22:56:45.879724+0000","last_peered":"2024-02-15T22:56:45.879724+0000","last_clean":"2024-02-15T22:56:45.879724+0000","last_became_active":"2024-02-15T22:56:05.713142+0000","last_became_peered":"2024-02-15T22:56:05.713142+0000","last_unstale":"2024-02-15T22:56:45.879724+0000","last_undegraded":"2024-02-15T22:56:45.879724+0000","last_fullsized":"2024-02-15T22:56:45.879724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:23:08.154056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":46,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672986,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35764,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336076,"statfs":{"total":96636764160,"available":96600141824,"internally_reserved":0,"allocated":438272,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.25}]},{"osd":1,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.28000000000000003}]}]},{"osd":2,"up_from":10,"seq":42949672987,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":978944,"data_stored":722767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.441},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.313}]}]},{"osd":1,"up_from":10,"seq":42949672986,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"last":0.313},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.35699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705689,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.377},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.313}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:57:43.568 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T22:57:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.689+0000 7f8a328fb640 1 Processor -- start 2024-02-15T22:57:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.690+0000 7f8a328fb640 1 -- start start 2024-02-15T22:57:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.690+0000 7f8a328fb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8a2c0993f0 0x7f8a2c133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.690+0000 7f8a328fb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c09dc90 con 0x7f8a2c098900 2024-02-15T22:57:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.690+0000 7f8a328fb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c09a170 con 0x7f8a2c0993f0 2024-02-15T22:57:43.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.690+0000 7f8a2b7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8a2c0993f0 0x7f8a2c133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.690+0000 7f8a2bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8a2c098900 0x7f8a2c098ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34766/0 (socket says 172.21.15.52:34766) 2024-02-15T22:57:43.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.690+0000 7f8a2bfff640 1 -- 172.21.15.52:0/118336770 learned_addr learned my addr 172.21.15.52:0/118336770 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:43.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.690+0000 7f8a2b7fe640 1 -- 172.21.15.52:0/118336770 >> v1:172.21.15.52:6789/0 conn(0x7f8a2c098900 legacy=0x7f8a2c098ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.690+0000 7f8a2b7fe640 1 -- 172.21.15.52:0/118336770 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c099d30 con 0x7f8a2c0993f0 2024-02-15T22:57:43.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.690+0000 7f8a2affd640 1 -- 172.21.15.52:0/118336770 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838809123 0 0) 0x7f8a2c09dc90 con 0x7f8a2c098900 2024-02-15T22:57:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.691+0000 7f8a2b7fe640 1 --2- 172.21.15.52:0/118336770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2c0993f0 0x7f8a2c133350 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009720 tx=0x7f8a1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae9f778014761ba server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.691+0000 7f8a2affd640 1 -- 172.21.15.52:0/118336770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a1402e070 con 0x7f8a2c0993f0 2024-02-15T22:57:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.691+0000 7f8a2affd640 1 -- 172.21.15.52:0/118336770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a140316d0 con 0x7f8a2c0993f0 2024-02-15T22:57:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.691+0000 7f8a2affd640 1 -- 172.21.15.52:0/118336770 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a14031990 con 0x7f8a2c0993f0 2024-02-15T22:57:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.692+0000 7f8a328fb640 1 -- 172.21.15.52:0/118336770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2c0993f0 msgr2=0x7f8a2c133350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.692+0000 7f8a328fb640 1 --2- 172.21.15.52:0/118336770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2c0993f0 0x7f8a2c133350 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009720 tx=0x7f8a1402b840 comp rx=0 tx=0).stop 2024-02-15T22:57:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.692+0000 7f8a328fb640 1 -- 172.21.15.52:0/118336770 shutdown_connections 2024-02-15T22:57:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.692+0000 7f8a328fb640 1 --2- 172.21.15.52:0/118336770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2c0993f0 0x7f8a2c133350 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.692+0000 7f8a328fb640 1 -- 172.21.15.52:0/118336770 >> 172.21.15.52:0/118336770 conn(0x7f8a2c0a0a20 msgr2=0x7f8a2c09cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.692+0000 7f8a328fb640 1 -- 172.21.15.52:0/118336770 shutdown_connections 2024-02-15T22:57:43.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.692+0000 7f8a328fb640 1 -- 172.21.15.52:0/118336770 wait complete. 2024-02-15T22:57:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.693+0000 7f8a328fb640 1 Processor -- start 2024-02-15T22:57:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.693+0000 7f8a328fb640 1 -- start start 2024-02-15T22:57:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.693+0000 7f8a328fb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2c098900 0x7f8a2c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.693+0000 7f8a328fb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c12c2a0 con 0x7f8a2c098900 2024-02-15T22:57:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.693+0000 7f8a2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2c098900 0x7f8a2c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.693+0000 7f8a2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2c098900 0x7f8a2c06fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33228/0 (socket says 172.21.15.52:33228) 2024-02-15T22:57:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.693+0000 7f8a2bfff640 1 -- 172.21.15.52:0/1529349598 learned_addr learned my addr 172.21.15.52:0/1529349598 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.693+0000 7f8a2bfff640 1 -- 172.21.15.52:0/1529349598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14009400 con 0x7f8a2c098900 2024-02-15T22:57:43.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.694+0000 7f8a2bfff640 1 --2- 172.21.15.52:0/1529349598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2c098900 0x7f8a2c06fca0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00c420 tx=0x7f8a1c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.694+0000 7f8a28ff9640 1 -- 172.21.15.52:0/1529349598 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a1c0074d0 con 0x7f8a2c098900 2024-02-15T22:57:43.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.694+0000 7f8a28ff9640 1 -- 172.21.15.52:0/1529349598 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c007630 con 0x7f8a2c098900 2024-02-15T22:57:43.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.694+0000 7f8a28ff9640 1 -- 172.21.15.52:0/1529349598 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a1c004950 con 0x7f8a2c098900 2024-02-15T22:57:43.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.694+0000 7f8a328fb640 1 -- 172.21.15.52:0/1529349598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c12c860 con 0x7f8a2c098900 2024-02-15T22:57:43.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.694+0000 7f8a328fb640 1 -- 172.21.15.52:0/1529349598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c071c90 con 0x7f8a2c098900 2024-02-15T22:57:43.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.694+0000 7f8a28ff9640 1 -- 172.21.15.52:0/1529349598 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8a1c004b70 con 0x7f8a2c098900 2024-02-15T22:57:43.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.695+0000 7f8a328fb640 1 -- 172.21.15.52:0/1529349598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c0627b0 con 0x7f8a2c098900 2024-02-15T22:57:43.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.695+0000 7f8a28ff9640 1 --2- 172.21.15.52:0/1529349598 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8a0c037ea0 0x7f8a0c03a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:43.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.695+0000 7f8a28ff9640 1 -- 172.21.15.52:0/1529349598 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f8a1c04a8d0 con 0x7f8a2c098900 2024-02-15T22:57:43.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.695+0000 7f8a2b7fe640 1 --2- 172.21.15.52:0/1529349598 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8a0c037ea0 0x7f8a0c03a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:43.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.695+0000 7f8a2b7fe640 1 --2- 172.21.15.52:0/1529349598 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8a0c037ea0 0x7f8a0c03a360 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8a14036000 tx=0x7f8a14008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:43.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.699+0000 7f8a28ff9640 1 -- 172.21.15.52:0/1529349598 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8a1c01abe0 con 0x7f8a2c098900 2024-02-15T22:57:43.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.875+0000 7f8a328fb640 1 -- 172.21.15.52:0/1529349598 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a2c09d7e0 con 0x7f8a0c037ea0 2024-02-15T22:57:43.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.890+0000 7f8a28ff9640 1 -- 172.21.15.52:0/1529349598 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673027 (secure 0 0 0) 0x7f8a14031b80 con 0x7f8a0c037ea0 2024-02-15T22:57:43.900 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:57:43.905 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-02-15T22:57:43.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.895+0000 7f8a328fb640 1 -- 172.21.15.52:0/1529349598 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8a0c037ea0 msgr2=0x7f8a0c03a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.895+0000 7f8a328fb640 1 --2- 172.21.15.52:0/1529349598 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8a0c037ea0 0x7f8a0c03a360 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8a14036000 tx=0x7f8a14008030 comp rx=0 tx=0).stop 2024-02-15T22:57:43.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.895+0000 7f8a328fb640 1 -- 172.21.15.52:0/1529349598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2c098900 msgr2=0x7f8a2c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:43.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.895+0000 7f8a328fb640 1 --2- 172.21.15.52:0/1529349598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2c098900 0x7f8a2c06fca0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00c420 tx=0x7f8a1c00c8e0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.895+0000 7f8a328fb640 1 -- 172.21.15.52:0/1529349598 shutdown_connections 2024-02-15T22:57:43.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.895+0000 7f8a328fb640 1 --2- 172.21.15.52:0/1529349598 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f8a0c037ea0 0x7f8a0c03a360 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.895+0000 7f8a328fb640 1 --2- 172.21.15.52:0/1529349598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2c098900 0x7f8a2c06fca0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:43.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.895+0000 7f8a328fb640 1 -- 172.21.15.52:0/1529349598 >> 172.21.15.52:0/1529349598 conn(0x7f8a2c0a0a20 msgr2=0x7f8a2c09b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:43.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.895+0000 7f8a328fb640 1 -- 172.21.15.52:0/1529349598 shutdown_connections 2024-02-15T22:57:43.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:43.895+0000 7f8a328fb640 1 -- 172.21.15.52:0/1529349598 wait complete. 2024-02-15T22:57:43.909 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-02-15T22:57:42.832792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3806,"num_read_kb":3453,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135792,"kb_used_data":2768,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351568,"statfs":{"total":386547056640,"available":386408005632,"internally_reserved":0,"allocated":2834432,"data_stored":1715324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1348,"num_objects":-27,"num_object_clones":0,"num_object_copies":-54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":270,"num_read_kb":261,"num_write":97,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003970"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887013+0000","last_change":"2024-02-15T22:56:03.700271+0000","last_active":"2024-02-15T22:56:45.887013+0000","last_peered":"2024-02-15T22:56:45.887013+0000","last_clean":"2024-02-15T22:56:45.887013+0000","last_became_active":"2024-02-15T22:56:03.699163+0000","last_became_peered":"2024-02-15T22:56:03.699163+0000","last_unstale":"2024-02-15T22:56:45.887013+0000","last_undegraded":"2024-02-15T22:56:45.887013+0000","last_fullsized":"2024-02-15T22:56:45.887013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391099+0000","last_change":"2024-02-15T22:56:05.708737+0000","last_active":"2024-02-15T22:57:35.391099+0000","last_peered":"2024-02-15T22:57:35.391099+0000","last_clean":"2024-02-15T22:57:35.391099+0000","last_became_active":"2024-02-15T22:56:05.708415+0000","last_became_peered":"2024-02-15T22:56:05.708415+0000","last_unstale":"2024-02-15T22:57:35.391099+0000","last_undegraded":"2024-02-15T22:57:35.391099+0000","last_fullsized":"2024-02-15T22:57:35.391099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:08.839506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881047+0000","last_change":"2024-02-15T22:56:03.704350+0000","last_active":"2024-02-15T22:56:45.881047+0000","last_peered":"2024-02-15T22:56:45.881047+0000","last_clean":"2024-02-15T22:56:45.881047+0000","last_became_active":"2024-02-15T22:56:03.704043+0000","last_became_peered":"2024-02-15T22:56:03.704043+0000","last_unstale":"2024-02-15T22:56:45.881047+0000","last_undegraded":"2024-02-15T22:56:45.881047+0000","last_fullsized":"2024-02-15T22:56:45.881047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:27.186561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882461+0000","last_change":"2024-02-15T22:56:05.703860+0000","last_active":"2024-02-15T22:56:45.882461+0000","last_peered":"2024-02-15T22:56:45.882461+0000","last_clean":"2024-02-15T22:56:45.882461+0000","last_became_active":"2024-02-15T22:56:05.703587+0000","last_became_peered":"2024-02-15T22:56:05.703587+0000","last_unstale":"2024-02-15T22:56:45.882461+0000","last_undegraded":"2024-02-15T22:56:45.882461+0000","last_fullsized":"2024-02-15T22:56:45.882461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:18.837089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884271+0000","last_change":"2024-02-15T22:56:03.703994+0000","last_active":"2024-02-15T22:56:45.884271+0000","last_peered":"2024-02-15T22:56:45.884271+0000","last_clean":"2024-02-15T22:56:45.884271+0000","last_became_active":"2024-02-15T22:56:03.703702+0000","last_became_peered":"2024-02-15T22:56:03.703702+0000","last_unstale":"2024-02-15T22:56:45.884271+0000","last_undegraded":"2024-02-15T22:56:45.884271+0000","last_fullsized":"2024-02-15T22:56:45.884271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:44.096887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883441+0000","last_change":"2024-02-15T22:56:05.709355+0000","last_active":"2024-02-15T22:57:29.883441+0000","last_peered":"2024-02-15T22:57:29.883441+0000","last_clean":"2024-02-15T22:57:29.883441+0000","last_became_active":"2024-02-15T22:56:05.709003+0000","last_became_peered":"2024-02-15T22:56:05.709003+0000","last_unstale":"2024-02-15T22:57:29.883441+0000","last_undegraded":"2024-02-15T22:57:29.883441+0000","last_fullsized":"2024-02-15T22:57:29.883441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:26:24.526593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885342+0000","last_change":"2024-02-15T22:56:03.692040+0000","last_active":"2024-02-15T22:56:45.885342+0000","last_peered":"2024-02-15T22:56:45.885342+0000","last_clean":"2024-02-15T22:56:45.885342+0000","last_became_active":"2024-02-15T22:56:03.691753+0000","last_became_peered":"2024-02-15T22:56:03.691753+0000","last_unstale":"2024-02-15T22:56:45.885342+0000","last_undegraded":"2024-02-15T22:56:45.885342+0000","last_fullsized":"2024-02-15T22:56:45.885342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214184+0000","last_change":"2024-02-15T22:56:05.703818+0000","last_active":"2024-02-15T22:57:29.214184+0000","last_peered":"2024-02-15T22:57:29.214184+0000","last_clean":"2024-02-15T22:57:29.214184+0000","last_became_active":"2024-02-15T22:56:05.703541+0000","last_became_peered":"2024-02-15T22:56:05.703541+0000","last_unstale":"2024-02-15T22:57:29.214184+0000","last_undegraded":"2024-02-15T22:57:29.214184+0000","last_fullsized":"2024-02-15T22:57:29.214184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:49.366897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881533+0000","last_change":"2024-02-15T22:56:03.694830+0000","last_active":"2024-02-15T22:56:45.881533+0000","last_peered":"2024-02-15T22:56:45.881533+0000","last_clean":"2024-02-15T22:56:45.881533+0000","last_became_active":"2024-02-15T22:56:03.694522+0000","last_became_peered":"2024-02-15T22:56:03.694522+0000","last_unstale":"2024-02-15T22:56:45.881533+0000","last_undegraded":"2024-02-15T22:56:45.881533+0000","last_fullsized":"2024-02-15T22:56:45.881533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:51.289434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.875000+0000","last_change":"2024-02-15T22:56:05.705402+0000","last_active":"2024-02-15T22:56:46.875000+0000","last_peered":"2024-02-15T22:56:46.875000+0000","last_clean":"2024-02-15T22:56:46.875000+0000","last_became_active":"2024-02-15T22:56:05.704411+0000","last_became_peered":"2024-02-15T22:56:05.704411+0000","last_unstale":"2024-02-15T22:56:46.875000+0000","last_undegraded":"2024-02-15T22:56:46.875000+0000","last_fullsized":"2024-02-15T22:56:46.875000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:12.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882213+0000","last_change":"2024-02-15T22:56:03.692633+0000","last_active":"2024-02-15T22:56:45.882213+0000","last_peered":"2024-02-15T22:56:45.882213+0000","last_clean":"2024-02-15T22:56:45.882213+0000","last_became_active":"2024-02-15T22:56:03.692316+0000","last_became_peered":"2024-02-15T22:56:03.692316+0000","last_unstale":"2024-02-15T22:56:45.882213+0000","last_undegraded":"2024-02-15T22:56:45.882213+0000","last_fullsized":"2024-02-15T22:56:45.882213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:26.885390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.214550+0000","last_change":"2024-02-15T22:56:05.715708+0000","last_active":"2024-02-15T22:56:47.214550+0000","last_peered":"2024-02-15T22:56:47.214550+0000","last_clean":"2024-02-15T22:56:47.214550+0000","last_became_active":"2024-02-15T22:56:05.715460+0000","last_became_peered":"2024-02-15T22:56:05.715460+0000","last_unstale":"2024-02-15T22:56:47.214550+0000","last_undegraded":"2024-02-15T22:56:47.214550+0000","last_fullsized":"2024-02-15T22:56:47.214550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:27.899628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.858213+0000","last_change":"2024-02-15T22:56:03.701184+0000","last_active":"2024-02-15T22:56:46.858213+0000","last_peered":"2024-02-15T22:56:46.858213+0000","last_clean":"2024-02-15T22:56:46.858213+0000","last_became_active":"2024-02-15T22:56:03.700908+0000","last_became_peered":"2024-02-15T22:56:03.700908+0000","last_unstale":"2024-02-15T22:56:46.858213+0000","last_undegraded":"2024-02-15T22:56:46.858213+0000","last_fullsized":"2024-02-15T22:56:46.858213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:10.798077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883471+0000","last_change":"2024-02-15T22:56:05.706807+0000","last_active":"2024-02-15T22:57:29.883471+0000","last_peered":"2024-02-15T22:57:29.883471+0000","last_clean":"2024-02-15T22:57:29.883471+0000","last_became_active":"2024-02-15T22:56:05.706078+0000","last_became_peered":"2024-02-15T22:56:05.706078+0000","last_unstale":"2024-02-15T22:57:29.883471+0000","last_undegraded":"2024-02-15T22:57:29.883471+0000","last_fullsized":"2024-02-15T22:57:29.883471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879163+0000","last_change":"2024-02-15T22:56:03.697612+0000","last_active":"2024-02-15T22:56:45.879163+0000","last_peered":"2024-02-15T22:56:45.879163+0000","last_clean":"2024-02-15T22:56:45.879163+0000","last_became_active":"2024-02-15T22:56:03.697327+0000","last_became_peered":"2024-02-15T22:56:03.697327+0000","last_unstale":"2024-02-15T22:56:45.879163+0000","last_undegraded":"2024-02-15T22:56:45.879163+0000","last_fullsized":"2024-02-15T22:56:45.879163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886735+0000","last_change":"2024-02-15T22:56:05.705497+0000","last_active":"2024-02-15T22:56:45.886735+0000","last_peered":"2024-02-15T22:56:45.886735+0000","last_clean":"2024-02-15T22:56:45.886735+0000","last_became_active":"2024-02-15T22:56:05.705173+0000","last_became_peered":"2024-02-15T22:56:05.705173+0000","last_unstale":"2024-02-15T22:56:45.886735+0000","last_undegraded":"2024-02-15T22:56:45.886735+0000","last_fullsized":"2024-02-15T22:56:45.886735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:12.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.214944+0000","last_change":"2024-02-15T22:56:05.704020+0000","last_active":"2024-02-15T22:56:47.214944+0000","last_peered":"2024-02-15T22:56:47.214944+0000","last_clean":"2024-02-15T22:56:47.214944+0000","last_became_active":"2024-02-15T22:56:05.703708+0000","last_became_peered":"2024-02-15T22:56:05.703708+0000","last_unstale":"2024-02-15T22:56:47.214944+0000","last_undegraded":"2024-02-15T22:56:47.214944+0000","last_fullsized":"2024-02-15T22:56:47.214944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:55.285758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880443+0000","last_change":"2024-02-15T22:56:03.697488+0000","last_active":"2024-02-15T22:56:45.880443+0000","last_peered":"2024-02-15T22:56:45.880443+0000","last_clean":"2024-02-15T22:56:45.880443+0000","last_became_active":"2024-02-15T22:56:03.696959+0000","last_became_peered":"2024-02-15T22:56:03.696959+0000","last_unstale":"2024-02-15T22:56:45.880443+0000","last_undegraded":"2024-02-15T22:56:45.880443+0000","last_fullsized":"2024-02-15T22:56:45.880443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883271+0000","last_change":"2024-02-15T22:56:05.700345+0000","last_active":"2024-02-15T22:57:29.883271+0000","last_peered":"2024-02-15T22:57:29.883271+0000","last_clean":"2024-02-15T22:57:29.883271+0000","last_became_active":"2024-02-15T22:56:05.700071+0000","last_became_peered":"2024-02-15T22:56:05.700071+0000","last_unstale":"2024-02-15T22:57:29.883271+0000","last_undegraded":"2024-02-15T22:57:29.883271+0000","last_fullsized":"2024-02-15T22:57:29.883271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887112+0000","last_change":"2024-02-15T22:56:03.700009+0000","last_active":"2024-02-15T22:56:45.887112+0000","last_peered":"2024-02-15T22:56:45.887112+0000","last_clean":"2024-02-15T22:56:45.887112+0000","last_became_active":"2024-02-15T22:56:03.699574+0000","last_became_peered":"2024-02-15T22:56:03.699574+0000","last_unstale":"2024-02-15T22:56:45.887112+0000","last_undegraded":"2024-02-15T22:56:45.887112+0000","last_fullsized":"2024-02-15T22:56:45.887112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391273+0000","last_change":"2024-02-15T22:56:05.702837+0000","last_active":"2024-02-15T22:57:35.391273+0000","last_peered":"2024-02-15T22:57:35.391273+0000","last_clean":"2024-02-15T22:57:35.391273+0000","last_became_active":"2024-02-15T22:56:05.702488+0000","last_became_peered":"2024-02-15T22:56:05.702488+0000","last_unstale":"2024-02-15T22:57:35.391273+0000","last_undegraded":"2024-02-15T22:57:35.391273+0000","last_fullsized":"2024-02-15T22:57:35.391273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:38.755197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886045+0000","last_change":"2024-02-15T22:56:45.886045+0000","last_active":"2024-02-15T22:56:45.886045+0000","last_peered":"2024-02-15T22:56:45.886045+0000","last_clean":"2024-02-15T22:56:45.886045+0000","last_became_active":"2024-02-15T22:56:45.885555+0000","last_became_peered":"2024-02-15T22:56:45.885555+0000","last_unstale":"2024-02-15T22:56:45.886045+0000","last_undegraded":"2024-02-15T22:56:45.886045+0000","last_fullsized":"2024-02-15T22:56:45.886045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:17.695860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214283+0000","last_change":"2024-02-15T22:56:05.706693+0000","last_active":"2024-02-15T22:57:29.214283+0000","last_peered":"2024-02-15T22:57:29.214283+0000","last_clean":"2024-02-15T22:57:29.214283+0000","last_became_active":"2024-02-15T22:56:05.705386+0000","last_became_peered":"2024-02-15T22:56:05.705386+0000","last_unstale":"2024-02-15T22:57:29.214283+0000","last_undegraded":"2024-02-15T22:57:29.214283+0000","last_fullsized":"2024-02-15T22:57:29.214283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879821+0000","last_change":"2024-02-15T22:56:03.693697+0000","last_active":"2024-02-15T22:56:45.879821+0000","last_peered":"2024-02-15T22:56:45.879821+0000","last_clean":"2024-02-15T22:56:45.879821+0000","last_became_active":"2024-02-15T22:56:03.693329+0000","last_became_peered":"2024-02-15T22:56:03.693329+0000","last_unstale":"2024-02-15T22:56:45.879821+0000","last_undegraded":"2024-02-15T22:56:45.879821+0000","last_fullsized":"2024-02-15T22:56:45.879821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214299+0000","last_change":"2024-02-15T22:56:05.705032+0000","last_active":"2024-02-15T22:57:29.214299+0000","last_peered":"2024-02-15T22:57:29.214299+0000","last_clean":"2024-02-15T22:57:29.214299+0000","last_became_active":"2024-02-15T22:56:05.704729+0000","last_became_peered":"2024-02-15T22:56:05.704729+0000","last_unstale":"2024-02-15T22:57:29.214299+0000","last_undegraded":"2024-02-15T22:57:29.214299+0000","last_fullsized":"2024-02-15T22:57:29.214299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:13.582581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880416+0000","last_change":"2024-02-15T22:56:03.704183+0000","last_active":"2024-02-15T22:56:45.880416+0000","last_peered":"2024-02-15T22:56:45.880416+0000","last_clean":"2024-02-15T22:56:45.880416+0000","last_became_active":"2024-02-15T22:56:03.703885+0000","last_became_peered":"2024-02-15T22:56:03.703885+0000","last_unstale":"2024-02-15T22:56:45.880416+0000","last_undegraded":"2024-02-15T22:56:45.880416+0000","last_fullsized":"2024-02-15T22:56:45.880416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214309+0000","last_change":"2024-02-15T22:56:05.698851+0000","last_active":"2024-02-15T22:57:29.214309+0000","last_peered":"2024-02-15T22:57:29.214309+0000","last_clean":"2024-02-15T22:57:29.214309+0000","last_became_active":"2024-02-15T22:56:05.698553+0000","last_became_peered":"2024-02-15T22:56:05.698553+0000","last_unstale":"2024-02-15T22:57:29.214309+0000","last_undegraded":"2024-02-15T22:57:29.214309+0000","last_fullsized":"2024-02-15T22:57:29.214309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:59.069745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883379+0000","last_change":"2024-02-15T22:56:03.702268+0000","last_active":"2024-02-15T22:56:45.883379+0000","last_peered":"2024-02-15T22:56:45.883379+0000","last_clean":"2024-02-15T22:56:45.883379+0000","last_became_active":"2024-02-15T22:56:03.701819+0000","last_became_peered":"2024-02-15T22:56:03.701819+0000","last_unstale":"2024-02-15T22:56:45.883379+0000","last_undegraded":"2024-02-15T22:56:45.883379+0000","last_fullsized":"2024-02-15T22:56:45.883379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:24:36.815216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.380518+0000","last_change":"2024-02-15T22:56:13.731342+0000","last_active":"2024-02-15T22:57:35.380518+0000","last_peered":"2024-02-15T22:57:35.380518+0000","last_clean":"2024-02-15T22:57:35.380518+0000","last_became_active":"2024-02-15T22:56:13.730499+0000","last_became_peered":"2024-02-15T22:56:13.730499+0000","last_unstale":"2024-02-15T22:57:35.380518+0000","last_undegraded":"2024-02-15T22:57:35.380518+0000","last_fullsized":"2024-02-15T22:57:35.380518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:14:37.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.877218+0000","last_change":"2024-02-15T22:56:05.700054+0000","last_active":"2024-02-15T22:56:46.877218+0000","last_peered":"2024-02-15T22:56:46.877218+0000","last_clean":"2024-02-15T22:56:46.877218+0000","last_became_active":"2024-02-15T22:56:05.699821+0000","last_became_peered":"2024-02-15T22:56:05.699821+0000","last_unstale":"2024-02-15T22:56:46.877218+0000","last_undegraded":"2024-02-15T22:56:46.877218+0000","last_fullsized":"2024-02-15T22:56:46.877218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:38.452610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880655+0000","last_change":"2024-02-15T22:56:03.706199+0000","last_active":"2024-02-15T22:56:45.880655+0000","last_peered":"2024-02-15T22:56:45.880655+0000","last_clean":"2024-02-15T22:56:45.880655+0000","last_became_active":"2024-02-15T22:56:03.705881+0000","last_became_peered":"2024-02-15T22:56:03.705881+0000","last_unstale":"2024-02-15T22:56:45.880655+0000","last_undegraded":"2024-02-15T22:56:45.880655+0000","last_fullsized":"2024-02-15T22:56:45.880655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:08:53.948179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.893437+0000","last_change":"2024-02-15T22:56:45.893437+0000","last_active":"2024-02-15T22:56:45.893437+0000","last_peered":"2024-02-15T22:56:45.893437+0000","last_clean":"2024-02-15T22:56:45.893437+0000","last_became_active":"2024-02-15T22:56:45.893067+0000","last_became_peered":"2024-02-15T22:56:45.893067+0000","last_unstale":"2024-02-15T22:56:45.893437+0000","last_undegraded":"2024-02-15T22:56:45.893437+0000","last_fullsized":"2024-02-15T22:56:45.893437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:56:05.709507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.857479+0000","last_change":"2024-02-15T22:56:09.715523+0000","last_active":"2024-02-15T22:57:29.857479+0000","last_peered":"2024-02-15T22:57:29.857479+0000","last_clean":"2024-02-15T22:57:29.857479+0000","last_became_active":"2024-02-15T22:56:09.714201+0000","last_became_peered":"2024-02-15T22:56:09.714201+0000","last_unstale":"2024-02-15T22:57:29.857479+0000","last_undegraded":"2024-02-15T22:57:29.857479+0000","last_fullsized":"2024-02-15T22:57:29.857479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:23.715629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879512+0000","last_change":"2024-02-15T22:56:11.722548+0000","last_active":"2024-02-15T22:56:45.879512+0000","last_peered":"2024-02-15T22:56:45.879512+0000","last_clean":"2024-02-15T22:56:45.879512+0000","last_became_active":"2024-02-15T22:56:11.722257+0000","last_became_peered":"2024-02-15T22:56:11.722257+0000","last_unstale":"2024-02-15T22:56:45.879512+0000","last_undegraded":"2024-02-15T22:56:45.879512+0000","last_fullsized":"2024-02-15T22:56:45.879512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:57.504579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:24.174259+0000","last_change":"2024-02-15T22:56:13.729349+0000","last_active":"2024-02-15T22:57:24.174259+0000","last_peered":"2024-02-15T22:57:24.174259+0000","last_clean":"2024-02-15T22:57:24.174259+0000","last_became_active":"2024-02-15T22:56:13.729067+0000","last_became_peered":"2024-02-15T22:56:13.729067+0000","last_unstale":"2024-02-15T22:57:24.174259+0000","last_undegraded":"2024-02-15T22:57:24.174259+0000","last_fullsized":"2024-02-15T22:57:24.174259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:09.223558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427054+0000","last_change":"2024-02-15T22:56:05.709930+0000","last_active":"2024-02-15T22:56:47.427054+0000","last_peered":"2024-02-15T22:56:47.427054+0000","last_clean":"2024-02-15T22:56:47.427054+0000","last_became_active":"2024-02-15T22:56:05.709632+0000","last_became_peered":"2024-02-15T22:56:05.709632+0000","last_unstale":"2024-02-15T22:56:47.427054+0000","last_undegraded":"2024-02-15T22:56:47.427054+0000","last_fullsized":"2024-02-15T22:56:47.427054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:36.590473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882363+0000","last_change":"2024-02-15T22:56:03.699568+0000","last_active":"2024-02-15T22:56:45.882363+0000","last_peered":"2024-02-15T22:56:45.882363+0000","last_clean":"2024-02-15T22:56:45.882363+0000","last_became_active":"2024-02-15T22:56:03.699250+0000","last_became_peered":"2024-02-15T22:56:03.699250+0000","last_unstale":"2024-02-15T22:56:45.882363+0000","last_undegraded":"2024-02-15T22:56:45.882363+0000","last_fullsized":"2024-02-15T22:56:45.882363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880140+0000","last_change":"2024-02-15T22:56:07.706255+0000","last_active":"2024-02-15T22:56:45.880140+0000","last_peered":"2024-02-15T22:56:45.880140+0000","last_clean":"2024-02-15T22:56:45.880140+0000","last_became_active":"2024-02-15T22:56:07.705828+0000","last_became_peered":"2024-02-15T22:56:07.705828+0000","last_unstale":"2024-02-15T22:56:45.880140+0000","last_undegraded":"2024-02-15T22:56:45.880140+0000","last_fullsized":"2024-02-15T22:56:45.880140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:08.004261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883166+0000","last_change":"2024-02-15T22:56:09.713098+0000","last_active":"2024-02-15T22:56:45.883166+0000","last_peered":"2024-02-15T22:56:45.883166+0000","last_clean":"2024-02-15T22:56:45.883166+0000","last_became_active":"2024-02-15T22:56:09.712812+0000","last_became_peered":"2024-02-15T22:56:09.712812+0000","last_unstale":"2024-02-15T22:56:45.883166+0000","last_undegraded":"2024-02-15T22:56:45.883166+0000","last_fullsized":"2024-02-15T22:56:45.883166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:02:23.375846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879318+0000","last_change":"2024-02-15T22:56:11.721942+0000","last_active":"2024-02-15T22:56:45.879318+0000","last_peered":"2024-02-15T22:56:45.879318+0000","last_clean":"2024-02-15T22:56:45.879318+0000","last_became_active":"2024-02-15T22:56:11.721486+0000","last_became_peered":"2024-02-15T22:56:11.721486+0000","last_unstale":"2024-02-15T22:56:45.879318+0000","last_undegraded":"2024-02-15T22:56:45.879318+0000","last_fullsized":"2024-02-15T22:56:45.879318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:14.822800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879113+0000","last_change":"2024-02-15T22:56:13.734756+0000","last_active":"2024-02-15T22:56:45.879113+0000","last_peered":"2024-02-15T22:56:45.879113+0000","last_clean":"2024-02-15T22:56:45.879113+0000","last_became_active":"2024-02-15T22:56:13.734418+0000","last_became_peered":"2024-02-15T22:56:13.734418+0000","last_unstale":"2024-02-15T22:56:45.879113+0000","last_undegraded":"2024-02-15T22:56:45.879113+0000","last_fullsized":"2024-02-15T22:56:45.879113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:52.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391181+0000","last_change":"2024-02-15T22:56:05.700314+0000","last_active":"2024-02-15T22:57:35.391181+0000","last_peered":"2024-02-15T22:57:35.391181+0000","last_clean":"2024-02-15T22:57:35.391181+0000","last_became_active":"2024-02-15T22:56:05.699398+0000","last_became_peered":"2024-02-15T22:56:05.699398+0000","last_unstale":"2024-02-15T22:57:35.391181+0000","last_undegraded":"2024-02-15T22:57:35.391181+0000","last_fullsized":"2024-02-15T22:57:35.391181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:02.515595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881993+0000","last_change":"2024-02-15T22:56:03.707100+0000","last_active":"2024-02-15T22:56:45.881993+0000","last_peered":"2024-02-15T22:56:45.881993+0000","last_clean":"2024-02-15T22:56:45.881993+0000","last_became_active":"2024-02-15T22:56:03.706818+0000","last_became_peered":"2024-02-15T22:56:03.706818+0000","last_unstale":"2024-02-15T22:56:45.881993+0000","last_undegraded":"2024-02-15T22:56:45.881993+0000","last_fullsized":"2024-02-15T22:56:45.881993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:48.000599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882317+0000","last_change":"2024-02-15T22:56:07.704992+0000","last_active":"2024-02-15T22:56:45.882317+0000","last_peered":"2024-02-15T22:56:45.882317+0000","last_clean":"2024-02-15T22:56:45.882317+0000","last_became_active":"2024-02-15T22:56:07.704168+0000","last_became_peered":"2024-02-15T22:56:07.704168+0000","last_unstale":"2024-02-15T22:56:45.882317+0000","last_undegraded":"2024-02-15T22:56:45.882317+0000","last_fullsized":"2024-02-15T22:56:45.882317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:37.486705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885836+0000","last_change":"2024-02-15T22:56:09.718644+0000","last_active":"2024-02-15T22:56:45.885836+0000","last_peered":"2024-02-15T22:56:45.885836+0000","last_clean":"2024-02-15T22:56:45.885836+0000","last_became_active":"2024-02-15T22:56:09.718326+0000","last_became_peered":"2024-02-15T22:56:09.718326+0000","last_unstale":"2024-02-15T22:56:45.885836+0000","last_undegraded":"2024-02-15T22:56:45.885836+0000","last_fullsized":"2024-02-15T22:56:45.885836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:39.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'240","reported_seq":301,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.531415+0000","last_change":"2024-02-15T22:56:11.726498+0000","last_active":"2024-02-15T22:57:35.531415+0000","last_peered":"2024-02-15T22:57:35.531415+0000","last_clean":"2024-02-15T22:57:35.531415+0000","last_became_active":"2024-02-15T22:56:11.724138+0000","last_became_peered":"2024-02-15T22:56:11.724138+0000","last_unstale":"2024-02-15T22:57:35.531415+0000","last_undegraded":"2024-02-15T22:57:35.531415+0000","last_fullsized":"2024-02-15T22:57:35.531415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:55.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882299+0000","last_change":"2024-02-15T22:56:13.733123+0000","last_active":"2024-02-15T22:56:45.882299+0000","last_peered":"2024-02-15T22:56:45.882299+0000","last_clean":"2024-02-15T22:56:45.882299+0000","last_became_active":"2024-02-15T22:56:13.732762+0000","last_became_peered":"2024-02-15T22:56:13.732762+0000","last_unstale":"2024-02-15T22:56:45.882299+0000","last_undegraded":"2024-02-15T22:56:45.882299+0000","last_fullsized":"2024-02-15T22:56:45.882299+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:33.418832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215492+0000","last_change":"2024-02-15T22:56:05.705807+0000","last_active":"2024-02-15T22:56:47.215492+0000","last_peered":"2024-02-15T22:56:47.215492+0000","last_clean":"2024-02-15T22:56:47.215492+0000","last_became_active":"2024-02-15T22:56:05.705360+0000","last_became_peered":"2024-02-15T22:56:05.705360+0000","last_unstale":"2024-02-15T22:56:47.215492+0000","last_undegraded":"2024-02-15T22:56:47.215492+0000","last_fullsized":"2024-02-15T22:56:47.215492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:43.641211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.877537+0000","last_change":"2024-02-15T22:56:03.698653+0000","last_active":"2024-02-15T22:56:45.877537+0000","last_peered":"2024-02-15T22:56:45.877537+0000","last_clean":"2024-02-15T22:56:45.877537+0000","last_became_active":"2024-02-15T22:56:03.698225+0000","last_became_peered":"2024-02-15T22:56:03.698225+0000","last_unstale":"2024-02-15T22:56:45.877537+0000","last_undegraded":"2024-02-15T22:56:45.877537+0000","last_fullsized":"2024-02-15T22:56:45.877537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:08.872314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883033+0000","last_change":"2024-02-15T22:56:07.709503+0000","last_active":"2024-02-15T22:56:45.883033+0000","last_peered":"2024-02-15T22:56:45.883033+0000","last_clean":"2024-02-15T22:56:45.883033+0000","last_became_active":"2024-02-15T22:56:07.709236+0000","last_became_peered":"2024-02-15T22:56:07.709236+0000","last_unstale":"2024-02-15T22:56:45.883033+0000","last_undegraded":"2024-02-15T22:56:45.883033+0000","last_fullsized":"2024-02-15T22:56:45.883033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:01.415728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.852327+0000","last_change":"2024-02-15T22:56:09.729856+0000","last_active":"2024-02-15T22:57:29.852327+0000","last_peered":"2024-02-15T22:57:29.852327+0000","last_clean":"2024-02-15T22:57:29.852327+0000","last_became_active":"2024-02-15T22:56:09.729556+0000","last_became_peered":"2024-02-15T22:56:09.729556+0000","last_unstale":"2024-02-15T22:57:29.852327+0000","last_undegraded":"2024-02-15T22:57:29.852327+0000","last_fullsized":"2024-02-15T22:57:29.852327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:22.850275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'240","reported_seq":329,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.535608+0000","last_change":"2024-02-15T22:56:11.719971+0000","last_active":"2024-02-15T22:57:35.535608+0000","last_peered":"2024-02-15T22:57:35.535608+0000","last_clean":"2024-02-15T22:57:35.535608+0000","last_became_active":"2024-02-15T22:56:11.719588+0000","last_became_peered":"2024-02-15T22:56:11.719588+0000","last_unstale":"2024-02-15T22:57:35.535608+0000","last_undegraded":"2024-02-15T22:57:35.535608+0000","last_fullsized":"2024-02-15T22:57:35.535608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:49.146038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881166+0000","last_change":"2024-02-15T22:56:05.711111+0000","last_active":"2024-02-15T22:56:45.881166+0000","last_peered":"2024-02-15T22:56:45.881166+0000","last_clean":"2024-02-15T22:56:45.881166+0000","last_became_active":"2024-02-15T22:56:05.710578+0000","last_became_peered":"2024-02-15T22:56:05.710578+0000","last_unstale":"2024-02-15T22:56:45.881166+0000","last_undegraded":"2024-02-15T22:56:45.881166+0000","last_fullsized":"2024-02-15T22:56:45.881166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:33.216881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887207+0000","last_change":"2024-02-15T22:56:03.702464+0000","last_active":"2024-02-15T22:56:45.887207+0000","last_peered":"2024-02-15T22:56:45.887207+0000","last_clean":"2024-02-15T22:56:45.887207+0000","last_became_active":"2024-02-15T22:56:03.702187+0000","last_became_peered":"2024-02-15T22:56:03.702187+0000","last_unstale":"2024-02-15T22:56:45.887207+0000","last_undegraded":"2024-02-15T22:56:45.887207+0000","last_fullsized":"2024-02-15T22:56:45.887207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878050+0000","last_change":"2024-02-15T22:56:07.707641+0000","last_active":"2024-02-15T22:56:45.878050+0000","last_peered":"2024-02-15T22:56:45.878050+0000","last_clean":"2024-02-15T22:56:45.878050+0000","last_became_active":"2024-02-15T22:56:07.707328+0000","last_became_peered":"2024-02-15T22:56:07.707328+0000","last_unstale":"2024-02-15T22:56:45.878050+0000","last_undegraded":"2024-02-15T22:56:45.878050+0000","last_fullsized":"2024-02-15T22:56:45.878050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:20.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.861400+0000","last_change":"2024-02-15T22:56:09.715469+0000","last_active":"2024-02-15T22:57:29.861400+0000","last_peered":"2024-02-15T22:57:29.861400+0000","last_clean":"2024-02-15T22:57:29.861400+0000","last_became_active":"2024-02-15T22:56:09.715019+0000","last_became_peered":"2024-02-15T22:56:09.715019+0000","last_unstale":"2024-02-15T22:57:29.861400+0000","last_undegraded":"2024-02-15T22:57:29.861400+0000","last_fullsized":"2024-02-15T22:57:29.861400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:48.218723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879445+0000","last_change":"2024-02-15T22:56:11.720307+0000","last_active":"2024-02-15T22:56:45.879445+0000","last_peered":"2024-02-15T22:56:45.879445+0000","last_clean":"2024-02-15T22:56:45.879445+0000","last_became_active":"2024-02-15T22:56:11.719845+0000","last_became_peered":"2024-02-15T22:56:11.719845+0000","last_unstale":"2024-02-15T22:56:45.879445+0000","last_undegraded":"2024-02-15T22:56:45.879445+0000","last_fullsized":"2024-02-15T22:56:45.879445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:18:58.882768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.675724+0000","last_change":"2024-02-15T22:56:13.732667+0000","last_active":"2024-02-15T22:57:29.675724+0000","last_peered":"2024-02-15T22:57:29.675724+0000","last_clean":"2024-02-15T22:57:29.675724+0000","last_became_active":"2024-02-15T22:56:13.732321+0000","last_became_peered":"2024-02-15T22:56:13.732321+0000","last_unstale":"2024-02-15T22:57:29.675724+0000","last_undegraded":"2024-02-15T22:57:29.675724+0000","last_fullsized":"2024-02-15T22:57:29.675724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:10.109926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427434+0000","last_change":"2024-02-15T22:56:05.698607+0000","last_active":"2024-02-15T22:56:47.427434+0000","last_peered":"2024-02-15T22:56:47.427434+0000","last_clean":"2024-02-15T22:56:47.427434+0000","last_became_active":"2024-02-15T22:56:05.697834+0000","last_became_peered":"2024-02-15T22:56:05.697834+0000","last_unstale":"2024-02-15T22:56:47.427434+0000","last_undegraded":"2024-02-15T22:56:47.427434+0000","last_fullsized":"2024-02-15T22:56:47.427434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:13:53.631177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887539+0000","last_change":"2024-02-15T22:56:03.702616+0000","last_active":"2024-02-15T22:56:45.887539+0000","last_peered":"2024-02-15T22:56:45.887539+0000","last_clean":"2024-02-15T22:56:45.887539+0000","last_became_active":"2024-02-15T22:56:03.702353+0000","last_became_peered":"2024-02-15T22:56:03.702353+0000","last_unstale":"2024-02-15T22:56:45.887539+0000","last_undegraded":"2024-02-15T22:56:45.887539+0000","last_fullsized":"2024-02-15T22:56:45.887539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:27.186561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879943+0000","last_change":"2024-02-15T22:56:07.707046+0000","last_active":"2024-02-15T22:56:45.879943+0000","last_peered":"2024-02-15T22:56:45.879943+0000","last_clean":"2024-02-15T22:56:45.879943+0000","last_became_active":"2024-02-15T22:56:07.706656+0000","last_became_peered":"2024-02-15T22:56:07.706656+0000","last_unstale":"2024-02-15T22:56:45.879943+0000","last_undegraded":"2024-02-15T22:56:45.879943+0000","last_fullsized":"2024-02-15T22:56:45.879943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:21:30.878763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.842589+0000","last_change":"2024-02-15T22:56:09.717310+0000","last_active":"2024-02-15T22:57:29.842589+0000","last_peered":"2024-02-15T22:57:29.842589+0000","last_clean":"2024-02-15T22:57:29.842589+0000","last_became_active":"2024-02-15T22:56:09.716138+0000","last_became_peered":"2024-02-15T22:56:09.716138+0000","last_unstale":"2024-02-15T22:57:29.842589+0000","last_undegraded":"2024-02-15T22:57:29.842589+0000","last_fullsized":"2024-02-15T22:57:29.842589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:05:17.903871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879203+0000","last_change":"2024-02-15T22:56:11.724665+0000","last_active":"2024-02-15T22:56:45.879203+0000","last_peered":"2024-02-15T22:56:45.879203+0000","last_clean":"2024-02-15T22:56:45.879203+0000","last_became_active":"2024-02-15T22:56:11.724317+0000","last_became_peered":"2024-02-15T22:56:11.724317+0000","last_unstale":"2024-02-15T22:56:45.879203+0000","last_undegraded":"2024-02-15T22:56:45.879203+0000","last_fullsized":"2024-02-15T22:56:45.879203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:06:03.302828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.874077+0000","last_change":"2024-02-15T22:56:13.733414+0000","last_active":"2024-02-15T22:57:29.874077+0000","last_peered":"2024-02-15T22:57:29.874077+0000","last_clean":"2024-02-15T22:57:29.874077+0000","last_became_active":"2024-02-15T22:56:13.733118+0000","last_became_peered":"2024-02-15T22:56:13.733118+0000","last_unstale":"2024-02-15T22:57:29.874077+0000","last_undegraded":"2024-02-15T22:57:29.874077+0000","last_fullsized":"2024-02-15T22:57:29.874077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:38.491982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'20","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427488+0000","last_change":"2024-02-15T22:56:45.891684+0000","last_active":"2024-02-15T22:56:47.427488+0000","last_peered":"2024-02-15T22:56:47.427488+0000","last_clean":"2024-02-15T22:56:47.427488+0000","last_became_active":"2024-02-15T22:56:45.886248+0000","last_became_peered":"2024-02-15T22:56:45.886248+0000","last_unstale":"2024-02-15T22:56:47.427488+0000","last_undegraded":"2024-02-15T22:56:47.427488+0000","last_fullsized":"2024-02-15T22:56:47.427488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:01.197599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883087+0000","last_change":"2024-02-15T22:56:03.700436+0000","last_active":"2024-02-15T22:56:45.883087+0000","last_peered":"2024-02-15T22:56:45.883087+0000","last_clean":"2024-02-15T22:56:45.883087+0000","last_became_active":"2024-02-15T22:56:03.700087+0000","last_became_peered":"2024-02-15T22:56:03.700087+0000","last_unstale":"2024-02-15T22:56:45.883087+0000","last_undegraded":"2024-02-15T22:56:45.883087+0000","last_fullsized":"2024-02-15T22:56:45.883087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:00.883899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881488+0000","last_change":"2024-02-15T22:56:07.705816+0000","last_active":"2024-02-15T22:56:45.881488+0000","last_peered":"2024-02-15T22:56:45.881488+0000","last_clean":"2024-02-15T22:56:45.881488+0000","last_became_active":"2024-02-15T22:56:07.704502+0000","last_became_peered":"2024-02-15T22:56:07.704502+0000","last_unstale":"2024-02-15T22:56:45.881488+0000","last_undegraded":"2024-02-15T22:56:45.881488+0000","last_fullsized":"2024-02-15T22:56:45.881488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:50.097695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.863329+0000","last_change":"2024-02-15T22:56:09.719447+0000","last_active":"2024-02-15T22:57:29.863329+0000","last_peered":"2024-02-15T22:57:29.863329+0000","last_clean":"2024-02-15T22:57:29.863329+0000","last_became_active":"2024-02-15T22:56:09.717174+0000","last_became_peered":"2024-02-15T22:56:09.717174+0000","last_unstale":"2024-02-15T22:57:29.863329+0000","last_undegraded":"2024-02-15T22:57:29.863329+0000","last_fullsized":"2024-02-15T22:57:29.863329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:00:15.334493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'240","reported_seq":300,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.536541+0000","last_change":"2024-02-15T22:56:11.724657+0000","last_active":"2024-02-15T22:57:35.536541+0000","last_peered":"2024-02-15T22:57:35.536541+0000","last_clean":"2024-02-15T22:57:35.536541+0000","last_became_active":"2024-02-15T22:56:11.724273+0000","last_became_peered":"2024-02-15T22:56:11.724273+0000","last_unstale":"2024-02-15T22:57:35.536541+0000","last_undegraded":"2024-02-15T22:57:35.536541+0000","last_fullsized":"2024-02-15T22:57:35.536541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:26.704898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880623+0000","last_change":"2024-02-15T22:56:13.727119+0000","last_active":"2024-02-15T22:56:45.880623+0000","last_peered":"2024-02-15T22:56:45.880623+0000","last_clean":"2024-02-15T22:56:45.880623+0000","last_became_active":"2024-02-15T22:56:13.726858+0000","last_became_peered":"2024-02-15T22:56:13.726858+0000","last_unstale":"2024-02-15T22:56:45.880623+0000","last_undegraded":"2024-02-15T22:56:45.880623+0000","last_fullsized":"2024-02-15T22:56:45.880623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:04:07.015848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391133+0000","last_change":"2024-02-15T22:56:05.702296+0000","last_active":"2024-02-15T22:57:35.391133+0000","last_peered":"2024-02-15T22:57:35.391133+0000","last_clean":"2024-02-15T22:57:35.391133+0000","last_became_active":"2024-02-15T22:56:05.701568+0000","last_became_peered":"2024-02-15T22:56:05.701568+0000","last_unstale":"2024-02-15T22:57:35.391133+0000","last_undegraded":"2024-02-15T22:57:35.391133+0000","last_fullsized":"2024-02-15T22:57:35.391133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882522+0000","last_change":"2024-02-15T22:56:03.695726+0000","last_active":"2024-02-15T22:56:45.882522+0000","last_peered":"2024-02-15T22:56:45.882522+0000","last_clean":"2024-02-15T22:56:45.882522+0000","last_became_active":"2024-02-15T22:56:03.694668+0000","last_became_peered":"2024-02-15T22:56:03.694668+0000","last_unstale":"2024-02-15T22:56:45.882522+0000","last_undegraded":"2024-02-15T22:56:45.882522+0000","last_fullsized":"2024-02-15T22:56:45.882522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:14:39.799194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879866+0000","last_change":"2024-02-15T22:56:07.705196+0000","last_active":"2024-02-15T22:56:45.879866+0000","last_peered":"2024-02-15T22:56:45.879866+0000","last_clean":"2024-02-15T22:56:45.879866+0000","last_became_active":"2024-02-15T22:56:07.704054+0000","last_became_peered":"2024-02-15T22:56:07.704054+0000","last_unstale":"2024-02-15T22:56:45.879866+0000","last_undegraded":"2024-02-15T22:56:45.879866+0000","last_fullsized":"2024-02-15T22:56:45.879866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:27:50.211880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.351610+0000","last_change":"2024-02-15T22:56:09.719365+0000","last_active":"2024-02-15T22:57:35.351610+0000","last_peered":"2024-02-15T22:57:35.351610+0000","last_clean":"2024-02-15T22:57:35.351610+0000","last_became_active":"2024-02-15T22:56:09.717264+0000","last_became_peered":"2024-02-15T22:56:09.717264+0000","last_unstale":"2024-02-15T22:57:35.351610+0000","last_undegraded":"2024-02-15T22:57:35.351610+0000","last_fullsized":"2024-02-15T22:57:35.351610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:35:46.384248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879496+0000","last_change":"2024-02-15T22:56:11.720901+0000","last_active":"2024-02-15T22:56:45.879496+0000","last_peered":"2024-02-15T22:56:45.879496+0000","last_clean":"2024-02-15T22:56:45.879496+0000","last_became_active":"2024-02-15T22:56:11.720616+0000","last_became_peered":"2024-02-15T22:56:11.720616+0000","last_unstale":"2024-02-15T22:56:45.879496+0000","last_undegraded":"2024-02-15T22:56:45.879496+0000","last_fullsized":"2024-02-15T22:56:45.879496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:05.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.431962+0000","last_change":"2024-02-15T22:56:13.729263+0000","last_active":"2024-02-15T22:56:47.431962+0000","last_peered":"2024-02-15T22:56:47.431962+0000","last_clean":"2024-02-15T22:56:47.431962+0000","last_became_active":"2024-02-15T22:56:13.729015+0000","last_became_peered":"2024-02-15T22:56:13.729015+0000","last_unstale":"2024-02-15T22:56:47.431962+0000","last_undegraded":"2024-02-15T22:56:47.431962+0000","last_fullsized":"2024-02-15T22:56:47.431962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:14:21.943618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.882591+0000","last_change":"2024-02-15T22:56:45.898518+0000","last_active":"2024-02-15T22:56:46.882591+0000","last_peered":"2024-02-15T22:56:46.882591+0000","last_clean":"2024-02-15T22:56:46.882591+0000","last_became_active":"2024-02-15T22:56:45.893017+0000","last_became_peered":"2024-02-15T22:56:45.893017+0000","last_unstale":"2024-02-15T22:56:46.882591+0000","last_undegraded":"2024-02-15T22:56:46.882591+0000","last_fullsized":"2024-02-15T22:56:46.882591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:30.466023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886880+0000","last_change":"2024-02-15T22:56:45.886880+0000","last_active":"2024-02-15T22:56:45.886880+0000","last_peered":"2024-02-15T22:56:45.886880+0000","last_clean":"2024-02-15T22:56:45.886880+0000","last_became_active":"2024-02-15T22:56:45.886530+0000","last_became_peered":"2024-02-15T22:56:45.886530+0000","last_unstale":"2024-02-15T22:56:45.886880+0000","last_undegraded":"2024-02-15T22:56:45.886880+0000","last_fullsized":"2024-02-15T22:56:45.886880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:28.547710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885865+0000","last_change":"2024-02-15T22:56:07.707514+0000","last_active":"2024-02-15T22:56:45.885865+0000","last_peered":"2024-02-15T22:56:45.885865+0000","last_clean":"2024-02-15T22:56:45.885865+0000","last_became_active":"2024-02-15T22:56:07.707207+0000","last_became_peered":"2024-02-15T22:56:07.707207+0000","last_unstale":"2024-02-15T22:56:45.885865+0000","last_undegraded":"2024-02-15T22:56:45.885865+0000","last_fullsized":"2024-02-15T22:56:45.885865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:04:07.685154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.846704+0000","last_change":"2024-02-15T22:56:09.714917+0000","last_active":"2024-02-15T22:57:29.846704+0000","last_peered":"2024-02-15T22:57:29.846704+0000","last_clean":"2024-02-15T22:57:29.846704+0000","last_became_active":"2024-02-15T22:56:09.714592+0000","last_became_peered":"2024-02-15T22:56:09.714592+0000","last_unstale":"2024-02-15T22:57:29.846704+0000","last_undegraded":"2024-02-15T22:57:29.846704+0000","last_fullsized":"2024-02-15T22:57:29.846704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:41.601789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883307+0000","last_change":"2024-02-15T22:56:11.723908+0000","last_active":"2024-02-15T22:56:45.883307+0000","last_peered":"2024-02-15T22:56:45.883307+0000","last_clean":"2024-02-15T22:56:45.883307+0000","last_became_active":"2024-02-15T22:56:11.723557+0000","last_became_peered":"2024-02-15T22:56:11.723557+0000","last_unstale":"2024-02-15T22:56:45.883307+0000","last_undegraded":"2024-02-15T22:56:45.883307+0000","last_fullsized":"2024-02-15T22:56:45.883307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:11:50.121452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879474+0000","last_change":"2024-02-15T22:56:13.727205+0000","last_active":"2024-02-15T22:56:45.879474+0000","last_peered":"2024-02-15T22:56:45.879474+0000","last_clean":"2024-02-15T22:56:45.879474+0000","last_became_active":"2024-02-15T22:56:13.726586+0000","last_became_peered":"2024-02-15T22:56:13.726586+0000","last_unstale":"2024-02-15T22:56:45.879474+0000","last_undegraded":"2024-02-15T22:56:45.879474+0000","last_fullsized":"2024-02-15T22:56:45.879474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:34:15.904436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884445+0000","last_change":"2024-02-15T22:56:05.717008+0000","last_active":"2024-02-15T22:56:45.884445+0000","last_peered":"2024-02-15T22:56:45.884445+0000","last_clean":"2024-02-15T22:56:45.884445+0000","last_became_active":"2024-02-15T22:56:05.716590+0000","last_became_peered":"2024-02-15T22:56:05.716590+0000","last_unstale":"2024-02-15T22:56:45.884445+0000","last_undegraded":"2024-02-15T22:56:45.884445+0000","last_fullsized":"2024-02-15T22:56:45.884445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:02:19.362660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884747+0000","last_change":"2024-02-15T22:56:03.703244+0000","last_active":"2024-02-15T22:56:45.884747+0000","last_peered":"2024-02-15T22:56:45.884747+0000","last_clean":"2024-02-15T22:56:45.884747+0000","last_became_active":"2024-02-15T22:56:03.702875+0000","last_became_peered":"2024-02-15T22:56:03.702875+0000","last_unstale":"2024-02-15T22:56:45.884747+0000","last_undegraded":"2024-02-15T22:56:45.884747+0000","last_fullsized":"2024-02-15T22:56:45.884747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:09.868485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881664+0000","last_change":"2024-02-15T22:56:07.704747+0000","last_active":"2024-02-15T22:56:45.881664+0000","last_peered":"2024-02-15T22:56:45.881664+0000","last_clean":"2024-02-15T22:56:45.881664+0000","last_became_active":"2024-02-15T22:56:07.704058+0000","last_became_peered":"2024-02-15T22:56:07.704058+0000","last_unstale":"2024-02-15T22:56:45.881664+0000","last_undegraded":"2024-02-15T22:56:45.881664+0000","last_fullsized":"2024-02-15T22:56:45.881664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:47.729859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'35","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.871829+0000","last_change":"2024-02-15T22:56:09.712396+0000","last_active":"2024-02-15T22:57:29.871829+0000","last_peered":"2024-02-15T22:57:29.871829+0000","last_clean":"2024-02-15T22:57:29.871829+0000","last_became_active":"2024-02-15T22:56:09.712113+0000","last_became_peered":"2024-02-15T22:56:09.712113+0000","last_unstale":"2024-02-15T22:57:29.871829+0000","last_undegraded":"2024-02-15T22:57:29.871829+0000","last_fullsized":"2024-02-15T22:57:29.871829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:37.230068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'240","reported_seq":331,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.532382+0000","last_change":"2024-02-15T22:56:11.720788+0000","last_active":"2024-02-15T22:57:35.532382+0000","last_peered":"2024-02-15T22:57:35.532382+0000","last_clean":"2024-02-15T22:57:35.532382+0000","last_became_active":"2024-02-15T22:56:11.720390+0000","last_became_peered":"2024-02-15T22:56:11.720390+0000","last_unstale":"2024-02-15T22:57:35.532382+0000","last_undegraded":"2024-02-15T22:57:35.532382+0000","last_fullsized":"2024-02-15T22:57:35.532382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:37.820803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.895237+0000","last_change":"2024-02-15T22:56:13.734537+0000","last_active":"2024-02-15T22:57:29.895237+0000","last_peered":"2024-02-15T22:57:29.895237+0000","last_clean":"2024-02-15T22:57:29.895237+0000","last_became_active":"2024-02-15T22:56:13.734227+0000","last_became_peered":"2024-02-15T22:56:13.734227+0000","last_unstale":"2024-02-15T22:57:29.895237+0000","last_undegraded":"2024-02-15T22:57:29.895237+0000","last_fullsized":"2024-02-15T22:57:29.895237+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:14.942284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887843+0000","last_change":"2024-02-15T22:56:05.706339+0000","last_active":"2024-02-15T22:56:45.887843+0000","last_peered":"2024-02-15T22:56:45.887843+0000","last_clean":"2024-02-15T22:56:45.887843+0000","last_became_active":"2024-02-15T22:56:05.705551+0000","last_became_peered":"2024-02-15T22:56:05.705551+0000","last_unstale":"2024-02-15T22:56:45.887843+0000","last_undegraded":"2024-02-15T22:56:45.887843+0000","last_fullsized":"2024-02-15T22:56:45.887843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.420706+0000","last_change":"2024-02-15T22:56:03.704800+0000","last_active":"2024-02-15T22:56:47.420706+0000","last_peered":"2024-02-15T22:56:47.420706+0000","last_clean":"2024-02-15T22:56:47.420706+0000","last_became_active":"2024-02-15T22:56:03.704526+0000","last_became_peered":"2024-02-15T22:56:03.704526+0000","last_unstale":"2024-02-15T22:56:47.420706+0000","last_undegraded":"2024-02-15T22:56:47.420706+0000","last_fullsized":"2024-02-15T22:56:47.420706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:08:44.767171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'8","reported_seq":530,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:36.326084+0000","last_change":"2024-02-15T22:56:07.704570+0000","last_active":"2024-02-15T22:57:36.326084+0000","last_peered":"2024-02-15T22:57:36.326084+0000","last_clean":"2024-02-15T22:57:36.326084+0000","last_became_active":"2024-02-15T22:56:07.704281+0000","last_became_peered":"2024-02-15T22:56:07.704281+0000","last_unstale":"2024-02-15T22:57:36.326084+0000","last_undegraded":"2024-02-15T22:57:36.326084+0000","last_fullsized":"2024-02-15T22:57:36.326084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:48:03.804538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":588,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882855+0000","last_change":"2024-02-15T22:56:09.719243+0000","last_active":"2024-02-15T22:56:45.882855+0000","last_peered":"2024-02-15T22:56:45.882855+0000","last_clean":"2024-02-15T22:56:45.882855+0000","last_became_active":"2024-02-15T22:56:09.717735+0000","last_became_peered":"2024-02-15T22:56:09.717735+0000","last_unstale":"2024-02-15T22:56:45.882855+0000","last_undegraded":"2024-02-15T22:56:45.882855+0000","last_fullsized":"2024-02-15T22:56:45.882855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:28:54.383976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'240","reported_seq":374,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.533562+0000","last_change":"2024-02-15T22:56:11.717718+0000","last_active":"2024-02-15T22:57:35.533562+0000","last_peered":"2024-02-15T22:57:35.533562+0000","last_clean":"2024-02-15T22:57:35.533562+0000","last_became_active":"2024-02-15T22:56:11.717380+0000","last_became_peered":"2024-02-15T22:56:11.717380+0000","last_unstale":"2024-02-15T22:57:35.533562+0000","last_undegraded":"2024-02-15T22:57:35.533562+0000","last_fullsized":"2024-02-15T22:57:35.533562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:49.146038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.381482+0000","last_change":"2024-02-15T22:56:13.729765+0000","last_active":"2024-02-15T22:57:35.381482+0000","last_peered":"2024-02-15T22:57:35.381482+0000","last_clean":"2024-02-15T22:57:35.381482+0000","last_became_active":"2024-02-15T22:56:13.729467+0000","last_became_peered":"2024-02-15T22:56:13.729467+0000","last_unstale":"2024-02-15T22:57:35.381482+0000","last_undegraded":"2024-02-15T22:57:35.381482+0000","last_fullsized":"2024-02-15T22:57:35.381482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:37.969353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"30'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.901891+0000","last_change":"2024-02-15T22:56:45.901463+0000","last_active":"2024-02-15T22:56:45.901891+0000","last_peered":"2024-02-15T22:56:45.901891+0000","last_clean":"2024-02-15T22:56:45.901891+0000","last_became_active":"2024-02-15T22:56:45.892949+0000","last_became_peered":"2024-02-15T22:56:45.892949+0000","last_unstale":"2024-02-15T22:56:45.901891+0000","last_undegraded":"2024-02-15T22:56:45.901891+0000","last_fullsized":"2024-02-15T22:56:45.901891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:07:27.041414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879850+0000","last_change":"2024-02-15T22:56:03.702334+0000","last_active":"2024-02-15T22:56:45.879850+0000","last_peered":"2024-02-15T22:56:45.879850+0000","last_clean":"2024-02-15T22:56:45.879850+0000","last_became_active":"2024-02-15T22:56:03.702035+0000","last_became_peered":"2024-02-15T22:56:03.702035+0000","last_unstale":"2024-02-15T22:56:45.879850+0000","last_undegraded":"2024-02-15T22:56:45.879850+0000","last_fullsized":"2024-02-15T22:56:45.879850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:00.410598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883534+0000","last_change":"2024-02-15T22:56:07.706890+0000","last_active":"2024-02-15T22:56:45.883534+0000","last_peered":"2024-02-15T22:56:45.883534+0000","last_clean":"2024-02-15T22:56:45.883534+0000","last_became_active":"2024-02-15T22:56:07.706615+0000","last_became_peered":"2024-02-15T22:56:07.706615+0000","last_unstale":"2024-02-15T22:56:45.883534+0000","last_undegraded":"2024-02-15T22:56:45.883534+0000","last_fullsized":"2024-02-15T22:56:45.883534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:00.323059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.858464+0000","last_change":"2024-02-15T22:56:09.714286+0000","last_active":"2024-02-15T22:57:29.858464+0000","last_peered":"2024-02-15T22:57:29.858464+0000","last_clean":"2024-02-15T22:57:29.858464+0000","last_became_active":"2024-02-15T22:56:09.713660+0000","last_became_peered":"2024-02-15T22:56:09.713660+0000","last_unstale":"2024-02-15T22:57:29.858464+0000","last_undegraded":"2024-02-15T22:57:29.858464+0000","last_fullsized":"2024-02-15T22:57:29.858464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:40.603660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885416+0000","last_change":"2024-02-15T22:56:11.724920+0000","last_active":"2024-02-15T22:56:45.885416+0000","last_peered":"2024-02-15T22:56:45.885416+0000","last_clean":"2024-02-15T22:56:45.885416+0000","last_became_active":"2024-02-15T22:56:11.724575+0000","last_became_peered":"2024-02-15T22:56:11.724575+0000","last_unstale":"2024-02-15T22:56:45.885416+0000","last_undegraded":"2024-02-15T22:56:45.885416+0000","last_fullsized":"2024-02-15T22:56:45.885416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:32.467517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878828+0000","last_change":"2024-02-15T22:56:13.722807+0000","last_active":"2024-02-15T22:56:45.878828+0000","last_peered":"2024-02-15T22:56:45.878828+0000","last_clean":"2024-02-15T22:56:45.878828+0000","last_became_active":"2024-02-15T22:56:13.722550+0000","last_became_peered":"2024-02-15T22:56:13.722550+0000","last_unstale":"2024-02-15T22:56:45.878828+0000","last_undegraded":"2024-02-15T22:56:45.878828+0000","last_fullsized":"2024-02-15T22:56:45.878828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:07:35.067373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883476+0000","last_change":"2024-02-15T22:56:05.715752+0000","last_active":"2024-02-15T22:56:45.883476+0000","last_peered":"2024-02-15T22:56:45.883476+0000","last_clean":"2024-02-15T22:56:45.883476+0000","last_became_active":"2024-02-15T22:56:05.715513+0000","last_became_peered":"2024-02-15T22:56:05.715513+0000","last_unstale":"2024-02-15T22:56:45.883476+0000","last_undegraded":"2024-02-15T22:56:45.883476+0000","last_fullsized":"2024-02-15T22:56:45.883476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:26.448260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":198,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.877414+0000","last_change":"2024-02-15T22:55:52.658778+0000","last_active":"2024-02-15T22:56:45.877414+0000","last_peered":"2024-02-15T22:56:45.877414+0000","last_clean":"2024-02-15T22:56:45.877414+0000","last_became_active":"2024-02-15T22:55:52.657750+0000","last_became_peered":"2024-02-15T22:55:52.657750+0000","last_unstale":"2024-02-15T22:56:45.877414+0000","last_undegraded":"2024-02-15T22:56:45.877414+0000","last_fullsized":"2024-02-15T22:56:45.877414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_clean_scrub_stamp":"2024-02-15T22:55:51.648340+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:26.306952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880599+0000","last_change":"2024-02-15T22:55:57.672733+0000","last_active":"2024-02-15T22:56:45.880599+0000","last_peered":"2024-02-15T22:56:45.880599+0000","last_clean":"2024-02-15T22:56:45.880599+0000","last_became_active":"2024-02-15T22:55:57.672281+0000","last_became_peered":"2024-02-15T22:55:57.672281+0000","last_unstale":"2024-02-15T22:56:45.880599+0000","last_undegraded":"2024-02-15T22:56:45.880599+0000","last_fullsized":"2024-02-15T22:56:45.880599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:16:13.571164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881021+0000","last_change":"2024-02-15T22:56:03.707343+0000","last_active":"2024-02-15T22:56:45.881021+0000","last_peered":"2024-02-15T22:56:45.881021+0000","last_clean":"2024-02-15T22:56:45.881021+0000","last_became_active":"2024-02-15T22:56:03.706721+0000","last_became_peered":"2024-02-15T22:56:03.706721+0000","last_unstale":"2024-02-15T22:56:45.881021+0000","last_undegraded":"2024-02-15T22:56:45.881021+0000","last_fullsized":"2024-02-15T22:56:45.881021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:35.787671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887614+0000","last_change":"2024-02-15T22:56:45.887614+0000","last_active":"2024-02-15T22:56:45.887614+0000","last_peered":"2024-02-15T22:56:45.887614+0000","last_clean":"2024-02-15T22:56:45.887614+0000","last_became_active":"2024-02-15T22:56:45.887260+0000","last_became_peered":"2024-02-15T22:56:45.887260+0000","last_unstale":"2024-02-15T22:56:45.887614+0000","last_undegraded":"2024-02-15T22:56:45.887614+0000","last_fullsized":"2024-02-15T22:56:45.887614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:00:13.328033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'70","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.368277+0000","last_change":"2024-02-15T22:56:09.717520+0000","last_active":"2024-02-15T22:57:35.368277+0000","last_peered":"2024-02-15T22:57:35.368277+0000","last_clean":"2024-02-15T22:57:35.368277+0000","last_became_active":"2024-02-15T22:56:09.716109+0000","last_became_peered":"2024-02-15T22:56:09.716109+0000","last_unstale":"2024-02-15T22:57:35.368277+0000","last_undegraded":"2024-02-15T22:57:35.368277+0000","last_fullsized":"2024-02-15T22:57:35.368277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:43:27.838853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881677+0000","last_change":"2024-02-15T22:56:11.722725+0000","last_active":"2024-02-15T22:56:45.881677+0000","last_peered":"2024-02-15T22:56:45.881677+0000","last_clean":"2024-02-15T22:56:45.881677+0000","last_became_active":"2024-02-15T22:56:11.722390+0000","last_became_peered":"2024-02-15T22:56:11.722390+0000","last_unstale":"2024-02-15T22:56:45.881677+0000","last_undegraded":"2024-02-15T22:56:45.881677+0000","last_fullsized":"2024-02-15T22:56:45.881677+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:01.453104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.402200+0000","last_change":"2024-02-15T22:56:13.732746+0000","last_active":"2024-02-15T22:57:35.402200+0000","last_peered":"2024-02-15T22:57:35.402200+0000","last_clean":"2024-02-15T22:57:35.402200+0000","last_became_active":"2024-02-15T22:56:13.732437+0000","last_became_peered":"2024-02-15T22:56:13.732437+0000","last_unstale":"2024-02-15T22:57:35.402200+0000","last_undegraded":"2024-02-15T22:57:35.402200+0000","last_fullsized":"2024-02-15T22:57:35.402200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:19:49.186383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883640+0000","last_change":"2024-02-15T22:56:05.700559+0000","last_active":"2024-02-15T22:56:45.883640+0000","last_peered":"2024-02-15T22:56:45.883640+0000","last_clean":"2024-02-15T22:56:45.883640+0000","last_became_active":"2024-02-15T22:56:05.699679+0000","last_became_peered":"2024-02-15T22:56:05.699679+0000","last_unstale":"2024-02-15T22:56:45.883640+0000","last_undegraded":"2024-02-15T22:56:45.883640+0000","last_fullsized":"2024-02-15T22:56:45.883640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:31.801546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879712+0000","last_change":"2024-02-15T22:55:57.673021+0000","last_active":"2024-02-15T22:56:45.879712+0000","last_peered":"2024-02-15T22:56:45.879712+0000","last_clean":"2024-02-15T22:56:45.879712+0000","last_became_active":"2024-02-15T22:55:57.672705+0000","last_became_peered":"2024-02-15T22:55:57.672705+0000","last_unstale":"2024-02-15T22:56:45.879712+0000","last_undegraded":"2024-02-15T22:56:45.879712+0000","last_fullsized":"2024-02-15T22:56:45.879712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:51.539454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879585+0000","last_change":"2024-02-15T22:56:03.700496+0000","last_active":"2024-02-15T22:56:45.879585+0000","last_peered":"2024-02-15T22:56:45.879585+0000","last_clean":"2024-02-15T22:56:45.879585+0000","last_became_active":"2024-02-15T22:56:03.699864+0000","last_became_peered":"2024-02-15T22:56:03.699864+0000","last_unstale":"2024-02-15T22:56:45.879585+0000","last_undegraded":"2024-02-15T22:56:45.879585+0000","last_fullsized":"2024-02-15T22:56:45.879585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884516+0000","last_change":"2024-02-15T22:56:07.707939+0000","last_active":"2024-02-15T22:56:45.884516+0000","last_peered":"2024-02-15T22:56:45.884516+0000","last_clean":"2024-02-15T22:56:45.884516+0000","last_became_active":"2024-02-15T22:56:07.707620+0000","last_became_peered":"2024-02-15T22:56:07.707620+0000","last_unstale":"2024-02-15T22:56:45.884516+0000","last_undegraded":"2024-02-15T22:56:45.884516+0000","last_fullsized":"2024-02-15T22:56:45.884516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:53.492048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'239","reported_seq":407,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.528301+0000","last_change":"2024-02-15T22:56:09.718681+0000","last_active":"2024-02-15T22:57:35.528301+0000","last_peered":"2024-02-15T22:57:35.528301+0000","last_clean":"2024-02-15T22:57:35.528301+0000","last_became_active":"2024-02-15T22:56:09.718396+0000","last_became_peered":"2024-02-15T22:56:09.718396+0000","last_unstale":"2024-02-15T22:57:35.528301+0000","last_undegraded":"2024-02-15T22:57:35.528301+0000","last_fullsized":"2024-02-15T22:57:35.528301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:24.765590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880720+0000","last_change":"2024-02-15T22:56:11.725286+0000","last_active":"2024-02-15T22:56:45.880720+0000","last_peered":"2024-02-15T22:56:45.880720+0000","last_clean":"2024-02-15T22:56:45.880720+0000","last_became_active":"2024-02-15T22:56:11.725005+0000","last_became_peered":"2024-02-15T22:56:11.725005+0000","last_unstale":"2024-02-15T22:56:45.880720+0000","last_undegraded":"2024-02-15T22:56:45.880720+0000","last_fullsized":"2024-02-15T22:56:45.880720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:29.599168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:24.184779+0000","last_change":"2024-02-15T22:56:13.734036+0000","last_active":"2024-02-15T22:57:24.184779+0000","last_peered":"2024-02-15T22:57:24.184779+0000","last_clean":"2024-02-15T22:57:24.184779+0000","last_became_active":"2024-02-15T22:56:13.733760+0000","last_became_peered":"2024-02-15T22:56:13.733760+0000","last_unstale":"2024-02-15T22:57:24.184779+0000","last_undegraded":"2024-02-15T22:57:24.184779+0000","last_fullsized":"2024-02-15T22:57:24.184779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:52.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881842+0000","last_change":"2024-02-15T22:56:05.706098+0000","last_active":"2024-02-15T22:56:45.881842+0000","last_peered":"2024-02-15T22:56:45.881842+0000","last_clean":"2024-02-15T22:56:45.881842+0000","last_became_active":"2024-02-15T22:56:05.704953+0000","last_became_peered":"2024-02-15T22:56:05.704953+0000","last_unstale":"2024-02-15T22:56:45.881842+0000","last_undegraded":"2024-02-15T22:56:45.881842+0000","last_fullsized":"2024-02-15T22:56:45.881842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:08.839506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881265+0000","last_change":"2024-02-15T22:55:57.671425+0000","last_active":"2024-02-15T22:56:45.881265+0000","last_peered":"2024-02-15T22:56:45.881265+0000","last_clean":"2024-02-15T22:56:45.881265+0000","last_became_active":"2024-02-15T22:55:57.671130+0000","last_became_peered":"2024-02-15T22:55:57.671130+0000","last_unstale":"2024-02-15T22:56:45.881265+0000","last_undegraded":"2024-02-15T22:56:45.881265+0000","last_fullsized":"2024-02-15T22:56:45.881265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:07:19.263513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878991+0000","last_change":"2024-02-15T22:56:03.700250+0000","last_active":"2024-02-15T22:56:45.878991+0000","last_peered":"2024-02-15T22:56:45.878991+0000","last_clean":"2024-02-15T22:56:45.878991+0000","last_became_active":"2024-02-15T22:56:03.699598+0000","last_became_peered":"2024-02-15T22:56:03.699598+0000","last_unstale":"2024-02-15T22:56:45.878991+0000","last_undegraded":"2024-02-15T22:56:45.878991+0000","last_fullsized":"2024-02-15T22:56:45.878991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887215+0000","last_change":"2024-02-15T22:56:07.704552+0000","last_active":"2024-02-15T22:56:45.887215+0000","last_peered":"2024-02-15T22:56:45.887215+0000","last_clean":"2024-02-15T22:56:45.887215+0000","last_became_active":"2024-02-15T22:56:07.704107+0000","last_became_peered":"2024-02-15T22:56:07.704107+0000","last_unstale":"2024-02-15T22:56:45.887215+0000","last_undegraded":"2024-02-15T22:56:45.887215+0000","last_fullsized":"2024-02-15T22:56:45.887215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:40.761923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.400847+0000","last_change":"2024-02-15T22:56:09.711955+0000","last_active":"2024-02-15T22:57:35.400847+0000","last_peered":"2024-02-15T22:57:35.400847+0000","last_clean":"2024-02-15T22:57:35.400847+0000","last_became_active":"2024-02-15T22:56:09.711494+0000","last_became_peered":"2024-02-15T22:56:09.711494+0000","last_unstale":"2024-02-15T22:57:35.400847+0000","last_undegraded":"2024-02-15T22:57:35.400847+0000","last_fullsized":"2024-02-15T22:57:35.400847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:59.298944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880617+0000","last_change":"2024-02-15T22:56:11.722621+0000","last_active":"2024-02-15T22:56:45.880617+0000","last_peered":"2024-02-15T22:56:45.880617+0000","last_clean":"2024-02-15T22:56:45.880617+0000","last_became_active":"2024-02-15T22:56:11.722277+0000","last_became_peered":"2024-02-15T22:56:11.722277+0000","last_unstale":"2024-02-15T22:56:45.880617+0000","last_undegraded":"2024-02-15T22:56:45.880617+0000","last_fullsized":"2024-02-15T22:56:45.880617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:26.041161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880049+0000","last_change":"2024-02-15T22:56:13.726439+0000","last_active":"2024-02-15T22:56:45.880049+0000","last_peered":"2024-02-15T22:56:45.880049+0000","last_clean":"2024-02-15T22:56:45.880049+0000","last_became_active":"2024-02-15T22:56:13.726165+0000","last_became_peered":"2024-02-15T22:56:13.726165+0000","last_unstale":"2024-02-15T22:56:45.880049+0000","last_undegraded":"2024-02-15T22:56:45.880049+0000","last_fullsized":"2024-02-15T22:56:45.880049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:04.405292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'7","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214367+0000","last_change":"2024-02-15T22:56:05.707494+0000","last_active":"2024-02-15T22:57:29.214367+0000","last_peered":"2024-02-15T22:57:29.214367+0000","last_clean":"2024-02-15T22:57:29.214367+0000","last_became_active":"2024-02-15T22:56:05.707171+0000","last_became_peered":"2024-02-15T22:56:05.707171+0000","last_unstale":"2024-02-15T22:57:29.214367+0000","last_undegraded":"2024-02-15T22:57:29.214367+0000","last_fullsized":"2024-02-15T22:57:29.214367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:27:41.335097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880918+0000","last_change":"2024-02-15T22:55:57.672717+0000","last_active":"2024-02-15T22:56:45.880918+0000","last_peered":"2024-02-15T22:56:45.880918+0000","last_clean":"2024-02-15T22:56:45.880918+0000","last_became_active":"2024-02-15T22:55:57.672268+0000","last_became_peered":"2024-02-15T22:55:57.672268+0000","last_unstale":"2024-02-15T22:56:45.880918+0000","last_undegraded":"2024-02-15T22:56:45.880918+0000","last_fullsized":"2024-02-15T22:56:45.880918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:32.276372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882540+0000","last_change":"2024-02-15T22:56:03.697249+0000","last_active":"2024-02-15T22:56:45.882540+0000","last_peered":"2024-02-15T22:56:45.882540+0000","last_clean":"2024-02-15T22:56:45.882540+0000","last_became_active":"2024-02-15T22:56:03.693487+0000","last_became_peered":"2024-02-15T22:56:03.693487+0000","last_unstale":"2024-02-15T22:56:45.882540+0000","last_undegraded":"2024-02-15T22:56:45.882540+0000","last_fullsized":"2024-02-15T22:56:45.882540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:50.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880819+0000","last_change":"2024-02-15T22:56:07.707628+0000","last_active":"2024-02-15T22:56:45.880819+0000","last_peered":"2024-02-15T22:56:45.880819+0000","last_clean":"2024-02-15T22:56:45.880819+0000","last_became_active":"2024-02-15T22:56:07.707227+0000","last_became_peered":"2024-02-15T22:56:07.707227+0000","last_unstale":"2024-02-15T22:56:45.880819+0000","last_undegraded":"2024-02-15T22:56:45.880819+0000","last_fullsized":"2024-02-15T22:56:45.880819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:41:38.827598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884038+0000","last_change":"2024-02-15T22:56:09.720954+0000","last_active":"2024-02-15T22:56:45.884038+0000","last_peered":"2024-02-15T22:56:45.884038+0000","last_clean":"2024-02-15T22:56:45.884038+0000","last_became_active":"2024-02-15T22:56:09.719999+0000","last_became_peered":"2024-02-15T22:56:09.719999+0000","last_unstale":"2024-02-15T22:56:45.884038+0000","last_undegraded":"2024-02-15T22:56:45.884038+0000","last_fullsized":"2024-02-15T22:56:45.884038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:57.194342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883698+0000","last_change":"2024-02-15T22:56:11.724029+0000","last_active":"2024-02-15T22:56:45.883698+0000","last_peered":"2024-02-15T22:56:45.883698+0000","last_clean":"2024-02-15T22:56:45.883698+0000","last_became_active":"2024-02-15T22:56:11.723718+0000","last_became_peered":"2024-02-15T22:56:11.723718+0000","last_unstale":"2024-02-15T22:56:45.883698+0000","last_undegraded":"2024-02-15T22:56:45.883698+0000","last_fullsized":"2024-02-15T22:56:45.883698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:43:01.476474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878038+0000","last_change":"2024-02-15T22:56:13.731187+0000","last_active":"2024-02-15T22:56:45.878038+0000","last_peered":"2024-02-15T22:56:45.878038+0000","last_clean":"2024-02-15T22:56:45.878038+0000","last_became_active":"2024-02-15T22:56:13.730551+0000","last_became_peered":"2024-02-15T22:56:13.730551+0000","last_unstale":"2024-02-15T22:56:45.878038+0000","last_undegraded":"2024-02-15T22:56:45.878038+0000","last_fullsized":"2024-02-15T22:56:45.878038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:00.259943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907683+0000","last_change":"2024-02-15T22:56:05.714866+0000","last_active":"2024-02-15T22:56:47.907683+0000","last_peered":"2024-02-15T22:56:47.907683+0000","last_clean":"2024-02-15T22:56:47.907683+0000","last_became_active":"2024-02-15T22:56:05.714389+0000","last_became_peered":"2024-02-15T22:56:05.714389+0000","last_unstale":"2024-02-15T22:56:47.907683+0000","last_undegraded":"2024-02-15T22:56:47.907683+0000","last_fullsized":"2024-02-15T22:56:47.907683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:02.890481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886225+0000","last_change":"2024-02-15T22:56:03.693895+0000","last_active":"2024-02-15T22:56:45.886225+0000","last_peered":"2024-02-15T22:56:45.886225+0000","last_clean":"2024-02-15T22:56:45.886225+0000","last_became_active":"2024-02-15T22:56:03.693005+0000","last_became_peered":"2024-02-15T22:56:03.693005+0000","last_unstale":"2024-02-15T22:56:45.886225+0000","last_undegraded":"2024-02-15T22:56:45.886225+0000","last_fullsized":"2024-02-15T22:56:45.886225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880275+0000","last_change":"2024-02-15T22:55:57.671879+0000","last_active":"2024-02-15T22:56:45.880275+0000","last_peered":"2024-02-15T22:56:45.880275+0000","last_clean":"2024-02-15T22:56:45.880275+0000","last_became_active":"2024-02-15T22:55:57.671524+0000","last_became_peered":"2024-02-15T22:55:57.671524+0000","last_unstale":"2024-02-15T22:56:45.880275+0000","last_undegraded":"2024-02-15T22:56:45.880275+0000","last_fullsized":"2024-02-15T22:56:45.880275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:09:17.624102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880296+0000","last_change":"2024-02-15T22:56:07.707991+0000","last_active":"2024-02-15T22:56:45.880296+0000","last_peered":"2024-02-15T22:56:45.880296+0000","last_clean":"2024-02-15T22:56:45.880296+0000","last_became_active":"2024-02-15T22:56:07.707281+0000","last_became_peered":"2024-02-15T22:56:07.707281+0000","last_unstale":"2024-02-15T22:56:45.880296+0000","last_undegraded":"2024-02-15T22:56:45.880296+0000","last_fullsized":"2024-02-15T22:56:45.880296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:33:01.136377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'56","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.360300+0000","last_change":"2024-02-15T22:56:09.717947+0000","last_active":"2024-02-15T22:57:35.360300+0000","last_peered":"2024-02-15T22:57:35.360300+0000","last_clean":"2024-02-15T22:57:35.360300+0000","last_became_active":"2024-02-15T22:56:09.717692+0000","last_became_peered":"2024-02-15T22:56:09.717692+0000","last_unstale":"2024-02-15T22:57:35.360300+0000","last_undegraded":"2024-02-15T22:57:35.360300+0000","last_fullsized":"2024-02-15T22:57:35.360300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:32.340996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881741+0000","last_change":"2024-02-15T22:56:11.718632+0000","last_active":"2024-02-15T22:56:45.881741+0000","last_peered":"2024-02-15T22:56:45.881741+0000","last_clean":"2024-02-15T22:56:45.881741+0000","last_became_active":"2024-02-15T22:56:11.718332+0000","last_became_peered":"2024-02-15T22:56:11.718332+0000","last_unstale":"2024-02-15T22:56:45.881741+0000","last_undegraded":"2024-02-15T22:56:45.881741+0000","last_fullsized":"2024-02-15T22:56:45.881741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:38.078071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.872820+0000","last_change":"2024-02-15T22:56:13.723843+0000","last_active":"2024-02-15T22:57:29.872820+0000","last_peered":"2024-02-15T22:57:29.872820+0000","last_clean":"2024-02-15T22:57:29.872820+0000","last_became_active":"2024-02-15T22:56:13.723512+0000","last_became_peered":"2024-02-15T22:56:13.723512+0000","last_unstale":"2024-02-15T22:57:29.872820+0000","last_undegraded":"2024-02-15T22:57:29.872820+0000","last_fullsized":"2024-02-15T22:57:29.872820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:05:21.916643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.906030+0000","last_change":"2024-02-15T22:56:05.713346+0000","last_active":"2024-02-15T22:56:47.906030+0000","last_peered":"2024-02-15T22:56:47.906030+0000","last_clean":"2024-02-15T22:56:47.906030+0000","last_became_active":"2024-02-15T22:56:05.713036+0000","last_became_peered":"2024-02-15T22:56:05.713036+0000","last_unstale":"2024-02-15T22:56:47.906030+0000","last_undegraded":"2024-02-15T22:56:47.906030+0000","last_fullsized":"2024-02-15T22:56:47.906030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:53.786957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880599+0000","last_change":"2024-02-15T22:56:03.699990+0000","last_active":"2024-02-15T22:56:45.880599+0000","last_peered":"2024-02-15T22:56:45.880599+0000","last_clean":"2024-02-15T22:56:45.880599+0000","last_became_active":"2024-02-15T22:56:03.699564+0000","last_became_peered":"2024-02-15T22:56:03.699564+0000","last_unstale":"2024-02-15T22:56:45.880599+0000","last_undegraded":"2024-02-15T22:56:45.880599+0000","last_fullsized":"2024-02-15T22:56:45.880599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:50.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882944+0000","last_change":"2024-02-15T22:55:57.672438+0000","last_active":"2024-02-15T22:56:45.882944+0000","last_peered":"2024-02-15T22:56:45.882944+0000","last_clean":"2024-02-15T22:56:45.882944+0000","last_became_active":"2024-02-15T22:55:57.672053+0000","last_became_peered":"2024-02-15T22:55:57.672053+0000","last_unstale":"2024-02-15T22:56:45.882944+0000","last_undegraded":"2024-02-15T22:56:45.882944+0000","last_fullsized":"2024-02-15T22:56:45.882944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:01.363343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.893645+0000","last_change":"2024-02-15T22:56:45.893645+0000","last_active":"2024-02-15T22:56:45.893645+0000","last_peered":"2024-02-15T22:56:45.893645+0000","last_clean":"2024-02-15T22:56:45.893645+0000","last_became_active":"2024-02-15T22:56:45.893109+0000","last_became_peered":"2024-02-15T22:56:45.893109+0000","last_unstale":"2024-02-15T22:56:45.893645+0000","last_undegraded":"2024-02-15T22:56:45.893645+0000","last_fullsized":"2024-02-15T22:56:45.893645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:43:22.299794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878306+0000","last_change":"2024-02-15T22:56:09.721473+0000","last_active":"2024-02-15T22:56:45.878306+0000","last_peered":"2024-02-15T22:56:45.878306+0000","last_clean":"2024-02-15T22:56:45.878306+0000","last_became_active":"2024-02-15T22:56:09.721140+0000","last_became_peered":"2024-02-15T22:56:09.721140+0000","last_unstale":"2024-02-15T22:56:45.878306+0000","last_undegraded":"2024-02-15T22:56:45.878306+0000","last_fullsized":"2024-02-15T22:56:45.878306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:35.814733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'240","reported_seq":277,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.530512+0000","last_change":"2024-02-15T22:56:11.717865+0000","last_active":"2024-02-15T22:57:35.530512+0000","last_peered":"2024-02-15T22:57:35.530512+0000","last_clean":"2024-02-15T22:57:35.530512+0000","last_became_active":"2024-02-15T22:56:11.717544+0000","last_became_peered":"2024-02-15T22:56:11.717544+0000","last_unstale":"2024-02-15T22:57:35.530512+0000","last_undegraded":"2024-02-15T22:57:35.530512+0000","last_fullsized":"2024-02-15T22:57:35.530512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:08.103224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883381+0000","last_change":"2024-02-15T22:56:13.728952+0000","last_active":"2024-02-15T22:56:45.883381+0000","last_peered":"2024-02-15T22:56:45.883381+0000","last_clean":"2024-02-15T22:56:45.883381+0000","last_became_active":"2024-02-15T22:56:13.728228+0000","last_became_peered":"2024-02-15T22:56:13.728228+0000","last_unstale":"2024-02-15T22:56:45.883381+0000","last_undegraded":"2024-02-15T22:56:45.883381+0000","last_fullsized":"2024-02-15T22:56:45.883381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:28.350108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907892+0000","last_change":"2024-02-15T22:56:05.711219+0000","last_active":"2024-02-15T22:56:47.907892+0000","last_peered":"2024-02-15T22:56:47.907892+0000","last_clean":"2024-02-15T22:56:47.907892+0000","last_became_active":"2024-02-15T22:56:05.710924+0000","last_became_peered":"2024-02-15T22:56:05.710924+0000","last_unstale":"2024-02-15T22:56:47.907892+0000","last_undegraded":"2024-02-15T22:56:47.907892+0000","last_fullsized":"2024-02-15T22:56:47.907892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:00.260239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884070+0000","last_change":"2024-02-15T22:56:03.696202+0000","last_active":"2024-02-15T22:56:45.884070+0000","last_peered":"2024-02-15T22:56:45.884070+0000","last_clean":"2024-02-15T22:56:45.884070+0000","last_became_active":"2024-02-15T22:56:03.695921+0000","last_became_peered":"2024-02-15T22:56:03.695921+0000","last_unstale":"2024-02-15T22:56:45.884070+0000","last_undegraded":"2024-02-15T22:56:45.884070+0000","last_fullsized":"2024-02-15T22:56:45.884070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:10.975589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880782+0000","last_change":"2024-02-15T22:55:57.671686+0000","last_active":"2024-02-15T22:56:45.880782+0000","last_peered":"2024-02-15T22:56:45.880782+0000","last_clean":"2024-02-15T22:56:45.880782+0000","last_became_active":"2024-02-15T22:55:57.671257+0000","last_became_peered":"2024-02-15T22:55:57.671257+0000","last_unstale":"2024-02-15T22:56:45.880782+0000","last_undegraded":"2024-02-15T22:56:45.880782+0000","last_fullsized":"2024-02-15T22:56:45.880782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:04.954542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882599+0000","last_change":"2024-02-15T22:56:07.705589+0000","last_active":"2024-02-15T22:56:45.882599+0000","last_peered":"2024-02-15T22:56:45.882599+0000","last_clean":"2024-02-15T22:56:45.882599+0000","last_became_active":"2024-02-15T22:56:07.705323+0000","last_became_peered":"2024-02-15T22:56:07.705323+0000","last_unstale":"2024-02-15T22:56:45.882599+0000","last_undegraded":"2024-02-15T22:56:45.882599+0000","last_fullsized":"2024-02-15T22:56:45.882599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:10.810269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'11","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884687+0000","last_change":"2024-02-15T22:56:09.729641+0000","last_active":"2024-02-15T22:56:45.884687+0000","last_peered":"2024-02-15T22:56:45.884687+0000","last_clean":"2024-02-15T22:56:45.884687+0000","last_became_active":"2024-02-15T22:56:09.729131+0000","last_became_peered":"2024-02-15T22:56:09.729131+0000","last_unstale":"2024-02-15T22:56:45.884687+0000","last_undegraded":"2024-02-15T22:56:45.884687+0000","last_fullsized":"2024-02-15T22:56:45.884687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:25:53.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'240","reported_seq":310,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.534634+0000","last_change":"2024-02-15T22:56:11.720224+0000","last_active":"2024-02-15T22:57:35.534634+0000","last_peered":"2024-02-15T22:57:35.534634+0000","last_clean":"2024-02-15T22:57:35.534634+0000","last_became_active":"2024-02-15T22:56:11.719685+0000","last_became_peered":"2024-02-15T22:56:11.719685+0000","last_unstale":"2024-02-15T22:57:35.534634+0000","last_undegraded":"2024-02-15T22:57:35.534634+0000","last_fullsized":"2024-02-15T22:57:35.534634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:04.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879177+0000","last_change":"2024-02-15T22:56:13.730782+0000","last_active":"2024-02-15T22:56:45.879177+0000","last_peered":"2024-02-15T22:56:45.879177+0000","last_clean":"2024-02-15T22:56:45.879177+0000","last_became_active":"2024-02-15T22:56:13.730494+0000","last_became_peered":"2024-02-15T22:56:13.730494+0000","last_unstale":"2024-02-15T22:56:45.879177+0000","last_undegraded":"2024-02-15T22:56:45.879177+0000","last_fullsized":"2024-02-15T22:56:45.879177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:06:36.344805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'5","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214087+0000","last_change":"2024-02-15T22:56:05.706030+0000","last_active":"2024-02-15T22:57:29.214087+0000","last_peered":"2024-02-15T22:57:29.214087+0000","last_clean":"2024-02-15T22:57:29.214087+0000","last_became_active":"2024-02-15T22:56:05.705764+0000","last_became_peered":"2024-02-15T22:56:05.705764+0000","last_unstale":"2024-02-15T22:57:29.214087+0000","last_undegraded":"2024-02-15T22:57:29.214087+0000","last_fullsized":"2024-02-15T22:57:29.214087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:49.756184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879958+0000","last_change":"2024-02-15T22:56:03.706073+0000","last_active":"2024-02-15T22:56:45.879958+0000","last_peered":"2024-02-15T22:56:45.879958+0000","last_clean":"2024-02-15T22:56:45.879958+0000","last_became_active":"2024-02-15T22:56:03.705783+0000","last_became_peered":"2024-02-15T22:56:03.705783+0000","last_unstale":"2024-02-15T22:56:45.879958+0000","last_undegraded":"2024-02-15T22:56:45.879958+0000","last_fullsized":"2024-02-15T22:56:45.879958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883785+0000","last_change":"2024-02-15T22:55:57.854108+0000","last_active":"2024-02-15T22:56:45.883785+0000","last_peered":"2024-02-15T22:56:45.883785+0000","last_clean":"2024-02-15T22:56:45.883785+0000","last_became_active":"2024-02-15T22:55:57.853714+0000","last_became_peered":"2024-02-15T22:55:57.853714+0000","last_unstale":"2024-02-15T22:56:45.883785+0000","last_undegraded":"2024-02-15T22:56:45.883785+0000","last_fullsized":"2024-02-15T22:56:45.883785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:25:37.860937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881722+0000","last_change":"2024-02-15T22:56:07.705348+0000","last_active":"2024-02-15T22:56:45.881722+0000","last_peered":"2024-02-15T22:56:45.881722+0000","last_clean":"2024-02-15T22:56:45.881722+0000","last_became_active":"2024-02-15T22:56:07.705013+0000","last_became_peered":"2024-02-15T22:56:07.705013+0000","last_unstale":"2024-02-15T22:56:45.881722+0000","last_undegraded":"2024-02-15T22:56:45.881722+0000","last_fullsized":"2024-02-15T22:56:45.881722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:18:54.870237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'76","reported_seq":147,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.357077+0000","last_change":"2024-02-15T22:56:09.720229+0000","last_active":"2024-02-15T22:57:35.357077+0000","last_peered":"2024-02-15T22:57:35.357077+0000","last_clean":"2024-02-15T22:57:35.357077+0000","last_became_active":"2024-02-15T22:56:09.719916+0000","last_became_peered":"2024-02-15T22:56:09.719916+0000","last_unstale":"2024-02-15T22:57:35.357077+0000","last_undegraded":"2024-02-15T22:57:35.357077+0000","last_fullsized":"2024-02-15T22:57:35.357077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:49.736320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879563+0000","last_change":"2024-02-15T22:56:11.718006+0000","last_active":"2024-02-15T22:56:45.879563+0000","last_peered":"2024-02-15T22:56:45.879563+0000","last_clean":"2024-02-15T22:56:45.879563+0000","last_became_active":"2024-02-15T22:56:11.717758+0000","last_became_peered":"2024-02-15T22:56:11.717758+0000","last_unstale":"2024-02-15T22:56:45.879563+0000","last_undegraded":"2024-02-15T22:56:45.879563+0000","last_fullsized":"2024-02-15T22:56:45.879563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:14.822800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885412+0000","last_change":"2024-02-15T22:56:13.732654+0000","last_active":"2024-02-15T22:56:45.885412+0000","last_peered":"2024-02-15T22:56:45.885412+0000","last_clean":"2024-02-15T22:56:45.885412+0000","last_became_active":"2024-02-15T22:56:13.732325+0000","last_became_peered":"2024-02-15T22:56:13.732325+0000","last_unstale":"2024-02-15T22:56:45.885412+0000","last_undegraded":"2024-02-15T22:56:45.885412+0000","last_fullsized":"2024-02-15T22:56:45.885412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:28.711600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886278+0000","last_change":"2024-02-15T22:56:13.732647+0000","last_active":"2024-02-15T22:56:45.886278+0000","last_peered":"2024-02-15T22:56:45.886278+0000","last_clean":"2024-02-15T22:56:45.886278+0000","last_became_active":"2024-02-15T22:56:13.732216+0000","last_became_peered":"2024-02-15T22:56:13.732216+0000","last_unstale":"2024-02-15T22:56:45.886278+0000","last_undegraded":"2024-02-15T22:56:45.886278+0000","last_fullsized":"2024-02-15T22:56:45.886278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:16.829502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882801+0000","last_change":"2024-02-15T22:56:05.705497+0000","last_active":"2024-02-15T22:56:45.882801+0000","last_peered":"2024-02-15T22:56:45.882801+0000","last_clean":"2024-02-15T22:56:45.882801+0000","last_became_active":"2024-02-15T22:56:05.704959+0000","last_became_peered":"2024-02-15T22:56:05.704959+0000","last_unstale":"2024-02-15T22:56:45.882801+0000","last_undegraded":"2024-02-15T22:56:45.882801+0000","last_fullsized":"2024-02-15T22:56:45.882801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882619+0000","last_change":"2024-02-15T22:56:03.705460+0000","last_active":"2024-02-15T22:56:45.882619+0000","last_peered":"2024-02-15T22:56:45.882619+0000","last_clean":"2024-02-15T22:56:45.882619+0000","last_became_active":"2024-02-15T22:56:03.705176+0000","last_became_peered":"2024-02-15T22:56:03.705176+0000","last_unstale":"2024-02-15T22:56:45.882619+0000","last_undegraded":"2024-02-15T22:56:45.882619+0000","last_fullsized":"2024-02-15T22:56:45.882619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:05:19.142672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878857+0000","last_change":"2024-02-15T22:56:07.703334+0000","last_active":"2024-02-15T22:56:45.878857+0000","last_peered":"2024-02-15T22:56:45.878857+0000","last_clean":"2024-02-15T22:56:45.878857+0000","last_became_active":"2024-02-15T22:56:07.703060+0000","last_became_peered":"2024-02-15T22:56:07.703060+0000","last_unstale":"2024-02-15T22:56:45.878857+0000","last_undegraded":"2024-02-15T22:56:45.878857+0000","last_fullsized":"2024-02-15T22:56:45.878857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:26:26.533319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.862444+0000","last_change":"2024-02-15T22:56:09.720950+0000","last_active":"2024-02-15T22:57:29.862444+0000","last_peered":"2024-02-15T22:57:29.862444+0000","last_clean":"2024-02-15T22:57:29.862444+0000","last_became_active":"2024-02-15T22:56:09.720627+0000","last_became_peered":"2024-02-15T22:56:09.720627+0000","last_unstale":"2024-02-15T22:57:29.862444+0000","last_undegraded":"2024-02-15T22:57:29.862444+0000","last_fullsized":"2024-02-15T22:57:29.862444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:22.567556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881531+0000","last_change":"2024-02-15T22:56:11.724993+0000","last_active":"2024-02-15T22:56:45.881531+0000","last_peered":"2024-02-15T22:56:45.881531+0000","last_clean":"2024-02-15T22:56:45.881531+0000","last_became_active":"2024-02-15T22:56:11.724592+0000","last_became_peered":"2024-02-15T22:56:11.724592+0000","last_unstale":"2024-02-15T22:56:45.881531+0000","last_undegraded":"2024-02-15T22:56:45.881531+0000","last_fullsized":"2024-02-15T22:56:45.881531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:15:05.960640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880472+0000","last_change":"2024-02-15T22:56:13.730249+0000","last_active":"2024-02-15T22:56:45.880472+0000","last_peered":"2024-02-15T22:56:45.880472+0000","last_clean":"2024-02-15T22:56:45.880472+0000","last_became_active":"2024-02-15T22:56:13.729931+0000","last_became_peered":"2024-02-15T22:56:13.729931+0000","last_unstale":"2024-02-15T22:56:45.880472+0000","last_undegraded":"2024-02-15T22:56:45.880472+0000","last_fullsized":"2024-02-15T22:56:45.880472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:56.680543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879015+0000","last_change":"2024-02-15T22:56:05.714662+0000","last_active":"2024-02-15T22:56:45.879015+0000","last_peered":"2024-02-15T22:56:45.879015+0000","last_clean":"2024-02-15T22:56:45.879015+0000","last_became_active":"2024-02-15T22:56:05.714024+0000","last_became_peered":"2024-02-15T22:56:05.714024+0000","last_unstale":"2024-02-15T22:56:45.879015+0000","last_undegraded":"2024-02-15T22:56:45.879015+0000","last_fullsized":"2024-02-15T22:56:45.879015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:27:41.335097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886118+0000","last_change":"2024-02-15T22:56:03.698629+0000","last_active":"2024-02-15T22:56:45.886118+0000","last_peered":"2024-02-15T22:56:45.886118+0000","last_clean":"2024-02-15T22:56:45.886118+0000","last_became_active":"2024-02-15T22:56:03.695339+0000","last_became_peered":"2024-02-15T22:56:03.695339+0000","last_unstale":"2024-02-15T22:56:45.886118+0000","last_undegraded":"2024-02-15T22:56:45.886118+0000","last_fullsized":"2024-02-15T22:56:45.886118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882093+0000","last_change":"2024-02-15T22:56:07.708960+0000","last_active":"2024-02-15T22:56:45.882093+0000","last_peered":"2024-02-15T22:56:45.882093+0000","last_clean":"2024-02-15T22:56:45.882093+0000","last_became_active":"2024-02-15T22:56:07.708692+0000","last_became_peered":"2024-02-15T22:56:07.708692+0000","last_unstale":"2024-02-15T22:56:45.882093+0000","last_undegraded":"2024-02-15T22:56:45.882093+0000","last_fullsized":"2024-02-15T22:56:45.882093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:22.028630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"30'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:23.077273+0000","last_change":"2024-02-15T22:56:09.711326+0000","last_active":"2024-02-15T22:57:23.077273+0000","last_peered":"2024-02-15T22:57:23.077273+0000","last_clean":"2024-02-15T22:57:23.077273+0000","last_became_active":"2024-02-15T22:56:09.710942+0000","last_became_peered":"2024-02-15T22:56:09.710942+0000","last_unstale":"2024-02-15T22:57:23.077273+0000","last_undegraded":"2024-02-15T22:57:23.077273+0000","last_fullsized":"2024-02-15T22:57:23.077273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:53.380084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881415+0000","last_change":"2024-02-15T22:56:11.724852+0000","last_active":"2024-02-15T22:56:45.881415+0000","last_peered":"2024-02-15T22:56:45.881415+0000","last_clean":"2024-02-15T22:56:45.881415+0000","last_became_active":"2024-02-15T22:56:11.724533+0000","last_became_peered":"2024-02-15T22:56:11.724533+0000","last_unstale":"2024-02-15T22:56:45.881415+0000","last_undegraded":"2024-02-15T22:56:45.881415+0000","last_fullsized":"2024-02-15T22:56:45.881415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:34.347066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.216560+0000","last_change":"2024-02-15T22:56:13.734719+0000","last_active":"2024-02-15T22:56:47.216560+0000","last_peered":"2024-02-15T22:56:47.216560+0000","last_clean":"2024-02-15T22:56:47.216560+0000","last_became_active":"2024-02-15T22:56:13.734428+0000","last_became_peered":"2024-02-15T22:56:13.734428+0000","last_unstale":"2024-02-15T22:56:47.216560+0000","last_undegraded":"2024-02-15T22:56:47.216560+0000","last_fullsized":"2024-02-15T22:56:47.216560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:26:47.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883407+0000","last_change":"2024-02-15T22:56:05.706212+0000","last_active":"2024-02-15T22:57:29.883407+0000","last_peered":"2024-02-15T22:57:29.883407+0000","last_clean":"2024-02-15T22:57:29.883407+0000","last_became_active":"2024-02-15T22:56:05.705385+0000","last_became_peered":"2024-02-15T22:56:05.705385+0000","last_unstale":"2024-02-15T22:57:29.883407+0000","last_undegraded":"2024-02-15T22:57:29.883407+0000","last_fullsized":"2024-02-15T22:57:29.883407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:11.875068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886682+0000","last_change":"2024-02-15T22:56:03.700283+0000","last_active":"2024-02-15T22:56:45.886682+0000","last_peered":"2024-02-15T22:56:45.886682+0000","last_clean":"2024-02-15T22:56:45.886682+0000","last_became_active":"2024-02-15T22:56:03.699626+0000","last_became_peered":"2024-02-15T22:56:03.699626+0000","last_unstale":"2024-02-15T22:56:45.886682+0000","last_undegraded":"2024-02-15T22:56:45.886682+0000","last_fullsized":"2024-02-15T22:56:45.886682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880040+0000","last_change":"2024-02-15T22:56:07.706016+0000","last_active":"2024-02-15T22:56:45.880040+0000","last_peered":"2024-02-15T22:56:45.880040+0000","last_clean":"2024-02-15T22:56:45.880040+0000","last_became_active":"2024-02-15T22:56:07.705705+0000","last_became_peered":"2024-02-15T22:56:07.705705+0000","last_unstale":"2024-02-15T22:56:45.880040+0000","last_undegraded":"2024-02-15T22:56:45.880040+0000","last_fullsized":"2024-02-15T22:56:45.880040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:23:10.160782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'34","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.183999+0000","last_change":"2024-02-15T22:56:09.712570+0000","last_active":"2024-02-15T22:57:35.183999+0000","last_peered":"2024-02-15T22:57:35.183999+0000","last_clean":"2024-02-15T22:57:35.183999+0000","last_became_active":"2024-02-15T22:56:09.712337+0000","last_became_peered":"2024-02-15T22:56:09.712337+0000","last_unstale":"2024-02-15T22:57:35.183999+0000","last_undegraded":"2024-02-15T22:57:35.183999+0000","last_fullsized":"2024-02-15T22:57:35.183999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:42.465797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878361+0000","last_change":"2024-02-15T22:56:11.715966+0000","last_active":"2024-02-15T22:56:45.878361+0000","last_peered":"2024-02-15T22:56:45.878361+0000","last_clean":"2024-02-15T22:56:45.878361+0000","last_became_active":"2024-02-15T22:56:11.715697+0000","last_became_peered":"2024-02-15T22:56:11.715697+0000","last_unstale":"2024-02-15T22:56:45.878361+0000","last_undegraded":"2024-02-15T22:56:45.878361+0000","last_fullsized":"2024-02-15T22:56:45.878361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:26.704898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880177+0000","last_change":"2024-02-15T22:56:13.734867+0000","last_active":"2024-02-15T22:56:45.880177+0000","last_peered":"2024-02-15T22:56:45.880177+0000","last_clean":"2024-02-15T22:56:45.880177+0000","last_became_active":"2024-02-15T22:56:13.734565+0000","last_became_peered":"2024-02-15T22:56:13.734565+0000","last_unstale":"2024-02-15T22:56:45.880177+0000","last_undegraded":"2024-02-15T22:56:45.880177+0000","last_fullsized":"2024-02-15T22:56:45.880177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:44:28.581885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'9","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883753+0000","last_change":"2024-02-15T22:56:05.710863+0000","last_active":"2024-02-15T22:57:29.883753+0000","last_peered":"2024-02-15T22:57:29.883753+0000","last_clean":"2024-02-15T22:57:29.883753+0000","last_became_active":"2024-02-15T22:56:05.710562+0000","last_became_peered":"2024-02-15T22:56:05.710562+0000","last_unstale":"2024-02-15T22:57:29.883753+0000","last_undegraded":"2024-02-15T22:57:29.883753+0000","last_fullsized":"2024-02-15T22:57:29.883753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880178+0000","last_change":"2024-02-15T22:56:03.697251+0000","last_active":"2024-02-15T22:56:45.880178+0000","last_peered":"2024-02-15T22:56:45.880178+0000","last_clean":"2024-02-15T22:56:45.880178+0000","last_became_active":"2024-02-15T22:56:03.696590+0000","last_became_peered":"2024-02-15T22:56:03.696590+0000","last_unstale":"2024-02-15T22:56:45.880178+0000","last_undegraded":"2024-02-15T22:56:45.880178+0000","last_fullsized":"2024-02-15T22:56:45.880178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882678+0000","last_change":"2024-02-15T22:56:07.705557+0000","last_active":"2024-02-15T22:56:45.882678+0000","last_peered":"2024-02-15T22:56:45.882678+0000","last_clean":"2024-02-15T22:56:45.882678+0000","last_became_active":"2024-02-15T22:56:07.705239+0000","last_became_peered":"2024-02-15T22:56:07.705239+0000","last_unstale":"2024-02-15T22:56:45.882678+0000","last_undegraded":"2024-02-15T22:56:45.882678+0000","last_fullsized":"2024-02-15T22:56:45.882678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:45.133507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.848608+0000","last_change":"2024-02-15T22:56:09.710915+0000","last_active":"2024-02-15T22:57:29.848608+0000","last_peered":"2024-02-15T22:57:29.848608+0000","last_clean":"2024-02-15T22:57:29.848608+0000","last_became_active":"2024-02-15T22:56:09.710616+0000","last_became_peered":"2024-02-15T22:56:09.710616+0000","last_unstale":"2024-02-15T22:57:29.848608+0000","last_undegraded":"2024-02-15T22:57:29.848608+0000","last_fullsized":"2024-02-15T22:57:29.848608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:52.104156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883516+0000","last_change":"2024-02-15T22:56:11.719273+0000","last_active":"2024-02-15T22:56:45.883516+0000","last_peered":"2024-02-15T22:56:45.883516+0000","last_clean":"2024-02-15T22:56:45.883516+0000","last_became_active":"2024-02-15T22:56:11.718995+0000","last_became_peered":"2024-02-15T22:56:11.718995+0000","last_unstale":"2024-02-15T22:56:45.883516+0000","last_undegraded":"2024-02-15T22:56:45.883516+0000","last_fullsized":"2024-02-15T22:56:45.883516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:42.609730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391474+0000","last_change":"2024-02-15T22:56:05.699435+0000","last_active":"2024-02-15T22:57:35.391474+0000","last_peered":"2024-02-15T22:57:35.391474+0000","last_clean":"2024-02-15T22:57:35.391474+0000","last_became_active":"2024-02-15T22:56:05.699196+0000","last_became_peered":"2024-02-15T22:56:05.699196+0000","last_unstale":"2024-02-15T22:57:35.391474+0000","last_undegraded":"2024-02-15T22:57:35.391474+0000","last_fullsized":"2024-02-15T22:57:35.391474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:28.327809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.216627+0000","last_change":"2024-02-15T22:56:03.702280+0000","last_active":"2024-02-15T22:57:29.216627+0000","last_peered":"2024-02-15T22:57:29.216627+0000","last_clean":"2024-02-15T22:57:29.216627+0000","last_became_active":"2024-02-15T22:56:03.702007+0000","last_became_peered":"2024-02-15T22:56:03.702007+0000","last_unstale":"2024-02-15T22:57:29.216627+0000","last_undegraded":"2024-02-15T22:57:29.216627+0000","last_fullsized":"2024-02-15T22:57:29.216627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:17:47.733980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881599+0000","last_change":"2024-02-15T22:56:07.707669+0000","last_active":"2024-02-15T22:56:45.881599+0000","last_peered":"2024-02-15T22:56:45.881599+0000","last_clean":"2024-02-15T22:56:45.881599+0000","last_became_active":"2024-02-15T22:56:07.707124+0000","last_became_peered":"2024-02-15T22:56:07.707124+0000","last_unstale":"2024-02-15T22:56:45.881599+0000","last_undegraded":"2024-02-15T22:56:45.881599+0000","last_fullsized":"2024-02-15T22:56:45.881599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:46.212262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.354113+0000","last_change":"2024-02-15T22:56:09.713405+0000","last_active":"2024-02-15T22:57:35.354113+0000","last_peered":"2024-02-15T22:57:35.354113+0000","last_clean":"2024-02-15T22:57:35.354113+0000","last_became_active":"2024-02-15T22:56:09.713076+0000","last_became_peered":"2024-02-15T22:56:09.713076+0000","last_unstale":"2024-02-15T22:57:35.354113+0000","last_undegraded":"2024-02-15T22:57:35.354113+0000","last_fullsized":"2024-02-15T22:57:35.354113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:36.072001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885912+0000","last_change":"2024-02-15T22:56:11.718389+0000","last_active":"2024-02-15T22:56:45.885912+0000","last_peered":"2024-02-15T22:56:45.885912+0000","last_clean":"2024-02-15T22:56:45.885912+0000","last_became_active":"2024-02-15T22:56:11.718102+0000","last_became_peered":"2024-02-15T22:56:11.718102+0000","last_unstale":"2024-02-15T22:56:45.885912+0000","last_undegraded":"2024-02-15T22:56:45.885912+0000","last_fullsized":"2024-02-15T22:56:45.885912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:26.771661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.339922+0000","last_change":"2024-02-15T22:56:13.734724+0000","last_active":"2024-02-15T22:57:29.339922+0000","last_peered":"2024-02-15T22:57:29.339922+0000","last_clean":"2024-02-15T22:57:29.339922+0000","last_became_active":"2024-02-15T22:56:13.734372+0000","last_became_peered":"2024-02-15T22:56:13.734372+0000","last_unstale":"2024-02-15T22:57:29.339922+0000","last_undegraded":"2024-02-15T22:57:29.339922+0000","last_fullsized":"2024-02-15T22:57:29.339922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:39.885870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391646+0000","last_change":"2024-02-15T22:56:05.705862+0000","last_active":"2024-02-15T22:57:35.391646+0000","last_peered":"2024-02-15T22:57:35.391646+0000","last_clean":"2024-02-15T22:57:35.391646+0000","last_became_active":"2024-02-15T22:56:05.705473+0000","last_became_peered":"2024-02-15T22:56:05.705473+0000","last_unstale":"2024-02-15T22:57:35.391646+0000","last_undegraded":"2024-02-15T22:57:35.391646+0000","last_fullsized":"2024-02-15T22:57:35.391646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:08.053314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.418196+0000","last_change":"2024-02-15T22:56:03.698010+0000","last_active":"2024-02-15T22:56:47.418196+0000","last_peered":"2024-02-15T22:56:47.418196+0000","last_clean":"2024-02-15T22:56:47.418196+0000","last_became_active":"2024-02-15T22:56:03.697691+0000","last_became_peered":"2024-02-15T22:56:03.697691+0000","last_unstale":"2024-02-15T22:56:47.418196+0000","last_undegraded":"2024-02-15T22:56:47.418196+0000","last_fullsized":"2024-02-15T22:56:47.418196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886468+0000","last_change":"2024-02-15T22:56:07.704334+0000","last_active":"2024-02-15T22:56:45.886468+0000","last_peered":"2024-02-15T22:56:45.886468+0000","last_clean":"2024-02-15T22:56:45.886468+0000","last_became_active":"2024-02-15T22:56:07.704018+0000","last_became_peered":"2024-02-15T22:56:07.704018+0000","last_unstale":"2024-02-15T22:56:45.886468+0000","last_undegraded":"2024-02-15T22:56:45.886468+0000","last_fullsized":"2024-02-15T22:56:45.886468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:59.601424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.849508+0000","last_change":"2024-02-15T22:56:09.717626+0000","last_active":"2024-02-15T22:57:29.849508+0000","last_peered":"2024-02-15T22:57:29.849508+0000","last_clean":"2024-02-15T22:57:29.849508+0000","last_became_active":"2024-02-15T22:56:09.717105+0000","last_became_peered":"2024-02-15T22:56:09.717105+0000","last_unstale":"2024-02-15T22:57:29.849508+0000","last_undegraded":"2024-02-15T22:57:29.849508+0000","last_fullsized":"2024-02-15T22:57:29.849508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:04:03.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882499+0000","last_change":"2024-02-15T22:56:11.723141+0000","last_active":"2024-02-15T22:56:45.882499+0000","last_peered":"2024-02-15T22:56:45.882499+0000","last_clean":"2024-02-15T22:56:45.882499+0000","last_became_active":"2024-02-15T22:56:11.722865+0000","last_became_peered":"2024-02-15T22:56:11.722865+0000","last_unstale":"2024-02-15T22:56:45.882499+0000","last_undegraded":"2024-02-15T22:56:45.882499+0000","last_fullsized":"2024-02-15T22:56:45.882499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:05.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879845+0000","last_change":"2024-02-15T22:56:13.727435+0000","last_active":"2024-02-15T22:56:45.879845+0000","last_peered":"2024-02-15T22:56:45.879845+0000","last_clean":"2024-02-15T22:56:45.879845+0000","last_became_active":"2024-02-15T22:56:13.726748+0000","last_became_peered":"2024-02-15T22:56:13.726748+0000","last_unstale":"2024-02-15T22:56:45.879845+0000","last_undegraded":"2024-02-15T22:56:45.879845+0000","last_fullsized":"2024-02-15T22:56:45.879845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:41:50.659346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883279+0000","last_change":"2024-02-15T22:56:05.716925+0000","last_active":"2024-02-15T22:57:29.883279+0000","last_peered":"2024-02-15T22:57:29.883279+0000","last_clean":"2024-02-15T22:57:29.883279+0000","last_became_active":"2024-02-15T22:56:05.716677+0000","last_became_peered":"2024-02-15T22:56:05.716677+0000","last_unstale":"2024-02-15T22:57:29.883279+0000","last_undegraded":"2024-02-15T22:57:29.883279+0000","last_fullsized":"2024-02-15T22:57:29.883279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:37.588602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878559+0000","last_change":"2024-02-15T22:56:03.692964+0000","last_active":"2024-02-15T22:56:45.878559+0000","last_peered":"2024-02-15T22:56:45.878559+0000","last_clean":"2024-02-15T22:56:45.878559+0000","last_became_active":"2024-02-15T22:56:03.692632+0000","last_became_peered":"2024-02-15T22:56:03.692632+0000","last_unstale":"2024-02-15T22:56:45.878559+0000","last_undegraded":"2024-02-15T22:56:45.878559+0000","last_fullsized":"2024-02-15T22:56:45.878559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:26.885390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885768+0000","last_change":"2024-02-15T22:56:07.704513+0000","last_active":"2024-02-15T22:56:45.885768+0000","last_peered":"2024-02-15T22:56:45.885768+0000","last_clean":"2024-02-15T22:56:45.885768+0000","last_became_active":"2024-02-15T22:56:07.704208+0000","last_became_peered":"2024-02-15T22:56:07.704208+0000","last_unstale":"2024-02-15T22:56:45.885768+0000","last_undegraded":"2024-02-15T22:56:45.885768+0000","last_fullsized":"2024-02-15T22:56:45.885768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:13:55.637902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.894297+0000","last_change":"2024-02-15T22:56:09.717007+0000","last_active":"2024-02-15T22:57:29.894297+0000","last_peered":"2024-02-15T22:57:29.894297+0000","last_clean":"2024-02-15T22:57:29.894297+0000","last_became_active":"2024-02-15T22:56:09.716753+0000","last_became_peered":"2024-02-15T22:56:09.716753+0000","last_unstale":"2024-02-15T22:57:29.894297+0000","last_undegraded":"2024-02-15T22:57:29.894297+0000","last_fullsized":"2024-02-15T22:57:29.894297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:06.528782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880705+0000","last_change":"2024-02-15T22:56:11.722996+0000","last_active":"2024-02-15T22:56:45.880705+0000","last_peered":"2024-02-15T22:56:45.880705+0000","last_clean":"2024-02-15T22:56:45.880705+0000","last_became_active":"2024-02-15T22:56:11.722738+0000","last_became_peered":"2024-02-15T22:56:11.722738+0000","last_unstale":"2024-02-15T22:56:45.880705+0000","last_undegraded":"2024-02-15T22:56:45.880705+0000","last_fullsized":"2024-02-15T22:56:45.880705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:45.887455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880053+0000","last_change":"2024-02-15T22:56:13.727522+0000","last_active":"2024-02-15T22:56:45.880053+0000","last_peered":"2024-02-15T22:56:45.880053+0000","last_clean":"2024-02-15T22:56:45.880053+0000","last_became_active":"2024-02-15T22:56:13.727216+0000","last_became_peered":"2024-02-15T22:56:13.727216+0000","last_unstale":"2024-02-15T22:56:45.880053+0000","last_undegraded":"2024-02-15T22:56:45.880053+0000","last_fullsized":"2024-02-15T22:56:45.880053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:39:14.707814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881181+0000","last_change":"2024-02-15T22:56:05.707488+0000","last_active":"2024-02-15T22:56:45.881181+0000","last_peered":"2024-02-15T22:56:45.881181+0000","last_clean":"2024-02-15T22:56:45.881181+0000","last_became_active":"2024-02-15T22:56:05.707154+0000","last_became_peered":"2024-02-15T22:56:05.707154+0000","last_unstale":"2024-02-15T22:56:45.881181+0000","last_undegraded":"2024-02-15T22:56:45.881181+0000","last_fullsized":"2024-02-15T22:56:45.881181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881248+0000","last_change":"2024-02-15T22:56:03.700157+0000","last_active":"2024-02-15T22:56:45.881248+0000","last_peered":"2024-02-15T22:56:45.881248+0000","last_clean":"2024-02-15T22:56:45.881248+0000","last_became_active":"2024-02-15T22:56:03.699843+0000","last_became_peered":"2024-02-15T22:56:03.699843+0000","last_unstale":"2024-02-15T22:56:45.881248+0000","last_undegraded":"2024-02-15T22:56:45.881248+0000","last_fullsized":"2024-02-15T22:56:45.881248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:47.749601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:36.239355+0000","last_change":"2024-02-15T22:56:07.702631+0000","last_active":"2024-02-15T22:57:36.239355+0000","last_peered":"2024-02-15T22:57:36.239355+0000","last_clean":"2024-02-15T22:57:36.239355+0000","last_became_active":"2024-02-15T22:56:07.702014+0000","last_became_peered":"2024-02-15T22:56:07.702014+0000","last_unstale":"2024-02-15T22:57:36.239355+0000","last_undegraded":"2024-02-15T22:57:36.239355+0000","last_fullsized":"2024-02-15T22:57:36.239355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:02.266965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883138+0000","last_change":"2024-02-15T22:56:09.717362+0000","last_active":"2024-02-15T22:56:45.883138+0000","last_peered":"2024-02-15T22:56:45.883138+0000","last_clean":"2024-02-15T22:56:45.883138+0000","last_became_active":"2024-02-15T22:56:09.715996+0000","last_became_peered":"2024-02-15T22:56:09.715996+0000","last_unstale":"2024-02-15T22:56:45.883138+0000","last_undegraded":"2024-02-15T22:56:45.883138+0000","last_fullsized":"2024-02-15T22:56:45.883138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:10.389319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'240","reported_seq":289,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.529299+0000","last_change":"2024-02-15T22:56:11.725698+0000","last_active":"2024-02-15T22:57:35.529299+0000","last_peered":"2024-02-15T22:57:35.529299+0000","last_clean":"2024-02-15T22:57:35.529299+0000","last_became_active":"2024-02-15T22:56:11.724520+0000","last_became_peered":"2024-02-15T22:56:11.724520+0000","last_unstale":"2024-02-15T22:57:35.529299+0000","last_undegraded":"2024-02-15T22:57:35.529299+0000","last_fullsized":"2024-02-15T22:57:35.529299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:08.534852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879365+0000","last_change":"2024-02-15T22:56:13.731954+0000","last_active":"2024-02-15T22:56:45.879365+0000","last_peered":"2024-02-15T22:56:45.879365+0000","last_clean":"2024-02-15T22:56:45.879365+0000","last_became_active":"2024-02-15T22:56:13.731683+0000","last_became_peered":"2024-02-15T22:56:13.731683+0000","last_unstale":"2024-02-15T22:56:45.879365+0000","last_undegraded":"2024-02-15T22:56:45.879365+0000","last_fullsized":"2024-02-15T22:56:45.879365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:12:05.571855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882882+0000","last_change":"2024-02-15T22:56:05.701652+0000","last_active":"2024-02-15T22:56:45.882882+0000","last_peered":"2024-02-15T22:56:45.882882+0000","last_clean":"2024-02-15T22:56:45.882882+0000","last_became_active":"2024-02-15T22:56:05.700922+0000","last_became_peered":"2024-02-15T22:56:05.700922+0000","last_unstale":"2024-02-15T22:56:45.882882+0000","last_undegraded":"2024-02-15T22:56:45.882882+0000","last_fullsized":"2024-02-15T22:56:45.882882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:11.875068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883283+0000","last_change":"2024-02-15T22:56:03.697064+0000","last_active":"2024-02-15T22:56:45.883283+0000","last_peered":"2024-02-15T22:56:45.883283+0000","last_clean":"2024-02-15T22:56:45.883283+0000","last_became_active":"2024-02-15T22:56:03.696168+0000","last_became_peered":"2024-02-15T22:56:03.696168+0000","last_unstale":"2024-02-15T22:56:45.883283+0000","last_undegraded":"2024-02-15T22:56:45.883283+0000","last_fullsized":"2024-02-15T22:56:45.883283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879369+0000","last_change":"2024-02-15T22:56:07.702419+0000","last_active":"2024-02-15T22:56:45.879369+0000","last_peered":"2024-02-15T22:56:45.879369+0000","last_clean":"2024-02-15T22:56:45.879369+0000","last_became_active":"2024-02-15T22:56:07.701777+0000","last_became_peered":"2024-02-15T22:56:07.701777+0000","last_unstale":"2024-02-15T22:56:45.879369+0000","last_undegraded":"2024-02-15T22:56:45.879369+0000","last_fullsized":"2024-02-15T22:56:45.879369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:35.223607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'35","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.840610+0000","last_change":"2024-02-15T22:56:09.713897+0000","last_active":"2024-02-15T22:57:29.840610+0000","last_peered":"2024-02-15T22:57:29.840610+0000","last_clean":"2024-02-15T22:57:29.840610+0000","last_became_active":"2024-02-15T22:56:09.713636+0000","last_became_peered":"2024-02-15T22:56:09.713636+0000","last_unstale":"2024-02-15T22:57:29.840610+0000","last_undegraded":"2024-02-15T22:57:29.840610+0000","last_fullsized":"2024-02-15T22:57:29.840610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:30.461447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878819+0000","last_change":"2024-02-15T22:56:11.722701+0000","last_active":"2024-02-15T22:56:45.878819+0000","last_peered":"2024-02-15T22:56:45.878819+0000","last_clean":"2024-02-15T22:56:45.878819+0000","last_became_active":"2024-02-15T22:56:11.722374+0000","last_became_peered":"2024-02-15T22:56:11.722374+0000","last_unstale":"2024-02-15T22:56:45.878819+0000","last_undegraded":"2024-02-15T22:56:45.878819+0000","last_fullsized":"2024-02-15T22:56:45.878819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:08.103224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879392+0000","last_change":"2024-02-15T22:56:13.733861+0000","last_active":"2024-02-15T22:56:45.879392+0000","last_peered":"2024-02-15T22:56:45.879392+0000","last_clean":"2024-02-15T22:56:45.879392+0000","last_became_active":"2024-02-15T22:56:13.733576+0000","last_became_peered":"2024-02-15T22:56:13.733576+0000","last_unstale":"2024-02-15T22:56:45.879392+0000","last_undegraded":"2024-02-15T22:56:45.879392+0000","last_fullsized":"2024-02-15T22:56:45.879392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:06.977567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.426850+0000","last_change":"2024-02-15T22:56:05.701307+0000","last_active":"2024-02-15T22:56:47.426850+0000","last_peered":"2024-02-15T22:56:47.426850+0000","last_clean":"2024-02-15T22:56:47.426850+0000","last_became_active":"2024-02-15T22:56:05.701026+0000","last_became_peered":"2024-02-15T22:56:05.701026+0000","last_unstale":"2024-02-15T22:56:47.426850+0000","last_undegraded":"2024-02-15T22:56:47.426850+0000","last_fullsized":"2024-02-15T22:56:47.426850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:08:46.773754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883580+0000","last_change":"2024-02-15T22:56:03.706706+0000","last_active":"2024-02-15T22:56:45.883580+0000","last_peered":"2024-02-15T22:56:45.883580+0000","last_clean":"2024-02-15T22:56:45.883580+0000","last_became_active":"2024-02-15T22:56:03.706422+0000","last_became_peered":"2024-02-15T22:56:03.706422+0000","last_unstale":"2024-02-15T22:56:45.883580+0000","last_undegraded":"2024-02-15T22:56:45.883580+0000","last_fullsized":"2024-02-15T22:56:45.883580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:53.983428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883428+0000","last_change":"2024-02-15T22:56:07.707525+0000","last_active":"2024-02-15T22:56:45.883428+0000","last_peered":"2024-02-15T22:56:45.883428+0000","last_clean":"2024-02-15T22:56:45.883428+0000","last_became_active":"2024-02-15T22:56:07.707265+0000","last_became_peered":"2024-02-15T22:56:07.707265+0000","last_unstale":"2024-02-15T22:56:45.883428+0000","last_undegraded":"2024-02-15T22:56:45.883428+0000","last_fullsized":"2024-02-15T22:56:45.883428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:05:01.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.841622+0000","last_change":"2024-02-15T22:56:09.717128+0000","last_active":"2024-02-15T22:57:29.841622+0000","last_peered":"2024-02-15T22:57:29.841622+0000","last_clean":"2024-02-15T22:57:29.841622+0000","last_became_active":"2024-02-15T22:56:09.716749+0000","last_became_peered":"2024-02-15T22:56:09.716749+0000","last_unstale":"2024-02-15T22:57:29.841622+0000","last_undegraded":"2024-02-15T22:57:29.841622+0000","last_fullsized":"2024-02-15T22:57:29.841622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:31.912815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880224+0000","last_change":"2024-02-15T22:56:11.726028+0000","last_active":"2024-02-15T22:56:45.880224+0000","last_peered":"2024-02-15T22:56:45.880224+0000","last_clean":"2024-02-15T22:56:45.880224+0000","last_became_active":"2024-02-15T22:56:11.725667+0000","last_became_peered":"2024-02-15T22:56:11.725667+0000","last_unstale":"2024-02-15T22:56:45.880224+0000","last_undegraded":"2024-02-15T22:56:45.880224+0000","last_fullsized":"2024-02-15T22:56:45.880224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:33.489028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'8","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881143+0000","last_change":"2024-02-15T22:56:13.729381+0000","last_active":"2024-02-15T22:56:45.881143+0000","last_peered":"2024-02-15T22:56:45.881143+0000","last_clean":"2024-02-15T22:56:45.881143+0000","last_became_active":"2024-02-15T22:56:13.728844+0000","last_became_peered":"2024-02-15T22:56:13.728844+0000","last_unstale":"2024-02-15T22:56:45.881143+0000","last_undegraded":"2024-02-15T22:56:45.881143+0000","last_fullsized":"2024-02-15T22:56:45.881143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:08.247734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214122+0000","last_change":"2024-02-15T22:56:05.701351+0000","last_active":"2024-02-15T22:57:29.214122+0000","last_peered":"2024-02-15T22:57:29.214122+0000","last_clean":"2024-02-15T22:57:29.214122+0000","last_became_active":"2024-02-15T22:56:05.700908+0000","last_became_peered":"2024-02-15T22:56:05.700908+0000","last_unstale":"2024-02-15T22:57:29.214122+0000","last_undegraded":"2024-02-15T22:57:29.214122+0000","last_fullsized":"2024-02-15T22:57:29.214122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:41:03.587630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881194+0000","last_change":"2024-02-15T22:56:03.704371+0000","last_active":"2024-02-15T22:56:45.881194+0000","last_peered":"2024-02-15T22:56:45.881194+0000","last_clean":"2024-02-15T22:56:45.881194+0000","last_became_active":"2024-02-15T22:56:03.704081+0000","last_became_peered":"2024-02-15T22:56:03.704081+0000","last_unstale":"2024-02-15T22:56:45.881194+0000","last_undegraded":"2024-02-15T22:56:45.881194+0000","last_fullsized":"2024-02-15T22:56:45.881194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:52.903955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878100+0000","last_change":"2024-02-15T22:56:07.708809+0000","last_active":"2024-02-15T22:56:45.878100+0000","last_peered":"2024-02-15T22:56:45.878100+0000","last_clean":"2024-02-15T22:56:45.878100+0000","last_became_active":"2024-02-15T22:56:07.708530+0000","last_became_peered":"2024-02-15T22:56:07.708530+0000","last_unstale":"2024-02-15T22:56:45.878100+0000","last_undegraded":"2024-02-15T22:56:45.878100+0000","last_fullsized":"2024-02-15T22:56:45.878100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:57.292484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.864140+0000","last_change":"2024-02-15T22:56:09.717300+0000","last_active":"2024-02-15T22:57:29.864140+0000","last_peered":"2024-02-15T22:57:29.864140+0000","last_clean":"2024-02-15T22:57:29.864140+0000","last_became_active":"2024-02-15T22:56:09.716134+0000","last_became_peered":"2024-02-15T22:56:09.716134+0000","last_unstale":"2024-02-15T22:57:29.864140+0000","last_undegraded":"2024-02-15T22:57:29.864140+0000","last_fullsized":"2024-02-15T22:57:29.864140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:52.667771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":40,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880819+0000","last_change":"2024-02-15T22:56:11.725615+0000","last_active":"2024-02-15T22:56:45.880819+0000","last_peered":"2024-02-15T22:56:45.880819+0000","last_clean":"2024-02-15T22:56:45.880819+0000","last_became_active":"2024-02-15T22:56:11.725271+0000","last_became_peered":"2024-02-15T22:56:11.725271+0000","last_unstale":"2024-02-15T22:56:45.880819+0000","last_undegraded":"2024-02-15T22:56:45.880819+0000","last_fullsized":"2024-02-15T22:56:45.880819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:13.922809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880951+0000","last_change":"2024-02-15T22:56:13.735140+0000","last_active":"2024-02-15T22:56:45.880951+0000","last_peered":"2024-02-15T22:56:45.880951+0000","last_clean":"2024-02-15T22:56:45.880951+0000","last_became_active":"2024-02-15T22:56:13.734871+0000","last_became_peered":"2024-02-15T22:56:13.734871+0000","last_unstale":"2024-02-15T22:56:45.880951+0000","last_undegraded":"2024-02-15T22:56:45.880951+0000","last_fullsized":"2024-02-15T22:56:45.880951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:23:54.224082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'15","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214442+0000","last_change":"2024-02-15T22:56:05.700345+0000","last_active":"2024-02-15T22:57:29.214442+0000","last_peered":"2024-02-15T22:57:29.214442+0000","last_clean":"2024-02-15T22:57:29.214442+0000","last_became_active":"2024-02-15T22:56:05.700066+0000","last_became_peered":"2024-02-15T22:56:05.700066+0000","last_unstale":"2024-02-15T22:57:29.214442+0000","last_undegraded":"2024-02-15T22:57:29.214442+0000","last_fullsized":"2024-02-15T22:57:29.214442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:53.296017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880320+0000","last_change":"2024-02-15T22:56:03.694391+0000","last_active":"2024-02-15T22:56:45.880320+0000","last_peered":"2024-02-15T22:56:45.880320+0000","last_clean":"2024-02-15T22:56:45.880320+0000","last_became_active":"2024-02-15T22:56:03.693300+0000","last_became_peered":"2024-02-15T22:56:03.693300+0000","last_unstale":"2024-02-15T22:56:45.880320+0000","last_undegraded":"2024-02-15T22:56:45.880320+0000","last_fullsized":"2024-02-15T22:56:45.880320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878222+0000","last_change":"2024-02-15T22:56:07.709035+0000","last_active":"2024-02-15T22:56:45.878222+0000","last_peered":"2024-02-15T22:56:45.878222+0000","last_clean":"2024-02-15T22:56:45.878222+0000","last_became_active":"2024-02-15T22:56:07.708720+0000","last_became_peered":"2024-02-15T22:56:07.708720+0000","last_unstale":"2024-02-15T22:56:45.878222+0000","last_undegraded":"2024-02-15T22:56:45.878222+0000","last_fullsized":"2024-02-15T22:56:45.878222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:37.486705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.374757+0000","last_change":"2024-02-15T22:56:09.720664+0000","last_active":"2024-02-15T22:57:35.374757+0000","last_peered":"2024-02-15T22:57:35.374757+0000","last_clean":"2024-02-15T22:57:35.374757+0000","last_became_active":"2024-02-15T22:56:09.717846+0000","last_became_peered":"2024-02-15T22:56:09.717846+0000","last_unstale":"2024-02-15T22:57:35.374757+0000","last_undegraded":"2024-02-15T22:57:35.374757+0000","last_fullsized":"2024-02-15T22:57:35.374757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:14:17.930845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879414+0000","last_change":"2024-02-15T22:56:11.722731+0000","last_active":"2024-02-15T22:56:45.879414+0000","last_peered":"2024-02-15T22:56:45.879414+0000","last_clean":"2024-02-15T22:56:45.879414+0000","last_became_active":"2024-02-15T22:56:11.722402+0000","last_became_peered":"2024-02-15T22:56:11.722402+0000","last_unstale":"2024-02-15T22:56:45.879414+0000","last_undegraded":"2024-02-15T22:56:45.879414+0000","last_fullsized":"2024-02-15T22:56:45.879414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:57.504579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882258+0000","last_change":"2024-02-15T22:56:13.733552+0000","last_active":"2024-02-15T22:56:45.882258+0000","last_peered":"2024-02-15T22:56:45.882258+0000","last_clean":"2024-02-15T22:56:45.882258+0000","last_became_active":"2024-02-15T22:56:13.733285+0000","last_became_peered":"2024-02-15T22:56:13.733285+0000","last_unstale":"2024-02-15T22:56:45.882258+0000","last_undegraded":"2024-02-15T22:56:45.882258+0000","last_fullsized":"2024-02-15T22:56:45.882258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:52:36.091970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391114+0000","last_change":"2024-02-15T22:56:05.715894+0000","last_active":"2024-02-15T22:57:35.391114+0000","last_peered":"2024-02-15T22:57:35.391114+0000","last_clean":"2024-02-15T22:57:35.391114+0000","last_became_active":"2024-02-15T22:56:05.715609+0000","last_became_peered":"2024-02-15T22:56:05.715609+0000","last_unstale":"2024-02-15T22:57:35.391114+0000","last_undegraded":"2024-02-15T22:57:35.391114+0000","last_fullsized":"2024-02-15T22:57:35.391114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:59:43.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880575+0000","last_change":"2024-02-15T22:56:03.694275+0000","last_active":"2024-02-15T22:56:45.880575+0000","last_peered":"2024-02-15T22:56:45.880575+0000","last_clean":"2024-02-15T22:56:45.880575+0000","last_became_active":"2024-02-15T22:56:03.691266+0000","last_became_peered":"2024-02-15T22:56:03.691266+0000","last_unstale":"2024-02-15T22:56:45.880575+0000","last_undegraded":"2024-02-15T22:56:45.880575+0000","last_fullsized":"2024-02-15T22:56:45.880575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:27.775050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215026+0000","last_change":"2024-02-15T22:56:05.707825+0000","last_active":"2024-02-15T22:56:47.215026+0000","last_peered":"2024-02-15T22:56:47.215026+0000","last_clean":"2024-02-15T22:56:47.215026+0000","last_became_active":"2024-02-15T22:56:05.707492+0000","last_became_peered":"2024-02-15T22:56:05.707492+0000","last_unstale":"2024-02-15T22:56:47.215026+0000","last_undegraded":"2024-02-15T22:56:47.215026+0000","last_fullsized":"2024-02-15T22:56:47.215026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:53.786957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879050+0000","last_change":"2024-02-15T22:56:03.693256+0000","last_active":"2024-02-15T22:56:45.879050+0000","last_peered":"2024-02-15T22:56:45.879050+0000","last_clean":"2024-02-15T22:56:45.879050+0000","last_became_active":"2024-02-15T22:56:03.692909+0000","last_became_peered":"2024-02-15T22:56:03.692909+0000","last_unstale":"2024-02-15T22:56:45.879050+0000","last_undegraded":"2024-02-15T22:56:45.879050+0000","last_fullsized":"2024-02-15T22:56:45.879050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215219+0000","last_change":"2024-02-15T22:56:05.710347+0000","last_active":"2024-02-15T22:56:47.215219+0000","last_peered":"2024-02-15T22:56:47.215219+0000","last_clean":"2024-02-15T22:56:47.215219+0000","last_became_active":"2024-02-15T22:56:05.710095+0000","last_became_peered":"2024-02-15T22:56:05.710095+0000","last_unstale":"2024-02-15T22:56:47.215219+0000","last_undegraded":"2024-02-15T22:56:47.215219+0000","last_fullsized":"2024-02-15T22:56:47.215219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:20.752404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884346+0000","last_change":"2024-02-15T22:56:03.695701+0000","last_active":"2024-02-15T22:56:45.884346+0000","last_peered":"2024-02-15T22:56:45.884346+0000","last_clean":"2024-02-15T22:56:45.884346+0000","last_became_active":"2024-02-15T22:56:03.695362+0000","last_became_peered":"2024-02-15T22:56:03.695362+0000","last_unstale":"2024-02-15T22:56:45.884346+0000","last_undegraded":"2024-02-15T22:56:45.884346+0000","last_fullsized":"2024-02-15T22:56:45.884346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:11.575998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391183+0000","last_change":"2024-02-15T22:56:05.701633+0000","last_active":"2024-02-15T22:57:35.391183+0000","last_peered":"2024-02-15T22:57:35.391183+0000","last_clean":"2024-02-15T22:57:35.391183+0000","last_became_active":"2024-02-15T22:56:05.701253+0000","last_became_peered":"2024-02-15T22:56:05.701253+0000","last_unstale":"2024-02-15T22:57:35.391183+0000","last_undegraded":"2024-02-15T22:57:35.391183+0000","last_fullsized":"2024-02-15T22:57:35.391183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880157+0000","last_change":"2024-02-15T22:56:03.700366+0000","last_active":"2024-02-15T22:56:45.880157+0000","last_peered":"2024-02-15T22:56:45.880157+0000","last_clean":"2024-02-15T22:56:45.880157+0000","last_became_active":"2024-02-15T22:56:03.699881+0000","last_became_peered":"2024-02-15T22:56:03.699881+0000","last_unstale":"2024-02-15T22:56:45.880157+0000","last_undegraded":"2024-02-15T22:56:45.880157+0000","last_fullsized":"2024-02-15T22:56:45.880157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887346+0000","last_change":"2024-02-15T22:56:45.887346+0000","last_active":"2024-02-15T22:56:45.887346+0000","last_peered":"2024-02-15T22:56:45.887346+0000","last_clean":"2024-02-15T22:56:45.887346+0000","last_became_active":"2024-02-15T22:56:45.886976+0000","last_became_peered":"2024-02-15T22:56:45.886976+0000","last_unstale":"2024-02-15T22:56:45.887346+0000","last_undegraded":"2024-02-15T22:56:45.887346+0000","last_fullsized":"2024-02-15T22:56:45.887346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:43.710640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.878637+0000","last_change":"2024-02-15T22:56:03.693265+0000","last_active":"2024-02-15T22:57:29.878637+0000","last_peered":"2024-02-15T22:57:29.878637+0000","last_clean":"2024-02-15T22:57:29.878637+0000","last_became_active":"2024-02-15T22:56:03.692939+0000","last_became_peered":"2024-02-15T22:56:03.692939+0000","last_unstale":"2024-02-15T22:57:29.878637+0000","last_undegraded":"2024-02-15T22:57:29.878637+0000","last_fullsized":"2024-02-15T22:57:29.878637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878893+0000","last_change":"2024-02-15T22:56:05.714686+0000","last_active":"2024-02-15T22:56:45.878893+0000","last_peered":"2024-02-15T22:56:45.878893+0000","last_clean":"2024-02-15T22:56:45.878893+0000","last_became_active":"2024-02-15T22:56:05.713670+0000","last_became_peered":"2024-02-15T22:56:05.713670+0000","last_unstale":"2024-02-15T22:56:45.878893+0000","last_undegraded":"2024-02-15T22:56:45.878893+0000","last_fullsized":"2024-02-15T22:56:45.878893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:57.594699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882088+0000","last_change":"2024-02-15T22:56:03.697544+0000","last_active":"2024-02-15T22:56:45.882088+0000","last_peered":"2024-02-15T22:56:45.882088+0000","last_clean":"2024-02-15T22:56:45.882088+0000","last_became_active":"2024-02-15T22:56:03.696174+0000","last_became_peered":"2024-02-15T22:56:03.696174+0000","last_unstale":"2024-02-15T22:56:45.882088+0000","last_undegraded":"2024-02-15T22:56:45.882088+0000","last_fullsized":"2024-02-15T22:56:45.882088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.426942+0000","last_change":"2024-02-15T22:56:05.703501+0000","last_active":"2024-02-15T22:56:47.426942+0000","last_peered":"2024-02-15T22:56:47.426942+0000","last_clean":"2024-02-15T22:56:47.426942+0000","last_became_active":"2024-02-15T22:56:05.703183+0000","last_became_peered":"2024-02-15T22:56:05.703183+0000","last_unstale":"2024-02-15T22:56:47.426942+0000","last_undegraded":"2024-02-15T22:56:47.426942+0000","last_fullsized":"2024-02-15T22:56:47.426942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:08:55.954762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.415547+0000","last_change":"2024-02-15T22:56:03.700841+0000","last_active":"2024-02-15T22:56:47.415547+0000","last_peered":"2024-02-15T22:56:47.415547+0000","last_clean":"2024-02-15T22:56:47.415547+0000","last_became_active":"2024-02-15T22:56:03.699989+0000","last_became_peered":"2024-02-15T22:56:03.699989+0000","last_unstale":"2024-02-15T22:56:47.415547+0000","last_undegraded":"2024-02-15T22:56:47.415547+0000","last_fullsized":"2024-02-15T22:56:47.415547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:24:52.527970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883377+0000","last_change":"2024-02-15T22:56:05.701522+0000","last_active":"2024-02-15T22:57:29.883377+0000","last_peered":"2024-02-15T22:57:29.883377+0000","last_clean":"2024-02-15T22:57:29.883377+0000","last_became_active":"2024-02-15T22:56:05.701193+0000","last_became_peered":"2024-02-15T22:56:05.701193+0000","last_unstale":"2024-02-15T22:57:29.883377+0000","last_undegraded":"2024-02-15T22:57:29.883377+0000","last_fullsized":"2024-02-15T22:57:29.883377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:25:28.743304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881646+0000","last_change":"2024-02-15T22:56:03.693252+0000","last_active":"2024-02-15T22:56:45.881646+0000","last_peered":"2024-02-15T22:56:45.881646+0000","last_clean":"2024-02-15T22:56:45.881646+0000","last_became_active":"2024-02-15T22:56:03.692902+0000","last_became_peered":"2024-02-15T22:56:03.692902+0000","last_unstale":"2024-02-15T22:56:45.881646+0000","last_undegraded":"2024-02-15T22:56:45.881646+0000","last_fullsized":"2024-02-15T22:56:45.881646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:05:12.685609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505930+0000","last_change":"2024-02-15T22:56:05.702770+0000","last_active":"2024-02-15T22:57:29.505930+0000","last_peered":"2024-02-15T22:57:29.505930+0000","last_clean":"2024-02-15T22:57:29.505930+0000","last_became_active":"2024-02-15T22:56:05.702455+0000","last_became_peered":"2024-02-15T22:56:05.702455+0000","last_unstale":"2024-02-15T22:57:29.505930+0000","last_undegraded":"2024-02-15T22:57:29.505930+0000","last_fullsized":"2024-02-15T22:57:29.505930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:31.736198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880494+0000","last_change":"2024-02-15T22:56:03.695480+0000","last_active":"2024-02-15T22:56:45.880494+0000","last_peered":"2024-02-15T22:56:45.880494+0000","last_clean":"2024-02-15T22:56:45.880494+0000","last_became_active":"2024-02-15T22:56:03.695149+0000","last_became_peered":"2024-02-15T22:56:03.695149+0000","last_unstale":"2024-02-15T22:56:45.880494+0000","last_undegraded":"2024-02-15T22:56:45.880494+0000","last_fullsized":"2024-02-15T22:56:45.880494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:25:29.596967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883783+0000","last_change":"2024-02-15T22:56:05.704460+0000","last_active":"2024-02-15T22:56:45.883783+0000","last_peered":"2024-02-15T22:56:45.883783+0000","last_clean":"2024-02-15T22:56:45.883783+0000","last_became_active":"2024-02-15T22:56:05.704211+0000","last_became_peered":"2024-02-15T22:56:05.704211+0000","last_unstale":"2024-02-15T22:56:45.883783+0000","last_undegraded":"2024-02-15T22:56:45.883783+0000","last_fullsized":"2024-02-15T22:56:45.883783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:32.058815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.412910+0000","last_change":"2024-02-15T22:56:03.700242+0000","last_active":"2024-02-15T22:56:47.412910+0000","last_peered":"2024-02-15T22:56:47.412910+0000","last_clean":"2024-02-15T22:56:47.412910+0000","last_became_active":"2024-02-15T22:56:03.699419+0000","last_became_peered":"2024-02-15T22:56:03.699419+0000","last_unstale":"2024-02-15T22:56:47.412910+0000","last_undegraded":"2024-02-15T22:56:47.412910+0000","last_fullsized":"2024-02-15T22:56:47.412910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880395+0000","last_change":"2024-02-15T22:56:05.711089+0000","last_active":"2024-02-15T22:56:45.880395+0000","last_peered":"2024-02-15T22:56:45.880395+0000","last_clean":"2024-02-15T22:56:45.880395+0000","last_became_active":"2024-02-15T22:56:05.710665+0000","last_became_peered":"2024-02-15T22:56:05.710665+0000","last_unstale":"2024-02-15T22:56:45.880395+0000","last_undegraded":"2024-02-15T22:56:45.880395+0000","last_fullsized":"2024-02-15T22:56:45.880395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878725+0000","last_change":"2024-02-15T22:56:03.706180+0000","last_active":"2024-02-15T22:56:45.878725+0000","last_peered":"2024-02-15T22:56:45.878725+0000","last_clean":"2024-02-15T22:56:45.878725+0000","last_became_active":"2024-02-15T22:56:03.705871+0000","last_became_peered":"2024-02-15T22:56:03.705871+0000","last_unstale":"2024-02-15T22:56:45.878725+0000","last_undegraded":"2024-02-15T22:56:45.878725+0000","last_fullsized":"2024-02-15T22:56:45.878725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:27.775050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907691+0000","last_change":"2024-02-15T22:56:05.705174+0000","last_active":"2024-02-15T22:56:47.907691+0000","last_peered":"2024-02-15T22:56:47.907691+0000","last_clean":"2024-02-15T22:56:47.907691+0000","last_became_active":"2024-02-15T22:56:05.704505+0000","last_became_peered":"2024-02-15T22:56:05.704505+0000","last_unstale":"2024-02-15T22:56:47.907691+0000","last_undegraded":"2024-02-15T22:56:47.907691+0000","last_fullsized":"2024-02-15T22:56:47.907691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:43.641211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878881+0000","last_change":"2024-02-15T22:56:03.706212+0000","last_active":"2024-02-15T22:56:45.878881+0000","last_peered":"2024-02-15T22:56:45.878881+0000","last_clean":"2024-02-15T22:56:45.878881+0000","last_became_active":"2024-02-15T22:56:03.705904+0000","last_became_peered":"2024-02-15T22:56:03.705904+0000","last_unstale":"2024-02-15T22:56:45.878881+0000","last_undegraded":"2024-02-15T22:56:45.878881+0000","last_fullsized":"2024-02-15T22:56:45.878881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878616+0000","last_change":"2024-02-15T22:56:05.713346+0000","last_active":"2024-02-15T22:56:45.878616+0000","last_peered":"2024-02-15T22:56:45.878616+0000","last_clean":"2024-02-15T22:56:45.878616+0000","last_became_active":"2024-02-15T22:56:05.713035+0000","last_became_peered":"2024-02-15T22:56:05.713035+0000","last_unstale":"2024-02-15T22:56:45.878616+0000","last_undegraded":"2024-02-15T22:56:45.878616+0000","last_fullsized":"2024-02-15T22:56:45.878616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883260+0000","last_change":"2024-02-15T22:56:03.696317+0000","last_active":"2024-02-15T22:56:45.883260+0000","last_peered":"2024-02-15T22:56:45.883260+0000","last_clean":"2024-02-15T22:56:45.883260+0000","last_became_active":"2024-02-15T22:56:03.696045+0000","last_became_peered":"2024-02-15T22:56:03.696045+0000","last_unstale":"2024-02-15T22:56:45.883260+0000","last_undegraded":"2024-02-15T22:56:45.883260+0000","last_fullsized":"2024-02-15T22:56:45.883260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:41:52.854353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391060+0000","last_change":"2024-02-15T22:56:05.705005+0000","last_active":"2024-02-15T22:57:35.391060+0000","last_peered":"2024-02-15T22:57:35.391060+0000","last_clean":"2024-02-15T22:57:35.391060+0000","last_became_active":"2024-02-15T22:56:05.704733+0000","last_became_peered":"2024-02-15T22:56:05.704733+0000","last_unstale":"2024-02-15T22:57:35.391060+0000","last_undegraded":"2024-02-15T22:57:35.391060+0000","last_fullsized":"2024-02-15T22:57:35.391060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883670+0000","last_change":"2024-02-15T22:56:03.695753+0000","last_active":"2024-02-15T22:56:45.883670+0000","last_peered":"2024-02-15T22:56:45.883670+0000","last_clean":"2024-02-15T22:56:45.883670+0000","last_became_active":"2024-02-15T22:56:03.695454+0000","last_became_peered":"2024-02-15T22:56:03.695454+0000","last_unstale":"2024-02-15T22:56:45.883670+0000","last_undegraded":"2024-02-15T22:56:45.883670+0000","last_fullsized":"2024-02-15T22:56:45.883670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:51.780374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391086+0000","last_change":"2024-02-15T22:56:05.707756+0000","last_active":"2024-02-15T22:57:35.391086+0000","last_peered":"2024-02-15T22:57:35.391086+0000","last_clean":"2024-02-15T22:57:35.391086+0000","last_became_active":"2024-02-15T22:56:05.707464+0000","last_became_peered":"2024-02-15T22:56:05.707464+0000","last_unstale":"2024-02-15T22:57:35.391086+0000","last_undegraded":"2024-02-15T22:57:35.391086+0000","last_fullsized":"2024-02-15T22:57:35.391086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:48:01.797813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.386901+0000","last_change":"2024-02-15T22:56:03.696562+0000","last_active":"2024-02-15T22:57:35.386901+0000","last_peered":"2024-02-15T22:57:35.386901+0000","last_clean":"2024-02-15T22:57:35.386901+0000","last_became_active":"2024-02-15T22:56:03.696267+0000","last_became_peered":"2024-02-15T22:56:03.696267+0000","last_unstale":"2024-02-15T22:57:35.386901+0000","last_undegraded":"2024-02-15T22:57:35.386901+0000","last_fullsized":"2024-02-15T22:57:35.386901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907693+0000","last_change":"2024-02-15T22:56:05.705880+0000","last_active":"2024-02-15T22:56:47.907693+0000","last_peered":"2024-02-15T22:56:47.907693+0000","last_clean":"2024-02-15T22:56:47.907693+0000","last_became_active":"2024-02-15T22:56:05.705496+0000","last_became_peered":"2024-02-15T22:56:05.705496+0000","last_unstale":"2024-02-15T22:56:47.907693+0000","last_undegraded":"2024-02-15T22:56:47.907693+0000","last_fullsized":"2024-02-15T22:56:47.907693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.375500+0000","last_change":"2024-02-15T22:56:03.707531+0000","last_active":"2024-02-15T22:56:46.375500+0000","last_peered":"2024-02-15T22:56:46.375500+0000","last_clean":"2024-02-15T22:56:46.375500+0000","last_became_active":"2024-02-15T22:56:03.707033+0000","last_became_peered":"2024-02-15T22:56:03.707033+0000","last_unstale":"2024-02-15T22:56:46.375500+0000","last_undegraded":"2024-02-15T22:56:46.375500+0000","last_fullsized":"2024-02-15T22:56:46.375500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:06.046731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881067+0000","last_change":"2024-02-15T22:56:03.706143+0000","last_active":"2024-02-15T22:56:45.881067+0000","last_peered":"2024-02-15T22:56:45.881067+0000","last_clean":"2024-02-15T22:56:45.881067+0000","last_became_active":"2024-02-15T22:56:03.705853+0000","last_became_peered":"2024-02-15T22:56:03.705853+0000","last_unstale":"2024-02-15T22:56:45.881067+0000","last_undegraded":"2024-02-15T22:56:45.881067+0000","last_fullsized":"2024-02-15T22:56:45.881067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:01.198670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391176+0000","last_change":"2024-02-15T22:56:05.699396+0000","last_active":"2024-02-15T22:57:35.391176+0000","last_peered":"2024-02-15T22:57:35.391176+0000","last_clean":"2024-02-15T22:57:35.391176+0000","last_became_active":"2024-02-15T22:56:05.699141+0000","last_became_peered":"2024-02-15T22:56:05.699141+0000","last_unstale":"2024-02-15T22:57:35.391176+0000","last_undegraded":"2024-02-15T22:57:35.391176+0000","last_fullsized":"2024-02-15T22:57:35.391176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:02.890481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879188+0000","last_change":"2024-02-15T22:56:03.700573+0000","last_active":"2024-02-15T22:56:45.879188+0000","last_peered":"2024-02-15T22:56:45.879188+0000","last_clean":"2024-02-15T22:56:45.879188+0000","last_became_active":"2024-02-15T22:56:03.700107+0000","last_became_peered":"2024-02-15T22:56:03.700107+0000","last_unstale":"2024-02-15T22:56:45.879188+0000","last_undegraded":"2024-02-15T22:56:45.879188+0000","last_fullsized":"2024-02-15T22:56:45.879188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879724+0000","last_change":"2024-02-15T22:56:05.713543+0000","last_active":"2024-02-15T22:56:45.879724+0000","last_peered":"2024-02-15T22:56:45.879724+0000","last_clean":"2024-02-15T22:56:45.879724+0000","last_became_active":"2024-02-15T22:56:05.713142+0000","last_became_peered":"2024-02-15T22:56:05.713142+0000","last_unstale":"2024-02-15T22:56:45.879724+0000","last_undegraded":"2024-02-15T22:56:45.879724+0000","last_fullsized":"2024-02-15T22:56:45.879724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:23:08.154056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":46,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672986,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35764,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336076,"statfs":{"total":96636764160,"available":96600141824,"internally_reserved":0,"allocated":438272,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.25}]},{"osd":1,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.28000000000000003}]}]},{"osd":2,"up_from":10,"seq":42949672987,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":978944,"data_stored":722767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.441},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.313}]}]},{"osd":1,"up_from":10,"seq":42949672986,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"last":0.313},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.35699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705689,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.377},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.313}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:57:43.919 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-15T22:57:43.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T22:57:44.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.047+0000 7febb629a640 1 Processor -- start 2024-02-15T22:57:44.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.047+0000 7febb629a640 1 -- start start 2024-02-15T22:57:44.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.047+0000 7febb629a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febb006c730 0x7febb01333b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:44.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.047+0000 7febb629a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb0094c10 con 0x7febb0071790 2024-02-15T22:57:44.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.047+0000 7febb629a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb009d0c0 con 0x7febb006c730 2024-02-15T22:57:44.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.048+0000 7febaf7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febb006c730 0x7febb01333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:44.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.048+0000 7febaffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7febb0071790 0x7febb006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34778/0 (socket says 172.21.15.52:34778) 2024-02-15T22:57:44.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.048+0000 7febaffff640 1 -- 172.21.15.52:0/1775829639 learned_addr learned my addr 172.21.15.52:0/1775829639 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:44.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.048+0000 7febaf7fe640 1 -- 172.21.15.52:0/1775829639 >> v1:172.21.15.52:6789/0 conn(0x7febb0071790 legacy=0x7febb006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:44.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.048+0000 7febaf7fe640 1 -- 172.21.15.52:0/1775829639 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb0095430 con 0x7febb006c730 2024-02-15T22:57:44.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.048+0000 7febaeffd640 1 -- 172.21.15.52:0/1775829639 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790912377 0 0) 0x7febb0094c10 con 0x7febb0071790 2024-02-15T22:57:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.049+0000 7febaf7fe640 1 --2- 172.21.15.52:0/1775829639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb006c730 0x7febb01333b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7feba0009720 tx=0x7feba002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea12037fe103453c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.049+0000 7febaeffd640 1 -- 172.21.15.52:0/1775829639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feba0031760 con 0x7febb006c730 2024-02-15T22:57:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.049+0000 7febaeffd640 1 -- 172.21.15.52:0/1775829639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba00318c0 con 0x7febb006c730 2024-02-15T22:57:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.049+0000 7febaeffd640 1 -- 172.21.15.52:0/1775829639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feba0031b80 con 0x7febb006c730 2024-02-15T22:57:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.049+0000 7febb629a640 1 -- 172.21.15.52:0/1775829639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb006c730 msgr2=0x7febb01333b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.049+0000 7febb629a640 1 --2- 172.21.15.52:0/1775829639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb006c730 0x7febb01333b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7feba0009720 tx=0x7feba002b8d0 comp rx=0 tx=0).stop 2024-02-15T22:57:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.049+0000 7febb629a640 1 -- 172.21.15.52:0/1775829639 shutdown_connections 2024-02-15T22:57:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.049+0000 7febb629a640 1 --2- 172.21.15.52:0/1775829639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb006c730 0x7febb01333b0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.049+0000 7febb629a640 1 -- 172.21.15.52:0/1775829639 >> 172.21.15.52:0/1775829639 conn(0x7febb009b520 msgr2=0x7febb009b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.049+0000 7febb629a640 1 -- 172.21.15.52:0/1775829639 shutdown_connections 2024-02-15T22:57:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.049+0000 7febb629a640 1 -- 172.21.15.52:0/1775829639 wait complete. 2024-02-15T22:57:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.050+0000 7febb629a640 1 Processor -- start 2024-02-15T22:57:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.050+0000 7febb629a640 1 -- start start 2024-02-15T22:57:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febb629a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb006c730 0x7febb01bf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febb629a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb0093c20 con 0x7febb006c730 2024-02-15T22:57:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febaffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb006c730 0x7febb01bf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febaffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb006c730 0x7febb01bf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33238/0 (socket says 172.21.15.52:33238) 2024-02-15T22:57:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febaffff640 1 -- 172.21.15.52:0/62006236 learned_addr learned my addr 172.21.15.52:0/62006236 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febaffff640 1 -- 172.21.15.52:0/62006236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba0009400 con 0x7febb006c730 2024-02-15T22:57:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febaffff640 1 --2- 172.21.15.52:0/62006236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb006c730 0x7febb01bf1c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7feba400c420 tx=0x7feba400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febacff9640 1 -- 172.21.15.52:0/62006236 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feba40074d0 con 0x7febb006c730 2024-02-15T22:57:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febacff9640 1 -- 172.21.15.52:0/62006236 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba4007630 con 0x7febb006c730 2024-02-15T22:57:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febb629a640 1 -- 172.21.15.52:0/62006236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb01aa350 con 0x7febb006c730 2024-02-15T22:57:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febacff9640 1 -- 172.21.15.52:0/62006236 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feba4004950 con 0x7febb006c730 2024-02-15T22:57:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.051+0000 7febb629a640 1 -- 172.21.15.52:0/62006236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb01a9b40 con 0x7febb006c730 2024-02-15T22:57:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.052+0000 7febacff9640 1 -- 172.21.15.52:0/62006236 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7feba4004b70 con 0x7febb006c730 2024-02-15T22:57:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.052+0000 7febb629a640 1 -- 172.21.15.52:0/62006236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb00627b0 con 0x7febb006c730 2024-02-15T22:57:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.052+0000 7febacff9640 1 --2- 172.21.15.52:0/62006236 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb9c037ea0 0x7feb9c03a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.052+0000 7febacff9640 1 -- 172.21.15.52:0/62006236 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7feba404a890 con 0x7febb006c730 2024-02-15T22:57:44.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.053+0000 7febaf7fe640 1 --2- 172.21.15.52:0/62006236 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb9c037ea0 0x7feb9c03a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:44.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.053+0000 7febaf7fe640 1 --2- 172.21.15.52:0/62006236 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb9c037ea0 0x7feb9c03a360 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feba0036000 tx=0x7feba0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:44.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.057+0000 7febacff9640 1 -- 172.21.15.52:0/62006236 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feba401abe0 con 0x7febb006c730 2024-02-15T22:57:44.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.236+0000 7febb629a640 1 -- 172.21.15.52:0/62006236 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7febb0093890 con 0x7feb9c037ea0 2024-02-15T22:57:44.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.251+0000 7febacff9640 1 -- 172.21.15.52:0/62006236 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673027 (secure 0 0 0) 0x7febb0093890 con 0x7feb9c037ea0 2024-02-15T22:57:44.262 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:57:44.268 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-02-15T22:57:44.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.256+0000 7febb629a640 1 -- 172.21.15.52:0/62006236 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb9c037ea0 msgr2=0x7feb9c03a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:44.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.256+0000 7febb629a640 1 --2- 172.21.15.52:0/62006236 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb9c037ea0 0x7feb9c03a360 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feba0036000 tx=0x7feba0008030 comp rx=0 tx=0).stop 2024-02-15T22:57:44.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.256+0000 7febb629a640 1 -- 172.21.15.52:0/62006236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb006c730 msgr2=0x7febb01bf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:44.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.256+0000 7febb629a640 1 --2- 172.21.15.52:0/62006236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb006c730 0x7febb01bf1c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7feba400c420 tx=0x7feba400c8e0 comp rx=0 tx=0).stop 2024-02-15T22:57:44.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.256+0000 7febb629a640 1 -- 172.21.15.52:0/62006236 shutdown_connections 2024-02-15T22:57:44.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.256+0000 7febb629a640 1 --2- 172.21.15.52:0/62006236 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7feb9c037ea0 0x7feb9c03a360 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:44.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.256+0000 7febb629a640 1 --2- 172.21.15.52:0/62006236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb006c730 0x7febb01bf1c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:44.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.256+0000 7febb629a640 1 -- 172.21.15.52:0/62006236 >> 172.21.15.52:0/62006236 conn(0x7febb009b520 msgr2=0x7febb008c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:44.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.256+0000 7febb629a640 1 -- 172.21.15.52:0/62006236 shutdown_connections 2024-02-15T22:57:44.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.256+0000 7febb629a640 1 -- 172.21.15.52:0/62006236 wait complete. 2024-02-15T22:57:44.272 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-02-15T22:57:42.832792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3806,"num_read_kb":3453,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135792,"kb_used_data":2768,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351568,"statfs":{"total":386547056640,"available":386408005632,"internally_reserved":0,"allocated":2834432,"data_stored":1715324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1348,"num_objects":-27,"num_object_clones":0,"num_object_copies":-54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":270,"num_read_kb":261,"num_write":97,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003970"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887013+0000","last_change":"2024-02-15T22:56:03.700271+0000","last_active":"2024-02-15T22:56:45.887013+0000","last_peered":"2024-02-15T22:56:45.887013+0000","last_clean":"2024-02-15T22:56:45.887013+0000","last_became_active":"2024-02-15T22:56:03.699163+0000","last_became_peered":"2024-02-15T22:56:03.699163+0000","last_unstale":"2024-02-15T22:56:45.887013+0000","last_undegraded":"2024-02-15T22:56:45.887013+0000","last_fullsized":"2024-02-15T22:56:45.887013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391099+0000","last_change":"2024-02-15T22:56:05.708737+0000","last_active":"2024-02-15T22:57:35.391099+0000","last_peered":"2024-02-15T22:57:35.391099+0000","last_clean":"2024-02-15T22:57:35.391099+0000","last_became_active":"2024-02-15T22:56:05.708415+0000","last_became_peered":"2024-02-15T22:56:05.708415+0000","last_unstale":"2024-02-15T22:57:35.391099+0000","last_undegraded":"2024-02-15T22:57:35.391099+0000","last_fullsized":"2024-02-15T22:57:35.391099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:08.839506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881047+0000","last_change":"2024-02-15T22:56:03.704350+0000","last_active":"2024-02-15T22:56:45.881047+0000","last_peered":"2024-02-15T22:56:45.881047+0000","last_clean":"2024-02-15T22:56:45.881047+0000","last_became_active":"2024-02-15T22:56:03.704043+0000","last_became_peered":"2024-02-15T22:56:03.704043+0000","last_unstale":"2024-02-15T22:56:45.881047+0000","last_undegraded":"2024-02-15T22:56:45.881047+0000","last_fullsized":"2024-02-15T22:56:45.881047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:27.186561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882461+0000","last_change":"2024-02-15T22:56:05.703860+0000","last_active":"2024-02-15T22:56:45.882461+0000","last_peered":"2024-02-15T22:56:45.882461+0000","last_clean":"2024-02-15T22:56:45.882461+0000","last_became_active":"2024-02-15T22:56:05.703587+0000","last_became_peered":"2024-02-15T22:56:05.703587+0000","last_unstale":"2024-02-15T22:56:45.882461+0000","last_undegraded":"2024-02-15T22:56:45.882461+0000","last_fullsized":"2024-02-15T22:56:45.882461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:18.837089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884271+0000","last_change":"2024-02-15T22:56:03.703994+0000","last_active":"2024-02-15T22:56:45.884271+0000","last_peered":"2024-02-15T22:56:45.884271+0000","last_clean":"2024-02-15T22:56:45.884271+0000","last_became_active":"2024-02-15T22:56:03.703702+0000","last_became_peered":"2024-02-15T22:56:03.703702+0000","last_unstale":"2024-02-15T22:56:45.884271+0000","last_undegraded":"2024-02-15T22:56:45.884271+0000","last_fullsized":"2024-02-15T22:56:45.884271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:44.096887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883441+0000","last_change":"2024-02-15T22:56:05.709355+0000","last_active":"2024-02-15T22:57:29.883441+0000","last_peered":"2024-02-15T22:57:29.883441+0000","last_clean":"2024-02-15T22:57:29.883441+0000","last_became_active":"2024-02-15T22:56:05.709003+0000","last_became_peered":"2024-02-15T22:56:05.709003+0000","last_unstale":"2024-02-15T22:57:29.883441+0000","last_undegraded":"2024-02-15T22:57:29.883441+0000","last_fullsized":"2024-02-15T22:57:29.883441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:26:24.526593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885342+0000","last_change":"2024-02-15T22:56:03.692040+0000","last_active":"2024-02-15T22:56:45.885342+0000","last_peered":"2024-02-15T22:56:45.885342+0000","last_clean":"2024-02-15T22:56:45.885342+0000","last_became_active":"2024-02-15T22:56:03.691753+0000","last_became_peered":"2024-02-15T22:56:03.691753+0000","last_unstale":"2024-02-15T22:56:45.885342+0000","last_undegraded":"2024-02-15T22:56:45.885342+0000","last_fullsized":"2024-02-15T22:56:45.885342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214184+0000","last_change":"2024-02-15T22:56:05.703818+0000","last_active":"2024-02-15T22:57:29.214184+0000","last_peered":"2024-02-15T22:57:29.214184+0000","last_clean":"2024-02-15T22:57:29.214184+0000","last_became_active":"2024-02-15T22:56:05.703541+0000","last_became_peered":"2024-02-15T22:56:05.703541+0000","last_unstale":"2024-02-15T22:57:29.214184+0000","last_undegraded":"2024-02-15T22:57:29.214184+0000","last_fullsized":"2024-02-15T22:57:29.214184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:49.366897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881533+0000","last_change":"2024-02-15T22:56:03.694830+0000","last_active":"2024-02-15T22:56:45.881533+0000","last_peered":"2024-02-15T22:56:45.881533+0000","last_clean":"2024-02-15T22:56:45.881533+0000","last_became_active":"2024-02-15T22:56:03.694522+0000","last_became_peered":"2024-02-15T22:56:03.694522+0000","last_unstale":"2024-02-15T22:56:45.881533+0000","last_undegraded":"2024-02-15T22:56:45.881533+0000","last_fullsized":"2024-02-15T22:56:45.881533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:51.289434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.875000+0000","last_change":"2024-02-15T22:56:05.705402+0000","last_active":"2024-02-15T22:56:46.875000+0000","last_peered":"2024-02-15T22:56:46.875000+0000","last_clean":"2024-02-15T22:56:46.875000+0000","last_became_active":"2024-02-15T22:56:05.704411+0000","last_became_peered":"2024-02-15T22:56:05.704411+0000","last_unstale":"2024-02-15T22:56:46.875000+0000","last_undegraded":"2024-02-15T22:56:46.875000+0000","last_fullsized":"2024-02-15T22:56:46.875000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:12.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882213+0000","last_change":"2024-02-15T22:56:03.692633+0000","last_active":"2024-02-15T22:56:45.882213+0000","last_peered":"2024-02-15T22:56:45.882213+0000","last_clean":"2024-02-15T22:56:45.882213+0000","last_became_active":"2024-02-15T22:56:03.692316+0000","last_became_peered":"2024-02-15T22:56:03.692316+0000","last_unstale":"2024-02-15T22:56:45.882213+0000","last_undegraded":"2024-02-15T22:56:45.882213+0000","last_fullsized":"2024-02-15T22:56:45.882213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:26.885390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.214550+0000","last_change":"2024-02-15T22:56:05.715708+0000","last_active":"2024-02-15T22:56:47.214550+0000","last_peered":"2024-02-15T22:56:47.214550+0000","last_clean":"2024-02-15T22:56:47.214550+0000","last_became_active":"2024-02-15T22:56:05.715460+0000","last_became_peered":"2024-02-15T22:56:05.715460+0000","last_unstale":"2024-02-15T22:56:47.214550+0000","last_undegraded":"2024-02-15T22:56:47.214550+0000","last_fullsized":"2024-02-15T22:56:47.214550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:27.899628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.858213+0000","last_change":"2024-02-15T22:56:03.701184+0000","last_active":"2024-02-15T22:56:46.858213+0000","last_peered":"2024-02-15T22:56:46.858213+0000","last_clean":"2024-02-15T22:56:46.858213+0000","last_became_active":"2024-02-15T22:56:03.700908+0000","last_became_peered":"2024-02-15T22:56:03.700908+0000","last_unstale":"2024-02-15T22:56:46.858213+0000","last_undegraded":"2024-02-15T22:56:46.858213+0000","last_fullsized":"2024-02-15T22:56:46.858213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:10.798077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883471+0000","last_change":"2024-02-15T22:56:05.706807+0000","last_active":"2024-02-15T22:57:29.883471+0000","last_peered":"2024-02-15T22:57:29.883471+0000","last_clean":"2024-02-15T22:57:29.883471+0000","last_became_active":"2024-02-15T22:56:05.706078+0000","last_became_peered":"2024-02-15T22:56:05.706078+0000","last_unstale":"2024-02-15T22:57:29.883471+0000","last_undegraded":"2024-02-15T22:57:29.883471+0000","last_fullsized":"2024-02-15T22:57:29.883471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879163+0000","last_change":"2024-02-15T22:56:03.697612+0000","last_active":"2024-02-15T22:56:45.879163+0000","last_peered":"2024-02-15T22:56:45.879163+0000","last_clean":"2024-02-15T22:56:45.879163+0000","last_became_active":"2024-02-15T22:56:03.697327+0000","last_became_peered":"2024-02-15T22:56:03.697327+0000","last_unstale":"2024-02-15T22:56:45.879163+0000","last_undegraded":"2024-02-15T22:56:45.879163+0000","last_fullsized":"2024-02-15T22:56:45.879163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886735+0000","last_change":"2024-02-15T22:56:05.705497+0000","last_active":"2024-02-15T22:56:45.886735+0000","last_peered":"2024-02-15T22:56:45.886735+0000","last_clean":"2024-02-15T22:56:45.886735+0000","last_became_active":"2024-02-15T22:56:05.705173+0000","last_became_peered":"2024-02-15T22:56:05.705173+0000","last_unstale":"2024-02-15T22:56:45.886735+0000","last_undegraded":"2024-02-15T22:56:45.886735+0000","last_fullsized":"2024-02-15T22:56:45.886735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:12.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.214944+0000","last_change":"2024-02-15T22:56:05.704020+0000","last_active":"2024-02-15T22:56:47.214944+0000","last_peered":"2024-02-15T22:56:47.214944+0000","last_clean":"2024-02-15T22:56:47.214944+0000","last_became_active":"2024-02-15T22:56:05.703708+0000","last_became_peered":"2024-02-15T22:56:05.703708+0000","last_unstale":"2024-02-15T22:56:47.214944+0000","last_undegraded":"2024-02-15T22:56:47.214944+0000","last_fullsized":"2024-02-15T22:56:47.214944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:55.285758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880443+0000","last_change":"2024-02-15T22:56:03.697488+0000","last_active":"2024-02-15T22:56:45.880443+0000","last_peered":"2024-02-15T22:56:45.880443+0000","last_clean":"2024-02-15T22:56:45.880443+0000","last_became_active":"2024-02-15T22:56:03.696959+0000","last_became_peered":"2024-02-15T22:56:03.696959+0000","last_unstale":"2024-02-15T22:56:45.880443+0000","last_undegraded":"2024-02-15T22:56:45.880443+0000","last_fullsized":"2024-02-15T22:56:45.880443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883271+0000","last_change":"2024-02-15T22:56:05.700345+0000","last_active":"2024-02-15T22:57:29.883271+0000","last_peered":"2024-02-15T22:57:29.883271+0000","last_clean":"2024-02-15T22:57:29.883271+0000","last_became_active":"2024-02-15T22:56:05.700071+0000","last_became_peered":"2024-02-15T22:56:05.700071+0000","last_unstale":"2024-02-15T22:57:29.883271+0000","last_undegraded":"2024-02-15T22:57:29.883271+0000","last_fullsized":"2024-02-15T22:57:29.883271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887112+0000","last_change":"2024-02-15T22:56:03.700009+0000","last_active":"2024-02-15T22:56:45.887112+0000","last_peered":"2024-02-15T22:56:45.887112+0000","last_clean":"2024-02-15T22:56:45.887112+0000","last_became_active":"2024-02-15T22:56:03.699574+0000","last_became_peered":"2024-02-15T22:56:03.699574+0000","last_unstale":"2024-02-15T22:56:45.887112+0000","last_undegraded":"2024-02-15T22:56:45.887112+0000","last_fullsized":"2024-02-15T22:56:45.887112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391273+0000","last_change":"2024-02-15T22:56:05.702837+0000","last_active":"2024-02-15T22:57:35.391273+0000","last_peered":"2024-02-15T22:57:35.391273+0000","last_clean":"2024-02-15T22:57:35.391273+0000","last_became_active":"2024-02-15T22:56:05.702488+0000","last_became_peered":"2024-02-15T22:56:05.702488+0000","last_unstale":"2024-02-15T22:57:35.391273+0000","last_undegraded":"2024-02-15T22:57:35.391273+0000","last_fullsized":"2024-02-15T22:57:35.391273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:38.755197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886045+0000","last_change":"2024-02-15T22:56:45.886045+0000","last_active":"2024-02-15T22:56:45.886045+0000","last_peered":"2024-02-15T22:56:45.886045+0000","last_clean":"2024-02-15T22:56:45.886045+0000","last_became_active":"2024-02-15T22:56:45.885555+0000","last_became_peered":"2024-02-15T22:56:45.885555+0000","last_unstale":"2024-02-15T22:56:45.886045+0000","last_undegraded":"2024-02-15T22:56:45.886045+0000","last_fullsized":"2024-02-15T22:56:45.886045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:17.695860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214283+0000","last_change":"2024-02-15T22:56:05.706693+0000","last_active":"2024-02-15T22:57:29.214283+0000","last_peered":"2024-02-15T22:57:29.214283+0000","last_clean":"2024-02-15T22:57:29.214283+0000","last_became_active":"2024-02-15T22:56:05.705386+0000","last_became_peered":"2024-02-15T22:56:05.705386+0000","last_unstale":"2024-02-15T22:57:29.214283+0000","last_undegraded":"2024-02-15T22:57:29.214283+0000","last_fullsized":"2024-02-15T22:57:29.214283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879821+0000","last_change":"2024-02-15T22:56:03.693697+0000","last_active":"2024-02-15T22:56:45.879821+0000","last_peered":"2024-02-15T22:56:45.879821+0000","last_clean":"2024-02-15T22:56:45.879821+0000","last_became_active":"2024-02-15T22:56:03.693329+0000","last_became_peered":"2024-02-15T22:56:03.693329+0000","last_unstale":"2024-02-15T22:56:45.879821+0000","last_undegraded":"2024-02-15T22:56:45.879821+0000","last_fullsized":"2024-02-15T22:56:45.879821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214299+0000","last_change":"2024-02-15T22:56:05.705032+0000","last_active":"2024-02-15T22:57:29.214299+0000","last_peered":"2024-02-15T22:57:29.214299+0000","last_clean":"2024-02-15T22:57:29.214299+0000","last_became_active":"2024-02-15T22:56:05.704729+0000","last_became_peered":"2024-02-15T22:56:05.704729+0000","last_unstale":"2024-02-15T22:57:29.214299+0000","last_undegraded":"2024-02-15T22:57:29.214299+0000","last_fullsized":"2024-02-15T22:57:29.214299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:13.582581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880416+0000","last_change":"2024-02-15T22:56:03.704183+0000","last_active":"2024-02-15T22:56:45.880416+0000","last_peered":"2024-02-15T22:56:45.880416+0000","last_clean":"2024-02-15T22:56:45.880416+0000","last_became_active":"2024-02-15T22:56:03.703885+0000","last_became_peered":"2024-02-15T22:56:03.703885+0000","last_unstale":"2024-02-15T22:56:45.880416+0000","last_undegraded":"2024-02-15T22:56:45.880416+0000","last_fullsized":"2024-02-15T22:56:45.880416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214309+0000","last_change":"2024-02-15T22:56:05.698851+0000","last_active":"2024-02-15T22:57:29.214309+0000","last_peered":"2024-02-15T22:57:29.214309+0000","last_clean":"2024-02-15T22:57:29.214309+0000","last_became_active":"2024-02-15T22:56:05.698553+0000","last_became_peered":"2024-02-15T22:56:05.698553+0000","last_unstale":"2024-02-15T22:57:29.214309+0000","last_undegraded":"2024-02-15T22:57:29.214309+0000","last_fullsized":"2024-02-15T22:57:29.214309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:59.069745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883379+0000","last_change":"2024-02-15T22:56:03.702268+0000","last_active":"2024-02-15T22:56:45.883379+0000","last_peered":"2024-02-15T22:56:45.883379+0000","last_clean":"2024-02-15T22:56:45.883379+0000","last_became_active":"2024-02-15T22:56:03.701819+0000","last_became_peered":"2024-02-15T22:56:03.701819+0000","last_unstale":"2024-02-15T22:56:45.883379+0000","last_undegraded":"2024-02-15T22:56:45.883379+0000","last_fullsized":"2024-02-15T22:56:45.883379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:24:36.815216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.380518+0000","last_change":"2024-02-15T22:56:13.731342+0000","last_active":"2024-02-15T22:57:35.380518+0000","last_peered":"2024-02-15T22:57:35.380518+0000","last_clean":"2024-02-15T22:57:35.380518+0000","last_became_active":"2024-02-15T22:56:13.730499+0000","last_became_peered":"2024-02-15T22:56:13.730499+0000","last_unstale":"2024-02-15T22:57:35.380518+0000","last_undegraded":"2024-02-15T22:57:35.380518+0000","last_fullsized":"2024-02-15T22:57:35.380518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:14:37.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.877218+0000","last_change":"2024-02-15T22:56:05.700054+0000","last_active":"2024-02-15T22:56:46.877218+0000","last_peered":"2024-02-15T22:56:46.877218+0000","last_clean":"2024-02-15T22:56:46.877218+0000","last_became_active":"2024-02-15T22:56:05.699821+0000","last_became_peered":"2024-02-15T22:56:05.699821+0000","last_unstale":"2024-02-15T22:56:46.877218+0000","last_undegraded":"2024-02-15T22:56:46.877218+0000","last_fullsized":"2024-02-15T22:56:46.877218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:38.452610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880655+0000","last_change":"2024-02-15T22:56:03.706199+0000","last_active":"2024-02-15T22:56:45.880655+0000","last_peered":"2024-02-15T22:56:45.880655+0000","last_clean":"2024-02-15T22:56:45.880655+0000","last_became_active":"2024-02-15T22:56:03.705881+0000","last_became_peered":"2024-02-15T22:56:03.705881+0000","last_unstale":"2024-02-15T22:56:45.880655+0000","last_undegraded":"2024-02-15T22:56:45.880655+0000","last_fullsized":"2024-02-15T22:56:45.880655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:08:53.948179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.893437+0000","last_change":"2024-02-15T22:56:45.893437+0000","last_active":"2024-02-15T22:56:45.893437+0000","last_peered":"2024-02-15T22:56:45.893437+0000","last_clean":"2024-02-15T22:56:45.893437+0000","last_became_active":"2024-02-15T22:56:45.893067+0000","last_became_peered":"2024-02-15T22:56:45.893067+0000","last_unstale":"2024-02-15T22:56:45.893437+0000","last_undegraded":"2024-02-15T22:56:45.893437+0000","last_fullsized":"2024-02-15T22:56:45.893437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:56:05.709507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.857479+0000","last_change":"2024-02-15T22:56:09.715523+0000","last_active":"2024-02-15T22:57:29.857479+0000","last_peered":"2024-02-15T22:57:29.857479+0000","last_clean":"2024-02-15T22:57:29.857479+0000","last_became_active":"2024-02-15T22:56:09.714201+0000","last_became_peered":"2024-02-15T22:56:09.714201+0000","last_unstale":"2024-02-15T22:57:29.857479+0000","last_undegraded":"2024-02-15T22:57:29.857479+0000","last_fullsized":"2024-02-15T22:57:29.857479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:23.715629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879512+0000","last_change":"2024-02-15T22:56:11.722548+0000","last_active":"2024-02-15T22:56:45.879512+0000","last_peered":"2024-02-15T22:56:45.879512+0000","last_clean":"2024-02-15T22:56:45.879512+0000","last_became_active":"2024-02-15T22:56:11.722257+0000","last_became_peered":"2024-02-15T22:56:11.722257+0000","last_unstale":"2024-02-15T22:56:45.879512+0000","last_undegraded":"2024-02-15T22:56:45.879512+0000","last_fullsized":"2024-02-15T22:56:45.879512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:57.504579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:24.174259+0000","last_change":"2024-02-15T22:56:13.729349+0000","last_active":"2024-02-15T22:57:24.174259+0000","last_peered":"2024-02-15T22:57:24.174259+0000","last_clean":"2024-02-15T22:57:24.174259+0000","last_became_active":"2024-02-15T22:56:13.729067+0000","last_became_peered":"2024-02-15T22:56:13.729067+0000","last_unstale":"2024-02-15T22:57:24.174259+0000","last_undegraded":"2024-02-15T22:57:24.174259+0000","last_fullsized":"2024-02-15T22:57:24.174259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:09.223558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427054+0000","last_change":"2024-02-15T22:56:05.709930+0000","last_active":"2024-02-15T22:56:47.427054+0000","last_peered":"2024-02-15T22:56:47.427054+0000","last_clean":"2024-02-15T22:56:47.427054+0000","last_became_active":"2024-02-15T22:56:05.709632+0000","last_became_peered":"2024-02-15T22:56:05.709632+0000","last_unstale":"2024-02-15T22:56:47.427054+0000","last_undegraded":"2024-02-15T22:56:47.427054+0000","last_fullsized":"2024-02-15T22:56:47.427054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:36.590473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882363+0000","last_change":"2024-02-15T22:56:03.699568+0000","last_active":"2024-02-15T22:56:45.882363+0000","last_peered":"2024-02-15T22:56:45.882363+0000","last_clean":"2024-02-15T22:56:45.882363+0000","last_became_active":"2024-02-15T22:56:03.699250+0000","last_became_peered":"2024-02-15T22:56:03.699250+0000","last_unstale":"2024-02-15T22:56:45.882363+0000","last_undegraded":"2024-02-15T22:56:45.882363+0000","last_fullsized":"2024-02-15T22:56:45.882363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880140+0000","last_change":"2024-02-15T22:56:07.706255+0000","last_active":"2024-02-15T22:56:45.880140+0000","last_peered":"2024-02-15T22:56:45.880140+0000","last_clean":"2024-02-15T22:56:45.880140+0000","last_became_active":"2024-02-15T22:56:07.705828+0000","last_became_peered":"2024-02-15T22:56:07.705828+0000","last_unstale":"2024-02-15T22:56:45.880140+0000","last_undegraded":"2024-02-15T22:56:45.880140+0000","last_fullsized":"2024-02-15T22:56:45.880140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:08.004261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883166+0000","last_change":"2024-02-15T22:56:09.713098+0000","last_active":"2024-02-15T22:56:45.883166+0000","last_peered":"2024-02-15T22:56:45.883166+0000","last_clean":"2024-02-15T22:56:45.883166+0000","last_became_active":"2024-02-15T22:56:09.712812+0000","last_became_peered":"2024-02-15T22:56:09.712812+0000","last_unstale":"2024-02-15T22:56:45.883166+0000","last_undegraded":"2024-02-15T22:56:45.883166+0000","last_fullsized":"2024-02-15T22:56:45.883166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:02:23.375846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879318+0000","last_change":"2024-02-15T22:56:11.721942+0000","last_active":"2024-02-15T22:56:45.879318+0000","last_peered":"2024-02-15T22:56:45.879318+0000","last_clean":"2024-02-15T22:56:45.879318+0000","last_became_active":"2024-02-15T22:56:11.721486+0000","last_became_peered":"2024-02-15T22:56:11.721486+0000","last_unstale":"2024-02-15T22:56:45.879318+0000","last_undegraded":"2024-02-15T22:56:45.879318+0000","last_fullsized":"2024-02-15T22:56:45.879318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:14.822800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879113+0000","last_change":"2024-02-15T22:56:13.734756+0000","last_active":"2024-02-15T22:56:45.879113+0000","last_peered":"2024-02-15T22:56:45.879113+0000","last_clean":"2024-02-15T22:56:45.879113+0000","last_became_active":"2024-02-15T22:56:13.734418+0000","last_became_peered":"2024-02-15T22:56:13.734418+0000","last_unstale":"2024-02-15T22:56:45.879113+0000","last_undegraded":"2024-02-15T22:56:45.879113+0000","last_fullsized":"2024-02-15T22:56:45.879113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:52.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391181+0000","last_change":"2024-02-15T22:56:05.700314+0000","last_active":"2024-02-15T22:57:35.391181+0000","last_peered":"2024-02-15T22:57:35.391181+0000","last_clean":"2024-02-15T22:57:35.391181+0000","last_became_active":"2024-02-15T22:56:05.699398+0000","last_became_peered":"2024-02-15T22:56:05.699398+0000","last_unstale":"2024-02-15T22:57:35.391181+0000","last_undegraded":"2024-02-15T22:57:35.391181+0000","last_fullsized":"2024-02-15T22:57:35.391181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:02.515595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881993+0000","last_change":"2024-02-15T22:56:03.707100+0000","last_active":"2024-02-15T22:56:45.881993+0000","last_peered":"2024-02-15T22:56:45.881993+0000","last_clean":"2024-02-15T22:56:45.881993+0000","last_became_active":"2024-02-15T22:56:03.706818+0000","last_became_peered":"2024-02-15T22:56:03.706818+0000","last_unstale":"2024-02-15T22:56:45.881993+0000","last_undegraded":"2024-02-15T22:56:45.881993+0000","last_fullsized":"2024-02-15T22:56:45.881993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:48.000599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882317+0000","last_change":"2024-02-15T22:56:07.704992+0000","last_active":"2024-02-15T22:56:45.882317+0000","last_peered":"2024-02-15T22:56:45.882317+0000","last_clean":"2024-02-15T22:56:45.882317+0000","last_became_active":"2024-02-15T22:56:07.704168+0000","last_became_peered":"2024-02-15T22:56:07.704168+0000","last_unstale":"2024-02-15T22:56:45.882317+0000","last_undegraded":"2024-02-15T22:56:45.882317+0000","last_fullsized":"2024-02-15T22:56:45.882317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:37.486705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885836+0000","last_change":"2024-02-15T22:56:09.718644+0000","last_active":"2024-02-15T22:56:45.885836+0000","last_peered":"2024-02-15T22:56:45.885836+0000","last_clean":"2024-02-15T22:56:45.885836+0000","last_became_active":"2024-02-15T22:56:09.718326+0000","last_became_peered":"2024-02-15T22:56:09.718326+0000","last_unstale":"2024-02-15T22:56:45.885836+0000","last_undegraded":"2024-02-15T22:56:45.885836+0000","last_fullsized":"2024-02-15T22:56:45.885836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:39.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'240","reported_seq":301,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.531415+0000","last_change":"2024-02-15T22:56:11.726498+0000","last_active":"2024-02-15T22:57:35.531415+0000","last_peered":"2024-02-15T22:57:35.531415+0000","last_clean":"2024-02-15T22:57:35.531415+0000","last_became_active":"2024-02-15T22:56:11.724138+0000","last_became_peered":"2024-02-15T22:56:11.724138+0000","last_unstale":"2024-02-15T22:57:35.531415+0000","last_undegraded":"2024-02-15T22:57:35.531415+0000","last_fullsized":"2024-02-15T22:57:35.531415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:55.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882299+0000","last_change":"2024-02-15T22:56:13.733123+0000","last_active":"2024-02-15T22:56:45.882299+0000","last_peered":"2024-02-15T22:56:45.882299+0000","last_clean":"2024-02-15T22:56:45.882299+0000","last_became_active":"2024-02-15T22:56:13.732762+0000","last_became_peered":"2024-02-15T22:56:13.732762+0000","last_unstale":"2024-02-15T22:56:45.882299+0000","last_undegraded":"2024-02-15T22:56:45.882299+0000","last_fullsized":"2024-02-15T22:56:45.882299+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:33.418832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215492+0000","last_change":"2024-02-15T22:56:05.705807+0000","last_active":"2024-02-15T22:56:47.215492+0000","last_peered":"2024-02-15T22:56:47.215492+0000","last_clean":"2024-02-15T22:56:47.215492+0000","last_became_active":"2024-02-15T22:56:05.705360+0000","last_became_peered":"2024-02-15T22:56:05.705360+0000","last_unstale":"2024-02-15T22:56:47.215492+0000","last_undegraded":"2024-02-15T22:56:47.215492+0000","last_fullsized":"2024-02-15T22:56:47.215492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:43.641211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.877537+0000","last_change":"2024-02-15T22:56:03.698653+0000","last_active":"2024-02-15T22:56:45.877537+0000","last_peered":"2024-02-15T22:56:45.877537+0000","last_clean":"2024-02-15T22:56:45.877537+0000","last_became_active":"2024-02-15T22:56:03.698225+0000","last_became_peered":"2024-02-15T22:56:03.698225+0000","last_unstale":"2024-02-15T22:56:45.877537+0000","last_undegraded":"2024-02-15T22:56:45.877537+0000","last_fullsized":"2024-02-15T22:56:45.877537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:08.872314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883033+0000","last_change":"2024-02-15T22:56:07.709503+0000","last_active":"2024-02-15T22:56:45.883033+0000","last_peered":"2024-02-15T22:56:45.883033+0000","last_clean":"2024-02-15T22:56:45.883033+0000","last_became_active":"2024-02-15T22:56:07.709236+0000","last_became_peered":"2024-02-15T22:56:07.709236+0000","last_unstale":"2024-02-15T22:56:45.883033+0000","last_undegraded":"2024-02-15T22:56:45.883033+0000","last_fullsized":"2024-02-15T22:56:45.883033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:01.415728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.852327+0000","last_change":"2024-02-15T22:56:09.729856+0000","last_active":"2024-02-15T22:57:29.852327+0000","last_peered":"2024-02-15T22:57:29.852327+0000","last_clean":"2024-02-15T22:57:29.852327+0000","last_became_active":"2024-02-15T22:56:09.729556+0000","last_became_peered":"2024-02-15T22:56:09.729556+0000","last_unstale":"2024-02-15T22:57:29.852327+0000","last_undegraded":"2024-02-15T22:57:29.852327+0000","last_fullsized":"2024-02-15T22:57:29.852327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:22.850275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'240","reported_seq":329,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.535608+0000","last_change":"2024-02-15T22:56:11.719971+0000","last_active":"2024-02-15T22:57:35.535608+0000","last_peered":"2024-02-15T22:57:35.535608+0000","last_clean":"2024-02-15T22:57:35.535608+0000","last_became_active":"2024-02-15T22:56:11.719588+0000","last_became_peered":"2024-02-15T22:56:11.719588+0000","last_unstale":"2024-02-15T22:57:35.535608+0000","last_undegraded":"2024-02-15T22:57:35.535608+0000","last_fullsized":"2024-02-15T22:57:35.535608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:49.146038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881166+0000","last_change":"2024-02-15T22:56:05.711111+0000","last_active":"2024-02-15T22:56:45.881166+0000","last_peered":"2024-02-15T22:56:45.881166+0000","last_clean":"2024-02-15T22:56:45.881166+0000","last_became_active":"2024-02-15T22:56:05.710578+0000","last_became_peered":"2024-02-15T22:56:05.710578+0000","last_unstale":"2024-02-15T22:56:45.881166+0000","last_undegraded":"2024-02-15T22:56:45.881166+0000","last_fullsized":"2024-02-15T22:56:45.881166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:33.216881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887207+0000","last_change":"2024-02-15T22:56:03.702464+0000","last_active":"2024-02-15T22:56:45.887207+0000","last_peered":"2024-02-15T22:56:45.887207+0000","last_clean":"2024-02-15T22:56:45.887207+0000","last_became_active":"2024-02-15T22:56:03.702187+0000","last_became_peered":"2024-02-15T22:56:03.702187+0000","last_unstale":"2024-02-15T22:56:45.887207+0000","last_undegraded":"2024-02-15T22:56:45.887207+0000","last_fullsized":"2024-02-15T22:56:45.887207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878050+0000","last_change":"2024-02-15T22:56:07.707641+0000","last_active":"2024-02-15T22:56:45.878050+0000","last_peered":"2024-02-15T22:56:45.878050+0000","last_clean":"2024-02-15T22:56:45.878050+0000","last_became_active":"2024-02-15T22:56:07.707328+0000","last_became_peered":"2024-02-15T22:56:07.707328+0000","last_unstale":"2024-02-15T22:56:45.878050+0000","last_undegraded":"2024-02-15T22:56:45.878050+0000","last_fullsized":"2024-02-15T22:56:45.878050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:20.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.861400+0000","last_change":"2024-02-15T22:56:09.715469+0000","last_active":"2024-02-15T22:57:29.861400+0000","last_peered":"2024-02-15T22:57:29.861400+0000","last_clean":"2024-02-15T22:57:29.861400+0000","last_became_active":"2024-02-15T22:56:09.715019+0000","last_became_peered":"2024-02-15T22:56:09.715019+0000","last_unstale":"2024-02-15T22:57:29.861400+0000","last_undegraded":"2024-02-15T22:57:29.861400+0000","last_fullsized":"2024-02-15T22:57:29.861400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:48.218723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879445+0000","last_change":"2024-02-15T22:56:11.720307+0000","last_active":"2024-02-15T22:56:45.879445+0000","last_peered":"2024-02-15T22:56:45.879445+0000","last_clean":"2024-02-15T22:56:45.879445+0000","last_became_active":"2024-02-15T22:56:11.719845+0000","last_became_peered":"2024-02-15T22:56:11.719845+0000","last_unstale":"2024-02-15T22:56:45.879445+0000","last_undegraded":"2024-02-15T22:56:45.879445+0000","last_fullsized":"2024-02-15T22:56:45.879445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:18:58.882768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.675724+0000","last_change":"2024-02-15T22:56:13.732667+0000","last_active":"2024-02-15T22:57:29.675724+0000","last_peered":"2024-02-15T22:57:29.675724+0000","last_clean":"2024-02-15T22:57:29.675724+0000","last_became_active":"2024-02-15T22:56:13.732321+0000","last_became_peered":"2024-02-15T22:56:13.732321+0000","last_unstale":"2024-02-15T22:57:29.675724+0000","last_undegraded":"2024-02-15T22:57:29.675724+0000","last_fullsized":"2024-02-15T22:57:29.675724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:10.109926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427434+0000","last_change":"2024-02-15T22:56:05.698607+0000","last_active":"2024-02-15T22:56:47.427434+0000","last_peered":"2024-02-15T22:56:47.427434+0000","last_clean":"2024-02-15T22:56:47.427434+0000","last_became_active":"2024-02-15T22:56:05.697834+0000","last_became_peered":"2024-02-15T22:56:05.697834+0000","last_unstale":"2024-02-15T22:56:47.427434+0000","last_undegraded":"2024-02-15T22:56:47.427434+0000","last_fullsized":"2024-02-15T22:56:47.427434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:13:53.631177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887539+0000","last_change":"2024-02-15T22:56:03.702616+0000","last_active":"2024-02-15T22:56:45.887539+0000","last_peered":"2024-02-15T22:56:45.887539+0000","last_clean":"2024-02-15T22:56:45.887539+0000","last_became_active":"2024-02-15T22:56:03.702353+0000","last_became_peered":"2024-02-15T22:56:03.702353+0000","last_unstale":"2024-02-15T22:56:45.887539+0000","last_undegraded":"2024-02-15T22:56:45.887539+0000","last_fullsized":"2024-02-15T22:56:45.887539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:27.186561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879943+0000","last_change":"2024-02-15T22:56:07.707046+0000","last_active":"2024-02-15T22:56:45.879943+0000","last_peered":"2024-02-15T22:56:45.879943+0000","last_clean":"2024-02-15T22:56:45.879943+0000","last_became_active":"2024-02-15T22:56:07.706656+0000","last_became_peered":"2024-02-15T22:56:07.706656+0000","last_unstale":"2024-02-15T22:56:45.879943+0000","last_undegraded":"2024-02-15T22:56:45.879943+0000","last_fullsized":"2024-02-15T22:56:45.879943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:21:30.878763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.842589+0000","last_change":"2024-02-15T22:56:09.717310+0000","last_active":"2024-02-15T22:57:29.842589+0000","last_peered":"2024-02-15T22:57:29.842589+0000","last_clean":"2024-02-15T22:57:29.842589+0000","last_became_active":"2024-02-15T22:56:09.716138+0000","last_became_peered":"2024-02-15T22:56:09.716138+0000","last_unstale":"2024-02-15T22:57:29.842589+0000","last_undegraded":"2024-02-15T22:57:29.842589+0000","last_fullsized":"2024-02-15T22:57:29.842589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:05:17.903871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879203+0000","last_change":"2024-02-15T22:56:11.724665+0000","last_active":"2024-02-15T22:56:45.879203+0000","last_peered":"2024-02-15T22:56:45.879203+0000","last_clean":"2024-02-15T22:56:45.879203+0000","last_became_active":"2024-02-15T22:56:11.724317+0000","last_became_peered":"2024-02-15T22:56:11.724317+0000","last_unstale":"2024-02-15T22:56:45.879203+0000","last_undegraded":"2024-02-15T22:56:45.879203+0000","last_fullsized":"2024-02-15T22:56:45.879203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:06:03.302828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.874077+0000","last_change":"2024-02-15T22:56:13.733414+0000","last_active":"2024-02-15T22:57:29.874077+0000","last_peered":"2024-02-15T22:57:29.874077+0000","last_clean":"2024-02-15T22:57:29.874077+0000","last_became_active":"2024-02-15T22:56:13.733118+0000","last_became_peered":"2024-02-15T22:56:13.733118+0000","last_unstale":"2024-02-15T22:57:29.874077+0000","last_undegraded":"2024-02-15T22:57:29.874077+0000","last_fullsized":"2024-02-15T22:57:29.874077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:38.491982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'20","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427488+0000","last_change":"2024-02-15T22:56:45.891684+0000","last_active":"2024-02-15T22:56:47.427488+0000","last_peered":"2024-02-15T22:56:47.427488+0000","last_clean":"2024-02-15T22:56:47.427488+0000","last_became_active":"2024-02-15T22:56:45.886248+0000","last_became_peered":"2024-02-15T22:56:45.886248+0000","last_unstale":"2024-02-15T22:56:47.427488+0000","last_undegraded":"2024-02-15T22:56:47.427488+0000","last_fullsized":"2024-02-15T22:56:47.427488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:01.197599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883087+0000","last_change":"2024-02-15T22:56:03.700436+0000","last_active":"2024-02-15T22:56:45.883087+0000","last_peered":"2024-02-15T22:56:45.883087+0000","last_clean":"2024-02-15T22:56:45.883087+0000","last_became_active":"2024-02-15T22:56:03.700087+0000","last_became_peered":"2024-02-15T22:56:03.700087+0000","last_unstale":"2024-02-15T22:56:45.883087+0000","last_undegraded":"2024-02-15T22:56:45.883087+0000","last_fullsized":"2024-02-15T22:56:45.883087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:00.883899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881488+0000","last_change":"2024-02-15T22:56:07.705816+0000","last_active":"2024-02-15T22:56:45.881488+0000","last_peered":"2024-02-15T22:56:45.881488+0000","last_clean":"2024-02-15T22:56:45.881488+0000","last_became_active":"2024-02-15T22:56:07.704502+0000","last_became_peered":"2024-02-15T22:56:07.704502+0000","last_unstale":"2024-02-15T22:56:45.881488+0000","last_undegraded":"2024-02-15T22:56:45.881488+0000","last_fullsized":"2024-02-15T22:56:45.881488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:50.097695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.863329+0000","last_change":"2024-02-15T22:56:09.719447+0000","last_active":"2024-02-15T22:57:29.863329+0000","last_peered":"2024-02-15T22:57:29.863329+0000","last_clean":"2024-02-15T22:57:29.863329+0000","last_became_active":"2024-02-15T22:56:09.717174+0000","last_became_peered":"2024-02-15T22:56:09.717174+0000","last_unstale":"2024-02-15T22:57:29.863329+0000","last_undegraded":"2024-02-15T22:57:29.863329+0000","last_fullsized":"2024-02-15T22:57:29.863329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:00:15.334493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'240","reported_seq":300,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.536541+0000","last_change":"2024-02-15T22:56:11.724657+0000","last_active":"2024-02-15T22:57:35.536541+0000","last_peered":"2024-02-15T22:57:35.536541+0000","last_clean":"2024-02-15T22:57:35.536541+0000","last_became_active":"2024-02-15T22:56:11.724273+0000","last_became_peered":"2024-02-15T22:56:11.724273+0000","last_unstale":"2024-02-15T22:57:35.536541+0000","last_undegraded":"2024-02-15T22:57:35.536541+0000","last_fullsized":"2024-02-15T22:57:35.536541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:26.704898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880623+0000","last_change":"2024-02-15T22:56:13.727119+0000","last_active":"2024-02-15T22:56:45.880623+0000","last_peered":"2024-02-15T22:56:45.880623+0000","last_clean":"2024-02-15T22:56:45.880623+0000","last_became_active":"2024-02-15T22:56:13.726858+0000","last_became_peered":"2024-02-15T22:56:13.726858+0000","last_unstale":"2024-02-15T22:56:45.880623+0000","last_undegraded":"2024-02-15T22:56:45.880623+0000","last_fullsized":"2024-02-15T22:56:45.880623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:04:07.015848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391133+0000","last_change":"2024-02-15T22:56:05.702296+0000","last_active":"2024-02-15T22:57:35.391133+0000","last_peered":"2024-02-15T22:57:35.391133+0000","last_clean":"2024-02-15T22:57:35.391133+0000","last_became_active":"2024-02-15T22:56:05.701568+0000","last_became_peered":"2024-02-15T22:56:05.701568+0000","last_unstale":"2024-02-15T22:57:35.391133+0000","last_undegraded":"2024-02-15T22:57:35.391133+0000","last_fullsized":"2024-02-15T22:57:35.391133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882522+0000","last_change":"2024-02-15T22:56:03.695726+0000","last_active":"2024-02-15T22:56:45.882522+0000","last_peered":"2024-02-15T22:56:45.882522+0000","last_clean":"2024-02-15T22:56:45.882522+0000","last_became_active":"2024-02-15T22:56:03.694668+0000","last_became_peered":"2024-02-15T22:56:03.694668+0000","last_unstale":"2024-02-15T22:56:45.882522+0000","last_undegraded":"2024-02-15T22:56:45.882522+0000","last_fullsized":"2024-02-15T22:56:45.882522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:14:39.799194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879866+0000","last_change":"2024-02-15T22:56:07.705196+0000","last_active":"2024-02-15T22:56:45.879866+0000","last_peered":"2024-02-15T22:56:45.879866+0000","last_clean":"2024-02-15T22:56:45.879866+0000","last_became_active":"2024-02-15T22:56:07.704054+0000","last_became_peered":"2024-02-15T22:56:07.704054+0000","last_unstale":"2024-02-15T22:56:45.879866+0000","last_undegraded":"2024-02-15T22:56:45.879866+0000","last_fullsized":"2024-02-15T22:56:45.879866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:27:50.211880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.351610+0000","last_change":"2024-02-15T22:56:09.719365+0000","last_active":"2024-02-15T22:57:35.351610+0000","last_peered":"2024-02-15T22:57:35.351610+0000","last_clean":"2024-02-15T22:57:35.351610+0000","last_became_active":"2024-02-15T22:56:09.717264+0000","last_became_peered":"2024-02-15T22:56:09.717264+0000","last_unstale":"2024-02-15T22:57:35.351610+0000","last_undegraded":"2024-02-15T22:57:35.351610+0000","last_fullsized":"2024-02-15T22:57:35.351610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:35:46.384248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879496+0000","last_change":"2024-02-15T22:56:11.720901+0000","last_active":"2024-02-15T22:56:45.879496+0000","last_peered":"2024-02-15T22:56:45.879496+0000","last_clean":"2024-02-15T22:56:45.879496+0000","last_became_active":"2024-02-15T22:56:11.720616+0000","last_became_peered":"2024-02-15T22:56:11.720616+0000","last_unstale":"2024-02-15T22:56:45.879496+0000","last_undegraded":"2024-02-15T22:56:45.879496+0000","last_fullsized":"2024-02-15T22:56:45.879496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:05.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.431962+0000","last_change":"2024-02-15T22:56:13.729263+0000","last_active":"2024-02-15T22:56:47.431962+0000","last_peered":"2024-02-15T22:56:47.431962+0000","last_clean":"2024-02-15T22:56:47.431962+0000","last_became_active":"2024-02-15T22:56:13.729015+0000","last_became_peered":"2024-02-15T22:56:13.729015+0000","last_unstale":"2024-02-15T22:56:47.431962+0000","last_undegraded":"2024-02-15T22:56:47.431962+0000","last_fullsized":"2024-02-15T22:56:47.431962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:14:21.943618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.882591+0000","last_change":"2024-02-15T22:56:45.898518+0000","last_active":"2024-02-15T22:56:46.882591+0000","last_peered":"2024-02-15T22:56:46.882591+0000","last_clean":"2024-02-15T22:56:46.882591+0000","last_became_active":"2024-02-15T22:56:45.893017+0000","last_became_peered":"2024-02-15T22:56:45.893017+0000","last_unstale":"2024-02-15T22:56:46.882591+0000","last_undegraded":"2024-02-15T22:56:46.882591+0000","last_fullsized":"2024-02-15T22:56:46.882591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:30.466023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886880+0000","last_change":"2024-02-15T22:56:45.886880+0000","last_active":"2024-02-15T22:56:45.886880+0000","last_peered":"2024-02-15T22:56:45.886880+0000","last_clean":"2024-02-15T22:56:45.886880+0000","last_became_active":"2024-02-15T22:56:45.886530+0000","last_became_peered":"2024-02-15T22:56:45.886530+0000","last_unstale":"2024-02-15T22:56:45.886880+0000","last_undegraded":"2024-02-15T22:56:45.886880+0000","last_fullsized":"2024-02-15T22:56:45.886880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:28.547710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885865+0000","last_change":"2024-02-15T22:56:07.707514+0000","last_active":"2024-02-15T22:56:45.885865+0000","last_peered":"2024-02-15T22:56:45.885865+0000","last_clean":"2024-02-15T22:56:45.885865+0000","last_became_active":"2024-02-15T22:56:07.707207+0000","last_became_peered":"2024-02-15T22:56:07.707207+0000","last_unstale":"2024-02-15T22:56:45.885865+0000","last_undegraded":"2024-02-15T22:56:45.885865+0000","last_fullsized":"2024-02-15T22:56:45.885865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:04:07.685154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.846704+0000","last_change":"2024-02-15T22:56:09.714917+0000","last_active":"2024-02-15T22:57:29.846704+0000","last_peered":"2024-02-15T22:57:29.846704+0000","last_clean":"2024-02-15T22:57:29.846704+0000","last_became_active":"2024-02-15T22:56:09.714592+0000","last_became_peered":"2024-02-15T22:56:09.714592+0000","last_unstale":"2024-02-15T22:57:29.846704+0000","last_undegraded":"2024-02-15T22:57:29.846704+0000","last_fullsized":"2024-02-15T22:57:29.846704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:41.601789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883307+0000","last_change":"2024-02-15T22:56:11.723908+0000","last_active":"2024-02-15T22:56:45.883307+0000","last_peered":"2024-02-15T22:56:45.883307+0000","last_clean":"2024-02-15T22:56:45.883307+0000","last_became_active":"2024-02-15T22:56:11.723557+0000","last_became_peered":"2024-02-15T22:56:11.723557+0000","last_unstale":"2024-02-15T22:56:45.883307+0000","last_undegraded":"2024-02-15T22:56:45.883307+0000","last_fullsized":"2024-02-15T22:56:45.883307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:11:50.121452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879474+0000","last_change":"2024-02-15T22:56:13.727205+0000","last_active":"2024-02-15T22:56:45.879474+0000","last_peered":"2024-02-15T22:56:45.879474+0000","last_clean":"2024-02-15T22:56:45.879474+0000","last_became_active":"2024-02-15T22:56:13.726586+0000","last_became_peered":"2024-02-15T22:56:13.726586+0000","last_unstale":"2024-02-15T22:56:45.879474+0000","last_undegraded":"2024-02-15T22:56:45.879474+0000","last_fullsized":"2024-02-15T22:56:45.879474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:34:15.904436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884445+0000","last_change":"2024-02-15T22:56:05.717008+0000","last_active":"2024-02-15T22:56:45.884445+0000","last_peered":"2024-02-15T22:56:45.884445+0000","last_clean":"2024-02-15T22:56:45.884445+0000","last_became_active":"2024-02-15T22:56:05.716590+0000","last_became_peered":"2024-02-15T22:56:05.716590+0000","last_unstale":"2024-02-15T22:56:45.884445+0000","last_undegraded":"2024-02-15T22:56:45.884445+0000","last_fullsized":"2024-02-15T22:56:45.884445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:02:19.362660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884747+0000","last_change":"2024-02-15T22:56:03.703244+0000","last_active":"2024-02-15T22:56:45.884747+0000","last_peered":"2024-02-15T22:56:45.884747+0000","last_clean":"2024-02-15T22:56:45.884747+0000","last_became_active":"2024-02-15T22:56:03.702875+0000","last_became_peered":"2024-02-15T22:56:03.702875+0000","last_unstale":"2024-02-15T22:56:45.884747+0000","last_undegraded":"2024-02-15T22:56:45.884747+0000","last_fullsized":"2024-02-15T22:56:45.884747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:09.868485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881664+0000","last_change":"2024-02-15T22:56:07.704747+0000","last_active":"2024-02-15T22:56:45.881664+0000","last_peered":"2024-02-15T22:56:45.881664+0000","last_clean":"2024-02-15T22:56:45.881664+0000","last_became_active":"2024-02-15T22:56:07.704058+0000","last_became_peered":"2024-02-15T22:56:07.704058+0000","last_unstale":"2024-02-15T22:56:45.881664+0000","last_undegraded":"2024-02-15T22:56:45.881664+0000","last_fullsized":"2024-02-15T22:56:45.881664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:47.729859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'35","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.871829+0000","last_change":"2024-02-15T22:56:09.712396+0000","last_active":"2024-02-15T22:57:29.871829+0000","last_peered":"2024-02-15T22:57:29.871829+0000","last_clean":"2024-02-15T22:57:29.871829+0000","last_became_active":"2024-02-15T22:56:09.712113+0000","last_became_peered":"2024-02-15T22:56:09.712113+0000","last_unstale":"2024-02-15T22:57:29.871829+0000","last_undegraded":"2024-02-15T22:57:29.871829+0000","last_fullsized":"2024-02-15T22:57:29.871829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:37.230068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'240","reported_seq":331,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.532382+0000","last_change":"2024-02-15T22:56:11.720788+0000","last_active":"2024-02-15T22:57:35.532382+0000","last_peered":"2024-02-15T22:57:35.532382+0000","last_clean":"2024-02-15T22:57:35.532382+0000","last_became_active":"2024-02-15T22:56:11.720390+0000","last_became_peered":"2024-02-15T22:56:11.720390+0000","last_unstale":"2024-02-15T22:57:35.532382+0000","last_undegraded":"2024-02-15T22:57:35.532382+0000","last_fullsized":"2024-02-15T22:57:35.532382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:37.820803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.895237+0000","last_change":"2024-02-15T22:56:13.734537+0000","last_active":"2024-02-15T22:57:29.895237+0000","last_peered":"2024-02-15T22:57:29.895237+0000","last_clean":"2024-02-15T22:57:29.895237+0000","last_became_active":"2024-02-15T22:56:13.734227+0000","last_became_peered":"2024-02-15T22:56:13.734227+0000","last_unstale":"2024-02-15T22:57:29.895237+0000","last_undegraded":"2024-02-15T22:57:29.895237+0000","last_fullsized":"2024-02-15T22:57:29.895237+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:14.942284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887843+0000","last_change":"2024-02-15T22:56:05.706339+0000","last_active":"2024-02-15T22:56:45.887843+0000","last_peered":"2024-02-15T22:56:45.887843+0000","last_clean":"2024-02-15T22:56:45.887843+0000","last_became_active":"2024-02-15T22:56:05.705551+0000","last_became_peered":"2024-02-15T22:56:05.705551+0000","last_unstale":"2024-02-15T22:56:45.887843+0000","last_undegraded":"2024-02-15T22:56:45.887843+0000","last_fullsized":"2024-02-15T22:56:45.887843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.420706+0000","last_change":"2024-02-15T22:56:03.704800+0000","last_active":"2024-02-15T22:56:47.420706+0000","last_peered":"2024-02-15T22:56:47.420706+0000","last_clean":"2024-02-15T22:56:47.420706+0000","last_became_active":"2024-02-15T22:56:03.704526+0000","last_became_peered":"2024-02-15T22:56:03.704526+0000","last_unstale":"2024-02-15T22:56:47.420706+0000","last_undegraded":"2024-02-15T22:56:47.420706+0000","last_fullsized":"2024-02-15T22:56:47.420706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:08:44.767171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'8","reported_seq":530,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:36.326084+0000","last_change":"2024-02-15T22:56:07.704570+0000","last_active":"2024-02-15T22:57:36.326084+0000","last_peered":"2024-02-15T22:57:36.326084+0000","last_clean":"2024-02-15T22:57:36.326084+0000","last_became_active":"2024-02-15T22:56:07.704281+0000","last_became_peered":"2024-02-15T22:56:07.704281+0000","last_unstale":"2024-02-15T22:57:36.326084+0000","last_undegraded":"2024-02-15T22:57:36.326084+0000","last_fullsized":"2024-02-15T22:57:36.326084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:48:03.804538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":588,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882855+0000","last_change":"2024-02-15T22:56:09.719243+0000","last_active":"2024-02-15T22:56:45.882855+0000","last_peered":"2024-02-15T22:56:45.882855+0000","last_clean":"2024-02-15T22:56:45.882855+0000","last_became_active":"2024-02-15T22:56:09.717735+0000","last_became_peered":"2024-02-15T22:56:09.717735+0000","last_unstale":"2024-02-15T22:56:45.882855+0000","last_undegraded":"2024-02-15T22:56:45.882855+0000","last_fullsized":"2024-02-15T22:56:45.882855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:28:54.383976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'240","reported_seq":374,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.533562+0000","last_change":"2024-02-15T22:56:11.717718+0000","last_active":"2024-02-15T22:57:35.533562+0000","last_peered":"2024-02-15T22:57:35.533562+0000","last_clean":"2024-02-15T22:57:35.533562+0000","last_became_active":"2024-02-15T22:56:11.717380+0000","last_became_peered":"2024-02-15T22:56:11.717380+0000","last_unstale":"2024-02-15T22:57:35.533562+0000","last_undegraded":"2024-02-15T22:57:35.533562+0000","last_fullsized":"2024-02-15T22:57:35.533562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:49.146038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.381482+0000","last_change":"2024-02-15T22:56:13.729765+0000","last_active":"2024-02-15T22:57:35.381482+0000","last_peered":"2024-02-15T22:57:35.381482+0000","last_clean":"2024-02-15T22:57:35.381482+0000","last_became_active":"2024-02-15T22:56:13.729467+0000","last_became_peered":"2024-02-15T22:56:13.729467+0000","last_unstale":"2024-02-15T22:57:35.381482+0000","last_undegraded":"2024-02-15T22:57:35.381482+0000","last_fullsized":"2024-02-15T22:57:35.381482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:37.969353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"30'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.901891+0000","last_change":"2024-02-15T22:56:45.901463+0000","last_active":"2024-02-15T22:56:45.901891+0000","last_peered":"2024-02-15T22:56:45.901891+0000","last_clean":"2024-02-15T22:56:45.901891+0000","last_became_active":"2024-02-15T22:56:45.892949+0000","last_became_peered":"2024-02-15T22:56:45.892949+0000","last_unstale":"2024-02-15T22:56:45.901891+0000","last_undegraded":"2024-02-15T22:56:45.901891+0000","last_fullsized":"2024-02-15T22:56:45.901891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:07:27.041414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879850+0000","last_change":"2024-02-15T22:56:03.702334+0000","last_active":"2024-02-15T22:56:45.879850+0000","last_peered":"2024-02-15T22:56:45.879850+0000","last_clean":"2024-02-15T22:56:45.879850+0000","last_became_active":"2024-02-15T22:56:03.702035+0000","last_became_peered":"2024-02-15T22:56:03.702035+0000","last_unstale":"2024-02-15T22:56:45.879850+0000","last_undegraded":"2024-02-15T22:56:45.879850+0000","last_fullsized":"2024-02-15T22:56:45.879850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:00.410598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883534+0000","last_change":"2024-02-15T22:56:07.706890+0000","last_active":"2024-02-15T22:56:45.883534+0000","last_peered":"2024-02-15T22:56:45.883534+0000","last_clean":"2024-02-15T22:56:45.883534+0000","last_became_active":"2024-02-15T22:56:07.706615+0000","last_became_peered":"2024-02-15T22:56:07.706615+0000","last_unstale":"2024-02-15T22:56:45.883534+0000","last_undegraded":"2024-02-15T22:56:45.883534+0000","last_fullsized":"2024-02-15T22:56:45.883534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:00.323059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.858464+0000","last_change":"2024-02-15T22:56:09.714286+0000","last_active":"2024-02-15T22:57:29.858464+0000","last_peered":"2024-02-15T22:57:29.858464+0000","last_clean":"2024-02-15T22:57:29.858464+0000","last_became_active":"2024-02-15T22:56:09.713660+0000","last_became_peered":"2024-02-15T22:56:09.713660+0000","last_unstale":"2024-02-15T22:57:29.858464+0000","last_undegraded":"2024-02-15T22:57:29.858464+0000","last_fullsized":"2024-02-15T22:57:29.858464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:40.603660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885416+0000","last_change":"2024-02-15T22:56:11.724920+0000","last_active":"2024-02-15T22:56:45.885416+0000","last_peered":"2024-02-15T22:56:45.885416+0000","last_clean":"2024-02-15T22:56:45.885416+0000","last_became_active":"2024-02-15T22:56:11.724575+0000","last_became_peered":"2024-02-15T22:56:11.724575+0000","last_unstale":"2024-02-15T22:56:45.885416+0000","last_undegraded":"2024-02-15T22:56:45.885416+0000","last_fullsized":"2024-02-15T22:56:45.885416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:32.467517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878828+0000","last_change":"2024-02-15T22:56:13.722807+0000","last_active":"2024-02-15T22:56:45.878828+0000","last_peered":"2024-02-15T22:56:45.878828+0000","last_clean":"2024-02-15T22:56:45.878828+0000","last_became_active":"2024-02-15T22:56:13.722550+0000","last_became_peered":"2024-02-15T22:56:13.722550+0000","last_unstale":"2024-02-15T22:56:45.878828+0000","last_undegraded":"2024-02-15T22:56:45.878828+0000","last_fullsized":"2024-02-15T22:56:45.878828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:07:35.067373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883476+0000","last_change":"2024-02-15T22:56:05.715752+0000","last_active":"2024-02-15T22:56:45.883476+0000","last_peered":"2024-02-15T22:56:45.883476+0000","last_clean":"2024-02-15T22:56:45.883476+0000","last_became_active":"2024-02-15T22:56:05.715513+0000","last_became_peered":"2024-02-15T22:56:05.715513+0000","last_unstale":"2024-02-15T22:56:45.883476+0000","last_undegraded":"2024-02-15T22:56:45.883476+0000","last_fullsized":"2024-02-15T22:56:45.883476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:26.448260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":198,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.877414+0000","last_change":"2024-02-15T22:55:52.658778+0000","last_active":"2024-02-15T22:56:45.877414+0000","last_peered":"2024-02-15T22:56:45.877414+0000","last_clean":"2024-02-15T22:56:45.877414+0000","last_became_active":"2024-02-15T22:55:52.657750+0000","last_became_peered":"2024-02-15T22:55:52.657750+0000","last_unstale":"2024-02-15T22:56:45.877414+0000","last_undegraded":"2024-02-15T22:56:45.877414+0000","last_fullsized":"2024-02-15T22:56:45.877414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_clean_scrub_stamp":"2024-02-15T22:55:51.648340+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:26.306952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880599+0000","last_change":"2024-02-15T22:55:57.672733+0000","last_active":"2024-02-15T22:56:45.880599+0000","last_peered":"2024-02-15T22:56:45.880599+0000","last_clean":"2024-02-15T22:56:45.880599+0000","last_became_active":"2024-02-15T22:55:57.672281+0000","last_became_peered":"2024-02-15T22:55:57.672281+0000","last_unstale":"2024-02-15T22:56:45.880599+0000","last_undegraded":"2024-02-15T22:56:45.880599+0000","last_fullsized":"2024-02-15T22:56:45.880599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:16:13.571164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881021+0000","last_change":"2024-02-15T22:56:03.707343+0000","last_active":"2024-02-15T22:56:45.881021+0000","last_peered":"2024-02-15T22:56:45.881021+0000","last_clean":"2024-02-15T22:56:45.881021+0000","last_became_active":"2024-02-15T22:56:03.706721+0000","last_became_peered":"2024-02-15T22:56:03.706721+0000","last_unstale":"2024-02-15T22:56:45.881021+0000","last_undegraded":"2024-02-15T22:56:45.881021+0000","last_fullsized":"2024-02-15T22:56:45.881021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:35.787671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887614+0000","last_change":"2024-02-15T22:56:45.887614+0000","last_active":"2024-02-15T22:56:45.887614+0000","last_peered":"2024-02-15T22:56:45.887614+0000","last_clean":"2024-02-15T22:56:45.887614+0000","last_became_active":"2024-02-15T22:56:45.887260+0000","last_became_peered":"2024-02-15T22:56:45.887260+0000","last_unstale":"2024-02-15T22:56:45.887614+0000","last_undegraded":"2024-02-15T22:56:45.887614+0000","last_fullsized":"2024-02-15T22:56:45.887614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:00:13.328033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'70","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.368277+0000","last_change":"2024-02-15T22:56:09.717520+0000","last_active":"2024-02-15T22:57:35.368277+0000","last_peered":"2024-02-15T22:57:35.368277+0000","last_clean":"2024-02-15T22:57:35.368277+0000","last_became_active":"2024-02-15T22:56:09.716109+0000","last_became_peered":"2024-02-15T22:56:09.716109+0000","last_unstale":"2024-02-15T22:57:35.368277+0000","last_undegraded":"2024-02-15T22:57:35.368277+0000","last_fullsized":"2024-02-15T22:57:35.368277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:43:27.838853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881677+0000","last_change":"2024-02-15T22:56:11.722725+0000","last_active":"2024-02-15T22:56:45.881677+0000","last_peered":"2024-02-15T22:56:45.881677+0000","last_clean":"2024-02-15T22:56:45.881677+0000","last_became_active":"2024-02-15T22:56:11.722390+0000","last_became_peered":"2024-02-15T22:56:11.722390+0000","last_unstale":"2024-02-15T22:56:45.881677+0000","last_undegraded":"2024-02-15T22:56:45.881677+0000","last_fullsized":"2024-02-15T22:56:45.881677+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:01.453104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.402200+0000","last_change":"2024-02-15T22:56:13.732746+0000","last_active":"2024-02-15T22:57:35.402200+0000","last_peered":"2024-02-15T22:57:35.402200+0000","last_clean":"2024-02-15T22:57:35.402200+0000","last_became_active":"2024-02-15T22:56:13.732437+0000","last_became_peered":"2024-02-15T22:56:13.732437+0000","last_unstale":"2024-02-15T22:57:35.402200+0000","last_undegraded":"2024-02-15T22:57:35.402200+0000","last_fullsized":"2024-02-15T22:57:35.402200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:19:49.186383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883640+0000","last_change":"2024-02-15T22:56:05.700559+0000","last_active":"2024-02-15T22:56:45.883640+0000","last_peered":"2024-02-15T22:56:45.883640+0000","last_clean":"2024-02-15T22:56:45.883640+0000","last_became_active":"2024-02-15T22:56:05.699679+0000","last_became_peered":"2024-02-15T22:56:05.699679+0000","last_unstale":"2024-02-15T22:56:45.883640+0000","last_undegraded":"2024-02-15T22:56:45.883640+0000","last_fullsized":"2024-02-15T22:56:45.883640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:31.801546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879712+0000","last_change":"2024-02-15T22:55:57.673021+0000","last_active":"2024-02-15T22:56:45.879712+0000","last_peered":"2024-02-15T22:56:45.879712+0000","last_clean":"2024-02-15T22:56:45.879712+0000","last_became_active":"2024-02-15T22:55:57.672705+0000","last_became_peered":"2024-02-15T22:55:57.672705+0000","last_unstale":"2024-02-15T22:56:45.879712+0000","last_undegraded":"2024-02-15T22:56:45.879712+0000","last_fullsized":"2024-02-15T22:56:45.879712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:51.539454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879585+0000","last_change":"2024-02-15T22:56:03.700496+0000","last_active":"2024-02-15T22:56:45.879585+0000","last_peered":"2024-02-15T22:56:45.879585+0000","last_clean":"2024-02-15T22:56:45.879585+0000","last_became_active":"2024-02-15T22:56:03.699864+0000","last_became_peered":"2024-02-15T22:56:03.699864+0000","last_unstale":"2024-02-15T22:56:45.879585+0000","last_undegraded":"2024-02-15T22:56:45.879585+0000","last_fullsized":"2024-02-15T22:56:45.879585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884516+0000","last_change":"2024-02-15T22:56:07.707939+0000","last_active":"2024-02-15T22:56:45.884516+0000","last_peered":"2024-02-15T22:56:45.884516+0000","last_clean":"2024-02-15T22:56:45.884516+0000","last_became_active":"2024-02-15T22:56:07.707620+0000","last_became_peered":"2024-02-15T22:56:07.707620+0000","last_unstale":"2024-02-15T22:56:45.884516+0000","last_undegraded":"2024-02-15T22:56:45.884516+0000","last_fullsized":"2024-02-15T22:56:45.884516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:53.492048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'239","reported_seq":407,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.528301+0000","last_change":"2024-02-15T22:56:09.718681+0000","last_active":"2024-02-15T22:57:35.528301+0000","last_peered":"2024-02-15T22:57:35.528301+0000","last_clean":"2024-02-15T22:57:35.528301+0000","last_became_active":"2024-02-15T22:56:09.718396+0000","last_became_peered":"2024-02-15T22:56:09.718396+0000","last_unstale":"2024-02-15T22:57:35.528301+0000","last_undegraded":"2024-02-15T22:57:35.528301+0000","last_fullsized":"2024-02-15T22:57:35.528301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:24.765590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880720+0000","last_change":"2024-02-15T22:56:11.725286+0000","last_active":"2024-02-15T22:56:45.880720+0000","last_peered":"2024-02-15T22:56:45.880720+0000","last_clean":"2024-02-15T22:56:45.880720+0000","last_became_active":"2024-02-15T22:56:11.725005+0000","last_became_peered":"2024-02-15T22:56:11.725005+0000","last_unstale":"2024-02-15T22:56:45.880720+0000","last_undegraded":"2024-02-15T22:56:45.880720+0000","last_fullsized":"2024-02-15T22:56:45.880720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:29.599168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:24.184779+0000","last_change":"2024-02-15T22:56:13.734036+0000","last_active":"2024-02-15T22:57:24.184779+0000","last_peered":"2024-02-15T22:57:24.184779+0000","last_clean":"2024-02-15T22:57:24.184779+0000","last_became_active":"2024-02-15T22:56:13.733760+0000","last_became_peered":"2024-02-15T22:56:13.733760+0000","last_unstale":"2024-02-15T22:57:24.184779+0000","last_undegraded":"2024-02-15T22:57:24.184779+0000","last_fullsized":"2024-02-15T22:57:24.184779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:52.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881842+0000","last_change":"2024-02-15T22:56:05.706098+0000","last_active":"2024-02-15T22:56:45.881842+0000","last_peered":"2024-02-15T22:56:45.881842+0000","last_clean":"2024-02-15T22:56:45.881842+0000","last_became_active":"2024-02-15T22:56:05.704953+0000","last_became_peered":"2024-02-15T22:56:05.704953+0000","last_unstale":"2024-02-15T22:56:45.881842+0000","last_undegraded":"2024-02-15T22:56:45.881842+0000","last_fullsized":"2024-02-15T22:56:45.881842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:08.839506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881265+0000","last_change":"2024-02-15T22:55:57.671425+0000","last_active":"2024-02-15T22:56:45.881265+0000","last_peered":"2024-02-15T22:56:45.881265+0000","last_clean":"2024-02-15T22:56:45.881265+0000","last_became_active":"2024-02-15T22:55:57.671130+0000","last_became_peered":"2024-02-15T22:55:57.671130+0000","last_unstale":"2024-02-15T22:56:45.881265+0000","last_undegraded":"2024-02-15T22:56:45.881265+0000","last_fullsized":"2024-02-15T22:56:45.881265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:07:19.263513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878991+0000","last_change":"2024-02-15T22:56:03.700250+0000","last_active":"2024-02-15T22:56:45.878991+0000","last_peered":"2024-02-15T22:56:45.878991+0000","last_clean":"2024-02-15T22:56:45.878991+0000","last_became_active":"2024-02-15T22:56:03.699598+0000","last_became_peered":"2024-02-15T22:56:03.699598+0000","last_unstale":"2024-02-15T22:56:45.878991+0000","last_undegraded":"2024-02-15T22:56:45.878991+0000","last_fullsized":"2024-02-15T22:56:45.878991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887215+0000","last_change":"2024-02-15T22:56:07.704552+0000","last_active":"2024-02-15T22:56:45.887215+0000","last_peered":"2024-02-15T22:56:45.887215+0000","last_clean":"2024-02-15T22:56:45.887215+0000","last_became_active":"2024-02-15T22:56:07.704107+0000","last_became_peered":"2024-02-15T22:56:07.704107+0000","last_unstale":"2024-02-15T22:56:45.887215+0000","last_undegraded":"2024-02-15T22:56:45.887215+0000","last_fullsized":"2024-02-15T22:56:45.887215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:40.761923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.400847+0000","last_change":"2024-02-15T22:56:09.711955+0000","last_active":"2024-02-15T22:57:35.400847+0000","last_peered":"2024-02-15T22:57:35.400847+0000","last_clean":"2024-02-15T22:57:35.400847+0000","last_became_active":"2024-02-15T22:56:09.711494+0000","last_became_peered":"2024-02-15T22:56:09.711494+0000","last_unstale":"2024-02-15T22:57:35.400847+0000","last_undegraded":"2024-02-15T22:57:35.400847+0000","last_fullsized":"2024-02-15T22:57:35.400847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:59.298944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880617+0000","last_change":"2024-02-15T22:56:11.722621+0000","last_active":"2024-02-15T22:56:45.880617+0000","last_peered":"2024-02-15T22:56:45.880617+0000","last_clean":"2024-02-15T22:56:45.880617+0000","last_became_active":"2024-02-15T22:56:11.722277+0000","last_became_peered":"2024-02-15T22:56:11.722277+0000","last_unstale":"2024-02-15T22:56:45.880617+0000","last_undegraded":"2024-02-15T22:56:45.880617+0000","last_fullsized":"2024-02-15T22:56:45.880617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:26.041161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880049+0000","last_change":"2024-02-15T22:56:13.726439+0000","last_active":"2024-02-15T22:56:45.880049+0000","last_peered":"2024-02-15T22:56:45.880049+0000","last_clean":"2024-02-15T22:56:45.880049+0000","last_became_active":"2024-02-15T22:56:13.726165+0000","last_became_peered":"2024-02-15T22:56:13.726165+0000","last_unstale":"2024-02-15T22:56:45.880049+0000","last_undegraded":"2024-02-15T22:56:45.880049+0000","last_fullsized":"2024-02-15T22:56:45.880049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:04.405292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'7","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214367+0000","last_change":"2024-02-15T22:56:05.707494+0000","last_active":"2024-02-15T22:57:29.214367+0000","last_peered":"2024-02-15T22:57:29.214367+0000","last_clean":"2024-02-15T22:57:29.214367+0000","last_became_active":"2024-02-15T22:56:05.707171+0000","last_became_peered":"2024-02-15T22:56:05.707171+0000","last_unstale":"2024-02-15T22:57:29.214367+0000","last_undegraded":"2024-02-15T22:57:29.214367+0000","last_fullsized":"2024-02-15T22:57:29.214367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:27:41.335097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880918+0000","last_change":"2024-02-15T22:55:57.672717+0000","last_active":"2024-02-15T22:56:45.880918+0000","last_peered":"2024-02-15T22:56:45.880918+0000","last_clean":"2024-02-15T22:56:45.880918+0000","last_became_active":"2024-02-15T22:55:57.672268+0000","last_became_peered":"2024-02-15T22:55:57.672268+0000","last_unstale":"2024-02-15T22:56:45.880918+0000","last_undegraded":"2024-02-15T22:56:45.880918+0000","last_fullsized":"2024-02-15T22:56:45.880918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:32.276372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882540+0000","last_change":"2024-02-15T22:56:03.697249+0000","last_active":"2024-02-15T22:56:45.882540+0000","last_peered":"2024-02-15T22:56:45.882540+0000","last_clean":"2024-02-15T22:56:45.882540+0000","last_became_active":"2024-02-15T22:56:03.693487+0000","last_became_peered":"2024-02-15T22:56:03.693487+0000","last_unstale":"2024-02-15T22:56:45.882540+0000","last_undegraded":"2024-02-15T22:56:45.882540+0000","last_fullsized":"2024-02-15T22:56:45.882540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:50.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880819+0000","last_change":"2024-02-15T22:56:07.707628+0000","last_active":"2024-02-15T22:56:45.880819+0000","last_peered":"2024-02-15T22:56:45.880819+0000","last_clean":"2024-02-15T22:56:45.880819+0000","last_became_active":"2024-02-15T22:56:07.707227+0000","last_became_peered":"2024-02-15T22:56:07.707227+0000","last_unstale":"2024-02-15T22:56:45.880819+0000","last_undegraded":"2024-02-15T22:56:45.880819+0000","last_fullsized":"2024-02-15T22:56:45.880819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:41:38.827598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884038+0000","last_change":"2024-02-15T22:56:09.720954+0000","last_active":"2024-02-15T22:56:45.884038+0000","last_peered":"2024-02-15T22:56:45.884038+0000","last_clean":"2024-02-15T22:56:45.884038+0000","last_became_active":"2024-02-15T22:56:09.719999+0000","last_became_peered":"2024-02-15T22:56:09.719999+0000","last_unstale":"2024-02-15T22:56:45.884038+0000","last_undegraded":"2024-02-15T22:56:45.884038+0000","last_fullsized":"2024-02-15T22:56:45.884038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:57.194342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883698+0000","last_change":"2024-02-15T22:56:11.724029+0000","last_active":"2024-02-15T22:56:45.883698+0000","last_peered":"2024-02-15T22:56:45.883698+0000","last_clean":"2024-02-15T22:56:45.883698+0000","last_became_active":"2024-02-15T22:56:11.723718+0000","last_became_peered":"2024-02-15T22:56:11.723718+0000","last_unstale":"2024-02-15T22:56:45.883698+0000","last_undegraded":"2024-02-15T22:56:45.883698+0000","last_fullsized":"2024-02-15T22:56:45.883698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:43:01.476474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878038+0000","last_change":"2024-02-15T22:56:13.731187+0000","last_active":"2024-02-15T22:56:45.878038+0000","last_peered":"2024-02-15T22:56:45.878038+0000","last_clean":"2024-02-15T22:56:45.878038+0000","last_became_active":"2024-02-15T22:56:13.730551+0000","last_became_peered":"2024-02-15T22:56:13.730551+0000","last_unstale":"2024-02-15T22:56:45.878038+0000","last_undegraded":"2024-02-15T22:56:45.878038+0000","last_fullsized":"2024-02-15T22:56:45.878038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:00.259943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907683+0000","last_change":"2024-02-15T22:56:05.714866+0000","last_active":"2024-02-15T22:56:47.907683+0000","last_peered":"2024-02-15T22:56:47.907683+0000","last_clean":"2024-02-15T22:56:47.907683+0000","last_became_active":"2024-02-15T22:56:05.714389+0000","last_became_peered":"2024-02-15T22:56:05.714389+0000","last_unstale":"2024-02-15T22:56:47.907683+0000","last_undegraded":"2024-02-15T22:56:47.907683+0000","last_fullsized":"2024-02-15T22:56:47.907683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:02.890481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886225+0000","last_change":"2024-02-15T22:56:03.693895+0000","last_active":"2024-02-15T22:56:45.886225+0000","last_peered":"2024-02-15T22:56:45.886225+0000","last_clean":"2024-02-15T22:56:45.886225+0000","last_became_active":"2024-02-15T22:56:03.693005+0000","last_became_peered":"2024-02-15T22:56:03.693005+0000","last_unstale":"2024-02-15T22:56:45.886225+0000","last_undegraded":"2024-02-15T22:56:45.886225+0000","last_fullsized":"2024-02-15T22:56:45.886225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880275+0000","last_change":"2024-02-15T22:55:57.671879+0000","last_active":"2024-02-15T22:56:45.880275+0000","last_peered":"2024-02-15T22:56:45.880275+0000","last_clean":"2024-02-15T22:56:45.880275+0000","last_became_active":"2024-02-15T22:55:57.671524+0000","last_became_peered":"2024-02-15T22:55:57.671524+0000","last_unstale":"2024-02-15T22:56:45.880275+0000","last_undegraded":"2024-02-15T22:56:45.880275+0000","last_fullsized":"2024-02-15T22:56:45.880275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:09:17.624102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880296+0000","last_change":"2024-02-15T22:56:07.707991+0000","last_active":"2024-02-15T22:56:45.880296+0000","last_peered":"2024-02-15T22:56:45.880296+0000","last_clean":"2024-02-15T22:56:45.880296+0000","last_became_active":"2024-02-15T22:56:07.707281+0000","last_became_peered":"2024-02-15T22:56:07.707281+0000","last_unstale":"2024-02-15T22:56:45.880296+0000","last_undegraded":"2024-02-15T22:56:45.880296+0000","last_fullsized":"2024-02-15T22:56:45.880296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:33:01.136377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'56","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.360300+0000","last_change":"2024-02-15T22:56:09.717947+0000","last_active":"2024-02-15T22:57:35.360300+0000","last_peered":"2024-02-15T22:57:35.360300+0000","last_clean":"2024-02-15T22:57:35.360300+0000","last_became_active":"2024-02-15T22:56:09.717692+0000","last_became_peered":"2024-02-15T22:56:09.717692+0000","last_unstale":"2024-02-15T22:57:35.360300+0000","last_undegraded":"2024-02-15T22:57:35.360300+0000","last_fullsized":"2024-02-15T22:57:35.360300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:32.340996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881741+0000","last_change":"2024-02-15T22:56:11.718632+0000","last_active":"2024-02-15T22:56:45.881741+0000","last_peered":"2024-02-15T22:56:45.881741+0000","last_clean":"2024-02-15T22:56:45.881741+0000","last_became_active":"2024-02-15T22:56:11.718332+0000","last_became_peered":"2024-02-15T22:56:11.718332+0000","last_unstale":"2024-02-15T22:56:45.881741+0000","last_undegraded":"2024-02-15T22:56:45.881741+0000","last_fullsized":"2024-02-15T22:56:45.881741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:38.078071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.872820+0000","last_change":"2024-02-15T22:56:13.723843+0000","last_active":"2024-02-15T22:57:29.872820+0000","last_peered":"2024-02-15T22:57:29.872820+0000","last_clean":"2024-02-15T22:57:29.872820+0000","last_became_active":"2024-02-15T22:56:13.723512+0000","last_became_peered":"2024-02-15T22:56:13.723512+0000","last_unstale":"2024-02-15T22:57:29.872820+0000","last_undegraded":"2024-02-15T22:57:29.872820+0000","last_fullsized":"2024-02-15T22:57:29.872820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:05:21.916643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.906030+0000","last_change":"2024-02-15T22:56:05.713346+0000","last_active":"2024-02-15T22:56:47.906030+0000","last_peered":"2024-02-15T22:56:47.906030+0000","last_clean":"2024-02-15T22:56:47.906030+0000","last_became_active":"2024-02-15T22:56:05.713036+0000","last_became_peered":"2024-02-15T22:56:05.713036+0000","last_unstale":"2024-02-15T22:56:47.906030+0000","last_undegraded":"2024-02-15T22:56:47.906030+0000","last_fullsized":"2024-02-15T22:56:47.906030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:53.786957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880599+0000","last_change":"2024-02-15T22:56:03.699990+0000","last_active":"2024-02-15T22:56:45.880599+0000","last_peered":"2024-02-15T22:56:45.880599+0000","last_clean":"2024-02-15T22:56:45.880599+0000","last_became_active":"2024-02-15T22:56:03.699564+0000","last_became_peered":"2024-02-15T22:56:03.699564+0000","last_unstale":"2024-02-15T22:56:45.880599+0000","last_undegraded":"2024-02-15T22:56:45.880599+0000","last_fullsized":"2024-02-15T22:56:45.880599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:50.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882944+0000","last_change":"2024-02-15T22:55:57.672438+0000","last_active":"2024-02-15T22:56:45.882944+0000","last_peered":"2024-02-15T22:56:45.882944+0000","last_clean":"2024-02-15T22:56:45.882944+0000","last_became_active":"2024-02-15T22:55:57.672053+0000","last_became_peered":"2024-02-15T22:55:57.672053+0000","last_unstale":"2024-02-15T22:56:45.882944+0000","last_undegraded":"2024-02-15T22:56:45.882944+0000","last_fullsized":"2024-02-15T22:56:45.882944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:01.363343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.893645+0000","last_change":"2024-02-15T22:56:45.893645+0000","last_active":"2024-02-15T22:56:45.893645+0000","last_peered":"2024-02-15T22:56:45.893645+0000","last_clean":"2024-02-15T22:56:45.893645+0000","last_became_active":"2024-02-15T22:56:45.893109+0000","last_became_peered":"2024-02-15T22:56:45.893109+0000","last_unstale":"2024-02-15T22:56:45.893645+0000","last_undegraded":"2024-02-15T22:56:45.893645+0000","last_fullsized":"2024-02-15T22:56:45.893645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:43:22.299794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878306+0000","last_change":"2024-02-15T22:56:09.721473+0000","last_active":"2024-02-15T22:56:45.878306+0000","last_peered":"2024-02-15T22:56:45.878306+0000","last_clean":"2024-02-15T22:56:45.878306+0000","last_became_active":"2024-02-15T22:56:09.721140+0000","last_became_peered":"2024-02-15T22:56:09.721140+0000","last_unstale":"2024-02-15T22:56:45.878306+0000","last_undegraded":"2024-02-15T22:56:45.878306+0000","last_fullsized":"2024-02-15T22:56:45.878306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:35.814733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'240","reported_seq":277,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.530512+0000","last_change":"2024-02-15T22:56:11.717865+0000","last_active":"2024-02-15T22:57:35.530512+0000","last_peered":"2024-02-15T22:57:35.530512+0000","last_clean":"2024-02-15T22:57:35.530512+0000","last_became_active":"2024-02-15T22:56:11.717544+0000","last_became_peered":"2024-02-15T22:56:11.717544+0000","last_unstale":"2024-02-15T22:57:35.530512+0000","last_undegraded":"2024-02-15T22:57:35.530512+0000","last_fullsized":"2024-02-15T22:57:35.530512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:08.103224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883381+0000","last_change":"2024-02-15T22:56:13.728952+0000","last_active":"2024-02-15T22:56:45.883381+0000","last_peered":"2024-02-15T22:56:45.883381+0000","last_clean":"2024-02-15T22:56:45.883381+0000","last_became_active":"2024-02-15T22:56:13.728228+0000","last_became_peered":"2024-02-15T22:56:13.728228+0000","last_unstale":"2024-02-15T22:56:45.883381+0000","last_undegraded":"2024-02-15T22:56:45.883381+0000","last_fullsized":"2024-02-15T22:56:45.883381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:28.350108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907892+0000","last_change":"2024-02-15T22:56:05.711219+0000","last_active":"2024-02-15T22:56:47.907892+0000","last_peered":"2024-02-15T22:56:47.907892+0000","last_clean":"2024-02-15T22:56:47.907892+0000","last_became_active":"2024-02-15T22:56:05.710924+0000","last_became_peered":"2024-02-15T22:56:05.710924+0000","last_unstale":"2024-02-15T22:56:47.907892+0000","last_undegraded":"2024-02-15T22:56:47.907892+0000","last_fullsized":"2024-02-15T22:56:47.907892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:00.260239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884070+0000","last_change":"2024-02-15T22:56:03.696202+0000","last_active":"2024-02-15T22:56:45.884070+0000","last_peered":"2024-02-15T22:56:45.884070+0000","last_clean":"2024-02-15T22:56:45.884070+0000","last_became_active":"2024-02-15T22:56:03.695921+0000","last_became_peered":"2024-02-15T22:56:03.695921+0000","last_unstale":"2024-02-15T22:56:45.884070+0000","last_undegraded":"2024-02-15T22:56:45.884070+0000","last_fullsized":"2024-02-15T22:56:45.884070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:10.975589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880782+0000","last_change":"2024-02-15T22:55:57.671686+0000","last_active":"2024-02-15T22:56:45.880782+0000","last_peered":"2024-02-15T22:56:45.880782+0000","last_clean":"2024-02-15T22:56:45.880782+0000","last_became_active":"2024-02-15T22:55:57.671257+0000","last_became_peered":"2024-02-15T22:55:57.671257+0000","last_unstale":"2024-02-15T22:56:45.880782+0000","last_undegraded":"2024-02-15T22:56:45.880782+0000","last_fullsized":"2024-02-15T22:56:45.880782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:04.954542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882599+0000","last_change":"2024-02-15T22:56:07.705589+0000","last_active":"2024-02-15T22:56:45.882599+0000","last_peered":"2024-02-15T22:56:45.882599+0000","last_clean":"2024-02-15T22:56:45.882599+0000","last_became_active":"2024-02-15T22:56:07.705323+0000","last_became_peered":"2024-02-15T22:56:07.705323+0000","last_unstale":"2024-02-15T22:56:45.882599+0000","last_undegraded":"2024-02-15T22:56:45.882599+0000","last_fullsized":"2024-02-15T22:56:45.882599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:10.810269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'11","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884687+0000","last_change":"2024-02-15T22:56:09.729641+0000","last_active":"2024-02-15T22:56:45.884687+0000","last_peered":"2024-02-15T22:56:45.884687+0000","last_clean":"2024-02-15T22:56:45.884687+0000","last_became_active":"2024-02-15T22:56:09.729131+0000","last_became_peered":"2024-02-15T22:56:09.729131+0000","last_unstale":"2024-02-15T22:56:45.884687+0000","last_undegraded":"2024-02-15T22:56:45.884687+0000","last_fullsized":"2024-02-15T22:56:45.884687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:25:53.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'240","reported_seq":310,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.534634+0000","last_change":"2024-02-15T22:56:11.720224+0000","last_active":"2024-02-15T22:57:35.534634+0000","last_peered":"2024-02-15T22:57:35.534634+0000","last_clean":"2024-02-15T22:57:35.534634+0000","last_became_active":"2024-02-15T22:56:11.719685+0000","last_became_peered":"2024-02-15T22:56:11.719685+0000","last_unstale":"2024-02-15T22:57:35.534634+0000","last_undegraded":"2024-02-15T22:57:35.534634+0000","last_fullsized":"2024-02-15T22:57:35.534634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:04.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879177+0000","last_change":"2024-02-15T22:56:13.730782+0000","last_active":"2024-02-15T22:56:45.879177+0000","last_peered":"2024-02-15T22:56:45.879177+0000","last_clean":"2024-02-15T22:56:45.879177+0000","last_became_active":"2024-02-15T22:56:13.730494+0000","last_became_peered":"2024-02-15T22:56:13.730494+0000","last_unstale":"2024-02-15T22:56:45.879177+0000","last_undegraded":"2024-02-15T22:56:45.879177+0000","last_fullsized":"2024-02-15T22:56:45.879177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:06:36.344805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'5","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214087+0000","last_change":"2024-02-15T22:56:05.706030+0000","last_active":"2024-02-15T22:57:29.214087+0000","last_peered":"2024-02-15T22:57:29.214087+0000","last_clean":"2024-02-15T22:57:29.214087+0000","last_became_active":"2024-02-15T22:56:05.705764+0000","last_became_peered":"2024-02-15T22:56:05.705764+0000","last_unstale":"2024-02-15T22:57:29.214087+0000","last_undegraded":"2024-02-15T22:57:29.214087+0000","last_fullsized":"2024-02-15T22:57:29.214087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:49.756184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879958+0000","last_change":"2024-02-15T22:56:03.706073+0000","last_active":"2024-02-15T22:56:45.879958+0000","last_peered":"2024-02-15T22:56:45.879958+0000","last_clean":"2024-02-15T22:56:45.879958+0000","last_became_active":"2024-02-15T22:56:03.705783+0000","last_became_peered":"2024-02-15T22:56:03.705783+0000","last_unstale":"2024-02-15T22:56:45.879958+0000","last_undegraded":"2024-02-15T22:56:45.879958+0000","last_fullsized":"2024-02-15T22:56:45.879958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883785+0000","last_change":"2024-02-15T22:55:57.854108+0000","last_active":"2024-02-15T22:56:45.883785+0000","last_peered":"2024-02-15T22:56:45.883785+0000","last_clean":"2024-02-15T22:56:45.883785+0000","last_became_active":"2024-02-15T22:55:57.853714+0000","last_became_peered":"2024-02-15T22:55:57.853714+0000","last_unstale":"2024-02-15T22:56:45.883785+0000","last_undegraded":"2024-02-15T22:56:45.883785+0000","last_fullsized":"2024-02-15T22:56:45.883785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:25:37.860937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881722+0000","last_change":"2024-02-15T22:56:07.705348+0000","last_active":"2024-02-15T22:56:45.881722+0000","last_peered":"2024-02-15T22:56:45.881722+0000","last_clean":"2024-02-15T22:56:45.881722+0000","last_became_active":"2024-02-15T22:56:07.705013+0000","last_became_peered":"2024-02-15T22:56:07.705013+0000","last_unstale":"2024-02-15T22:56:45.881722+0000","last_undegraded":"2024-02-15T22:56:45.881722+0000","last_fullsized":"2024-02-15T22:56:45.881722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:18:54.870237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'76","reported_seq":147,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.357077+0000","last_change":"2024-02-15T22:56:09.720229+0000","last_active":"2024-02-15T22:57:35.357077+0000","last_peered":"2024-02-15T22:57:35.357077+0000","last_clean":"2024-02-15T22:57:35.357077+0000","last_became_active":"2024-02-15T22:56:09.719916+0000","last_became_peered":"2024-02-15T22:56:09.719916+0000","last_unstale":"2024-02-15T22:57:35.357077+0000","last_undegraded":"2024-02-15T22:57:35.357077+0000","last_fullsized":"2024-02-15T22:57:35.357077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:49.736320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879563+0000","last_change":"2024-02-15T22:56:11.718006+0000","last_active":"2024-02-15T22:56:45.879563+0000","last_peered":"2024-02-15T22:56:45.879563+0000","last_clean":"2024-02-15T22:56:45.879563+0000","last_became_active":"2024-02-15T22:56:11.717758+0000","last_became_peered":"2024-02-15T22:56:11.717758+0000","last_unstale":"2024-02-15T22:56:45.879563+0000","last_undegraded":"2024-02-15T22:56:45.879563+0000","last_fullsized":"2024-02-15T22:56:45.879563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:14.822800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885412+0000","last_change":"2024-02-15T22:56:13.732654+0000","last_active":"2024-02-15T22:56:45.885412+0000","last_peered":"2024-02-15T22:56:45.885412+0000","last_clean":"2024-02-15T22:56:45.885412+0000","last_became_active":"2024-02-15T22:56:13.732325+0000","last_became_peered":"2024-02-15T22:56:13.732325+0000","last_unstale":"2024-02-15T22:56:45.885412+0000","last_undegraded":"2024-02-15T22:56:45.885412+0000","last_fullsized":"2024-02-15T22:56:45.885412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:28.711600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886278+0000","last_change":"2024-02-15T22:56:13.732647+0000","last_active":"2024-02-15T22:56:45.886278+0000","last_peered":"2024-02-15T22:56:45.886278+0000","last_clean":"2024-02-15T22:56:45.886278+0000","last_became_active":"2024-02-15T22:56:13.732216+0000","last_became_peered":"2024-02-15T22:56:13.732216+0000","last_unstale":"2024-02-15T22:56:45.886278+0000","last_undegraded":"2024-02-15T22:56:45.886278+0000","last_fullsized":"2024-02-15T22:56:45.886278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:16.829502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882801+0000","last_change":"2024-02-15T22:56:05.705497+0000","last_active":"2024-02-15T22:56:45.882801+0000","last_peered":"2024-02-15T22:56:45.882801+0000","last_clean":"2024-02-15T22:56:45.882801+0000","last_became_active":"2024-02-15T22:56:05.704959+0000","last_became_peered":"2024-02-15T22:56:05.704959+0000","last_unstale":"2024-02-15T22:56:45.882801+0000","last_undegraded":"2024-02-15T22:56:45.882801+0000","last_fullsized":"2024-02-15T22:56:45.882801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882619+0000","last_change":"2024-02-15T22:56:03.705460+0000","last_active":"2024-02-15T22:56:45.882619+0000","last_peered":"2024-02-15T22:56:45.882619+0000","last_clean":"2024-02-15T22:56:45.882619+0000","last_became_active":"2024-02-15T22:56:03.705176+0000","last_became_peered":"2024-02-15T22:56:03.705176+0000","last_unstale":"2024-02-15T22:56:45.882619+0000","last_undegraded":"2024-02-15T22:56:45.882619+0000","last_fullsized":"2024-02-15T22:56:45.882619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:05:19.142672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878857+0000","last_change":"2024-02-15T22:56:07.703334+0000","last_active":"2024-02-15T22:56:45.878857+0000","last_peered":"2024-02-15T22:56:45.878857+0000","last_clean":"2024-02-15T22:56:45.878857+0000","last_became_active":"2024-02-15T22:56:07.703060+0000","last_became_peered":"2024-02-15T22:56:07.703060+0000","last_unstale":"2024-02-15T22:56:45.878857+0000","last_undegraded":"2024-02-15T22:56:45.878857+0000","last_fullsized":"2024-02-15T22:56:45.878857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:26:26.533319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.862444+0000","last_change":"2024-02-15T22:56:09.720950+0000","last_active":"2024-02-15T22:57:29.862444+0000","last_peered":"2024-02-15T22:57:29.862444+0000","last_clean":"2024-02-15T22:57:29.862444+0000","last_became_active":"2024-02-15T22:56:09.720627+0000","last_became_peered":"2024-02-15T22:56:09.720627+0000","last_unstale":"2024-02-15T22:57:29.862444+0000","last_undegraded":"2024-02-15T22:57:29.862444+0000","last_fullsized":"2024-02-15T22:57:29.862444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:22.567556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881531+0000","last_change":"2024-02-15T22:56:11.724993+0000","last_active":"2024-02-15T22:56:45.881531+0000","last_peered":"2024-02-15T22:56:45.881531+0000","last_clean":"2024-02-15T22:56:45.881531+0000","last_became_active":"2024-02-15T22:56:11.724592+0000","last_became_peered":"2024-02-15T22:56:11.724592+0000","last_unstale":"2024-02-15T22:56:45.881531+0000","last_undegraded":"2024-02-15T22:56:45.881531+0000","last_fullsized":"2024-02-15T22:56:45.881531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:15:05.960640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880472+0000","last_change":"2024-02-15T22:56:13.730249+0000","last_active":"2024-02-15T22:56:45.880472+0000","last_peered":"2024-02-15T22:56:45.880472+0000","last_clean":"2024-02-15T22:56:45.880472+0000","last_became_active":"2024-02-15T22:56:13.729931+0000","last_became_peered":"2024-02-15T22:56:13.729931+0000","last_unstale":"2024-02-15T22:56:45.880472+0000","last_undegraded":"2024-02-15T22:56:45.880472+0000","last_fullsized":"2024-02-15T22:56:45.880472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:56.680543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879015+0000","last_change":"2024-02-15T22:56:05.714662+0000","last_active":"2024-02-15T22:56:45.879015+0000","last_peered":"2024-02-15T22:56:45.879015+0000","last_clean":"2024-02-15T22:56:45.879015+0000","last_became_active":"2024-02-15T22:56:05.714024+0000","last_became_peered":"2024-02-15T22:56:05.714024+0000","last_unstale":"2024-02-15T22:56:45.879015+0000","last_undegraded":"2024-02-15T22:56:45.879015+0000","last_fullsized":"2024-02-15T22:56:45.879015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:27:41.335097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886118+0000","last_change":"2024-02-15T22:56:03.698629+0000","last_active":"2024-02-15T22:56:45.886118+0000","last_peered":"2024-02-15T22:56:45.886118+0000","last_clean":"2024-02-15T22:56:45.886118+0000","last_became_active":"2024-02-15T22:56:03.695339+0000","last_became_peered":"2024-02-15T22:56:03.695339+0000","last_unstale":"2024-02-15T22:56:45.886118+0000","last_undegraded":"2024-02-15T22:56:45.886118+0000","last_fullsized":"2024-02-15T22:56:45.886118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882093+0000","last_change":"2024-02-15T22:56:07.708960+0000","last_active":"2024-02-15T22:56:45.882093+0000","last_peered":"2024-02-15T22:56:45.882093+0000","last_clean":"2024-02-15T22:56:45.882093+0000","last_became_active":"2024-02-15T22:56:07.708692+0000","last_became_peered":"2024-02-15T22:56:07.708692+0000","last_unstale":"2024-02-15T22:56:45.882093+0000","last_undegraded":"2024-02-15T22:56:45.882093+0000","last_fullsized":"2024-02-15T22:56:45.882093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:22.028630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"30'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:23.077273+0000","last_change":"2024-02-15T22:56:09.711326+0000","last_active":"2024-02-15T22:57:23.077273+0000","last_peered":"2024-02-15T22:57:23.077273+0000","last_clean":"2024-02-15T22:57:23.077273+0000","last_became_active":"2024-02-15T22:56:09.710942+0000","last_became_peered":"2024-02-15T22:56:09.710942+0000","last_unstale":"2024-02-15T22:57:23.077273+0000","last_undegraded":"2024-02-15T22:57:23.077273+0000","last_fullsized":"2024-02-15T22:57:23.077273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:53.380084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881415+0000","last_change":"2024-02-15T22:56:11.724852+0000","last_active":"2024-02-15T22:56:45.881415+0000","last_peered":"2024-02-15T22:56:45.881415+0000","last_clean":"2024-02-15T22:56:45.881415+0000","last_became_active":"2024-02-15T22:56:11.724533+0000","last_became_peered":"2024-02-15T22:56:11.724533+0000","last_unstale":"2024-02-15T22:56:45.881415+0000","last_undegraded":"2024-02-15T22:56:45.881415+0000","last_fullsized":"2024-02-15T22:56:45.881415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:34.347066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.216560+0000","last_change":"2024-02-15T22:56:13.734719+0000","last_active":"2024-02-15T22:56:47.216560+0000","last_peered":"2024-02-15T22:56:47.216560+0000","last_clean":"2024-02-15T22:56:47.216560+0000","last_became_active":"2024-02-15T22:56:13.734428+0000","last_became_peered":"2024-02-15T22:56:13.734428+0000","last_unstale":"2024-02-15T22:56:47.216560+0000","last_undegraded":"2024-02-15T22:56:47.216560+0000","last_fullsized":"2024-02-15T22:56:47.216560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:26:47.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883407+0000","last_change":"2024-02-15T22:56:05.706212+0000","last_active":"2024-02-15T22:57:29.883407+0000","last_peered":"2024-02-15T22:57:29.883407+0000","last_clean":"2024-02-15T22:57:29.883407+0000","last_became_active":"2024-02-15T22:56:05.705385+0000","last_became_peered":"2024-02-15T22:56:05.705385+0000","last_unstale":"2024-02-15T22:57:29.883407+0000","last_undegraded":"2024-02-15T22:57:29.883407+0000","last_fullsized":"2024-02-15T22:57:29.883407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:11.875068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886682+0000","last_change":"2024-02-15T22:56:03.700283+0000","last_active":"2024-02-15T22:56:45.886682+0000","last_peered":"2024-02-15T22:56:45.886682+0000","last_clean":"2024-02-15T22:56:45.886682+0000","last_became_active":"2024-02-15T22:56:03.699626+0000","last_became_peered":"2024-02-15T22:56:03.699626+0000","last_unstale":"2024-02-15T22:56:45.886682+0000","last_undegraded":"2024-02-15T22:56:45.886682+0000","last_fullsized":"2024-02-15T22:56:45.886682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880040+0000","last_change":"2024-02-15T22:56:07.706016+0000","last_active":"2024-02-15T22:56:45.880040+0000","last_peered":"2024-02-15T22:56:45.880040+0000","last_clean":"2024-02-15T22:56:45.880040+0000","last_became_active":"2024-02-15T22:56:07.705705+0000","last_became_peered":"2024-02-15T22:56:07.705705+0000","last_unstale":"2024-02-15T22:56:45.880040+0000","last_undegraded":"2024-02-15T22:56:45.880040+0000","last_fullsized":"2024-02-15T22:56:45.880040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:23:10.160782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'34","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.183999+0000","last_change":"2024-02-15T22:56:09.712570+0000","last_active":"2024-02-15T22:57:35.183999+0000","last_peered":"2024-02-15T22:57:35.183999+0000","last_clean":"2024-02-15T22:57:35.183999+0000","last_became_active":"2024-02-15T22:56:09.712337+0000","last_became_peered":"2024-02-15T22:56:09.712337+0000","last_unstale":"2024-02-15T22:57:35.183999+0000","last_undegraded":"2024-02-15T22:57:35.183999+0000","last_fullsized":"2024-02-15T22:57:35.183999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:42.465797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878361+0000","last_change":"2024-02-15T22:56:11.715966+0000","last_active":"2024-02-15T22:56:45.878361+0000","last_peered":"2024-02-15T22:56:45.878361+0000","last_clean":"2024-02-15T22:56:45.878361+0000","last_became_active":"2024-02-15T22:56:11.715697+0000","last_became_peered":"2024-02-15T22:56:11.715697+0000","last_unstale":"2024-02-15T22:56:45.878361+0000","last_undegraded":"2024-02-15T22:56:45.878361+0000","last_fullsized":"2024-02-15T22:56:45.878361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:26.704898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880177+0000","last_change":"2024-02-15T22:56:13.734867+0000","last_active":"2024-02-15T22:56:45.880177+0000","last_peered":"2024-02-15T22:56:45.880177+0000","last_clean":"2024-02-15T22:56:45.880177+0000","last_became_active":"2024-02-15T22:56:13.734565+0000","last_became_peered":"2024-02-15T22:56:13.734565+0000","last_unstale":"2024-02-15T22:56:45.880177+0000","last_undegraded":"2024-02-15T22:56:45.880177+0000","last_fullsized":"2024-02-15T22:56:45.880177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:44:28.581885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'9","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883753+0000","last_change":"2024-02-15T22:56:05.710863+0000","last_active":"2024-02-15T22:57:29.883753+0000","last_peered":"2024-02-15T22:57:29.883753+0000","last_clean":"2024-02-15T22:57:29.883753+0000","last_became_active":"2024-02-15T22:56:05.710562+0000","last_became_peered":"2024-02-15T22:56:05.710562+0000","last_unstale":"2024-02-15T22:57:29.883753+0000","last_undegraded":"2024-02-15T22:57:29.883753+0000","last_fullsized":"2024-02-15T22:57:29.883753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880178+0000","last_change":"2024-02-15T22:56:03.697251+0000","last_active":"2024-02-15T22:56:45.880178+0000","last_peered":"2024-02-15T22:56:45.880178+0000","last_clean":"2024-02-15T22:56:45.880178+0000","last_became_active":"2024-02-15T22:56:03.696590+0000","last_became_peered":"2024-02-15T22:56:03.696590+0000","last_unstale":"2024-02-15T22:56:45.880178+0000","last_undegraded":"2024-02-15T22:56:45.880178+0000","last_fullsized":"2024-02-15T22:56:45.880178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882678+0000","last_change":"2024-02-15T22:56:07.705557+0000","last_active":"2024-02-15T22:56:45.882678+0000","last_peered":"2024-02-15T22:56:45.882678+0000","last_clean":"2024-02-15T22:56:45.882678+0000","last_became_active":"2024-02-15T22:56:07.705239+0000","last_became_peered":"2024-02-15T22:56:07.705239+0000","last_unstale":"2024-02-15T22:56:45.882678+0000","last_undegraded":"2024-02-15T22:56:45.882678+0000","last_fullsized":"2024-02-15T22:56:45.882678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:45.133507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.848608+0000","last_change":"2024-02-15T22:56:09.710915+0000","last_active":"2024-02-15T22:57:29.848608+0000","last_peered":"2024-02-15T22:57:29.848608+0000","last_clean":"2024-02-15T22:57:29.848608+0000","last_became_active":"2024-02-15T22:56:09.710616+0000","last_became_peered":"2024-02-15T22:56:09.710616+0000","last_unstale":"2024-02-15T22:57:29.848608+0000","last_undegraded":"2024-02-15T22:57:29.848608+0000","last_fullsized":"2024-02-15T22:57:29.848608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:52.104156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883516+0000","last_change":"2024-02-15T22:56:11.719273+0000","last_active":"2024-02-15T22:56:45.883516+0000","last_peered":"2024-02-15T22:56:45.883516+0000","last_clean":"2024-02-15T22:56:45.883516+0000","last_became_active":"2024-02-15T22:56:11.718995+0000","last_became_peered":"2024-02-15T22:56:11.718995+0000","last_unstale":"2024-02-15T22:56:45.883516+0000","last_undegraded":"2024-02-15T22:56:45.883516+0000","last_fullsized":"2024-02-15T22:56:45.883516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:42.609730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391474+0000","last_change":"2024-02-15T22:56:05.699435+0000","last_active":"2024-02-15T22:57:35.391474+0000","last_peered":"2024-02-15T22:57:35.391474+0000","last_clean":"2024-02-15T22:57:35.391474+0000","last_became_active":"2024-02-15T22:56:05.699196+0000","last_became_peered":"2024-02-15T22:56:05.699196+0000","last_unstale":"2024-02-15T22:57:35.391474+0000","last_undegraded":"2024-02-15T22:57:35.391474+0000","last_fullsized":"2024-02-15T22:57:35.391474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:28.327809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.216627+0000","last_change":"2024-02-15T22:56:03.702280+0000","last_active":"2024-02-15T22:57:29.216627+0000","last_peered":"2024-02-15T22:57:29.216627+0000","last_clean":"2024-02-15T22:57:29.216627+0000","last_became_active":"2024-02-15T22:56:03.702007+0000","last_became_peered":"2024-02-15T22:56:03.702007+0000","last_unstale":"2024-02-15T22:57:29.216627+0000","last_undegraded":"2024-02-15T22:57:29.216627+0000","last_fullsized":"2024-02-15T22:57:29.216627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:17:47.733980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881599+0000","last_change":"2024-02-15T22:56:07.707669+0000","last_active":"2024-02-15T22:56:45.881599+0000","last_peered":"2024-02-15T22:56:45.881599+0000","last_clean":"2024-02-15T22:56:45.881599+0000","last_became_active":"2024-02-15T22:56:07.707124+0000","last_became_peered":"2024-02-15T22:56:07.707124+0000","last_unstale":"2024-02-15T22:56:45.881599+0000","last_undegraded":"2024-02-15T22:56:45.881599+0000","last_fullsized":"2024-02-15T22:56:45.881599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:46.212262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.354113+0000","last_change":"2024-02-15T22:56:09.713405+0000","last_active":"2024-02-15T22:57:35.354113+0000","last_peered":"2024-02-15T22:57:35.354113+0000","last_clean":"2024-02-15T22:57:35.354113+0000","last_became_active":"2024-02-15T22:56:09.713076+0000","last_became_peered":"2024-02-15T22:56:09.713076+0000","last_unstale":"2024-02-15T22:57:35.354113+0000","last_undegraded":"2024-02-15T22:57:35.354113+0000","last_fullsized":"2024-02-15T22:57:35.354113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:36.072001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885912+0000","last_change":"2024-02-15T22:56:11.718389+0000","last_active":"2024-02-15T22:56:45.885912+0000","last_peered":"2024-02-15T22:56:45.885912+0000","last_clean":"2024-02-15T22:56:45.885912+0000","last_became_active":"2024-02-15T22:56:11.718102+0000","last_became_peered":"2024-02-15T22:56:11.718102+0000","last_unstale":"2024-02-15T22:56:45.885912+0000","last_undegraded":"2024-02-15T22:56:45.885912+0000","last_fullsized":"2024-02-15T22:56:45.885912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:26.771661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.339922+0000","last_change":"2024-02-15T22:56:13.734724+0000","last_active":"2024-02-15T22:57:29.339922+0000","last_peered":"2024-02-15T22:57:29.339922+0000","last_clean":"2024-02-15T22:57:29.339922+0000","last_became_active":"2024-02-15T22:56:13.734372+0000","last_became_peered":"2024-02-15T22:56:13.734372+0000","last_unstale":"2024-02-15T22:57:29.339922+0000","last_undegraded":"2024-02-15T22:57:29.339922+0000","last_fullsized":"2024-02-15T22:57:29.339922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:39.885870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391646+0000","last_change":"2024-02-15T22:56:05.705862+0000","last_active":"2024-02-15T22:57:35.391646+0000","last_peered":"2024-02-15T22:57:35.391646+0000","last_clean":"2024-02-15T22:57:35.391646+0000","last_became_active":"2024-02-15T22:56:05.705473+0000","last_became_peered":"2024-02-15T22:56:05.705473+0000","last_unstale":"2024-02-15T22:57:35.391646+0000","last_undegraded":"2024-02-15T22:57:35.391646+0000","last_fullsized":"2024-02-15T22:57:35.391646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:08.053314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.418196+0000","last_change":"2024-02-15T22:56:03.698010+0000","last_active":"2024-02-15T22:56:47.418196+0000","last_peered":"2024-02-15T22:56:47.418196+0000","last_clean":"2024-02-15T22:56:47.418196+0000","last_became_active":"2024-02-15T22:56:03.697691+0000","last_became_peered":"2024-02-15T22:56:03.697691+0000","last_unstale":"2024-02-15T22:56:47.418196+0000","last_undegraded":"2024-02-15T22:56:47.418196+0000","last_fullsized":"2024-02-15T22:56:47.418196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886468+0000","last_change":"2024-02-15T22:56:07.704334+0000","last_active":"2024-02-15T22:56:45.886468+0000","last_peered":"2024-02-15T22:56:45.886468+0000","last_clean":"2024-02-15T22:56:45.886468+0000","last_became_active":"2024-02-15T22:56:07.704018+0000","last_became_peered":"2024-02-15T22:56:07.704018+0000","last_unstale":"2024-02-15T22:56:45.886468+0000","last_undegraded":"2024-02-15T22:56:45.886468+0000","last_fullsized":"2024-02-15T22:56:45.886468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:59.601424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.849508+0000","last_change":"2024-02-15T22:56:09.717626+0000","last_active":"2024-02-15T22:57:29.849508+0000","last_peered":"2024-02-15T22:57:29.849508+0000","last_clean":"2024-02-15T22:57:29.849508+0000","last_became_active":"2024-02-15T22:56:09.717105+0000","last_became_peered":"2024-02-15T22:56:09.717105+0000","last_unstale":"2024-02-15T22:57:29.849508+0000","last_undegraded":"2024-02-15T22:57:29.849508+0000","last_fullsized":"2024-02-15T22:57:29.849508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:04:03.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882499+0000","last_change":"2024-02-15T22:56:11.723141+0000","last_active":"2024-02-15T22:56:45.882499+0000","last_peered":"2024-02-15T22:56:45.882499+0000","last_clean":"2024-02-15T22:56:45.882499+0000","last_became_active":"2024-02-15T22:56:11.722865+0000","last_became_peered":"2024-02-15T22:56:11.722865+0000","last_unstale":"2024-02-15T22:56:45.882499+0000","last_undegraded":"2024-02-15T22:56:45.882499+0000","last_fullsized":"2024-02-15T22:56:45.882499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:05.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879845+0000","last_change":"2024-02-15T22:56:13.727435+0000","last_active":"2024-02-15T22:56:45.879845+0000","last_peered":"2024-02-15T22:56:45.879845+0000","last_clean":"2024-02-15T22:56:45.879845+0000","last_became_active":"2024-02-15T22:56:13.726748+0000","last_became_peered":"2024-02-15T22:56:13.726748+0000","last_unstale":"2024-02-15T22:56:45.879845+0000","last_undegraded":"2024-02-15T22:56:45.879845+0000","last_fullsized":"2024-02-15T22:56:45.879845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:41:50.659346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883279+0000","last_change":"2024-02-15T22:56:05.716925+0000","last_active":"2024-02-15T22:57:29.883279+0000","last_peered":"2024-02-15T22:57:29.883279+0000","last_clean":"2024-02-15T22:57:29.883279+0000","last_became_active":"2024-02-15T22:56:05.716677+0000","last_became_peered":"2024-02-15T22:56:05.716677+0000","last_unstale":"2024-02-15T22:57:29.883279+0000","last_undegraded":"2024-02-15T22:57:29.883279+0000","last_fullsized":"2024-02-15T22:57:29.883279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:37.588602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878559+0000","last_change":"2024-02-15T22:56:03.692964+0000","last_active":"2024-02-15T22:56:45.878559+0000","last_peered":"2024-02-15T22:56:45.878559+0000","last_clean":"2024-02-15T22:56:45.878559+0000","last_became_active":"2024-02-15T22:56:03.692632+0000","last_became_peered":"2024-02-15T22:56:03.692632+0000","last_unstale":"2024-02-15T22:56:45.878559+0000","last_undegraded":"2024-02-15T22:56:45.878559+0000","last_fullsized":"2024-02-15T22:56:45.878559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:26.885390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885768+0000","last_change":"2024-02-15T22:56:07.704513+0000","last_active":"2024-02-15T22:56:45.885768+0000","last_peered":"2024-02-15T22:56:45.885768+0000","last_clean":"2024-02-15T22:56:45.885768+0000","last_became_active":"2024-02-15T22:56:07.704208+0000","last_became_peered":"2024-02-15T22:56:07.704208+0000","last_unstale":"2024-02-15T22:56:45.885768+0000","last_undegraded":"2024-02-15T22:56:45.885768+0000","last_fullsized":"2024-02-15T22:56:45.885768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:13:55.637902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.894297+0000","last_change":"2024-02-15T22:56:09.717007+0000","last_active":"2024-02-15T22:57:29.894297+0000","last_peered":"2024-02-15T22:57:29.894297+0000","last_clean":"2024-02-15T22:57:29.894297+0000","last_became_active":"2024-02-15T22:56:09.716753+0000","last_became_peered":"2024-02-15T22:56:09.716753+0000","last_unstale":"2024-02-15T22:57:29.894297+0000","last_undegraded":"2024-02-15T22:57:29.894297+0000","last_fullsized":"2024-02-15T22:57:29.894297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:06.528782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880705+0000","last_change":"2024-02-15T22:56:11.722996+0000","last_active":"2024-02-15T22:56:45.880705+0000","last_peered":"2024-02-15T22:56:45.880705+0000","last_clean":"2024-02-15T22:56:45.880705+0000","last_became_active":"2024-02-15T22:56:11.722738+0000","last_became_peered":"2024-02-15T22:56:11.722738+0000","last_unstale":"2024-02-15T22:56:45.880705+0000","last_undegraded":"2024-02-15T22:56:45.880705+0000","last_fullsized":"2024-02-15T22:56:45.880705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:45.887455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880053+0000","last_change":"2024-02-15T22:56:13.727522+0000","last_active":"2024-02-15T22:56:45.880053+0000","last_peered":"2024-02-15T22:56:45.880053+0000","last_clean":"2024-02-15T22:56:45.880053+0000","last_became_active":"2024-02-15T22:56:13.727216+0000","last_became_peered":"2024-02-15T22:56:13.727216+0000","last_unstale":"2024-02-15T22:56:45.880053+0000","last_undegraded":"2024-02-15T22:56:45.880053+0000","last_fullsized":"2024-02-15T22:56:45.880053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:39:14.707814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881181+0000","last_change":"2024-02-15T22:56:05.707488+0000","last_active":"2024-02-15T22:56:45.881181+0000","last_peered":"2024-02-15T22:56:45.881181+0000","last_clean":"2024-02-15T22:56:45.881181+0000","last_became_active":"2024-02-15T22:56:05.707154+0000","last_became_peered":"2024-02-15T22:56:05.707154+0000","last_unstale":"2024-02-15T22:56:45.881181+0000","last_undegraded":"2024-02-15T22:56:45.881181+0000","last_fullsized":"2024-02-15T22:56:45.881181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881248+0000","last_change":"2024-02-15T22:56:03.700157+0000","last_active":"2024-02-15T22:56:45.881248+0000","last_peered":"2024-02-15T22:56:45.881248+0000","last_clean":"2024-02-15T22:56:45.881248+0000","last_became_active":"2024-02-15T22:56:03.699843+0000","last_became_peered":"2024-02-15T22:56:03.699843+0000","last_unstale":"2024-02-15T22:56:45.881248+0000","last_undegraded":"2024-02-15T22:56:45.881248+0000","last_fullsized":"2024-02-15T22:56:45.881248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:47.749601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:36.239355+0000","last_change":"2024-02-15T22:56:07.702631+0000","last_active":"2024-02-15T22:57:36.239355+0000","last_peered":"2024-02-15T22:57:36.239355+0000","last_clean":"2024-02-15T22:57:36.239355+0000","last_became_active":"2024-02-15T22:56:07.702014+0000","last_became_peered":"2024-02-15T22:56:07.702014+0000","last_unstale":"2024-02-15T22:57:36.239355+0000","last_undegraded":"2024-02-15T22:57:36.239355+0000","last_fullsized":"2024-02-15T22:57:36.239355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:02.266965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883138+0000","last_change":"2024-02-15T22:56:09.717362+0000","last_active":"2024-02-15T22:56:45.883138+0000","last_peered":"2024-02-15T22:56:45.883138+0000","last_clean":"2024-02-15T22:56:45.883138+0000","last_became_active":"2024-02-15T22:56:09.715996+0000","last_became_peered":"2024-02-15T22:56:09.715996+0000","last_unstale":"2024-02-15T22:56:45.883138+0000","last_undegraded":"2024-02-15T22:56:45.883138+0000","last_fullsized":"2024-02-15T22:56:45.883138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:10.389319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'240","reported_seq":289,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.529299+0000","last_change":"2024-02-15T22:56:11.725698+0000","last_active":"2024-02-15T22:57:35.529299+0000","last_peered":"2024-02-15T22:57:35.529299+0000","last_clean":"2024-02-15T22:57:35.529299+0000","last_became_active":"2024-02-15T22:56:11.724520+0000","last_became_peered":"2024-02-15T22:56:11.724520+0000","last_unstale":"2024-02-15T22:57:35.529299+0000","last_undegraded":"2024-02-15T22:57:35.529299+0000","last_fullsized":"2024-02-15T22:57:35.529299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:08.534852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879365+0000","last_change":"2024-02-15T22:56:13.731954+0000","last_active":"2024-02-15T22:56:45.879365+0000","last_peered":"2024-02-15T22:56:45.879365+0000","last_clean":"2024-02-15T22:56:45.879365+0000","last_became_active":"2024-02-15T22:56:13.731683+0000","last_became_peered":"2024-02-15T22:56:13.731683+0000","last_unstale":"2024-02-15T22:56:45.879365+0000","last_undegraded":"2024-02-15T22:56:45.879365+0000","last_fullsized":"2024-02-15T22:56:45.879365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:12:05.571855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882882+0000","last_change":"2024-02-15T22:56:05.701652+0000","last_active":"2024-02-15T22:56:45.882882+0000","last_peered":"2024-02-15T22:56:45.882882+0000","last_clean":"2024-02-15T22:56:45.882882+0000","last_became_active":"2024-02-15T22:56:05.700922+0000","last_became_peered":"2024-02-15T22:56:05.700922+0000","last_unstale":"2024-02-15T22:56:45.882882+0000","last_undegraded":"2024-02-15T22:56:45.882882+0000","last_fullsized":"2024-02-15T22:56:45.882882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:11.875068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883283+0000","last_change":"2024-02-15T22:56:03.697064+0000","last_active":"2024-02-15T22:56:45.883283+0000","last_peered":"2024-02-15T22:56:45.883283+0000","last_clean":"2024-02-15T22:56:45.883283+0000","last_became_active":"2024-02-15T22:56:03.696168+0000","last_became_peered":"2024-02-15T22:56:03.696168+0000","last_unstale":"2024-02-15T22:56:45.883283+0000","last_undegraded":"2024-02-15T22:56:45.883283+0000","last_fullsized":"2024-02-15T22:56:45.883283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879369+0000","last_change":"2024-02-15T22:56:07.702419+0000","last_active":"2024-02-15T22:56:45.879369+0000","last_peered":"2024-02-15T22:56:45.879369+0000","last_clean":"2024-02-15T22:56:45.879369+0000","last_became_active":"2024-02-15T22:56:07.701777+0000","last_became_peered":"2024-02-15T22:56:07.701777+0000","last_unstale":"2024-02-15T22:56:45.879369+0000","last_undegraded":"2024-02-15T22:56:45.879369+0000","last_fullsized":"2024-02-15T22:56:45.879369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:35.223607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'35","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.840610+0000","last_change":"2024-02-15T22:56:09.713897+0000","last_active":"2024-02-15T22:57:29.840610+0000","last_peered":"2024-02-15T22:57:29.840610+0000","last_clean":"2024-02-15T22:57:29.840610+0000","last_became_active":"2024-02-15T22:56:09.713636+0000","last_became_peered":"2024-02-15T22:56:09.713636+0000","last_unstale":"2024-02-15T22:57:29.840610+0000","last_undegraded":"2024-02-15T22:57:29.840610+0000","last_fullsized":"2024-02-15T22:57:29.840610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:30.461447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878819+0000","last_change":"2024-02-15T22:56:11.722701+0000","last_active":"2024-02-15T22:56:45.878819+0000","last_peered":"2024-02-15T22:56:45.878819+0000","last_clean":"2024-02-15T22:56:45.878819+0000","last_became_active":"2024-02-15T22:56:11.722374+0000","last_became_peered":"2024-02-15T22:56:11.722374+0000","last_unstale":"2024-02-15T22:56:45.878819+0000","last_undegraded":"2024-02-15T22:56:45.878819+0000","last_fullsized":"2024-02-15T22:56:45.878819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:08.103224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879392+0000","last_change":"2024-02-15T22:56:13.733861+0000","last_active":"2024-02-15T22:56:45.879392+0000","last_peered":"2024-02-15T22:56:45.879392+0000","last_clean":"2024-02-15T22:56:45.879392+0000","last_became_active":"2024-02-15T22:56:13.733576+0000","last_became_peered":"2024-02-15T22:56:13.733576+0000","last_unstale":"2024-02-15T22:56:45.879392+0000","last_undegraded":"2024-02-15T22:56:45.879392+0000","last_fullsized":"2024-02-15T22:56:45.879392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:06.977567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.426850+0000","last_change":"2024-02-15T22:56:05.701307+0000","last_active":"2024-02-15T22:56:47.426850+0000","last_peered":"2024-02-15T22:56:47.426850+0000","last_clean":"2024-02-15T22:56:47.426850+0000","last_became_active":"2024-02-15T22:56:05.701026+0000","last_became_peered":"2024-02-15T22:56:05.701026+0000","last_unstale":"2024-02-15T22:56:47.426850+0000","last_undegraded":"2024-02-15T22:56:47.426850+0000","last_fullsized":"2024-02-15T22:56:47.426850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:08:46.773754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883580+0000","last_change":"2024-02-15T22:56:03.706706+0000","last_active":"2024-02-15T22:56:45.883580+0000","last_peered":"2024-02-15T22:56:45.883580+0000","last_clean":"2024-02-15T22:56:45.883580+0000","last_became_active":"2024-02-15T22:56:03.706422+0000","last_became_peered":"2024-02-15T22:56:03.706422+0000","last_unstale":"2024-02-15T22:56:45.883580+0000","last_undegraded":"2024-02-15T22:56:45.883580+0000","last_fullsized":"2024-02-15T22:56:45.883580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:53.983428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883428+0000","last_change":"2024-02-15T22:56:07.707525+0000","last_active":"2024-02-15T22:56:45.883428+0000","last_peered":"2024-02-15T22:56:45.883428+0000","last_clean":"2024-02-15T22:56:45.883428+0000","last_became_active":"2024-02-15T22:56:07.707265+0000","last_became_peered":"2024-02-15T22:56:07.707265+0000","last_unstale":"2024-02-15T22:56:45.883428+0000","last_undegraded":"2024-02-15T22:56:45.883428+0000","last_fullsized":"2024-02-15T22:56:45.883428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:05:01.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.841622+0000","last_change":"2024-02-15T22:56:09.717128+0000","last_active":"2024-02-15T22:57:29.841622+0000","last_peered":"2024-02-15T22:57:29.841622+0000","last_clean":"2024-02-15T22:57:29.841622+0000","last_became_active":"2024-02-15T22:56:09.716749+0000","last_became_peered":"2024-02-15T22:56:09.716749+0000","last_unstale":"2024-02-15T22:57:29.841622+0000","last_undegraded":"2024-02-15T22:57:29.841622+0000","last_fullsized":"2024-02-15T22:57:29.841622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:31.912815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880224+0000","last_change":"2024-02-15T22:56:11.726028+0000","last_active":"2024-02-15T22:56:45.880224+0000","last_peered":"2024-02-15T22:56:45.880224+0000","last_clean":"2024-02-15T22:56:45.880224+0000","last_became_active":"2024-02-15T22:56:11.725667+0000","last_became_peered":"2024-02-15T22:56:11.725667+0000","last_unstale":"2024-02-15T22:56:45.880224+0000","last_undegraded":"2024-02-15T22:56:45.880224+0000","last_fullsized":"2024-02-15T22:56:45.880224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:33.489028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'8","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881143+0000","last_change":"2024-02-15T22:56:13.729381+0000","last_active":"2024-02-15T22:56:45.881143+0000","last_peered":"2024-02-15T22:56:45.881143+0000","last_clean":"2024-02-15T22:56:45.881143+0000","last_became_active":"2024-02-15T22:56:13.728844+0000","last_became_peered":"2024-02-15T22:56:13.728844+0000","last_unstale":"2024-02-15T22:56:45.881143+0000","last_undegraded":"2024-02-15T22:56:45.881143+0000","last_fullsized":"2024-02-15T22:56:45.881143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:08.247734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214122+0000","last_change":"2024-02-15T22:56:05.701351+0000","last_active":"2024-02-15T22:57:29.214122+0000","last_peered":"2024-02-15T22:57:29.214122+0000","last_clean":"2024-02-15T22:57:29.214122+0000","last_became_active":"2024-02-15T22:56:05.700908+0000","last_became_peered":"2024-02-15T22:56:05.700908+0000","last_unstale":"2024-02-15T22:57:29.214122+0000","last_undegraded":"2024-02-15T22:57:29.214122+0000","last_fullsized":"2024-02-15T22:57:29.214122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:41:03.587630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881194+0000","last_change":"2024-02-15T22:56:03.704371+0000","last_active":"2024-02-15T22:56:45.881194+0000","last_peered":"2024-02-15T22:56:45.881194+0000","last_clean":"2024-02-15T22:56:45.881194+0000","last_became_active":"2024-02-15T22:56:03.704081+0000","last_became_peered":"2024-02-15T22:56:03.704081+0000","last_unstale":"2024-02-15T22:56:45.881194+0000","last_undegraded":"2024-02-15T22:56:45.881194+0000","last_fullsized":"2024-02-15T22:56:45.881194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:52.903955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878100+0000","last_change":"2024-02-15T22:56:07.708809+0000","last_active":"2024-02-15T22:56:45.878100+0000","last_peered":"2024-02-15T22:56:45.878100+0000","last_clean":"2024-02-15T22:56:45.878100+0000","last_became_active":"2024-02-15T22:56:07.708530+0000","last_became_peered":"2024-02-15T22:56:07.708530+0000","last_unstale":"2024-02-15T22:56:45.878100+0000","last_undegraded":"2024-02-15T22:56:45.878100+0000","last_fullsized":"2024-02-15T22:56:45.878100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:57.292484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.864140+0000","last_change":"2024-02-15T22:56:09.717300+0000","last_active":"2024-02-15T22:57:29.864140+0000","last_peered":"2024-02-15T22:57:29.864140+0000","last_clean":"2024-02-15T22:57:29.864140+0000","last_became_active":"2024-02-15T22:56:09.716134+0000","last_became_peered":"2024-02-15T22:56:09.716134+0000","last_unstale":"2024-02-15T22:57:29.864140+0000","last_undegraded":"2024-02-15T22:57:29.864140+0000","last_fullsized":"2024-02-15T22:57:29.864140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:52.667771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":40,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880819+0000","last_change":"2024-02-15T22:56:11.725615+0000","last_active":"2024-02-15T22:56:45.880819+0000","last_peered":"2024-02-15T22:56:45.880819+0000","last_clean":"2024-02-15T22:56:45.880819+0000","last_became_active":"2024-02-15T22:56:11.725271+0000","last_became_peered":"2024-02-15T22:56:11.725271+0000","last_unstale":"2024-02-15T22:56:45.880819+0000","last_undegraded":"2024-02-15T22:56:45.880819+0000","last_fullsized":"2024-02-15T22:56:45.880819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:13.922809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880951+0000","last_change":"2024-02-15T22:56:13.735140+0000","last_active":"2024-02-15T22:56:45.880951+0000","last_peered":"2024-02-15T22:56:45.880951+0000","last_clean":"2024-02-15T22:56:45.880951+0000","last_became_active":"2024-02-15T22:56:13.734871+0000","last_became_peered":"2024-02-15T22:56:13.734871+0000","last_unstale":"2024-02-15T22:56:45.880951+0000","last_undegraded":"2024-02-15T22:56:45.880951+0000","last_fullsized":"2024-02-15T22:56:45.880951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:23:54.224082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'15","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214442+0000","last_change":"2024-02-15T22:56:05.700345+0000","last_active":"2024-02-15T22:57:29.214442+0000","last_peered":"2024-02-15T22:57:29.214442+0000","last_clean":"2024-02-15T22:57:29.214442+0000","last_became_active":"2024-02-15T22:56:05.700066+0000","last_became_peered":"2024-02-15T22:56:05.700066+0000","last_unstale":"2024-02-15T22:57:29.214442+0000","last_undegraded":"2024-02-15T22:57:29.214442+0000","last_fullsized":"2024-02-15T22:57:29.214442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:53.296017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880320+0000","last_change":"2024-02-15T22:56:03.694391+0000","last_active":"2024-02-15T22:56:45.880320+0000","last_peered":"2024-02-15T22:56:45.880320+0000","last_clean":"2024-02-15T22:56:45.880320+0000","last_became_active":"2024-02-15T22:56:03.693300+0000","last_became_peered":"2024-02-15T22:56:03.693300+0000","last_unstale":"2024-02-15T22:56:45.880320+0000","last_undegraded":"2024-02-15T22:56:45.880320+0000","last_fullsized":"2024-02-15T22:56:45.880320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878222+0000","last_change":"2024-02-15T22:56:07.709035+0000","last_active":"2024-02-15T22:56:45.878222+0000","last_peered":"2024-02-15T22:56:45.878222+0000","last_clean":"2024-02-15T22:56:45.878222+0000","last_became_active":"2024-02-15T22:56:07.708720+0000","last_became_peered":"2024-02-15T22:56:07.708720+0000","last_unstale":"2024-02-15T22:56:45.878222+0000","last_undegraded":"2024-02-15T22:56:45.878222+0000","last_fullsized":"2024-02-15T22:56:45.878222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:37.486705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.374757+0000","last_change":"2024-02-15T22:56:09.720664+0000","last_active":"2024-02-15T22:57:35.374757+0000","last_peered":"2024-02-15T22:57:35.374757+0000","last_clean":"2024-02-15T22:57:35.374757+0000","last_became_active":"2024-02-15T22:56:09.717846+0000","last_became_peered":"2024-02-15T22:56:09.717846+0000","last_unstale":"2024-02-15T22:57:35.374757+0000","last_undegraded":"2024-02-15T22:57:35.374757+0000","last_fullsized":"2024-02-15T22:57:35.374757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:14:17.930845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879414+0000","last_change":"2024-02-15T22:56:11.722731+0000","last_active":"2024-02-15T22:56:45.879414+0000","last_peered":"2024-02-15T22:56:45.879414+0000","last_clean":"2024-02-15T22:56:45.879414+0000","last_became_active":"2024-02-15T22:56:11.722402+0000","last_became_peered":"2024-02-15T22:56:11.722402+0000","last_unstale":"2024-02-15T22:56:45.879414+0000","last_undegraded":"2024-02-15T22:56:45.879414+0000","last_fullsized":"2024-02-15T22:56:45.879414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:57.504579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882258+0000","last_change":"2024-02-15T22:56:13.733552+0000","last_active":"2024-02-15T22:56:45.882258+0000","last_peered":"2024-02-15T22:56:45.882258+0000","last_clean":"2024-02-15T22:56:45.882258+0000","last_became_active":"2024-02-15T22:56:13.733285+0000","last_became_peered":"2024-02-15T22:56:13.733285+0000","last_unstale":"2024-02-15T22:56:45.882258+0000","last_undegraded":"2024-02-15T22:56:45.882258+0000","last_fullsized":"2024-02-15T22:56:45.882258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:52:36.091970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391114+0000","last_change":"2024-02-15T22:56:05.715894+0000","last_active":"2024-02-15T22:57:35.391114+0000","last_peered":"2024-02-15T22:57:35.391114+0000","last_clean":"2024-02-15T22:57:35.391114+0000","last_became_active":"2024-02-15T22:56:05.715609+0000","last_became_peered":"2024-02-15T22:56:05.715609+0000","last_unstale":"2024-02-15T22:57:35.391114+0000","last_undegraded":"2024-02-15T22:57:35.391114+0000","last_fullsized":"2024-02-15T22:57:35.391114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:59:43.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880575+0000","last_change":"2024-02-15T22:56:03.694275+0000","last_active":"2024-02-15T22:56:45.880575+0000","last_peered":"2024-02-15T22:56:45.880575+0000","last_clean":"2024-02-15T22:56:45.880575+0000","last_became_active":"2024-02-15T22:56:03.691266+0000","last_became_peered":"2024-02-15T22:56:03.691266+0000","last_unstale":"2024-02-15T22:56:45.880575+0000","last_undegraded":"2024-02-15T22:56:45.880575+0000","last_fullsized":"2024-02-15T22:56:45.880575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:27.775050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215026+0000","last_change":"2024-02-15T22:56:05.707825+0000","last_active":"2024-02-15T22:56:47.215026+0000","last_peered":"2024-02-15T22:56:47.215026+0000","last_clean":"2024-02-15T22:56:47.215026+0000","last_became_active":"2024-02-15T22:56:05.707492+0000","last_became_peered":"2024-02-15T22:56:05.707492+0000","last_unstale":"2024-02-15T22:56:47.215026+0000","last_undegraded":"2024-02-15T22:56:47.215026+0000","last_fullsized":"2024-02-15T22:56:47.215026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:53.786957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879050+0000","last_change":"2024-02-15T22:56:03.693256+0000","last_active":"2024-02-15T22:56:45.879050+0000","last_peered":"2024-02-15T22:56:45.879050+0000","last_clean":"2024-02-15T22:56:45.879050+0000","last_became_active":"2024-02-15T22:56:03.692909+0000","last_became_peered":"2024-02-15T22:56:03.692909+0000","last_unstale":"2024-02-15T22:56:45.879050+0000","last_undegraded":"2024-02-15T22:56:45.879050+0000","last_fullsized":"2024-02-15T22:56:45.879050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215219+0000","last_change":"2024-02-15T22:56:05.710347+0000","last_active":"2024-02-15T22:56:47.215219+0000","last_peered":"2024-02-15T22:56:47.215219+0000","last_clean":"2024-02-15T22:56:47.215219+0000","last_became_active":"2024-02-15T22:56:05.710095+0000","last_became_peered":"2024-02-15T22:56:05.710095+0000","last_unstale":"2024-02-15T22:56:47.215219+0000","last_undegraded":"2024-02-15T22:56:47.215219+0000","last_fullsized":"2024-02-15T22:56:47.215219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:20.752404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884346+0000","last_change":"2024-02-15T22:56:03.695701+0000","last_active":"2024-02-15T22:56:45.884346+0000","last_peered":"2024-02-15T22:56:45.884346+0000","last_clean":"2024-02-15T22:56:45.884346+0000","last_became_active":"2024-02-15T22:56:03.695362+0000","last_became_peered":"2024-02-15T22:56:03.695362+0000","last_unstale":"2024-02-15T22:56:45.884346+0000","last_undegraded":"2024-02-15T22:56:45.884346+0000","last_fullsized":"2024-02-15T22:56:45.884346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:11.575998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391183+0000","last_change":"2024-02-15T22:56:05.701633+0000","last_active":"2024-02-15T22:57:35.391183+0000","last_peered":"2024-02-15T22:57:35.391183+0000","last_clean":"2024-02-15T22:57:35.391183+0000","last_became_active":"2024-02-15T22:56:05.701253+0000","last_became_peered":"2024-02-15T22:56:05.701253+0000","last_unstale":"2024-02-15T22:57:35.391183+0000","last_undegraded":"2024-02-15T22:57:35.391183+0000","last_fullsized":"2024-02-15T22:57:35.391183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880157+0000","last_change":"2024-02-15T22:56:03.700366+0000","last_active":"2024-02-15T22:56:45.880157+0000","last_peered":"2024-02-15T22:56:45.880157+0000","last_clean":"2024-02-15T22:56:45.880157+0000","last_became_active":"2024-02-15T22:56:03.699881+0000","last_became_peered":"2024-02-15T22:56:03.699881+0000","last_unstale":"2024-02-15T22:56:45.880157+0000","last_undegraded":"2024-02-15T22:56:45.880157+0000","last_fullsized":"2024-02-15T22:56:45.880157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887346+0000","last_change":"2024-02-15T22:56:45.887346+0000","last_active":"2024-02-15T22:56:45.887346+0000","last_peered":"2024-02-15T22:56:45.887346+0000","last_clean":"2024-02-15T22:56:45.887346+0000","last_became_active":"2024-02-15T22:56:45.886976+0000","last_became_peered":"2024-02-15T22:56:45.886976+0000","last_unstale":"2024-02-15T22:56:45.887346+0000","last_undegraded":"2024-02-15T22:56:45.887346+0000","last_fullsized":"2024-02-15T22:56:45.887346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:43.710640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.878637+0000","last_change":"2024-02-15T22:56:03.693265+0000","last_active":"2024-02-15T22:57:29.878637+0000","last_peered":"2024-02-15T22:57:29.878637+0000","last_clean":"2024-02-15T22:57:29.878637+0000","last_became_active":"2024-02-15T22:56:03.692939+0000","last_became_peered":"2024-02-15T22:56:03.692939+0000","last_unstale":"2024-02-15T22:57:29.878637+0000","last_undegraded":"2024-02-15T22:57:29.878637+0000","last_fullsized":"2024-02-15T22:57:29.878637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878893+0000","last_change":"2024-02-15T22:56:05.714686+0000","last_active":"2024-02-15T22:56:45.878893+0000","last_peered":"2024-02-15T22:56:45.878893+0000","last_clean":"2024-02-15T22:56:45.878893+0000","last_became_active":"2024-02-15T22:56:05.713670+0000","last_became_peered":"2024-02-15T22:56:05.713670+0000","last_unstale":"2024-02-15T22:56:45.878893+0000","last_undegraded":"2024-02-15T22:56:45.878893+0000","last_fullsized":"2024-02-15T22:56:45.878893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:57.594699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882088+0000","last_change":"2024-02-15T22:56:03.697544+0000","last_active":"2024-02-15T22:56:45.882088+0000","last_peered":"2024-02-15T22:56:45.882088+0000","last_clean":"2024-02-15T22:56:45.882088+0000","last_became_active":"2024-02-15T22:56:03.696174+0000","last_became_peered":"2024-02-15T22:56:03.696174+0000","last_unstale":"2024-02-15T22:56:45.882088+0000","last_undegraded":"2024-02-15T22:56:45.882088+0000","last_fullsized":"2024-02-15T22:56:45.882088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.426942+0000","last_change":"2024-02-15T22:56:05.703501+0000","last_active":"2024-02-15T22:56:47.426942+0000","last_peered":"2024-02-15T22:56:47.426942+0000","last_clean":"2024-02-15T22:56:47.426942+0000","last_became_active":"2024-02-15T22:56:05.703183+0000","last_became_peered":"2024-02-15T22:56:05.703183+0000","last_unstale":"2024-02-15T22:56:47.426942+0000","last_undegraded":"2024-02-15T22:56:47.426942+0000","last_fullsized":"2024-02-15T22:56:47.426942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:08:55.954762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.415547+0000","last_change":"2024-02-15T22:56:03.700841+0000","last_active":"2024-02-15T22:56:47.415547+0000","last_peered":"2024-02-15T22:56:47.415547+0000","last_clean":"2024-02-15T22:56:47.415547+0000","last_became_active":"2024-02-15T22:56:03.699989+0000","last_became_peered":"2024-02-15T22:56:03.699989+0000","last_unstale":"2024-02-15T22:56:47.415547+0000","last_undegraded":"2024-02-15T22:56:47.415547+0000","last_fullsized":"2024-02-15T22:56:47.415547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:24:52.527970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883377+0000","last_change":"2024-02-15T22:56:05.701522+0000","last_active":"2024-02-15T22:57:29.883377+0000","last_peered":"2024-02-15T22:57:29.883377+0000","last_clean":"2024-02-15T22:57:29.883377+0000","last_became_active":"2024-02-15T22:56:05.701193+0000","last_became_peered":"2024-02-15T22:56:05.701193+0000","last_unstale":"2024-02-15T22:57:29.883377+0000","last_undegraded":"2024-02-15T22:57:29.883377+0000","last_fullsized":"2024-02-15T22:57:29.883377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:25:28.743304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881646+0000","last_change":"2024-02-15T22:56:03.693252+0000","last_active":"2024-02-15T22:56:45.881646+0000","last_peered":"2024-02-15T22:56:45.881646+0000","last_clean":"2024-02-15T22:56:45.881646+0000","last_became_active":"2024-02-15T22:56:03.692902+0000","last_became_peered":"2024-02-15T22:56:03.692902+0000","last_unstale":"2024-02-15T22:56:45.881646+0000","last_undegraded":"2024-02-15T22:56:45.881646+0000","last_fullsized":"2024-02-15T22:56:45.881646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:05:12.685609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505930+0000","last_change":"2024-02-15T22:56:05.702770+0000","last_active":"2024-02-15T22:57:29.505930+0000","last_peered":"2024-02-15T22:57:29.505930+0000","last_clean":"2024-02-15T22:57:29.505930+0000","last_became_active":"2024-02-15T22:56:05.702455+0000","last_became_peered":"2024-02-15T22:56:05.702455+0000","last_unstale":"2024-02-15T22:57:29.505930+0000","last_undegraded":"2024-02-15T22:57:29.505930+0000","last_fullsized":"2024-02-15T22:57:29.505930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:31.736198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880494+0000","last_change":"2024-02-15T22:56:03.695480+0000","last_active":"2024-02-15T22:56:45.880494+0000","last_peered":"2024-02-15T22:56:45.880494+0000","last_clean":"2024-02-15T22:56:45.880494+0000","last_became_active":"2024-02-15T22:56:03.695149+0000","last_became_peered":"2024-02-15T22:56:03.695149+0000","last_unstale":"2024-02-15T22:56:45.880494+0000","last_undegraded":"2024-02-15T22:56:45.880494+0000","last_fullsized":"2024-02-15T22:56:45.880494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:25:29.596967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883783+0000","last_change":"2024-02-15T22:56:05.704460+0000","last_active":"2024-02-15T22:56:45.883783+0000","last_peered":"2024-02-15T22:56:45.883783+0000","last_clean":"2024-02-15T22:56:45.883783+0000","last_became_active":"2024-02-15T22:56:05.704211+0000","last_became_peered":"2024-02-15T22:56:05.704211+0000","last_unstale":"2024-02-15T22:56:45.883783+0000","last_undegraded":"2024-02-15T22:56:45.883783+0000","last_fullsized":"2024-02-15T22:56:45.883783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:32.058815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.412910+0000","last_change":"2024-02-15T22:56:03.700242+0000","last_active":"2024-02-15T22:56:47.412910+0000","last_peered":"2024-02-15T22:56:47.412910+0000","last_clean":"2024-02-15T22:56:47.412910+0000","last_became_active":"2024-02-15T22:56:03.699419+0000","last_became_peered":"2024-02-15T22:56:03.699419+0000","last_unstale":"2024-02-15T22:56:47.412910+0000","last_undegraded":"2024-02-15T22:56:47.412910+0000","last_fullsized":"2024-02-15T22:56:47.412910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880395+0000","last_change":"2024-02-15T22:56:05.711089+0000","last_active":"2024-02-15T22:56:45.880395+0000","last_peered":"2024-02-15T22:56:45.880395+0000","last_clean":"2024-02-15T22:56:45.880395+0000","last_became_active":"2024-02-15T22:56:05.710665+0000","last_became_peered":"2024-02-15T22:56:05.710665+0000","last_unstale":"2024-02-15T22:56:45.880395+0000","last_undegraded":"2024-02-15T22:56:45.880395+0000","last_fullsized":"2024-02-15T22:56:45.880395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878725+0000","last_change":"2024-02-15T22:56:03.706180+0000","last_active":"2024-02-15T22:56:45.878725+0000","last_peered":"2024-02-15T22:56:45.878725+0000","last_clean":"2024-02-15T22:56:45.878725+0000","last_became_active":"2024-02-15T22:56:03.705871+0000","last_became_peered":"2024-02-15T22:56:03.705871+0000","last_unstale":"2024-02-15T22:56:45.878725+0000","last_undegraded":"2024-02-15T22:56:45.878725+0000","last_fullsized":"2024-02-15T22:56:45.878725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:27.775050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907691+0000","last_change":"2024-02-15T22:56:05.705174+0000","last_active":"2024-02-15T22:56:47.907691+0000","last_peered":"2024-02-15T22:56:47.907691+0000","last_clean":"2024-02-15T22:56:47.907691+0000","last_became_active":"2024-02-15T22:56:05.704505+0000","last_became_peered":"2024-02-15T22:56:05.704505+0000","last_unstale":"2024-02-15T22:56:47.907691+0000","last_undegraded":"2024-02-15T22:56:47.907691+0000","last_fullsized":"2024-02-15T22:56:47.907691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:43.641211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878881+0000","last_change":"2024-02-15T22:56:03.706212+0000","last_active":"2024-02-15T22:56:45.878881+0000","last_peered":"2024-02-15T22:56:45.878881+0000","last_clean":"2024-02-15T22:56:45.878881+0000","last_became_active":"2024-02-15T22:56:03.705904+0000","last_became_peered":"2024-02-15T22:56:03.705904+0000","last_unstale":"2024-02-15T22:56:45.878881+0000","last_undegraded":"2024-02-15T22:56:45.878881+0000","last_fullsized":"2024-02-15T22:56:45.878881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878616+0000","last_change":"2024-02-15T22:56:05.713346+0000","last_active":"2024-02-15T22:56:45.878616+0000","last_peered":"2024-02-15T22:56:45.878616+0000","last_clean":"2024-02-15T22:56:45.878616+0000","last_became_active":"2024-02-15T22:56:05.713035+0000","last_became_peered":"2024-02-15T22:56:05.713035+0000","last_unstale":"2024-02-15T22:56:45.878616+0000","last_undegraded":"2024-02-15T22:56:45.878616+0000","last_fullsized":"2024-02-15T22:56:45.878616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883260+0000","last_change":"2024-02-15T22:56:03.696317+0000","last_active":"2024-02-15T22:56:45.883260+0000","last_peered":"2024-02-15T22:56:45.883260+0000","last_clean":"2024-02-15T22:56:45.883260+0000","last_became_active":"2024-02-15T22:56:03.696045+0000","last_became_peered":"2024-02-15T22:56:03.696045+0000","last_unstale":"2024-02-15T22:56:45.883260+0000","last_undegraded":"2024-02-15T22:56:45.883260+0000","last_fullsized":"2024-02-15T22:56:45.883260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:41:52.854353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391060+0000","last_change":"2024-02-15T22:56:05.705005+0000","last_active":"2024-02-15T22:57:35.391060+0000","last_peered":"2024-02-15T22:57:35.391060+0000","last_clean":"2024-02-15T22:57:35.391060+0000","last_became_active":"2024-02-15T22:56:05.704733+0000","last_became_peered":"2024-02-15T22:56:05.704733+0000","last_unstale":"2024-02-15T22:57:35.391060+0000","last_undegraded":"2024-02-15T22:57:35.391060+0000","last_fullsized":"2024-02-15T22:57:35.391060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883670+0000","last_change":"2024-02-15T22:56:03.695753+0000","last_active":"2024-02-15T22:56:45.883670+0000","last_peered":"2024-02-15T22:56:45.883670+0000","last_clean":"2024-02-15T22:56:45.883670+0000","last_became_active":"2024-02-15T22:56:03.695454+0000","last_became_peered":"2024-02-15T22:56:03.695454+0000","last_unstale":"2024-02-15T22:56:45.883670+0000","last_undegraded":"2024-02-15T22:56:45.883670+0000","last_fullsized":"2024-02-15T22:56:45.883670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:51.780374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391086+0000","last_change":"2024-02-15T22:56:05.707756+0000","last_active":"2024-02-15T22:57:35.391086+0000","last_peered":"2024-02-15T22:57:35.391086+0000","last_clean":"2024-02-15T22:57:35.391086+0000","last_became_active":"2024-02-15T22:56:05.707464+0000","last_became_peered":"2024-02-15T22:56:05.707464+0000","last_unstale":"2024-02-15T22:57:35.391086+0000","last_undegraded":"2024-02-15T22:57:35.391086+0000","last_fullsized":"2024-02-15T22:57:35.391086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:48:01.797813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.386901+0000","last_change":"2024-02-15T22:56:03.696562+0000","last_active":"2024-02-15T22:57:35.386901+0000","last_peered":"2024-02-15T22:57:35.386901+0000","last_clean":"2024-02-15T22:57:35.386901+0000","last_became_active":"2024-02-15T22:56:03.696267+0000","last_became_peered":"2024-02-15T22:56:03.696267+0000","last_unstale":"2024-02-15T22:57:35.386901+0000","last_undegraded":"2024-02-15T22:57:35.386901+0000","last_fullsized":"2024-02-15T22:57:35.386901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907693+0000","last_change":"2024-02-15T22:56:05.705880+0000","last_active":"2024-02-15T22:56:47.907693+0000","last_peered":"2024-02-15T22:56:47.907693+0000","last_clean":"2024-02-15T22:56:47.907693+0000","last_became_active":"2024-02-15T22:56:05.705496+0000","last_became_peered":"2024-02-15T22:56:05.705496+0000","last_unstale":"2024-02-15T22:56:47.907693+0000","last_undegraded":"2024-02-15T22:56:47.907693+0000","last_fullsized":"2024-02-15T22:56:47.907693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.375500+0000","last_change":"2024-02-15T22:56:03.707531+0000","last_active":"2024-02-15T22:56:46.375500+0000","last_peered":"2024-02-15T22:56:46.375500+0000","last_clean":"2024-02-15T22:56:46.375500+0000","last_became_active":"2024-02-15T22:56:03.707033+0000","last_became_peered":"2024-02-15T22:56:03.707033+0000","last_unstale":"2024-02-15T22:56:46.375500+0000","last_undegraded":"2024-02-15T22:56:46.375500+0000","last_fullsized":"2024-02-15T22:56:46.375500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:06.046731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881067+0000","last_change":"2024-02-15T22:56:03.706143+0000","last_active":"2024-02-15T22:56:45.881067+0000","last_peered":"2024-02-15T22:56:45.881067+0000","last_clean":"2024-02-15T22:56:45.881067+0000","last_became_active":"2024-02-15T22:56:03.705853+0000","last_became_peered":"2024-02-15T22:56:03.705853+0000","last_unstale":"2024-02-15T22:56:45.881067+0000","last_undegraded":"2024-02-15T22:56:45.881067+0000","last_fullsized":"2024-02-15T22:56:45.881067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:01.198670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391176+0000","last_change":"2024-02-15T22:56:05.699396+0000","last_active":"2024-02-15T22:57:35.391176+0000","last_peered":"2024-02-15T22:57:35.391176+0000","last_clean":"2024-02-15T22:57:35.391176+0000","last_became_active":"2024-02-15T22:56:05.699141+0000","last_became_peered":"2024-02-15T22:56:05.699141+0000","last_unstale":"2024-02-15T22:57:35.391176+0000","last_undegraded":"2024-02-15T22:57:35.391176+0000","last_fullsized":"2024-02-15T22:57:35.391176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:02.890481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879188+0000","last_change":"2024-02-15T22:56:03.700573+0000","last_active":"2024-02-15T22:56:45.879188+0000","last_peered":"2024-02-15T22:56:45.879188+0000","last_clean":"2024-02-15T22:56:45.879188+0000","last_became_active":"2024-02-15T22:56:03.700107+0000","last_became_peered":"2024-02-15T22:56:03.700107+0000","last_unstale":"2024-02-15T22:56:45.879188+0000","last_undegraded":"2024-02-15T22:56:45.879188+0000","last_fullsized":"2024-02-15T22:56:45.879188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879724+0000","last_change":"2024-02-15T22:56:05.713543+0000","last_active":"2024-02-15T22:56:45.879724+0000","last_peered":"2024-02-15T22:56:45.879724+0000","last_clean":"2024-02-15T22:56:45.879724+0000","last_became_active":"2024-02-15T22:56:05.713142+0000","last_became_peered":"2024-02-15T22:56:05.713142+0000","last_unstale":"2024-02-15T22:56:45.879724+0000","last_undegraded":"2024-02-15T22:56:45.879724+0000","last_fullsized":"2024-02-15T22:56:45.879724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:23:08.154056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":46,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672986,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35764,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336076,"statfs":{"total":96636764160,"available":96600141824,"internally_reserved":0,"allocated":438272,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.25}]},{"osd":1,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.28000000000000003}]}]},{"osd":2,"up_from":10,"seq":42949672987,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":978944,"data_stored":722767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.441},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.313}]}]},{"osd":1,"up_from":10,"seq":42949672986,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"last":0.313},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.35699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705689,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.377},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.313}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:57:44.281 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T22:57:44.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.408+0000 7faacd86e640 1 Processor -- start 2024-02-15T22:57:44.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.408+0000 7faacd86e640 1 -- start start 2024-02-15T22:57:44.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.408+0000 7faacd86e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faac812e0b0 0x7faac812e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:44.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.408+0000 7faacd86e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac812dba0 con 0x7faac8098820 2024-02-15T22:57:44.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.408+0000 7faacd86e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac809d790 con 0x7faac812e0b0 2024-02-15T22:57:44.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.409+0000 7faac6ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faac812e0b0 0x7faac812e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:44.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.409+0000 7faac67fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faac8098820 0x7faac8098c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34782/0 (socket says 172.21.15.52:34782) 2024-02-15T22:57:44.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.409+0000 7faac67fc640 1 -- 172.21.15.52:0/3307647043 learned_addr learned my addr 172.21.15.52:0/3307647043 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:44.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.409+0000 7faac6ffd640 1 -- 172.21.15.52:0/3307647043 >> v1:172.21.15.52:6789/0 conn(0x7faac8098820 legacy=0x7faac8098c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:44.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.409+0000 7faac6ffd640 1 -- 172.21.15.52:0/3307647043 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac809a220 con 0x7faac812e0b0 2024-02-15T22:57:44.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.409+0000 7faac5ffb640 1 -- 172.21.15.52:0/3307647043 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265670904 0 0) 0x7faac812dba0 con 0x7faac8098820 2024-02-15T22:57:44.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.410+0000 7faac6ffd640 1 --2- 172.21.15.52:0/3307647043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faac812e0b0 0x7faac812e490 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7faac0009720 tx=0x7faac002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9870440b8384fe1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:44.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.410+0000 7faac5ffb640 1 -- 172.21.15.52:0/3307647043 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faac002e070 con 0x7faac812e0b0 2024-02-15T22:57:44.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.410+0000 7faac5ffb640 1 -- 172.21.15.52:0/3307647043 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac00316d0 con 0x7faac812e0b0 2024-02-15T22:57:44.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.410+0000 7faac5ffb640 1 -- 172.21.15.52:0/3307647043 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faac0031990 con 0x7faac812e0b0 2024-02-15T22:57:44.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.410+0000 7faacd86e640 1 -- 172.21.15.52:0/3307647043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faac812e0b0 msgr2=0x7faac812e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:44.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.410+0000 7faacd86e640 1 --2- 172.21.15.52:0/3307647043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faac812e0b0 0x7faac812e490 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7faac0009720 tx=0x7faac002b840 comp rx=0 tx=0).stop 2024-02-15T22:57:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.410+0000 7faacd86e640 1 -- 172.21.15.52:0/3307647043 shutdown_connections 2024-02-15T22:57:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.410+0000 7faacd86e640 1 --2- 172.21.15.52:0/3307647043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faac812e0b0 0x7faac812e490 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.410+0000 7faacd86e640 1 -- 172.21.15.52:0/3307647043 >> 172.21.15.52:0/3307647043 conn(0x7faac80a0940 msgr2=0x7faac809ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.410+0000 7faacd86e640 1 -- 172.21.15.52:0/3307647043 shutdown_connections 2024-02-15T22:57:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.410+0000 7faacd86e640 1 -- 172.21.15.52:0/3307647043 wait complete. 2024-02-15T22:57:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.411+0000 7faacd86e640 1 Processor -- start 2024-02-15T22:57:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.411+0000 7faacd86e640 1 -- start start 2024-02-15T22:57:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faacd86e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faac8098820 0x7faac806c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faacd86e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac806f3f0 con 0x7faac8098820 2024-02-15T22:57:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faac6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faac8098820 0x7faac806c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faac6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faac8098820 0x7faac806c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33262/0 (socket says 172.21.15.52:33262) 2024-02-15T22:57:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faac6ffd640 1 -- 172.21.15.52:0/1230939536 learned_addr learned my addr 172.21.15.52:0/1230939536 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faac6ffd640 1 -- 172.21.15.52:0/1230939536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0009400 con 0x7faac8098820 2024-02-15T22:57:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faac6ffd640 1 --2- 172.21.15.52:0/1230939536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faac8098820 0x7faac806c1a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7faac0034040 tx=0x7faac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faaaffff640 1 -- 172.21.15.52:0/1230939536 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faac0032830 con 0x7faac8098820 2024-02-15T22:57:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faaaffff640 1 -- 172.21.15.52:0/1230939536 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac0032990 con 0x7faac8098820 2024-02-15T22:57:44.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faacd86e640 1 -- 172.21.15.52:0/1230939536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac806f1b0 con 0x7faac8098820 2024-02-15T22:57:44.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faaaffff640 1 -- 172.21.15.52:0/1230939536 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faac0032c50 con 0x7faac8098820 2024-02-15T22:57:44.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.412+0000 7faacd86e640 1 -- 172.21.15.52:0/1230939536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac8094240 con 0x7faac8098820 2024-02-15T22:57:44.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.413+0000 7faaaffff640 1 -- 172.21.15.52:0/1230939536 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7faac004d3f0 con 0x7faac8098820 2024-02-15T22:57:44.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.413+0000 7faacd86e640 1 -- 172.21.15.52:0/1230939536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac806d710 con 0x7faac8098820 2024-02-15T22:57:44.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.413+0000 7faaaffff640 1 --2- 172.21.15.52:0/1230939536 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faab4037ef0 0x7faab403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:44.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.413+0000 7faaaffff640 1 -- 172.21.15.52:0/1230939536 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7faac006ce50 con 0x7faac8098820 2024-02-15T22:57:44.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.414+0000 7faac67fc640 1 --2- 172.21.15.52:0/1230939536 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faab4037ef0 0x7faab403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:44.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.414+0000 7faac67fc640 1 --2- 172.21.15.52:0/1230939536 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faab4037ef0 0x7faab403a3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faabc000c00 tx=0x7faabc007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:44.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.418+0000 7faaaffff640 1 -- 172.21.15.52:0/1230939536 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faac00302f0 con 0x7faac8098820 2024-02-15T22:57:44.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.597+0000 7faacd86e640 1 -- 172.21.15.52:0/1230939536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faac806f1b0 con 0x7faac8098820 2024-02-15T22:57:44.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.599+0000 7faaaffff640 1 -- 172.21.15.52:0/1230939536 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+21080 (secure 0 0 0) 0x7faac0039ba0 con 0x7faac8098820 2024-02-15T22:57:44.601 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:57:44.602 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":32,"fsid":"81db0e6a-c08b-432e-840e-21ec1a74d746","created":"2024-02-15T22:55:40.454080+0000","modified":"2024-02-15T22:56:45.874529+0000","last_up_change":"2024-02-15T22:55:49.646698+0000","last_in_change":"2024-02-15T22:55:41.529472+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:55:50.841585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-15T22:55:56.053677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-02-15T22:56:01.919336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.440000057220459,"score_stable":1.440000057220459,"optimal_score":1,"raw_score_acting":1.440000057220459,"raw_score_stable":1.440000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-02-15T22:56:04.019583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-02-15T22:56:06.035293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-02-15T22:56:07.782700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-02-15T22:56:09.749170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-02-15T22:56:11.810077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"257a07e8-165d-4ad0-9cf2-429df58aa049","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6801","nonce":431200118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6803","nonce":431200118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6807","nonce":431200118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":431200118},{"type":"v1","addr":"172.21.15.52:6805","nonce":431200118}]},"public_addr":"172.21.15.52:6801/431200118","cluster_addr":"172.21.15.52:6803/431200118","heartbeat_back_addr":"172.21.15.52:6807/431200118","heartbeat_front_addr":"172.21.15.52:6805/431200118","state":["exists","up"]},{"osd":1,"uuid":"5c3aacaf-92b7-4999-acbc-0104cff9c2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6809","nonce":2671624067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6811","nonce":2671624067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6815","nonce":2671624067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2671624067},{"type":"v1","addr":"172.21.15.133:6813","nonce":2671624067}]},"public_addr":"172.21.15.133:6809/2671624067","cluster_addr":"172.21.15.133:6811/2671624067","heartbeat_back_addr":"172.21.15.133:6815/2671624067","heartbeat_front_addr":"172.21.15.133:6813/2671624067","state":["exists","up"]},{"osd":2,"uuid":"49103408-6b04-4a33-a6ed-5fa50f5ba06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6801","nonce":2073628168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6803","nonce":2073628168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6807","nonce":2073628168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2073628168},{"type":"v1","addr":"172.21.15.133:6805","nonce":2073628168}]},"public_addr":"172.21.15.133:6801/2073628168","cluster_addr":"172.21.15.133:6803/2073628168","heartbeat_back_addr":"172.21.15.133:6807/2073628168","heartbeat_front_addr":"172.21.15.133:6805/2073628168","state":["exists","up"]},{"osd":3,"uuid":"280168c8-d5b8-4549-bbf7-a196e7d0dd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6817","nonce":1065500544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6819","nonce":1065500544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6823","nonce":1065500544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1065500544},{"type":"v1","addr":"172.21.15.133:6821","nonce":1065500544}]},"public_addr":"172.21.15.133:6817/1065500544","cluster_addr":"172.21.15.133:6819/1065500544","heartbeat_back_addr":"172.21.15.133:6823/1065500544","heartbeat_front_addr":"172.21.15.133:6821/1065500544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.543998+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.701390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.655590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:55:46.685597+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.35","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"5.2","mappings":[{"from":0,"to":2}]},{"pgid":"5.4","mappings":[{"from":0,"to":2}]},{"pgid":"5.15","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:57:44.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.600+0000 7faacd86e640 1 -- 172.21.15.52:0/1230939536 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faab4037ef0 msgr2=0x7faab403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:44.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.600+0000 7faacd86e640 1 --2- 172.21.15.52:0/1230939536 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faab4037ef0 0x7faab403a3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faabc000c00 tx=0x7faabc007910 comp rx=0 tx=0).stop 2024-02-15T22:57:44.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.600+0000 7faacd86e640 1 -- 172.21.15.52:0/1230939536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faac8098820 msgr2=0x7faac806c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:44.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.600+0000 7faacd86e640 1 --2- 172.21.15.52:0/1230939536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faac8098820 0x7faac806c1a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7faac0034040 tx=0x7faac00046c0 comp rx=0 tx=0).stop 2024-02-15T22:57:44.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.600+0000 7faacd86e640 1 -- 172.21.15.52:0/1230939536 shutdown_connections 2024-02-15T22:57:44.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.601+0000 7faacd86e640 1 --2- 172.21.15.52:0/1230939536 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7faab4037ef0 0x7faab403a3b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:44.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.601+0000 7faacd86e640 1 --2- 172.21.15.52:0/1230939536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faac8098820 0x7faac806c1a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:44.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.601+0000 7faacd86e640 1 -- 172.21.15.52:0/1230939536 >> 172.21.15.52:0/1230939536 conn(0x7faac80a0940 msgr2=0x7faac8096b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:44.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.601+0000 7faacd86e640 1 -- 172.21.15.52:0/1230939536 shutdown_connections 2024-02-15T22:57:44.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:44.601+0000 7faacd86e640 1 -- 172.21.15.52:0/1230939536 wait complete. 2024-02-15T22:57:45.614 INFO:tasks.ceph:Scrubbing osd.0 2024-02-15T22:57:45.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-15T22:57:45.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.728+0000 7fb154e9a640 1 Processor -- start 2024-02-15T22:57:45.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.728+0000 7fb154e9a640 1 -- start start 2024-02-15T22:57:45.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.728+0000 7fb154e9a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb15012e210 0x7fb15012e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:45.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.728+0000 7fb154e9a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb150098e00 con 0x7fb15012eb30 2024-02-15T22:57:45.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.728+0000 7fb154e9a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb15009dd30 con 0x7fb15012e210 2024-02-15T22:57:45.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.728+0000 7fb14e59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb15012e210 0x7fb15012e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.728+0000 7fb14dd9b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb15012eb30 0x7fb15006d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34790/0 (socket says 172.21.15.52:34790) 2024-02-15T22:57:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.728+0000 7fb14dd9b640 1 -- 172.21.15.52:0/3192798974 learned_addr learned my addr 172.21.15.52:0/3192798974 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.729+0000 7fb14e59c640 1 -- 172.21.15.52:0/3192798974 >> v1:172.21.15.52:6789/0 conn(0x7fb15012eb30 legacy=0x7fb15006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.729+0000 7fb14e59c640 1 -- 172.21.15.52:0/3192798974 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15009dea0 con 0x7fb15012e210 2024-02-15T22:57:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.729+0000 7fb14e59c640 1 --2- 172.21.15.52:0/3192798974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15012e210 0x7fb15012e5f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb140009720 tx=0x7fb14002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434dce1a44f62d26 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.729+0000 7fb14d59a640 1 -- 172.21.15.52:0/3192798974 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb14002e070 con 0x7fb15012e210 2024-02-15T22:57:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.730+0000 7fb14d59a640 1 -- 172.21.15.52:0/3192798974 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1400316d0 con 0x7fb15012e210 2024-02-15T22:57:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.730+0000 7fb14d59a640 1 -- 172.21.15.52:0/3192798974 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb140031990 con 0x7fb15012e210 2024-02-15T22:57:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.730+0000 7fb154e9a640 1 -- 172.21.15.52:0/3192798974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15012e210 msgr2=0x7fb15012e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.730+0000 7fb154e9a640 1 --2- 172.21.15.52:0/3192798974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15012e210 0x7fb15012e5f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb140009720 tx=0x7fb14002b840 comp rx=0 tx=0).stop 2024-02-15T22:57:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.730+0000 7fb154e9a640 1 -- 172.21.15.52:0/3192798974 shutdown_connections 2024-02-15T22:57:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.730+0000 7fb154e9a640 1 --2- 172.21.15.52:0/3192798974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15012e210 0x7fb15012e5f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.730+0000 7fb154e9a640 1 -- 172.21.15.52:0/3192798974 >> 172.21.15.52:0/3192798974 conn(0x7fb15009cfd0 msgr2=0x7fb15009d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.730+0000 7fb154e9a640 1 -- 172.21.15.52:0/3192798974 shutdown_connections 2024-02-15T22:57:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.730+0000 7fb154e9a640 1 -- 172.21.15.52:0/3192798974 wait complete. 2024-02-15T22:57:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.731+0000 7fb154e9a640 1 Processor -- start 2024-02-15T22:57:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.731+0000 7fb154e9a640 1 -- start start 2024-02-15T22:57:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb154e9a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15012e210 0x7fb15011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb154e9a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1501208c0 con 0x7fb15012e210 2024-02-15T22:57:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb14e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15012e210 0x7fb15011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb14e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15012e210 0x7fb15011f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33290/0 (socket says 172.21.15.52:33290) 2024-02-15T22:57:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb14e59c640 1 -- 172.21.15.52:0/780731350 learned_addr learned my addr 172.21.15.52:0/780731350 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb14e59c640 1 -- 172.21.15.52:0/780731350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb140009400 con 0x7fb15012e210 2024-02-15T22:57:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb14e59c640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15012e210 0x7fb15011f010 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb140034040 tx=0x7fb1400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb13effd640 1 -- 172.21.15.52:0/780731350 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb140032830 con 0x7fb15012e210 2024-02-15T22:57:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb13effd640 1 -- 172.21.15.52:0/780731350 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140032990 con 0x7fb15012e210 2024-02-15T22:57:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb154e9a640 1 -- 172.21.15.52:0/780731350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb150121a80 con 0x7fb15012e210 2024-02-15T22:57:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb13effd640 1 -- 172.21.15.52:0/780731350 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb140032c50 con 0x7fb15012e210 2024-02-15T22:57:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.732+0000 7fb154e9a640 1 -- 172.21.15.52:0/780731350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb150122160 con 0x7fb15012e210 2024-02-15T22:57:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.733+0000 7fb154e9a640 1 -- 172.21.15.52:0/780731350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb15006ed40 con 0x7fb15012e210 2024-02-15T22:57:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.733+0000 7fb13effd640 1 -- 172.21.15.52:0/780731350 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb14004e450 con 0x7fb15012e210 2024-02-15T22:57:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.733+0000 7fb13effd640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb130037ef0 0x7fb13003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.733+0000 7fb13effd640 1 -- 172.21.15.52:0/780731350 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fb14006d520 con 0x7fb15012e210 2024-02-15T22:57:45.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.734+0000 7fb13effd640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb130043cf0 0x7fb130046190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:45.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.734+0000 7fb13effd640 1 -- 172.21.15.52:0/780731350 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb130046860 con 0x7fb130043cf0 2024-02-15T22:57:45.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.734+0000 7fb13effd640 1 -- 172.21.15.52:0/780731350 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb14006fb90 con 0x7fb15012e210 2024-02-15T22:57:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.734+0000 7fb14dd9b640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb130037ef0 0x7fb13003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.734+0000 7fb14ed9d640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb130043cf0 0x7fb130046190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.734+0000 7fb14ed9d640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb130043cf0 0x7fb130046190 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.734+0000 7fb14dd9b640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb130037ef0 0x7fb13003a3b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb144005880 tx=0x7fb144007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.735+0000 7fb13effd640 1 -- 172.21.15.52:0/780731350 <== osd.0 v2:172.21.15.52:6800/431200118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb130046860 con 0x7fb130043cf0 2024-02-15T22:57:45.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.748+0000 7fb154e9a640 1 -- 172.21.15.52:0/780731350 --> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb150122410 con 0x7fb130043cf0 2024-02-15T22:57:45.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.748+0000 7fb13effd640 1 -- 172.21.15.52:0/780731350 <== osd.0 v2:172.21.15.52:6800/431200118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb150122410 con 0x7fb130043cf0 2024-02-15T22:57:45.751 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-02-15T22:57:45.751 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-15T22:57:45.751 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-02-15T22:57:45.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.748+0000 7fb154e9a640 1 -- 172.21.15.52:0/780731350 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb130043cf0 msgr2=0x7fb130046190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.748+0000 7fb154e9a640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb130043cf0 0x7fb130046190 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.749+0000 7fb154e9a640 1 -- 172.21.15.52:0/780731350 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb130037ef0 msgr2=0x7fb13003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.749+0000 7fb154e9a640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb130037ef0 0x7fb13003a3b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb144005880 tx=0x7fb144007a80 comp rx=0 tx=0).stop 2024-02-15T22:57:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.749+0000 7fb154e9a640 1 -- 172.21.15.52:0/780731350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15012e210 msgr2=0x7fb15011f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.749+0000 7fb154e9a640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15012e210 0x7fb15011f010 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb140034040 tx=0x7fb1400046c0 comp rx=0 tx=0).stop 2024-02-15T22:57:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.749+0000 7fb154e9a640 1 -- 172.21.15.52:0/780731350 shutdown_connections 2024-02-15T22:57:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.749+0000 7fb154e9a640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.52:6800/431200118,v1:172.21.15.52:6801/431200118] conn(0x7fb130043cf0 0x7fb130046190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.749+0000 7fb154e9a640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fb130037ef0 0x7fb13003a3b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.749+0000 7fb154e9a640 1 --2- 172.21.15.52:0/780731350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb15012e210 0x7fb15011f010 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.749+0000 7fb154e9a640 1 -- 172.21.15.52:0/780731350 >> 172.21.15.52:0/780731350 conn(0x7fb15009cfd0 msgr2=0x7fb150070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.749+0000 7fb154e9a640 1 -- 172.21.15.52:0/780731350 shutdown_connections 2024-02-15T22:57:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.749+0000 7fb154e9a640 1 -- 172.21.15.52:0/780731350 wait complete. 2024-02-15T22:57:45.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-15T22:57:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.861+0000 7f1b254d9640 1 Processor -- start 2024-02-15T22:57:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.861+0000 7f1b254d9640 1 -- start start 2024-02-15T22:57:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.861+0000 7f1b254d9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b20130f70 0x7f1b20133360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.861+0000 7f1b254d9640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2006e470 con 0x7f1b2012df80 2024-02-15T22:57:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.861+0000 7f1b254d9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2012dd80 con 0x7f1b20130f70 2024-02-15T22:57:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.861+0000 7f1b17fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b20130f70 0x7f1b20133360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.861+0000 7f1b1effd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1b2012df80 0x7f1b2012e360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34798/0 (socket says 172.21.15.52:34798) 2024-02-15T22:57:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.861+0000 7f1b1effd640 1 -- 172.21.15.52:0/3326263646 learned_addr learned my addr 172.21.15.52:0/3326263646 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:45.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.862+0000 7f1b17fff640 1 -- 172.21.15.52:0/3326263646 >> v1:172.21.15.52:6789/0 conn(0x7f1b2012df80 legacy=0x7f1b2012e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:45.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.862+0000 7f1b17fff640 1 -- 172.21.15.52:0/3326263646 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b20098be0 con 0x7f1b20130f70 2024-02-15T22:57:45.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.862+0000 7f1b1e7fc640 1 -- 172.21.15.52:0/3326263646 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852416311 0 0) 0x7f1b2006e470 con 0x7f1b2012df80 2024-02-15T22:57:45.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.862+0000 7f1b17fff640 1 --2- 172.21.15.52:0/3326263646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b20130f70 0x7f1b20133360 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009720 tx=0x7f1b0802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12725435d625133 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:45.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.862+0000 7f1b1e7fc640 1 -- 172.21.15.52:0/3326263646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b0802e070 con 0x7f1b20130f70 2024-02-15T22:57:45.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.862+0000 7f1b1e7fc640 1 -- 172.21.15.52:0/3326263646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b080316d0 con 0x7f1b20130f70 2024-02-15T22:57:45.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.862+0000 7f1b1e7fc640 1 -- 172.21.15.52:0/3326263646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b08031990 con 0x7f1b20130f70 2024-02-15T22:57:45.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.863+0000 7f1b254d9640 1 -- 172.21.15.52:0/3326263646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b20130f70 msgr2=0x7f1b20133360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:45.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.863+0000 7f1b254d9640 1 --2- 172.21.15.52:0/3326263646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b20130f70 0x7f1b20133360 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009720 tx=0x7f1b0802b840 comp rx=0 tx=0).stop 2024-02-15T22:57:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.863+0000 7f1b254d9640 1 -- 172.21.15.52:0/3326263646 shutdown_connections 2024-02-15T22:57:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.863+0000 7f1b254d9640 1 --2- 172.21.15.52:0/3326263646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b20130f70 0x7f1b20133360 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.863+0000 7f1b254d9640 1 -- 172.21.15.52:0/3326263646 >> 172.21.15.52:0/3326263646 conn(0x7f1b2009d350 msgr2=0x7f1b20071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.863+0000 7f1b254d9640 1 -- 172.21.15.52:0/3326263646 shutdown_connections 2024-02-15T22:57:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.863+0000 7f1b254d9640 1 -- 172.21.15.52:0/3326263646 wait complete. 2024-02-15T22:57:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.864+0000 7f1b254d9640 1 Processor -- start 2024-02-15T22:57:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.864+0000 7f1b254d9640 1 -- start start 2024-02-15T22:57:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.864+0000 7f1b254d9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2012df80 0x7f1b201285e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.864+0000 7f1b254d9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20119270 con 0x7f1b2012df80 2024-02-15T22:57:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.864+0000 7f1b1effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2012df80 0x7f1b201285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.864+0000 7f1b1effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2012df80 0x7f1b201285e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33308/0 (socket says 172.21.15.52:33308) 2024-02-15T22:57:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.864+0000 7f1b1effd640 1 -- 172.21.15.52:0/779496696 learned_addr learned my addr 172.21.15.52:0/779496696 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.865+0000 7f1b1effd640 1 -- 172.21.15.52:0/779496696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b08009400 con 0x7f1b2012df80 2024-02-15T22:57:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.865+0000 7f1b1effd640 1 --2- 172.21.15.52:0/779496696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2012df80 0x7f1b201285e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000c420 tx=0x7f1b1000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.865+0000 7f1b177fe640 1 -- 172.21.15.52:0/779496696 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b100074d0 con 0x7f1b2012df80 2024-02-15T22:57:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.865+0000 7f1b177fe640 1 -- 172.21.15.52:0/779496696 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b10007630 con 0x7f1b2012df80 2024-02-15T22:57:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.865+0000 7f1b254d9640 1 -- 172.21.15.52:0/779496696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b20071460 con 0x7f1b2012df80 2024-02-15T22:57:45.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.865+0000 7f1b177fe640 1 -- 172.21.15.52:0/779496696 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b10004950 con 0x7f1b2012df80 2024-02-15T22:57:45.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.865+0000 7f1b254d9640 1 -- 172.21.15.52:0/779496696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2012ab50 con 0x7f1b2012df80 2024-02-15T22:57:45.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.866+0000 7f1b177fe640 1 -- 172.21.15.52:0/779496696 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1b10004b70 con 0x7f1b2012df80 2024-02-15T22:57:45.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.866+0000 7f1b254d9640 1 -- 172.21.15.52:0/779496696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2012aef0 con 0x7f1b2012df80 2024-02-15T22:57:45.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.866+0000 7f1b177fe640 1 --2- 172.21.15.52:0/779496696 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1b00037ea0 0x7f1b0003a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:45.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.866+0000 7f1b177fe640 1 -- 172.21.15.52:0/779496696 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f1b1004a890 con 0x7f1b2012df80 2024-02-15T22:57:45.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.866+0000 7f1b17fff640 1 --2- 172.21.15.52:0/779496696 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1b00037ea0 0x7f1b0003a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:45.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.867+0000 7f1b17fff640 1 --2- 172.21.15.52:0/779496696 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1b00037ea0 0x7f1b0003a360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1b08036000 tx=0x7f1b08008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:45.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:45.871+0000 7f1b177fe640 1 -- 172.21.15.52:0/779496696 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b1001abe0 con 0x7f1b2012df80 2024-02-15T22:57:46.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.051+0000 7f1b254d9640 1 -- 172.21.15.52:0/779496696 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b20129f40 con 0x7f1b00037ea0 2024-02-15T22:57:46.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.051+0000 7f1b177fe640 1 -- 172.21.15.52:0/779496696 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1b20129f40 con 0x7f1b00037ea0 2024-02-15T22:57:46.054 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2024-02-15T22:57:46.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.054+0000 7f1b254d9640 1 -- 172.21.15.52:0/779496696 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1b00037ea0 msgr2=0x7f1b0003a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.054+0000 7f1b254d9640 1 --2- 172.21.15.52:0/779496696 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1b00037ea0 0x7f1b0003a360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1b08036000 tx=0x7f1b08008030 comp rx=0 tx=0).stop 2024-02-15T22:57:46.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.054+0000 7f1b254d9640 1 -- 172.21.15.52:0/779496696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2012df80 msgr2=0x7f1b201285e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.054+0000 7f1b254d9640 1 --2- 172.21.15.52:0/779496696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2012df80 0x7f1b201285e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000c420 tx=0x7f1b1000c8e0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.054+0000 7f1b254d9640 1 -- 172.21.15.52:0/779496696 shutdown_connections 2024-02-15T22:57:46.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.054+0000 7f1b254d9640 1 --2- 172.21.15.52:0/779496696 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f1b00037ea0 0x7f1b0003a360 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.054+0000 7f1b254d9640 1 --2- 172.21.15.52:0/779496696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2012df80 0x7f1b201285e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.054+0000 7f1b254d9640 1 -- 172.21.15.52:0/779496696 >> 172.21.15.52:0/779496696 conn(0x7f1b2009d350 msgr2=0x7f1b2012ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:46.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.054+0000 7f1b254d9640 1 -- 172.21.15.52:0/779496696 shutdown_connections 2024-02-15T22:57:46.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.054+0000 7f1b254d9640 1 -- 172.21.15.52:0/779496696 wait complete. 2024-02-15T22:57:46.067 INFO:tasks.ceph:Scrubbing osd.1 2024-02-15T22:57:46.067 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-15T22:57:46.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.168+0000 7fcb7948d640 1 Processor -- start 2024-02-15T22:57:46.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.169+0000 7fcb7948d640 1 -- start start 2024-02-15T22:57:46.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.169+0000 7fcb7948d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcb7412de10 0x7fcb74130200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.169+0000 7fcb7948d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7409c0c0 con 0x7fcb7412b060 2024-02-15T22:57:46.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.169+0000 7fcb7948d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7406cfa0 con 0x7fcb7412de10 2024-02-15T22:57:46.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.169+0000 7fcb727fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcb7412de10 0x7fcb74130200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.169+0000 7fcb72ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcb7412b060 0x7fcb7412b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34814/0 (socket says 172.21.15.52:34814) 2024-02-15T22:57:46.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.169+0000 7fcb72ffd640 1 -- 172.21.15.52:0/2764705965 learned_addr learned my addr 172.21.15.52:0/2764705965 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:46.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.169+0000 7fcb727fc640 1 -- 172.21.15.52:0/2764705965 >> v1:172.21.15.52:6789/0 conn(0x7fcb7412b060 legacy=0x7fcb7412b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.169+0000 7fcb727fc640 1 -- 172.21.15.52:0/2764705965 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74093ad0 con 0x7fcb7412de10 2024-02-15T22:57:46.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.170+0000 7fcb727fc640 1 --2- 172.21.15.52:0/2764705965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb7412de10 0x7fcb74130200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009720 tx=0x7fcb6802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966cc0c92218faf1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.170+0000 7fcb71ffb640 1 -- 172.21.15.52:0/2764705965 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb6802e070 con 0x7fcb7412de10 2024-02-15T22:57:46.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.170+0000 7fcb71ffb640 1 -- 172.21.15.52:0/2764705965 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb680316d0 con 0x7fcb7412de10 2024-02-15T22:57:46.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.170+0000 7fcb71ffb640 1 -- 172.21.15.52:0/2764705965 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb68031990 con 0x7fcb7412de10 2024-02-15T22:57:46.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.171+0000 7fcb7948d640 1 -- 172.21.15.52:0/2764705965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb7412de10 msgr2=0x7fcb74130200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.171+0000 7fcb7948d640 1 --2- 172.21.15.52:0/2764705965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb7412de10 0x7fcb74130200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009720 tx=0x7fcb6802b840 comp rx=0 tx=0).stop 2024-02-15T22:57:46.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.171+0000 7fcb7948d640 1 -- 172.21.15.52:0/2764705965 shutdown_connections 2024-02-15T22:57:46.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.171+0000 7fcb7948d640 1 --2- 172.21.15.52:0/2764705965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb7412de10 0x7fcb74130200 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.171+0000 7fcb7948d640 1 -- 172.21.15.52:0/2764705965 >> 172.21.15.52:0/2764705965 conn(0x7fcb7409a290 msgr2=0x7fcb7409a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:46.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.171+0000 7fcb7948d640 1 -- 172.21.15.52:0/2764705965 shutdown_connections 2024-02-15T22:57:46.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.171+0000 7fcb7948d640 1 -- 172.21.15.52:0/2764705965 wait complete. 2024-02-15T22:57:46.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.172+0000 7fcb7948d640 1 Processor -- start 2024-02-15T22:57:46.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.172+0000 7fcb7948d640 1 -- start start 2024-02-15T22:57:46.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.172+0000 7fcb7948d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb7412b060 0x7fcb74094390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.172+0000 7fcb7948d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740707a0 con 0x7fcb7412b060 2024-02-15T22:57:46.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.172+0000 7fcb72ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb7412b060 0x7fcb74094390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.172+0000 7fcb72ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb7412b060 0x7fcb74094390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33328/0 (socket says 172.21.15.52:33328) 2024-02-15T22:57:46.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.172+0000 7fcb72ffd640 1 -- 172.21.15.52:0/363178144 learned_addr learned my addr 172.21.15.52:0/363178144 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:46.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.173+0000 7fcb72ffd640 1 -- 172.21.15.52:0/363178144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68009400 con 0x7fcb7412b060 2024-02-15T22:57:46.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.173+0000 7fcb72ffd640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb7412b060 0x7fcb74094390 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c4a0 tx=0x7fcb6400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.173+0000 7fcb5b7fe640 1 -- 172.21.15.52:0/363178144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb64005c10 con 0x7fcb7412b060 2024-02-15T22:57:46.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.173+0000 7fcb5b7fe640 1 -- 172.21.15.52:0/363178144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb64005d70 con 0x7fcb7412b060 2024-02-15T22:57:46.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.173+0000 7fcb5b7fe640 1 -- 172.21.15.52:0/363178144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb640071a0 con 0x7fcb7412b060 2024-02-15T22:57:46.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.173+0000 7fcb7948d640 1 -- 172.21.15.52:0/363178144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb74070990 con 0x7fcb7412b060 2024-02-15T22:57:46.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.173+0000 7fcb7948d640 1 -- 172.21.15.52:0/363178144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb740974a0 con 0x7fcb7412b060 2024-02-15T22:57:46.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.174+0000 7fcb5b7fe640 1 -- 172.21.15.52:0/363178144 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcb64007300 con 0x7fcb7412b060 2024-02-15T22:57:46.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.174+0000 7fcb7948d640 1 -- 172.21.15.52:0/363178144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb7406c630 con 0x7fcb7412b060 2024-02-15T22:57:46.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.174+0000 7fcb5b7fe640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb60037ef0 0x7fcb6003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.174+0000 7fcb5b7fe640 1 -- 172.21.15.52:0/363178144 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fcb6404a5d0 con 0x7fcb7412b060 2024-02-15T22:57:46.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.174+0000 7fcb5b7fe640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fcb60043d50 0x7fcb600461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.174+0000 7fcb5b7fe640 1 -- 172.21.15.52:0/363178144 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb600468c0 con 0x7fcb60043d50 2024-02-15T22:57:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.174+0000 7fcb5b7fe640 1 -- 172.21.15.52:0/363178144 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb6404cc40 con 0x7fcb7412b060 2024-02-15T22:57:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.174+0000 7fcb727fc640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb60037ef0 0x7fcb6003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.174+0000 7fcb737fe640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fcb60043d50 0x7fcb600461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.175+0000 7fcb737fe640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fcb60043d50 0x7fcb600461f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.175+0000 7fcb727fc640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb60037ef0 0x7fcb6003a3b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcb68036000 tx=0x7fcb68008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.175+0000 7fcb5b7fe640 1 -- 172.21.15.52:0/363178144 <== osd.1 v2:172.21.15.133:6808/2671624067 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcb600468c0 con 0x7fcb60043d50 2024-02-15T22:57:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.189+0000 7fcb7948d640 1 -- 172.21.15.52:0/363178144 --> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb740974a0 con 0x7fcb60043d50 2024-02-15T22:57:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.189+0000 7fcb5b7fe640 1 -- 172.21.15.52:0/363178144 <== osd.1 v2:172.21.15.133:6808/2671624067 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcb740974a0 con 0x7fcb60043d50 2024-02-15T22:57:46.192 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-02-15T22:57:46.192 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-15T22:57:46.193 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-02-15T22:57:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 -- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fcb60043d50 msgr2=0x7fcb600461f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fcb60043d50 0x7fcb600461f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 -- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb60037ef0 msgr2=0x7fcb6003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb60037ef0 0x7fcb6003a3b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcb68036000 tx=0x7fcb68008030 comp rx=0 tx=0).stop 2024-02-15T22:57:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 -- 172.21.15.52:0/363178144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb7412b060 msgr2=0x7fcb74094390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb7412b060 0x7fcb74094390 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c4a0 tx=0x7fcb6400c960 comp rx=0 tx=0).stop 2024-02-15T22:57:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 -- 172.21.15.52:0/363178144 shutdown_connections 2024-02-15T22:57:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6808/2671624067,v1:172.21.15.133:6809/2671624067] conn(0x7fcb60043d50 0x7fcb600461f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fcb60037ef0 0x7fcb6003a3b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 --2- 172.21.15.52:0/363178144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb7412b060 0x7fcb74094390 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 -- 172.21.15.52:0/363178144 >> 172.21.15.52:0/363178144 conn(0x7fcb7409a290 msgr2=0x7fcb7412bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 -- 172.21.15.52:0/363178144 shutdown_connections 2024-02-15T22:57:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.190+0000 7fcb7948d640 1 -- 172.21.15.52:0/363178144 wait complete. 2024-02-15T22:57:46.202 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-15T22:57:46.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.300+0000 7f47ef59d640 1 Processor -- start 2024-02-15T22:57:46.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.300+0000 7f47ef59d640 1 -- start start 2024-02-15T22:57:46.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.301+0000 7f47ef59d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47e806c020 0x7f47e806c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.301+0000 7f47ef59d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e80728e0 con 0x7f47e806c940 2024-02-15T22:57:46.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.301+0000 7f47ef59d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e80961c0 con 0x7f47e806c020 2024-02-15T22:57:46.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.301+0000 7f47ed339640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47e806c020 0x7f47e806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.301+0000 7f47ecb38640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f47e806c940 0x7f47e8132200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34830/0 (socket says 172.21.15.52:34830) 2024-02-15T22:57:46.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.301+0000 7f47ecb38640 1 -- 172.21.15.52:0/2818133857 learned_addr learned my addr 172.21.15.52:0/2818133857 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:46.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.301+0000 7f47ed339640 1 -- 172.21.15.52:0/2818133857 >> v1:172.21.15.52:6789/0 conn(0x7f47e806c940 legacy=0x7f47e8132200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.301+0000 7f47dffff640 1 -- 172.21.15.52:0/2818133857 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844601677 0 0) 0x7f47e80728e0 con 0x7f47e806c940 2024-02-15T22:57:46.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.301+0000 7f47ed339640 1 -- 172.21.15.52:0/2818133857 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e8094090 con 0x7f47e806c020 2024-02-15T22:57:46.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.302+0000 7f47ed339640 1 --2- 172.21.15.52:0/2818133857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e806c020 0x7f47e806c400 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009720 tx=0x7f47e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77baae732375b5a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.302+0000 7f47dffff640 1 -- 172.21.15.52:0/2818133857 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47e402e070 con 0x7f47e806c020 2024-02-15T22:57:46.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.302+0000 7f47dffff640 1 -- 172.21.15.52:0/2818133857 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e40316d0 con 0x7f47e806c020 2024-02-15T22:57:46.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.302+0000 7f47dffff640 1 -- 172.21.15.52:0/2818133857 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47e4031990 con 0x7f47e806c020 2024-02-15T22:57:46.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.303+0000 7f47ef59d640 1 -- 172.21.15.52:0/2818133857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e806c020 msgr2=0x7f47e806c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.303+0000 7f47ef59d640 1 --2- 172.21.15.52:0/2818133857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e806c020 0x7f47e806c400 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009720 tx=0x7f47e402b840 comp rx=0 tx=0).stop 2024-02-15T22:57:46.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.303+0000 7f47ef59d640 1 -- 172.21.15.52:0/2818133857 shutdown_connections 2024-02-15T22:57:46.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.303+0000 7f47ef59d640 1 --2- 172.21.15.52:0/2818133857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e806c020 0x7f47e806c400 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.303+0000 7f47ef59d640 1 -- 172.21.15.52:0/2818133857 >> 172.21.15.52:0/2818133857 conn(0x7f47e809d690 msgr2=0x7f47e8099b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:46.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.303+0000 7f47ef59d640 1 -- 172.21.15.52:0/2818133857 shutdown_connections 2024-02-15T22:57:46.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.303+0000 7f47ef59d640 1 -- 172.21.15.52:0/2818133857 wait complete. 2024-02-15T22:57:46.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.303+0000 7f47ef59d640 1 Processor -- start 2024-02-15T22:57:46.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.304+0000 7f47ef59d640 1 -- start start 2024-02-15T22:57:46.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.304+0000 7f47ef59d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e806c020 0x7f47e81a7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.304+0000 7f47ef59d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81a91c0 con 0x7f47e806c020 2024-02-15T22:57:46.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.304+0000 7f47ed339640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e806c020 0x7f47e81a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.304+0000 7f47ed339640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e806c020 0x7f47e81a7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33348/0 (socket says 172.21.15.52:33348) 2024-02-15T22:57:46.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.304+0000 7f47ed339640 1 -- 172.21.15.52:0/554876062 learned_addr learned my addr 172.21.15.52:0/554876062 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:46.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.304+0000 7f47ed339640 1 -- 172.21.15.52:0/554876062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e4009400 con 0x7f47e806c020 2024-02-15T22:57:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.304+0000 7f47ed339640 1 --2- 172.21.15.52:0/554876062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e806c020 0x7f47e81a7010 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f47e402b880 tx=0x7f47e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.304+0000 7f47ddffb640 1 -- 172.21.15.52:0/554876062 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47e4004160 con 0x7f47e806c020 2024-02-15T22:57:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.304+0000 7f47ddffb640 1 -- 172.21.15.52:0/554876062 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e40042c0 con 0x7f47e806c020 2024-02-15T22:57:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.305+0000 7f47ef59d640 1 -- 172.21.15.52:0/554876062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e81aa250 con 0x7f47e806c020 2024-02-15T22:57:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.305+0000 7f47ddffb640 1 -- 172.21.15.52:0/554876062 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47e4032640 con 0x7f47e806c020 2024-02-15T22:57:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.305+0000 7f47ef59d640 1 -- 172.21.15.52:0/554876062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e81a9410 con 0x7f47e806c020 2024-02-15T22:57:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.306+0000 7f47ddffb640 1 -- 172.21.15.52:0/554876062 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f47e40327a0 con 0x7f47e806c020 2024-02-15T22:57:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.306+0000 7f47ef59d640 1 -- 172.21.15.52:0/554876062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e80627b0 con 0x7f47e806c020 2024-02-15T22:57:46.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.306+0000 7f47ddffb640 1 --2- 172.21.15.52:0/554876062 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f47cc037ef0 0x7f47cc03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.306+0000 7f47ddffb640 1 -- 172.21.15.52:0/554876062 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f47e406d7c0 con 0x7f47e806c020 2024-02-15T22:57:46.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.306+0000 7f47ecb38640 1 --2- 172.21.15.52:0/554876062 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f47cc037ef0 0x7f47cc03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.307+0000 7f47ecb38640 1 --2- 172.21.15.52:0/554876062 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f47cc037ef0 0x7f47cc03a3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f47d8000c00 tx=0x7f47d8007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.310+0000 7f47ddffb640 1 -- 172.21.15.52:0/554876062 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f47e4045390 con 0x7f47e806c020 2024-02-15T22:57:46.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.489+0000 7f47ef59d640 1 -- 172.21.15.52:0/554876062 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f47e809a450 con 0x7f47cc037ef0 2024-02-15T22:57:46.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.490+0000 7f47ddffb640 1 -- 172.21.15.52:0/554876062 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f47d80058d0 con 0x7f47cc037ef0 2024-02-15T22:57:46.493 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2024-02-15T22:57:46.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.492+0000 7f47ef59d640 1 -- 172.21.15.52:0/554876062 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f47cc037ef0 msgr2=0x7f47cc03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.492+0000 7f47ef59d640 1 --2- 172.21.15.52:0/554876062 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f47cc037ef0 0x7f47cc03a3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f47d8000c00 tx=0x7f47d8007970 comp rx=0 tx=0).stop 2024-02-15T22:57:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.492+0000 7f47ef59d640 1 -- 172.21.15.52:0/554876062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e806c020 msgr2=0x7f47e81a7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.492+0000 7f47ef59d640 1 --2- 172.21.15.52:0/554876062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e806c020 0x7f47e81a7010 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f47e402b880 tx=0x7f47e40046c0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.492+0000 7f47ef59d640 1 -- 172.21.15.52:0/554876062 shutdown_connections 2024-02-15T22:57:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.492+0000 7f47ef59d640 1 --2- 172.21.15.52:0/554876062 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f47cc037ef0 0x7f47cc03a3b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.492+0000 7f47ef59d640 1 --2- 172.21.15.52:0/554876062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e806c020 0x7f47e81a7010 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.492+0000 7f47ef59d640 1 -- 172.21.15.52:0/554876062 >> 172.21.15.52:0/554876062 conn(0x7f47e809d690 msgr2=0x7f47e8090a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:46.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.492+0000 7f47ef59d640 1 -- 172.21.15.52:0/554876062 shutdown_connections 2024-02-15T22:57:46.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.492+0000 7f47ef59d640 1 -- 172.21.15.52:0/554876062 wait complete. 2024-02-15T22:57:46.505 INFO:tasks.ceph:Scrubbing osd.2 2024-02-15T22:57:46.505 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-15T22:57:46.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.607+0000 7fe189089640 1 Processor -- start 2024-02-15T22:57:46.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.607+0000 7fe189089640 1 -- start start 2024-02-15T22:57:46.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.607+0000 7fe189089640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe184098000 0x7fe1840983e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.607+0000 7fe189089640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18409a7d0 con 0x7fe184098920 2024-02-15T22:57:46.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.607+0000 7fe189089640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe184099a60 con 0x7fe184098000 2024-02-15T22:57:46.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.607+0000 7fe182d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe184098000 0x7fe1840983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.607+0000 7fe18259c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe184098920 0x7fe18412ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34840/0 (socket says 172.21.15.52:34840) 2024-02-15T22:57:46.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.607+0000 7fe18259c640 1 -- 172.21.15.52:0/530165827 learned_addr learned my addr 172.21.15.52:0/530165827 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:46.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.607+0000 7fe182d9d640 1 -- 172.21.15.52:0/530165827 >> v1:172.21.15.52:6789/0 conn(0x7fe184098920 legacy=0x7fe18412ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.607+0000 7fe182d9d640 1 -- 172.21.15.52:0/530165827 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18409a4c0 con 0x7fe184098000 2024-02-15T22:57:46.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.608+0000 7fe182d9d640 1 --2- 172.21.15.52:0/530165827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184098000 0x7fe1840983e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe174009720 tx=0x7fe17402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a767a16c6bb79a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.608+0000 7fe181d9b640 1 -- 172.21.15.52:0/530165827 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe17402e070 con 0x7fe184098000 2024-02-15T22:57:46.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.608+0000 7fe181d9b640 1 -- 172.21.15.52:0/530165827 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1740316d0 con 0x7fe184098000 2024-02-15T22:57:46.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.608+0000 7fe181d9b640 1 -- 172.21.15.52:0/530165827 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe174031990 con 0x7fe184098000 2024-02-15T22:57:46.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.609+0000 7fe189089640 1 -- 172.21.15.52:0/530165827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184098000 msgr2=0x7fe1840983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.609+0000 7fe189089640 1 --2- 172.21.15.52:0/530165827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184098000 0x7fe1840983e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe174009720 tx=0x7fe17402b840 comp rx=0 tx=0).stop 2024-02-15T22:57:46.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.609+0000 7fe189089640 1 -- 172.21.15.52:0/530165827 shutdown_connections 2024-02-15T22:57:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.609+0000 7fe189089640 1 --2- 172.21.15.52:0/530165827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184098000 0x7fe1840983e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.609+0000 7fe189089640 1 -- 172.21.15.52:0/530165827 >> 172.21.15.52:0/530165827 conn(0x7fe1840a07a0 msgr2=0x7fe1840a0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.609+0000 7fe189089640 1 -- 172.21.15.52:0/530165827 shutdown_connections 2024-02-15T22:57:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.609+0000 7fe189089640 1 -- 172.21.15.52:0/530165827 wait complete. 2024-02-15T22:57:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.610+0000 7fe189089640 1 Processor -- start 2024-02-15T22:57:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.610+0000 7fe189089640 1 -- start start 2024-02-15T22:57:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.610+0000 7fe189089640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184098000 0x7fe1841285c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.610+0000 7fe189089640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18412a990 con 0x7fe184098000 2024-02-15T22:57:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.610+0000 7fe182d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184098000 0x7fe1841285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.610+0000 7fe182d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184098000 0x7fe1841285c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33368/0 (socket says 172.21.15.52:33368) 2024-02-15T22:57:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.610+0000 7fe182d9d640 1 -- 172.21.15.52:0/4232857839 learned_addr learned my addr 172.21.15.52:0/4232857839 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.611+0000 7fe182d9d640 1 -- 172.21.15.52:0/4232857839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174009400 con 0x7fe184098000 2024-02-15T22:57:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.611+0000 7fe182d9d640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184098000 0x7fe1841285c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe17402b880 tx=0x7fe1740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.611+0000 7fe16b7fe640 1 -- 172.21.15.52:0/4232857839 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe174031ec0 con 0x7fe184098000 2024-02-15T22:57:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.611+0000 7fe16b7fe640 1 -- 172.21.15.52:0/4232857839 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe174032a10 con 0x7fe184098000 2024-02-15T22:57:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.611+0000 7fe189089640 1 -- 172.21.15.52:0/4232857839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18412b590 con 0x7fe184098000 2024-02-15T22:57:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.611+0000 7fe16b7fe640 1 -- 172.21.15.52:0/4232857839 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe174032cb0 con 0x7fe184098000 2024-02-15T22:57:46.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.611+0000 7fe189089640 1 -- 172.21.15.52:0/4232857839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18412ad60 con 0x7fe184098000 2024-02-15T22:57:46.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.612+0000 7fe16b7fe640 1 -- 172.21.15.52:0/4232857839 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe17404d3f0 con 0x7fe184098000 2024-02-15T22:57:46.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.612+0000 7fe189089640 1 -- 172.21.15.52:0/4232857839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe18408e470 con 0x7fe184098000 2024-02-15T22:57:46.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.612+0000 7fe16b7fe640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe170037ef0 0x7fe17003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.612+0000 7fe16b7fe640 1 -- 172.21.15.52:0/4232857839 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fe17406d200 con 0x7fe184098000 2024-02-15T22:57:46.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.612+0000 7fe16b7fe640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe170043c70 0x7fe170046110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.612+0000 7fe16b7fe640 1 -- 172.21.15.52:0/4232857839 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1700467e0 con 0x7fe170043c70 2024-02-15T22:57:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.612+0000 7fe16b7fe640 1 -- 172.21.15.52:0/4232857839 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe174032e10 con 0x7fe184098000 2024-02-15T22:57:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.612+0000 7fe18259c640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe170037ef0 0x7fe17003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.612+0000 7fe18359e640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe170043c70 0x7fe170046110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.613+0000 7fe18359e640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe170043c70 0x7fe170046110 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.613+0000 7fe18259c640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe170037ef0 0x7fe17003a3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe178000f60 tx=0x7fe178007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.614+0000 7fe16b7fe640 1 -- 172.21.15.52:0/4232857839 <== osd.2 v2:172.21.15.133:6800/2073628168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe1700467e0 con 0x7fe170043c70 2024-02-15T22:57:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.627+0000 7fe189089640 1 -- 172.21.15.52:0/4232857839 --> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe18412e4c0 con 0x7fe170043c70 2024-02-15T22:57:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.627+0000 7fe16b7fe640 1 -- 172.21.15.52:0/4232857839 <== osd.2 v2:172.21.15.133:6800/2073628168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe17c011040 con 0x7fe170043c70 2024-02-15T22:57:46.630 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-02-15T22:57:46.630 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-15T22:57:46.630 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-02-15T22:57:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.627+0000 7fe189089640 1 -- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe170043c70 msgr2=0x7fe170046110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.627+0000 7fe189089640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe170043c70 0x7fe170046110 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.627+0000 7fe189089640 1 -- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe170037ef0 msgr2=0x7fe17003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.627+0000 7fe189089640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe170037ef0 0x7fe17003a3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe178000f60 tx=0x7fe178007a80 comp rx=0 tx=0).stop 2024-02-15T22:57:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.627+0000 7fe189089640 1 -- 172.21.15.52:0/4232857839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184098000 msgr2=0x7fe1841285c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.627+0000 7fe189089640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184098000 0x7fe1841285c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe17402b880 tx=0x7fe1740046c0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.628+0000 7fe189089640 1 -- 172.21.15.52:0/4232857839 shutdown_connections 2024-02-15T22:57:46.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.628+0000 7fe189089640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6800/2073628168,v1:172.21.15.133:6801/2073628168] conn(0x7fe170043c70 0x7fe170046110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.628+0000 7fe189089640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe170037ef0 0x7fe17003a3b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.628+0000 7fe189089640 1 --2- 172.21.15.52:0/4232857839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe184098000 0x7fe1841285c0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.628+0000 7fe189089640 1 -- 172.21.15.52:0/4232857839 >> 172.21.15.52:0/4232857839 conn(0x7fe1840a07a0 msgr2=0x7fe18406e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:46.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.628+0000 7fe189089640 1 -- 172.21.15.52:0/4232857839 shutdown_connections 2024-02-15T22:57:46.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.628+0000 7fe189089640 1 -- 172.21.15.52:0/4232857839 wait complete. 2024-02-15T22:57:46.640 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-15T22:57:46.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.739+0000 7f36a5d32640 1 Processor -- start 2024-02-15T22:57:46.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.739+0000 7f36a5d32640 1 -- start start 2024-02-15T22:57:46.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.739+0000 7f36a5d32640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36a006cb10 0x7f36a0133420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.739+0000 7f36a5d32640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a009a940 con 0x7f36a006c020 2024-02-15T22:57:46.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.739+0000 7f36a5d32640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a00672e0 con 0x7f36a006cb10 2024-02-15T22:57:46.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.740+0000 7f369effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36a006cb10 0x7f36a0133420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.740+0000 7f369effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36a006cb10 0x7f36a0133420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33384/0 (socket says 172.21.15.52:33384) 2024-02-15T22:57:46.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.740+0000 7f369effd640 1 -- 172.21.15.52:0/2503188246 learned_addr learned my addr 172.21.15.52:0/2503188246 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:46.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.740+0000 7f369f7fe640 1 --1- 172.21.15.52:0/2503188246 >> v1:172.21.15.52:6789/0 conn(0x7f36a006c020 0x7f36a006c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34856/0 (socket says 172.21.15.52:34856) 2024-02-15T22:57:46.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.740+0000 7f369effd640 1 -- 172.21.15.52:0/2503188246 >> v1:172.21.15.52:6789/0 conn(0x7f36a006c020 legacy=0x7f36a006c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.740+0000 7f369effd640 1 -- 172.21.15.52:0/2503188246 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a0095fd0 con 0x7f36a006cb10 2024-02-15T22:57:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.741+0000 7f369effd640 1 --2- 172.21.15.52:0/2503188246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a006cb10 0x7f36a0133420 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f36940097f0 tx=0x7f369402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb67870426072239 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.741+0000 7f369e7fc640 1 -- 172.21.15.52:0/2503188246 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36940317a0 con 0x7f36a006cb10 2024-02-15T22:57:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.741+0000 7f369e7fc640 1 -- 172.21.15.52:0/2503188246 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694031900 con 0x7f36a006cb10 2024-02-15T22:57:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.741+0000 7f369e7fc640 1 -- 172.21.15.52:0/2503188246 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3694031bc0 con 0x7f36a006cb10 2024-02-15T22:57:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.741+0000 7f36a5d32640 1 -- 172.21.15.52:0/2503188246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a006cb10 msgr2=0x7f36a0133420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.741+0000 7f36a5d32640 1 --2- 172.21.15.52:0/2503188246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a006cb10 0x7f36a0133420 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f36940097f0 tx=0x7f369402b910 comp rx=0 tx=0).stop 2024-02-15T22:57:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.741+0000 7f36a5d32640 1 -- 172.21.15.52:0/2503188246 shutdown_connections 2024-02-15T22:57:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.741+0000 7f36a5d32640 1 --2- 172.21.15.52:0/2503188246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a006cb10 0x7f36a0133420 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.741+0000 7f36a5d32640 1 -- 172.21.15.52:0/2503188246 >> 172.21.15.52:0/2503188246 conn(0x7f36a009d690 msgr2=0x7f36a0099b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.741+0000 7f36a5d32640 1 -- 172.21.15.52:0/2503188246 shutdown_connections 2024-02-15T22:57:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.741+0000 7f36a5d32640 1 -- 172.21.15.52:0/2503188246 wait complete. 2024-02-15T22:57:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.742+0000 7f36a5d32640 1 Processor -- start 2024-02-15T22:57:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.742+0000 7f36a5d32640 1 -- start start 2024-02-15T22:57:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f36a5d32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a006c020 0x7f36a01c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f36a5d32640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a0123610 con 0x7f36a006c020 2024-02-15T22:57:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f369f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a006c020 0x7f36a01c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f369f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a006c020 0x7f36a01c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33386/0 (socket says 172.21.15.52:33386) 2024-02-15T22:57:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f369f7fe640 1 -- 172.21.15.52:0/3339714149 learned_addr learned my addr 172.21.15.52:0/3339714149 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f369f7fe640 1 -- 172.21.15.52:0/3339714149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940094d0 con 0x7f36a006c020 2024-02-15T22:57:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f369f7fe640 1 --2- 172.21.15.52:0/3339714149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a006c020 0x7f36a01c2b00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f369000c450 tx=0x7f369000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f3687fff640 1 -- 172.21.15.52:0/3339714149 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3690007410 con 0x7f36a006c020 2024-02-15T22:57:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f3687fff640 1 -- 172.21.15.52:0/3339714149 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3690007570 con 0x7f36a006c020 2024-02-15T22:57:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f3687fff640 1 -- 172.21.15.52:0/3339714149 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3690004910 con 0x7f36a006c020 2024-02-15T22:57:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f36a5d32640 1 -- 172.21.15.52:0/3339714149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a01240c0 con 0x7f36a006c020 2024-02-15T22:57:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.743+0000 7f36a5d32640 1 -- 172.21.15.52:0/3339714149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a01237f0 con 0x7f36a006c020 2024-02-15T22:57:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.744+0000 7f3687fff640 1 -- 172.21.15.52:0/3339714149 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3690004a70 con 0x7f36a006c020 2024-02-15T22:57:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.744+0000 7f3687fff640 1 --2- 172.21.15.52:0/3339714149 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f368c037ef0 0x7f368c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.744+0000 7f3687fff640 1 -- 172.21.15.52:0/3339714149 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f369004ac80 con 0x7f36a006c020 2024-02-15T22:57:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.744+0000 7f36a5d32640 1 -- 172.21.15.52:0/3339714149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a00627b0 con 0x7f36a006c020 2024-02-15T22:57:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.745+0000 7f369effd640 1 --2- 172.21.15.52:0/3339714149 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f368c037ef0 0x7f368c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.745+0000 7f369effd640 1 --2- 172.21.15.52:0/3339714149 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f368c037ef0 0x7f368c03a3b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f36940097f0 tx=0x7f3694008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.749+0000 7f3687fff640 1 -- 172.21.15.52:0/3339714149 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36900192c0 con 0x7f36a006c020 2024-02-15T22:57:46.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.928+0000 7f36a5d32640 1 -- 172.21.15.52:0/3339714149 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f36a0122b80 con 0x7f368c037ef0 2024-02-15T22:57:46.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.929+0000 7f3687fff640 1 -- 172.21.15.52:0/3339714149 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3694031790 con 0x7f368c037ef0 2024-02-15T22:57:46.932 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2024-02-15T22:57:46.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.931+0000 7f36a5d32640 1 -- 172.21.15.52:0/3339714149 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f368c037ef0 msgr2=0x7f368c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.931+0000 7f36a5d32640 1 --2- 172.21.15.52:0/3339714149 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f368c037ef0 0x7f368c03a3b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f36940097f0 tx=0x7f3694008030 comp rx=0 tx=0).stop 2024-02-15T22:57:46.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.931+0000 7f36a5d32640 1 -- 172.21.15.52:0/3339714149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a006c020 msgr2=0x7f36a01c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:46.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.931+0000 7f36a5d32640 1 --2- 172.21.15.52:0/3339714149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a006c020 0x7f36a01c2b00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f369000c450 tx=0x7f369000c910 comp rx=0 tx=0).stop 2024-02-15T22:57:46.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.931+0000 7f36a5d32640 1 -- 172.21.15.52:0/3339714149 shutdown_connections 2024-02-15T22:57:46.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.931+0000 7f36a5d32640 1 --2- 172.21.15.52:0/3339714149 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f368c037ef0 0x7f368c03a3b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.931+0000 7f36a5d32640 1 --2- 172.21.15.52:0/3339714149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a006c020 0x7f36a01c2b00 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:46.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.931+0000 7f36a5d32640 1 -- 172.21.15.52:0/3339714149 >> 172.21.15.52:0/3339714149 conn(0x7f36a009d690 msgr2=0x7f36a0132430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:46.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.932+0000 7f36a5d32640 1 -- 172.21.15.52:0/3339714149 shutdown_connections 2024-02-15T22:57:46.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:46.932+0000 7f36a5d32640 1 -- 172.21.15.52:0/3339714149 wait complete. 2024-02-15T22:57:46.944 INFO:tasks.ceph:Scrubbing osd.3 2024-02-15T22:57:46.945 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-15T22:57:47.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.047+0000 7f22f99d6640 1 Processor -- start 2024-02-15T22:57:47.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.047+0000 7f22f99d6640 1 -- start start 2024-02-15T22:57:47.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.047+0000 7f22f99d6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22f406c020 0x7f22f406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:47.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.047+0000 7f22f99d6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f40723a0 con 0x7f22f406c940 2024-02-15T22:57:47.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.047+0000 7f22f99d6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f4094f50 con 0x7f22f406c020 2024-02-15T22:57:47.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.047+0000 7f22f2ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22f406c020 0x7f22f406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:47.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.047+0000 7f22ebfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f22f406c940 0x7f22f412e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34866/0 (socket says 172.21.15.52:34866) 2024-02-15T22:57:47.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.047+0000 7f22ebfff640 1 -- 172.21.15.52:0/3562639673 learned_addr learned my addr 172.21.15.52:0/3562639673 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:47.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.048+0000 7f22f2ffd640 1 -- 172.21.15.52:0/3562639673 >> v1:172.21.15.52:6789/0 conn(0x7f22f406c940 legacy=0x7f22f412e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.048+0000 7f22f2ffd640 1 -- 172.21.15.52:0/3562639673 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4071b90 con 0x7f22f406c020 2024-02-15T22:57:47.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.048+0000 7f22f27fc640 1 -- 172.21.15.52:0/3562639673 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078730853 0 0) 0x7f22f40723a0 con 0x7f22f406c940 2024-02-15T22:57:47.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.048+0000 7f22f2ffd640 1 --2- 172.21.15.52:0/3562639673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22f406c020 0x7f22f406c400 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009720 tx=0x7f22e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7942dd6c44dc32e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:47.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.049+0000 7f22f27fc640 1 -- 172.21.15.52:0/3562639673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22e4031760 con 0x7f22f406c020 2024-02-15T22:57:47.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.049+0000 7f22f27fc640 1 -- 172.21.15.52:0/3562639673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e40318c0 con 0x7f22f406c020 2024-02-15T22:57:47.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.049+0000 7f22f27fc640 1 -- 172.21.15.52:0/3562639673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22e4031b80 con 0x7f22f406c020 2024-02-15T22:57:47.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.049+0000 7f22f99d6640 1 -- 172.21.15.52:0/3562639673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22f406c020 msgr2=0x7f22f406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.049+0000 7f22f99d6640 1 --2- 172.21.15.52:0/3562639673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22f406c020 0x7f22f406c400 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009720 tx=0x7f22e402b8d0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.049+0000 7f22f99d6640 1 -- 172.21.15.52:0/3562639673 shutdown_connections 2024-02-15T22:57:47.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.049+0000 7f22f99d6640 1 --2- 172.21.15.52:0/3562639673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22f406c020 0x7f22f406c400 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.049+0000 7f22f99d6640 1 -- 172.21.15.52:0/3562639673 >> 172.21.15.52:0/3562639673 conn(0x7f22f409d480 msgr2=0x7f22f409d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:47.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.049+0000 7f22f99d6640 1 -- 172.21.15.52:0/3562639673 shutdown_connections 2024-02-15T22:57:47.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.049+0000 7f22f99d6640 1 -- 172.21.15.52:0/3562639673 wait complete. 2024-02-15T22:57:47.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.050+0000 7f22f99d6640 1 Processor -- start 2024-02-15T22:57:47.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.050+0000 7f22f99d6640 1 -- start start 2024-02-15T22:57:47.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.050+0000 7f22f99d6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22f406c020 0x7f22f4122120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:47.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.050+0000 7f22f99d6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f4123cb0 con 0x7f22f406c020 2024-02-15T22:57:47.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.050+0000 7f22f2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22f406c020 0x7f22f4122120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:47.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.050+0000 7f22f2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22f406c020 0x7f22f4122120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33404/0 (socket says 172.21.15.52:33404) 2024-02-15T22:57:47.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.050+0000 7f22f2ffd640 1 -- 172.21.15.52:0/1010954081 learned_addr learned my addr 172.21.15.52:0/1010954081 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:47.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.051+0000 7f22f2ffd640 1 -- 172.21.15.52:0/1010954081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e4009400 con 0x7f22f406c020 2024-02-15T22:57:47.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.051+0000 7f22f2ffd640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22f406c020 0x7f22f4122120 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009720 tx=0x7f22e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:47.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.051+0000 7f22f0ff9640 1 -- 172.21.15.52:0/1010954081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22e403cb90 con 0x7f22f406c020 2024-02-15T22:57:47.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.051+0000 7f22f0ff9640 1 -- 172.21.15.52:0/1010954081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e403ccf0 con 0x7f22f406c020 2024-02-15T22:57:47.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.051+0000 7f22f99d6640 1 -- 172.21.15.52:0/1010954081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f406cea0 con 0x7f22f406c020 2024-02-15T22:57:47.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.051+0000 7f22f0ff9640 1 -- 172.21.15.52:0/1010954081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22e4004030 con 0x7f22f406c020 2024-02-15T22:57:47.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.051+0000 7f22f99d6640 1 -- 172.21.15.52:0/1010954081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f4093050 con 0x7f22f406c020 2024-02-15T22:57:47.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.052+0000 7f22f0ff9640 1 -- 172.21.15.52:0/1010954081 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f22e4004190 con 0x7f22f406c020 2024-02-15T22:57:47.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.052+0000 7f22f99d6640 1 -- 172.21.15.52:0/1010954081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22f409a8e0 con 0x7f22f406c020 2024-02-15T22:57:47.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.052+0000 7f22f0ff9640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f22d4037ef0 0x7f22d403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:47.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.052+0000 7f22f0ff9640 1 -- 172.21.15.52:0/1010954081 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f22e406dca0 con 0x7f22f406c020 2024-02-15T22:57:47.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.052+0000 7f22f0ff9640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f22d4043cd0 0x7f22d4046170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:47.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.052+0000 7f22f0ff9640 1 -- 172.21.15.52:0/1010954081 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22d4046840 con 0x7f22d4043cd0 2024-02-15T22:57:47.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.052+0000 7f22f0ff9640 1 -- 172.21.15.52:0/1010954081 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22e4045760 con 0x7f22f406c020 2024-02-15T22:57:47.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.052+0000 7f22ebfff640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f22d4037ef0 0x7f22d403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:47.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.052+0000 7f22f37fe640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f22d4043cd0 0x7f22d4046170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:47.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.053+0000 7f22f37fe640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f22d4043cd0 0x7f22d4046170 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:47.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.053+0000 7f22ebfff640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f22d4037ef0 0x7f22d403a3b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f22dc000c00 tx=0x7f22dc007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:47.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.054+0000 7f22f0ff9640 1 -- 172.21.15.52:0/1010954081 <== osd.3 v2:172.21.15.133:6816/1065500544 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f22d4046840 con 0x7f22d4043cd0 2024-02-15T22:57:47.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.067+0000 7f22f99d6640 1 -- 172.21.15.52:0/1010954081 --> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22f4099900 con 0x7f22d4043cd0 2024-02-15T22:57:47.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.067+0000 7f22f0ff9640 1 -- 172.21.15.52:0/1010954081 <== osd.3 v2:172.21.15.133:6816/1065500544 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f22f4099900 con 0x7f22d4043cd0 2024-02-15T22:57:47.070 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-02-15T22:57:47.070 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-15T22:57:47.070 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-02-15T22:57:47.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 -- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f22d4043cd0 msgr2=0x7f22d4046170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f22d4043cd0 0x7f22d4046170 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 -- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f22d4037ef0 msgr2=0x7f22d403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f22d4037ef0 0x7f22d403a3b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f22dc000c00 tx=0x7f22dc007910 comp rx=0 tx=0).stop 2024-02-15T22:57:47.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 -- 172.21.15.52:0/1010954081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22f406c020 msgr2=0x7f22f4122120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22f406c020 0x7f22f4122120 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009720 tx=0x7f22e40046c0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 -- 172.21.15.52:0/1010954081 shutdown_connections 2024-02-15T22:57:47.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6816/1065500544,v1:172.21.15.133:6817/1065500544] conn(0x7f22d4043cd0 0x7f22d4046170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f22d4037ef0 0x7f22d403a3b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 --2- 172.21.15.52:0/1010954081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22f406c020 0x7f22f4122120 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 -- 172.21.15.52:0/1010954081 >> 172.21.15.52:0/1010954081 conn(0x7f22f409d480 msgr2=0x7f22f4093840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:47.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 -- 172.21.15.52:0/1010954081 shutdown_connections 2024-02-15T22:57:47.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.068+0000 7f22f99d6640 1 -- 172.21.15.52:0/1010954081 wait complete. 2024-02-15T22:57:47.080 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-15T22:57:47.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.179+0000 7ff4c93ed640 1 Processor -- start 2024-02-15T22:57:47.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.180+0000 7ff4c93ed640 1 -- start start 2024-02-15T22:57:47.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.180+0000 7ff4c93ed640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4c412af10 0x7ff4c412b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:47.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.180+0000 7ff4c93ed640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c4072220 con 0x7ff4c4095020 2024-02-15T22:57:47.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.180+0000 7ff4c93ed640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c406cc30 con 0x7ff4c412af10 2024-02-15T22:57:47.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.180+0000 7ff4c2ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4c412af10 0x7ff4c412b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:47.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.180+0000 7ff4c27fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff4c4095020 0x7ff4c4095440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34880/0 (socket says 172.21.15.52:34880) 2024-02-15T22:57:47.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.180+0000 7ff4c27fc640 1 -- 172.21.15.52:0/3200111371 learned_addr learned my addr 172.21.15.52:0/3200111371 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:47.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.180+0000 7ff4c2ffd640 1 -- 172.21.15.52:0/3200111371 >> v1:172.21.15.52:6789/0 conn(0x7ff4c4095020 legacy=0x7ff4c4095440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.180+0000 7ff4c2ffd640 1 -- 172.21.15.52:0/3200111371 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c412aae0 con 0x7ff4c412af10 2024-02-15T22:57:47.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.181+0000 7ff4c2ffd640 1 --2- 172.21.15.52:0/3200111371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c412af10 0x7ff4c412b2f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009720 tx=0x7ff4b402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513f39fad6f5177 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:47.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.181+0000 7ff4c1ffb640 1 -- 172.21.15.52:0/3200111371 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4b402e070 con 0x7ff4c412af10 2024-02-15T22:57:47.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.181+0000 7ff4c1ffb640 1 -- 172.21.15.52:0/3200111371 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b40316d0 con 0x7ff4c412af10 2024-02-15T22:57:47.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.181+0000 7ff4c1ffb640 1 -- 172.21.15.52:0/3200111371 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4b4031990 con 0x7ff4c412af10 2024-02-15T22:57:47.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.182+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3200111371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c412af10 msgr2=0x7ff4c412b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.182+0000 7ff4c93ed640 1 --2- 172.21.15.52:0/3200111371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c412af10 0x7ff4c412b2f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009720 tx=0x7ff4b402b840 comp rx=0 tx=0).stop 2024-02-15T22:57:47.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.182+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3200111371 shutdown_connections 2024-02-15T22:57:47.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.182+0000 7ff4c93ed640 1 --2- 172.21.15.52:0/3200111371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c412af10 0x7ff4c412b2f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.182+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3200111371 >> 172.21.15.52:0/3200111371 conn(0x7ff4c409a050 msgr2=0x7ff4c409a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:47.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.182+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3200111371 shutdown_connections 2024-02-15T22:57:47.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.182+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3200111371 wait complete. 2024-02-15T22:57:47.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.183+0000 7ff4c93ed640 1 Processor -- start 2024-02-15T22:57:47.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.183+0000 7ff4c93ed640 1 -- start start 2024-02-15T22:57:47.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.183+0000 7ff4c93ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c4095020 0x7ff4c4123500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:47.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.183+0000 7ff4c93ed640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c406d570 con 0x7ff4c4095020 2024-02-15T22:57:47.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.183+0000 7ff4c2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c4095020 0x7ff4c4123500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:47.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.183+0000 7ff4c2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c4095020 0x7ff4c4123500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33416/0 (socket says 172.21.15.52:33416) 2024-02-15T22:57:47.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.183+0000 7ff4c2ffd640 1 -- 172.21.15.52:0/3164112862 learned_addr learned my addr 172.21.15.52:0/3164112862 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:47.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.183+0000 7ff4c2ffd640 1 -- 172.21.15.52:0/3164112862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b4009400 con 0x7ff4c4095020 2024-02-15T22:57:47.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.184+0000 7ff4c2ffd640 1 --2- 172.21.15.52:0/3164112862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c4095020 0x7ff4c4123500 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009840 tx=0x7ff4b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:47.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.184+0000 7ff4ab7fe640 1 -- 172.21.15.52:0/3164112862 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4b40328b0 con 0x7ff4c4095020 2024-02-15T22:57:47.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.184+0000 7ff4ab7fe640 1 -- 172.21.15.52:0/3164112862 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4032a10 con 0x7ff4c4095020 2024-02-15T22:57:47.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.184+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3164112862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c4124340 con 0x7ff4c4095020 2024-02-15T22:57:47.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.184+0000 7ff4ab7fe640 1 -- 172.21.15.52:0/3164112862 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4b4032cf0 con 0x7ff4c4095020 2024-02-15T22:57:47.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.184+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3164112862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c406e640 con 0x7ff4c4095020 2024-02-15T22:57:47.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.185+0000 7ff4ab7fe640 1 -- 172.21.15.52:0/3164112862 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff4b404d3f0 con 0x7ff4c4095020 2024-02-15T22:57:47.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.185+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3164112862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c40627b0 con 0x7ff4c4095020 2024-02-15T22:57:47.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.185+0000 7ff4ab7fe640 1 --2- 172.21.15.52:0/3164112862 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff4b0037ef0 0x7ff4b003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:47.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.185+0000 7ff4ab7fe640 1 -- 172.21.15.52:0/3164112862 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7ff4b406d070 con 0x7ff4c4095020 2024-02-15T22:57:47.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.185+0000 7ff4c27fc640 1 --2- 172.21.15.52:0/3164112862 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff4b0037ef0 0x7ff4b003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:47.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.186+0000 7ff4c27fc640 1 --2- 172.21.15.52:0/3164112862 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff4b0037ef0 0x7ff4b003a3b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8007fd0 tx=0x7ff4b8007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:47.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.190+0000 7ff4ab7fe640 1 -- 172.21.15.52:0/3164112862 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff4b40308e0 con 0x7ff4c4095020 2024-02-15T22:57:47.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.369+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3164112862 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4c412b830 con 0x7ff4b0037ef0 2024-02-15T22:57:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.370+0000 7ff4ab7fe640 1 -- 172.21.15.52:0/3164112862 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff4b80012f0 con 0x7ff4b0037ef0 2024-02-15T22:57:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 3 to deep-scrub 2024-02-15T22:57:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.372+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3164112862 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff4b0037ef0 msgr2=0x7ff4b003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.372+0000 7ff4c93ed640 1 --2- 172.21.15.52:0/3164112862 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff4b0037ef0 0x7ff4b003a3b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8007fd0 tx=0x7ff4b8007ac0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.372+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3164112862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c4095020 msgr2=0x7ff4c4123500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.372+0000 7ff4c93ed640 1 --2- 172.21.15.52:0/3164112862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c4095020 0x7ff4c4123500 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009840 tx=0x7ff4b40046c0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.372+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3164112862 shutdown_connections 2024-02-15T22:57:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.372+0000 7ff4c93ed640 1 --2- 172.21.15.52:0/3164112862 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7ff4b0037ef0 0x7ff4b003a3b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.372+0000 7ff4c93ed640 1 --2- 172.21.15.52:0/3164112862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c4095020 0x7ff4c4123500 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.372+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3164112862 >> 172.21.15.52:0/3164112862 conn(0x7ff4c409a050 msgr2=0x7ff4c4093ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.372+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3164112862 shutdown_connections 2024-02-15T22:57:47.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.372+0000 7ff4c93ed640 1 -- 172.21.15.52:0/3164112862 wait complete. 2024-02-15T22:57:47.385 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T22:57:47.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.482+0000 7f6f52f32640 1 Processor -- start 2024-02-15T22:57:47.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.483+0000 7f6f52f32640 1 -- start start 2024-02-15T22:57:47.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.483+0000 7f6f52f32640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f4c0938d0 0x7f6f4c0943d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.483+0000 7f6f52f32640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c095990 con 0x7f6f4c093cb0 2024-02-15T22:57:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.483+0000 7f6f52f32640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4c095ef0 con 0x7f6f4c0938d0 2024-02-15T22:57:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.483+0000 7f6f50cce640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f4c0938d0 0x7f6f4c0943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.483+0000 7f6f4bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6f4c093cb0 0x7f6f4c094910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34894/0 (socket says 172.21.15.52:34894) 2024-02-15T22:57:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.483+0000 7f6f50cce640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f4c0938d0 0x7f6f4c0943d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33426/0 (socket says 172.21.15.52:33426) 2024-02-15T22:57:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.483+0000 7f6f4bfff640 1 -- 172.21.15.52:0/3863737430 learned_addr learned my addr 172.21.15.52:0/3863737430 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:57:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.483+0000 7f6f50cce640 1 -- 172.21.15.52:0/3863737430 >> v1:172.21.15.52:6789/0 conn(0x7f6f4c093cb0 legacy=0x7f6f4c094910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.483+0000 7f6f50cce640 1 -- 172.21.15.52:0/3863737430 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c06c400 con 0x7f6f4c0938d0 2024-02-15T22:57:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.484+0000 7f6f50cce640 1 --2- 172.21.15.52:0/3863737430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0938d0 0x7f6f4c0943d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009d90 tx=0x7f6f4402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8f26293fea61a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.484+0000 7f6f4b7fe640 1 -- 172.21.15.52:0/3863737430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f4402cb10 con 0x7f6f4c0938d0 2024-02-15T22:57:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.484+0000 7f6f4b7fe640 1 -- 172.21.15.52:0/3863737430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4402cc70 con 0x7f6f4c0938d0 2024-02-15T22:57:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.484+0000 7f6f4b7fe640 1 -- 172.21.15.52:0/3863737430 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f44034440 con 0x7f6f4c0938d0 2024-02-15T22:57:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.485+0000 7f6f52f32640 1 -- 172.21.15.52:0/3863737430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0938d0 msgr2=0x7f6f4c0943d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.485+0000 7f6f52f32640 1 --2- 172.21.15.52:0/3863737430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0938d0 0x7f6f4c0943d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009d90 tx=0x7f6f4402beb0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.485+0000 7f6f52f32640 1 -- 172.21.15.52:0/3863737430 shutdown_connections 2024-02-15T22:57:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.485+0000 7f6f52f32640 1 --2- 172.21.15.52:0/3863737430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0938d0 0x7f6f4c0943d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.485+0000 7f6f52f32640 1 -- 172.21.15.52:0/3863737430 >> 172.21.15.52:0/3863737430 conn(0x7f6f4c09a300 msgr2=0x7f6f4c09a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.485+0000 7f6f52f32640 1 -- 172.21.15.52:0/3863737430 shutdown_connections 2024-02-15T22:57:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.485+0000 7f6f52f32640 1 -- 172.21.15.52:0/3863737430 wait complete. 2024-02-15T22:57:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.486+0000 7f6f52f32640 1 Processor -- start 2024-02-15T22:57:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.486+0000 7f6f52f32640 1 -- start start 2024-02-15T22:57:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.486+0000 7f6f52f32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0938d0 0x7f6f4c1c0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.486+0000 7f6f52f32640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c08ff80 con 0x7f6f4c0938d0 2024-02-15T22:57:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.486+0000 7f6f50cce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0938d0 0x7f6f4c1c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.486+0000 7f6f50cce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0938d0 0x7f6f4c1c0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33438/0 (socket says 172.21.15.52:33438) 2024-02-15T22:57:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.486+0000 7f6f50cce640 1 -- 172.21.15.52:0/870468916 learned_addr learned my addr 172.21.15.52:0/870468916 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:57:47.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.486+0000 7f6f50cce640 1 -- 172.21.15.52:0/870468916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44009a70 con 0x7f6f4c0938d0 2024-02-15T22:57:47.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.487+0000 7f6f50cce640 1 --2- 172.21.15.52:0/870468916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0938d0 0x7f6f4c1c0790 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6f44037040 tx=0x7f6f44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:47.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.487+0000 7f6f497fa640 1 -- 172.21.15.52:0/870468916 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f4403e620 con 0x7f6f4c0938d0 2024-02-15T22:57:47.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.487+0000 7f6f497fa640 1 -- 172.21.15.52:0/870468916 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4403e7a0 con 0x7f6f4c0938d0 2024-02-15T22:57:47.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.487+0000 7f6f52f32640 1 -- 172.21.15.52:0/870468916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4c098230 con 0x7f6f4c0938d0 2024-02-15T22:57:47.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.487+0000 7f6f497fa640 1 -- 172.21.15.52:0/870468916 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f4403ea80 con 0x7f6f4c0938d0 2024-02-15T22:57:47.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.487+0000 7f6f52f32640 1 -- 172.21.15.52:0/870468916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4c08fb60 con 0x7f6f4c0938d0 2024-02-15T22:57:47.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.488+0000 7f6f497fa640 1 -- 172.21.15.52:0/870468916 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6f4403b050 con 0x7f6f4c0938d0 2024-02-15T22:57:47.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.488+0000 7f6f52f32640 1 -- 172.21.15.52:0/870468916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4c0627b0 con 0x7f6f4c0938d0 2024-02-15T22:57:47.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.488+0000 7f6f497fa640 1 --2- 172.21.15.52:0/870468916 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f2c037ef0 0x7f6f2c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:47.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.488+0000 7f6f497fa640 1 -- 172.21.15.52:0/870468916 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f6f4406de60 con 0x7f6f4c0938d0 2024-02-15T22:57:47.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.488+0000 7f6f4bfff640 1 --2- 172.21.15.52:0/870468916 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f2c037ef0 0x7f6f2c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:47.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.489+0000 7f6f4bfff640 1 --2- 172.21.15.52:0/870468916 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f2c037ef0 0x7f6f2c03a3b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6f34005880 tx=0x7f6f34007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:47.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.492+0000 7f6f497fa640 1 -- 172.21.15.52:0/870468916 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6f44032930 con 0x7f6f4c0938d0 2024-02-15T22:57:47.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.669+0000 7f6f52f32640 1 -- 172.21.15.52:0/870468916 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f4c0960d0 con 0x7f6f2c037ef0 2024-02-15T22:57:47.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.684+0000 7f6f497fa640 1 -- 172.21.15.52:0/870468916 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673015 (secure 0 0 0) 0x7f6f340058b0 con 0x7f6f2c037ef0 2024-02-15T22:57:47.694 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:57:47.700 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-02-15T22:57:47.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.689+0000 7f6f52f32640 1 -- 172.21.15.52:0/870468916 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f2c037ef0 msgr2=0x7f6f2c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.689+0000 7f6f52f32640 1 --2- 172.21.15.52:0/870468916 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f2c037ef0 0x7f6f2c03a3b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6f34005880 tx=0x7f6f34007a80 comp rx=0 tx=0).stop 2024-02-15T22:57:47.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.689+0000 7f6f52f32640 1 -- 172.21.15.52:0/870468916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0938d0 msgr2=0x7f6f4c1c0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:47.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.689+0000 7f6f52f32640 1 --2- 172.21.15.52:0/870468916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0938d0 0x7f6f4c1c0790 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6f44037040 tx=0x7f6f44004a40 comp rx=0 tx=0).stop 2024-02-15T22:57:47.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.689+0000 7f6f52f32640 1 -- 172.21.15.52:0/870468916 shutdown_connections 2024-02-15T22:57:47.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.689+0000 7f6f52f32640 1 --2- 172.21.15.52:0/870468916 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f6f2c037ef0 0x7f6f2c03a3b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.689+0000 7f6f52f32640 1 --2- 172.21.15.52:0/870468916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0938d0 0x7f6f4c1c0790 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:47.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.689+0000 7f6f52f32640 1 -- 172.21.15.52:0/870468916 >> 172.21.15.52:0/870468916 conn(0x7f6f4c09a300 msgr2=0x7f6f4c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:47.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.689+0000 7f6f52f32640 1 -- 172.21.15.52:0/870468916 shutdown_connections 2024-02-15T22:57:47.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:57:47.689+0000 7f6f52f32640 1 -- 172.21.15.52:0/870468916 wait complete. 2024-02-15T22:57:47.704 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-02-15T22:57:46.833793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4011,"num_read_kb":3661,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3797,"ondisk_log_size":3797,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135792,"kb_used_data":2768,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351568,"statfs":{"total":386547056640,"available":386408005632,"internally_reserved":0,"allocated":2834432,"data_stored":1715324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1348,"num_objects":-27,"num_object_clones":0,"num_object_copies":-54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":443,"num_read_kb":439,"num_write":134,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003512"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887013+0000","last_change":"2024-02-15T22:56:03.700271+0000","last_active":"2024-02-15T22:56:45.887013+0000","last_peered":"2024-02-15T22:56:45.887013+0000","last_clean":"2024-02-15T22:56:45.887013+0000","last_became_active":"2024-02-15T22:56:03.699163+0000","last_became_peered":"2024-02-15T22:56:03.699163+0000","last_unstale":"2024-02-15T22:56:45.887013+0000","last_undegraded":"2024-02-15T22:56:45.887013+0000","last_fullsized":"2024-02-15T22:56:45.887013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391099+0000","last_change":"2024-02-15T22:56:05.708737+0000","last_active":"2024-02-15T22:57:35.391099+0000","last_peered":"2024-02-15T22:57:35.391099+0000","last_clean":"2024-02-15T22:57:35.391099+0000","last_became_active":"2024-02-15T22:56:05.708415+0000","last_became_peered":"2024-02-15T22:56:05.708415+0000","last_unstale":"2024-02-15T22:57:35.391099+0000","last_undegraded":"2024-02-15T22:57:35.391099+0000","last_fullsized":"2024-02-15T22:57:35.391099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:08.839506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881047+0000","last_change":"2024-02-15T22:56:03.704350+0000","last_active":"2024-02-15T22:56:45.881047+0000","last_peered":"2024-02-15T22:56:45.881047+0000","last_clean":"2024-02-15T22:56:45.881047+0000","last_became_active":"2024-02-15T22:56:03.704043+0000","last_became_peered":"2024-02-15T22:56:03.704043+0000","last_unstale":"2024-02-15T22:56:45.881047+0000","last_undegraded":"2024-02-15T22:56:45.881047+0000","last_fullsized":"2024-02-15T22:56:45.881047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:27.186561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882461+0000","last_change":"2024-02-15T22:56:05.703860+0000","last_active":"2024-02-15T22:56:45.882461+0000","last_peered":"2024-02-15T22:56:45.882461+0000","last_clean":"2024-02-15T22:56:45.882461+0000","last_became_active":"2024-02-15T22:56:05.703587+0000","last_became_peered":"2024-02-15T22:56:05.703587+0000","last_unstale":"2024-02-15T22:56:45.882461+0000","last_undegraded":"2024-02-15T22:56:45.882461+0000","last_fullsized":"2024-02-15T22:56:45.882461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:18.837089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884271+0000","last_change":"2024-02-15T22:56:03.703994+0000","last_active":"2024-02-15T22:56:45.884271+0000","last_peered":"2024-02-15T22:56:45.884271+0000","last_clean":"2024-02-15T22:56:45.884271+0000","last_became_active":"2024-02-15T22:56:03.703702+0000","last_became_peered":"2024-02-15T22:56:03.703702+0000","last_unstale":"2024-02-15T22:56:45.884271+0000","last_undegraded":"2024-02-15T22:56:45.884271+0000","last_fullsized":"2024-02-15T22:56:45.884271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:44.096887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883441+0000","last_change":"2024-02-15T22:56:05.709355+0000","last_active":"2024-02-15T22:57:29.883441+0000","last_peered":"2024-02-15T22:57:29.883441+0000","last_clean":"2024-02-15T22:57:29.883441+0000","last_became_active":"2024-02-15T22:56:05.709003+0000","last_became_peered":"2024-02-15T22:56:05.709003+0000","last_unstale":"2024-02-15T22:57:29.883441+0000","last_undegraded":"2024-02-15T22:57:29.883441+0000","last_fullsized":"2024-02-15T22:57:29.883441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:26:24.526593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885342+0000","last_change":"2024-02-15T22:56:03.692040+0000","last_active":"2024-02-15T22:56:45.885342+0000","last_peered":"2024-02-15T22:56:45.885342+0000","last_clean":"2024-02-15T22:56:45.885342+0000","last_became_active":"2024-02-15T22:56:03.691753+0000","last_became_peered":"2024-02-15T22:56:03.691753+0000","last_unstale":"2024-02-15T22:56:45.885342+0000","last_undegraded":"2024-02-15T22:56:45.885342+0000","last_fullsized":"2024-02-15T22:56:45.885342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214184+0000","last_change":"2024-02-15T22:56:05.703818+0000","last_active":"2024-02-15T22:57:29.214184+0000","last_peered":"2024-02-15T22:57:29.214184+0000","last_clean":"2024-02-15T22:57:29.214184+0000","last_became_active":"2024-02-15T22:56:05.703541+0000","last_became_peered":"2024-02-15T22:56:05.703541+0000","last_unstale":"2024-02-15T22:57:29.214184+0000","last_undegraded":"2024-02-15T22:57:29.214184+0000","last_fullsized":"2024-02-15T22:57:29.214184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:49.366897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881533+0000","last_change":"2024-02-15T22:56:03.694830+0000","last_active":"2024-02-15T22:56:45.881533+0000","last_peered":"2024-02-15T22:56:45.881533+0000","last_clean":"2024-02-15T22:56:45.881533+0000","last_became_active":"2024-02-15T22:56:03.694522+0000","last_became_peered":"2024-02-15T22:56:03.694522+0000","last_unstale":"2024-02-15T22:56:45.881533+0000","last_undegraded":"2024-02-15T22:56:45.881533+0000","last_fullsized":"2024-02-15T22:56:45.881533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:51.289434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.875000+0000","last_change":"2024-02-15T22:56:05.705402+0000","last_active":"2024-02-15T22:56:46.875000+0000","last_peered":"2024-02-15T22:56:46.875000+0000","last_clean":"2024-02-15T22:56:46.875000+0000","last_became_active":"2024-02-15T22:56:05.704411+0000","last_became_peered":"2024-02-15T22:56:05.704411+0000","last_unstale":"2024-02-15T22:56:46.875000+0000","last_undegraded":"2024-02-15T22:56:46.875000+0000","last_fullsized":"2024-02-15T22:56:46.875000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:12.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882213+0000","last_change":"2024-02-15T22:56:03.692633+0000","last_active":"2024-02-15T22:56:45.882213+0000","last_peered":"2024-02-15T22:56:45.882213+0000","last_clean":"2024-02-15T22:56:45.882213+0000","last_became_active":"2024-02-15T22:56:03.692316+0000","last_became_peered":"2024-02-15T22:56:03.692316+0000","last_unstale":"2024-02-15T22:56:45.882213+0000","last_undegraded":"2024-02-15T22:56:45.882213+0000","last_fullsized":"2024-02-15T22:56:45.882213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:26.885390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.214550+0000","last_change":"2024-02-15T22:56:05.715708+0000","last_active":"2024-02-15T22:56:47.214550+0000","last_peered":"2024-02-15T22:56:47.214550+0000","last_clean":"2024-02-15T22:56:47.214550+0000","last_became_active":"2024-02-15T22:56:05.715460+0000","last_became_peered":"2024-02-15T22:56:05.715460+0000","last_unstale":"2024-02-15T22:56:47.214550+0000","last_undegraded":"2024-02-15T22:56:47.214550+0000","last_fullsized":"2024-02-15T22:56:47.214550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:27.899628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.858213+0000","last_change":"2024-02-15T22:56:03.701184+0000","last_active":"2024-02-15T22:56:46.858213+0000","last_peered":"2024-02-15T22:56:46.858213+0000","last_clean":"2024-02-15T22:56:46.858213+0000","last_became_active":"2024-02-15T22:56:03.700908+0000","last_became_peered":"2024-02-15T22:56:03.700908+0000","last_unstale":"2024-02-15T22:56:46.858213+0000","last_undegraded":"2024-02-15T22:56:46.858213+0000","last_fullsized":"2024-02-15T22:56:46.858213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:55:10.798077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883471+0000","last_change":"2024-02-15T22:56:05.706807+0000","last_active":"2024-02-15T22:57:29.883471+0000","last_peered":"2024-02-15T22:57:29.883471+0000","last_clean":"2024-02-15T22:57:29.883471+0000","last_became_active":"2024-02-15T22:56:05.706078+0000","last_became_peered":"2024-02-15T22:56:05.706078+0000","last_unstale":"2024-02-15T22:57:29.883471+0000","last_undegraded":"2024-02-15T22:57:29.883471+0000","last_fullsized":"2024-02-15T22:57:29.883471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879163+0000","last_change":"2024-02-15T22:56:03.697612+0000","last_active":"2024-02-15T22:56:45.879163+0000","last_peered":"2024-02-15T22:56:45.879163+0000","last_clean":"2024-02-15T22:56:45.879163+0000","last_became_active":"2024-02-15T22:56:03.697327+0000","last_became_peered":"2024-02-15T22:56:03.697327+0000","last_unstale":"2024-02-15T22:56:45.879163+0000","last_undegraded":"2024-02-15T22:56:45.879163+0000","last_fullsized":"2024-02-15T22:56:45.879163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886735+0000","last_change":"2024-02-15T22:56:05.705497+0000","last_active":"2024-02-15T22:56:45.886735+0000","last_peered":"2024-02-15T22:56:45.886735+0000","last_clean":"2024-02-15T22:56:45.886735+0000","last_became_active":"2024-02-15T22:56:05.705173+0000","last_became_peered":"2024-02-15T22:56:05.705173+0000","last_unstale":"2024-02-15T22:56:45.886735+0000","last_undegraded":"2024-02-15T22:56:45.886735+0000","last_fullsized":"2024-02-15T22:56:45.886735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:12.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.214944+0000","last_change":"2024-02-15T22:56:05.704020+0000","last_active":"2024-02-15T22:56:47.214944+0000","last_peered":"2024-02-15T22:56:47.214944+0000","last_clean":"2024-02-15T22:56:47.214944+0000","last_became_active":"2024-02-15T22:56:05.703708+0000","last_became_peered":"2024-02-15T22:56:05.703708+0000","last_unstale":"2024-02-15T22:56:47.214944+0000","last_undegraded":"2024-02-15T22:56:47.214944+0000","last_fullsized":"2024-02-15T22:56:47.214944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:55.285758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880443+0000","last_change":"2024-02-15T22:56:03.697488+0000","last_active":"2024-02-15T22:56:45.880443+0000","last_peered":"2024-02-15T22:56:45.880443+0000","last_clean":"2024-02-15T22:56:45.880443+0000","last_became_active":"2024-02-15T22:56:03.696959+0000","last_became_peered":"2024-02-15T22:56:03.696959+0000","last_unstale":"2024-02-15T22:56:45.880443+0000","last_undegraded":"2024-02-15T22:56:45.880443+0000","last_fullsized":"2024-02-15T22:56:45.880443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883271+0000","last_change":"2024-02-15T22:56:05.700345+0000","last_active":"2024-02-15T22:57:29.883271+0000","last_peered":"2024-02-15T22:57:29.883271+0000","last_clean":"2024-02-15T22:57:29.883271+0000","last_became_active":"2024-02-15T22:56:05.700071+0000","last_became_peered":"2024-02-15T22:56:05.700071+0000","last_unstale":"2024-02-15T22:57:29.883271+0000","last_undegraded":"2024-02-15T22:57:29.883271+0000","last_fullsized":"2024-02-15T22:57:29.883271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887112+0000","last_change":"2024-02-15T22:56:03.700009+0000","last_active":"2024-02-15T22:56:45.887112+0000","last_peered":"2024-02-15T22:56:45.887112+0000","last_clean":"2024-02-15T22:56:45.887112+0000","last_became_active":"2024-02-15T22:56:03.699574+0000","last_became_peered":"2024-02-15T22:56:03.699574+0000","last_unstale":"2024-02-15T22:56:45.887112+0000","last_undegraded":"2024-02-15T22:56:45.887112+0000","last_fullsized":"2024-02-15T22:56:45.887112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391273+0000","last_change":"2024-02-15T22:56:05.702837+0000","last_active":"2024-02-15T22:57:35.391273+0000","last_peered":"2024-02-15T22:57:35.391273+0000","last_clean":"2024-02-15T22:57:35.391273+0000","last_became_active":"2024-02-15T22:56:05.702488+0000","last_became_peered":"2024-02-15T22:56:05.702488+0000","last_unstale":"2024-02-15T22:57:35.391273+0000","last_undegraded":"2024-02-15T22:57:35.391273+0000","last_fullsized":"2024-02-15T22:57:35.391273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:38.755197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886045+0000","last_change":"2024-02-15T22:56:45.886045+0000","last_active":"2024-02-15T22:56:45.886045+0000","last_peered":"2024-02-15T22:56:45.886045+0000","last_clean":"2024-02-15T22:56:45.886045+0000","last_became_active":"2024-02-15T22:56:45.885555+0000","last_became_peered":"2024-02-15T22:56:45.885555+0000","last_unstale":"2024-02-15T22:56:45.886045+0000","last_undegraded":"2024-02-15T22:56:45.886045+0000","last_fullsized":"2024-02-15T22:56:45.886045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:17.695860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214283+0000","last_change":"2024-02-15T22:56:05.706693+0000","last_active":"2024-02-15T22:57:29.214283+0000","last_peered":"2024-02-15T22:57:29.214283+0000","last_clean":"2024-02-15T22:57:29.214283+0000","last_became_active":"2024-02-15T22:56:05.705386+0000","last_became_peered":"2024-02-15T22:56:05.705386+0000","last_unstale":"2024-02-15T22:57:29.214283+0000","last_undegraded":"2024-02-15T22:57:29.214283+0000","last_fullsized":"2024-02-15T22:57:29.214283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:37.794254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879821+0000","last_change":"2024-02-15T22:56:03.693697+0000","last_active":"2024-02-15T22:56:45.879821+0000","last_peered":"2024-02-15T22:56:45.879821+0000","last_clean":"2024-02-15T22:56:45.879821+0000","last_became_active":"2024-02-15T22:56:03.693329+0000","last_became_peered":"2024-02-15T22:56:03.693329+0000","last_unstale":"2024-02-15T22:56:45.879821+0000","last_undegraded":"2024-02-15T22:56:45.879821+0000","last_fullsized":"2024-02-15T22:56:45.879821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214299+0000","last_change":"2024-02-15T22:56:05.705032+0000","last_active":"2024-02-15T22:57:29.214299+0000","last_peered":"2024-02-15T22:57:29.214299+0000","last_clean":"2024-02-15T22:57:29.214299+0000","last_became_active":"2024-02-15T22:56:05.704729+0000","last_became_peered":"2024-02-15T22:56:05.704729+0000","last_unstale":"2024-02-15T22:57:29.214299+0000","last_undegraded":"2024-02-15T22:57:29.214299+0000","last_fullsized":"2024-02-15T22:57:29.214299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:13.582581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880416+0000","last_change":"2024-02-15T22:56:03.704183+0000","last_active":"2024-02-15T22:56:45.880416+0000","last_peered":"2024-02-15T22:56:45.880416+0000","last_clean":"2024-02-15T22:56:45.880416+0000","last_became_active":"2024-02-15T22:56:03.703885+0000","last_became_peered":"2024-02-15T22:56:03.703885+0000","last_unstale":"2024-02-15T22:56:45.880416+0000","last_undegraded":"2024-02-15T22:56:45.880416+0000","last_fullsized":"2024-02-15T22:56:45.880416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214309+0000","last_change":"2024-02-15T22:56:05.698851+0000","last_active":"2024-02-15T22:57:29.214309+0000","last_peered":"2024-02-15T22:57:29.214309+0000","last_clean":"2024-02-15T22:57:29.214309+0000","last_became_active":"2024-02-15T22:56:05.698553+0000","last_became_peered":"2024-02-15T22:56:05.698553+0000","last_unstale":"2024-02-15T22:57:29.214309+0000","last_undegraded":"2024-02-15T22:57:29.214309+0000","last_fullsized":"2024-02-15T22:57:29.214309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:04:59.069745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883379+0000","last_change":"2024-02-15T22:56:03.702268+0000","last_active":"2024-02-15T22:56:45.883379+0000","last_peered":"2024-02-15T22:56:45.883379+0000","last_clean":"2024-02-15T22:56:45.883379+0000","last_became_active":"2024-02-15T22:56:03.701819+0000","last_became_peered":"2024-02-15T22:56:03.701819+0000","last_unstale":"2024-02-15T22:56:45.883379+0000","last_undegraded":"2024-02-15T22:56:45.883379+0000","last_fullsized":"2024-02-15T22:56:45.883379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:24:36.815216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.380518+0000","last_change":"2024-02-15T22:56:13.731342+0000","last_active":"2024-02-15T22:57:35.380518+0000","last_peered":"2024-02-15T22:57:35.380518+0000","last_clean":"2024-02-15T22:57:35.380518+0000","last_became_active":"2024-02-15T22:56:13.730499+0000","last_became_peered":"2024-02-15T22:56:13.730499+0000","last_unstale":"2024-02-15T22:57:35.380518+0000","last_undegraded":"2024-02-15T22:57:35.380518+0000","last_fullsized":"2024-02-15T22:57:35.380518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:14:37.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.877218+0000","last_change":"2024-02-15T22:56:05.700054+0000","last_active":"2024-02-15T22:56:46.877218+0000","last_peered":"2024-02-15T22:56:46.877218+0000","last_clean":"2024-02-15T22:56:46.877218+0000","last_became_active":"2024-02-15T22:56:05.699821+0000","last_became_peered":"2024-02-15T22:56:05.699821+0000","last_unstale":"2024-02-15T22:56:46.877218+0000","last_undegraded":"2024-02-15T22:56:46.877218+0000","last_fullsized":"2024-02-15T22:56:46.877218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:38.452610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880655+0000","last_change":"2024-02-15T22:56:03.706199+0000","last_active":"2024-02-15T22:56:45.880655+0000","last_peered":"2024-02-15T22:56:45.880655+0000","last_clean":"2024-02-15T22:56:45.880655+0000","last_became_active":"2024-02-15T22:56:03.705881+0000","last_became_peered":"2024-02-15T22:56:03.705881+0000","last_unstale":"2024-02-15T22:56:45.880655+0000","last_undegraded":"2024-02-15T22:56:45.880655+0000","last_fullsized":"2024-02-15T22:56:45.880655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:08:53.948179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.893437+0000","last_change":"2024-02-15T22:56:45.893437+0000","last_active":"2024-02-15T22:56:45.893437+0000","last_peered":"2024-02-15T22:56:45.893437+0000","last_clean":"2024-02-15T22:56:45.893437+0000","last_became_active":"2024-02-15T22:56:45.893067+0000","last_became_peered":"2024-02-15T22:56:45.893067+0000","last_unstale":"2024-02-15T22:56:45.893437+0000","last_undegraded":"2024-02-15T22:56:45.893437+0000","last_fullsized":"2024-02-15T22:56:45.893437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:56:05.709507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.116737+0000","last_change":"2024-02-15T22:56:09.715523+0000","last_active":"2024-02-15T22:57:43.116737+0000","last_peered":"2024-02-15T22:57:43.116737+0000","last_clean":"2024-02-15T22:57:43.116737+0000","last_became_active":"2024-02-15T22:56:09.714201+0000","last_became_peered":"2024-02-15T22:56:09.714201+0000","last_unstale":"2024-02-15T22:57:43.116737+0000","last_undegraded":"2024-02-15T22:57:43.116737+0000","last_fullsized":"2024-02-15T22:57:43.116737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:23.715629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879512+0000","last_change":"2024-02-15T22:56:11.722548+0000","last_active":"2024-02-15T22:56:45.879512+0000","last_peered":"2024-02-15T22:56:45.879512+0000","last_clean":"2024-02-15T22:56:45.879512+0000","last_became_active":"2024-02-15T22:56:11.722257+0000","last_became_peered":"2024-02-15T22:56:11.722257+0000","last_unstale":"2024-02-15T22:56:45.879512+0000","last_undegraded":"2024-02-15T22:56:45.879512+0000","last_fullsized":"2024-02-15T22:56:45.879512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:57.504579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:24.174259+0000","last_change":"2024-02-15T22:56:13.729349+0000","last_active":"2024-02-15T22:57:24.174259+0000","last_peered":"2024-02-15T22:57:24.174259+0000","last_clean":"2024-02-15T22:57:24.174259+0000","last_became_active":"2024-02-15T22:56:13.729067+0000","last_became_peered":"2024-02-15T22:56:13.729067+0000","last_unstale":"2024-02-15T22:57:24.174259+0000","last_undegraded":"2024-02-15T22:57:24.174259+0000","last_fullsized":"2024-02-15T22:57:24.174259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:09.223558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427054+0000","last_change":"2024-02-15T22:56:05.709930+0000","last_active":"2024-02-15T22:56:47.427054+0000","last_peered":"2024-02-15T22:56:47.427054+0000","last_clean":"2024-02-15T22:56:47.427054+0000","last_became_active":"2024-02-15T22:56:05.709632+0000","last_became_peered":"2024-02-15T22:56:05.709632+0000","last_unstale":"2024-02-15T22:56:47.427054+0000","last_undegraded":"2024-02-15T22:56:47.427054+0000","last_fullsized":"2024-02-15T22:56:47.427054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:36.590473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882363+0000","last_change":"2024-02-15T22:56:03.699568+0000","last_active":"2024-02-15T22:56:45.882363+0000","last_peered":"2024-02-15T22:56:45.882363+0000","last_clean":"2024-02-15T22:56:45.882363+0000","last_became_active":"2024-02-15T22:56:03.699250+0000","last_became_peered":"2024-02-15T22:56:03.699250+0000","last_unstale":"2024-02-15T22:56:45.882363+0000","last_undegraded":"2024-02-15T22:56:45.882363+0000","last_fullsized":"2024-02-15T22:56:45.882363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880140+0000","last_change":"2024-02-15T22:56:07.706255+0000","last_active":"2024-02-15T22:56:45.880140+0000","last_peered":"2024-02-15T22:56:45.880140+0000","last_clean":"2024-02-15T22:56:45.880140+0000","last_became_active":"2024-02-15T22:56:07.705828+0000","last_became_peered":"2024-02-15T22:56:07.705828+0000","last_unstale":"2024-02-15T22:56:45.880140+0000","last_undegraded":"2024-02-15T22:56:45.880140+0000","last_fullsized":"2024-02-15T22:56:45.880140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:08.004261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883166+0000","last_change":"2024-02-15T22:56:09.713098+0000","last_active":"2024-02-15T22:56:45.883166+0000","last_peered":"2024-02-15T22:56:45.883166+0000","last_clean":"2024-02-15T22:56:45.883166+0000","last_became_active":"2024-02-15T22:56:09.712812+0000","last_became_peered":"2024-02-15T22:56:09.712812+0000","last_unstale":"2024-02-15T22:56:45.883166+0000","last_undegraded":"2024-02-15T22:56:45.883166+0000","last_fullsized":"2024-02-15T22:56:45.883166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:02:23.375846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879318+0000","last_change":"2024-02-15T22:56:11.721942+0000","last_active":"2024-02-15T22:56:45.879318+0000","last_peered":"2024-02-15T22:56:45.879318+0000","last_clean":"2024-02-15T22:56:45.879318+0000","last_became_active":"2024-02-15T22:56:11.721486+0000","last_became_peered":"2024-02-15T22:56:11.721486+0000","last_unstale":"2024-02-15T22:56:45.879318+0000","last_undegraded":"2024-02-15T22:56:45.879318+0000","last_fullsized":"2024-02-15T22:56:45.879318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:14.822800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879113+0000","last_change":"2024-02-15T22:56:13.734756+0000","last_active":"2024-02-15T22:56:45.879113+0000","last_peered":"2024-02-15T22:56:45.879113+0000","last_clean":"2024-02-15T22:56:45.879113+0000","last_became_active":"2024-02-15T22:56:13.734418+0000","last_became_peered":"2024-02-15T22:56:13.734418+0000","last_unstale":"2024-02-15T22:56:45.879113+0000","last_undegraded":"2024-02-15T22:56:45.879113+0000","last_fullsized":"2024-02-15T22:56:45.879113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:52.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391181+0000","last_change":"2024-02-15T22:56:05.700314+0000","last_active":"2024-02-15T22:57:35.391181+0000","last_peered":"2024-02-15T22:57:35.391181+0000","last_clean":"2024-02-15T22:57:35.391181+0000","last_became_active":"2024-02-15T22:56:05.699398+0000","last_became_peered":"2024-02-15T22:56:05.699398+0000","last_unstale":"2024-02-15T22:57:35.391181+0000","last_undegraded":"2024-02-15T22:57:35.391181+0000","last_fullsized":"2024-02-15T22:57:35.391181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:02.515595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881993+0000","last_change":"2024-02-15T22:56:03.707100+0000","last_active":"2024-02-15T22:56:45.881993+0000","last_peered":"2024-02-15T22:56:45.881993+0000","last_clean":"2024-02-15T22:56:45.881993+0000","last_became_active":"2024-02-15T22:56:03.706818+0000","last_became_peered":"2024-02-15T22:56:03.706818+0000","last_unstale":"2024-02-15T22:56:45.881993+0000","last_undegraded":"2024-02-15T22:56:45.881993+0000","last_fullsized":"2024-02-15T22:56:45.881993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:48.000599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882317+0000","last_change":"2024-02-15T22:56:07.704992+0000","last_active":"2024-02-15T22:56:45.882317+0000","last_peered":"2024-02-15T22:56:45.882317+0000","last_clean":"2024-02-15T22:56:45.882317+0000","last_became_active":"2024-02-15T22:56:07.704168+0000","last_became_peered":"2024-02-15T22:56:07.704168+0000","last_unstale":"2024-02-15T22:56:45.882317+0000","last_undegraded":"2024-02-15T22:56:45.882317+0000","last_fullsized":"2024-02-15T22:56:45.882317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:37.486705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885836+0000","last_change":"2024-02-15T22:56:09.718644+0000","last_active":"2024-02-15T22:56:45.885836+0000","last_peered":"2024-02-15T22:56:45.885836+0000","last_clean":"2024-02-15T22:56:45.885836+0000","last_became_active":"2024-02-15T22:56:09.718326+0000","last_became_peered":"2024-02-15T22:56:09.718326+0000","last_unstale":"2024-02-15T22:56:45.885836+0000","last_undegraded":"2024-02-15T22:56:45.885836+0000","last_fullsized":"2024-02-15T22:56:45.885836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:39.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'243","reported_seq":304,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.040536+0000","last_change":"2024-02-15T22:56:11.726498+0000","last_active":"2024-02-15T22:57:43.040536+0000","last_peered":"2024-02-15T22:57:43.040536+0000","last_clean":"2024-02-15T22:57:43.040536+0000","last_became_active":"2024-02-15T22:56:11.724138+0000","last_became_peered":"2024-02-15T22:56:11.724138+0000","last_unstale":"2024-02-15T22:57:43.040536+0000","last_undegraded":"2024-02-15T22:57:43.040536+0000","last_fullsized":"2024-02-15T22:57:43.040536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:55.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882299+0000","last_change":"2024-02-15T22:56:13.733123+0000","last_active":"2024-02-15T22:56:45.882299+0000","last_peered":"2024-02-15T22:56:45.882299+0000","last_clean":"2024-02-15T22:56:45.882299+0000","last_became_active":"2024-02-15T22:56:13.732762+0000","last_became_peered":"2024-02-15T22:56:13.732762+0000","last_unstale":"2024-02-15T22:56:45.882299+0000","last_undegraded":"2024-02-15T22:56:45.882299+0000","last_fullsized":"2024-02-15T22:56:45.882299+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:33.418832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215492+0000","last_change":"2024-02-15T22:56:05.705807+0000","last_active":"2024-02-15T22:56:47.215492+0000","last_peered":"2024-02-15T22:56:47.215492+0000","last_clean":"2024-02-15T22:56:47.215492+0000","last_became_active":"2024-02-15T22:56:05.705360+0000","last_became_peered":"2024-02-15T22:56:05.705360+0000","last_unstale":"2024-02-15T22:56:47.215492+0000","last_undegraded":"2024-02-15T22:56:47.215492+0000","last_fullsized":"2024-02-15T22:56:47.215492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:43.641211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.877537+0000","last_change":"2024-02-15T22:56:03.698653+0000","last_active":"2024-02-15T22:56:45.877537+0000","last_peered":"2024-02-15T22:56:45.877537+0000","last_clean":"2024-02-15T22:56:45.877537+0000","last_became_active":"2024-02-15T22:56:03.698225+0000","last_became_peered":"2024-02-15T22:56:03.698225+0000","last_unstale":"2024-02-15T22:56:45.877537+0000","last_undegraded":"2024-02-15T22:56:45.877537+0000","last_fullsized":"2024-02-15T22:56:45.877537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:08.872314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883033+0000","last_change":"2024-02-15T22:56:07.709503+0000","last_active":"2024-02-15T22:56:45.883033+0000","last_peered":"2024-02-15T22:56:45.883033+0000","last_clean":"2024-02-15T22:56:45.883033+0000","last_became_active":"2024-02-15T22:56:07.709236+0000","last_became_peered":"2024-02-15T22:56:07.709236+0000","last_unstale":"2024-02-15T22:56:45.883033+0000","last_undegraded":"2024-02-15T22:56:45.883033+0000","last_fullsized":"2024-02-15T22:56:45.883033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:01.415728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.100152+0000","last_change":"2024-02-15T22:56:09.729856+0000","last_active":"2024-02-15T22:57:43.100152+0000","last_peered":"2024-02-15T22:57:43.100152+0000","last_clean":"2024-02-15T22:57:43.100152+0000","last_became_active":"2024-02-15T22:56:09.729556+0000","last_became_peered":"2024-02-15T22:56:09.729556+0000","last_unstale":"2024-02-15T22:57:43.100152+0000","last_undegraded":"2024-02-15T22:57:43.100152+0000","last_fullsized":"2024-02-15T22:57:43.100152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:22.850275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":332,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.045257+0000","last_change":"2024-02-15T22:56:11.719971+0000","last_active":"2024-02-15T22:57:43.045257+0000","last_peered":"2024-02-15T22:57:43.045257+0000","last_clean":"2024-02-15T22:57:43.045257+0000","last_became_active":"2024-02-15T22:56:11.719588+0000","last_became_peered":"2024-02-15T22:56:11.719588+0000","last_unstale":"2024-02-15T22:57:43.045257+0000","last_undegraded":"2024-02-15T22:57:43.045257+0000","last_fullsized":"2024-02-15T22:57:43.045257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:49.146038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881166+0000","last_change":"2024-02-15T22:56:05.711111+0000","last_active":"2024-02-15T22:56:45.881166+0000","last_peered":"2024-02-15T22:56:45.881166+0000","last_clean":"2024-02-15T22:56:45.881166+0000","last_became_active":"2024-02-15T22:56:05.710578+0000","last_became_peered":"2024-02-15T22:56:05.710578+0000","last_unstale":"2024-02-15T22:56:45.881166+0000","last_undegraded":"2024-02-15T22:56:45.881166+0000","last_fullsized":"2024-02-15T22:56:45.881166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:33.216881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887207+0000","last_change":"2024-02-15T22:56:03.702464+0000","last_active":"2024-02-15T22:56:45.887207+0000","last_peered":"2024-02-15T22:56:45.887207+0000","last_clean":"2024-02-15T22:56:45.887207+0000","last_became_active":"2024-02-15T22:56:03.702187+0000","last_became_peered":"2024-02-15T22:56:03.702187+0000","last_unstale":"2024-02-15T22:56:45.887207+0000","last_undegraded":"2024-02-15T22:56:45.887207+0000","last_fullsized":"2024-02-15T22:56:45.887207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878050+0000","last_change":"2024-02-15T22:56:07.707641+0000","last_active":"2024-02-15T22:56:45.878050+0000","last_peered":"2024-02-15T22:56:45.878050+0000","last_clean":"2024-02-15T22:56:45.878050+0000","last_became_active":"2024-02-15T22:56:07.707328+0000","last_became_peered":"2024-02-15T22:56:07.707328+0000","last_unstale":"2024-02-15T22:56:45.878050+0000","last_undegraded":"2024-02-15T22:56:45.878050+0000","last_fullsized":"2024-02-15T22:56:45.878050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:40:20.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'41","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.129345+0000","last_change":"2024-02-15T22:56:09.715469+0000","last_active":"2024-02-15T22:57:43.129345+0000","last_peered":"2024-02-15T22:57:43.129345+0000","last_clean":"2024-02-15T22:57:43.129345+0000","last_became_active":"2024-02-15T22:56:09.715019+0000","last_became_peered":"2024-02-15T22:56:09.715019+0000","last_unstale":"2024-02-15T22:57:43.129345+0000","last_undegraded":"2024-02-15T22:57:43.129345+0000","last_fullsized":"2024-02-15T22:57:43.129345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:48.218723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879445+0000","last_change":"2024-02-15T22:56:11.720307+0000","last_active":"2024-02-15T22:56:45.879445+0000","last_peered":"2024-02-15T22:56:45.879445+0000","last_clean":"2024-02-15T22:56:45.879445+0000","last_became_active":"2024-02-15T22:56:11.719845+0000","last_became_peered":"2024-02-15T22:56:11.719845+0000","last_unstale":"2024-02-15T22:56:45.879445+0000","last_undegraded":"2024-02-15T22:56:45.879445+0000","last_fullsized":"2024-02-15T22:56:45.879445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:18:58.882768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.675724+0000","last_change":"2024-02-15T22:56:13.732667+0000","last_active":"2024-02-15T22:57:29.675724+0000","last_peered":"2024-02-15T22:57:29.675724+0000","last_clean":"2024-02-15T22:57:29.675724+0000","last_became_active":"2024-02-15T22:56:13.732321+0000","last_became_peered":"2024-02-15T22:56:13.732321+0000","last_unstale":"2024-02-15T22:57:29.675724+0000","last_undegraded":"2024-02-15T22:57:29.675724+0000","last_fullsized":"2024-02-15T22:57:29.675724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:10.109926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427434+0000","last_change":"2024-02-15T22:56:05.698607+0000","last_active":"2024-02-15T22:56:47.427434+0000","last_peered":"2024-02-15T22:56:47.427434+0000","last_clean":"2024-02-15T22:56:47.427434+0000","last_became_active":"2024-02-15T22:56:05.697834+0000","last_became_peered":"2024-02-15T22:56:05.697834+0000","last_unstale":"2024-02-15T22:56:47.427434+0000","last_undegraded":"2024-02-15T22:56:47.427434+0000","last_fullsized":"2024-02-15T22:56:47.427434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:13:53.631177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887539+0000","last_change":"2024-02-15T22:56:03.702616+0000","last_active":"2024-02-15T22:56:45.887539+0000","last_peered":"2024-02-15T22:56:45.887539+0000","last_clean":"2024-02-15T22:56:45.887539+0000","last_became_active":"2024-02-15T22:56:03.702353+0000","last_became_peered":"2024-02-15T22:56:03.702353+0000","last_unstale":"2024-02-15T22:56:45.887539+0000","last_undegraded":"2024-02-15T22:56:45.887539+0000","last_fullsized":"2024-02-15T22:56:45.887539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:27.186561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879943+0000","last_change":"2024-02-15T22:56:07.707046+0000","last_active":"2024-02-15T22:56:45.879943+0000","last_peered":"2024-02-15T22:56:45.879943+0000","last_clean":"2024-02-15T22:56:45.879943+0000","last_became_active":"2024-02-15T22:56:07.706656+0000","last_became_peered":"2024-02-15T22:56:07.706656+0000","last_unstale":"2024-02-15T22:56:45.879943+0000","last_undegraded":"2024-02-15T22:56:45.879943+0000","last_fullsized":"2024-02-15T22:56:45.879943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:21:30.878763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.167887+0000","last_change":"2024-02-15T22:56:09.717310+0000","last_active":"2024-02-15T22:57:43.167887+0000","last_peered":"2024-02-15T22:57:43.167887+0000","last_clean":"2024-02-15T22:57:43.167887+0000","last_became_active":"2024-02-15T22:56:09.716138+0000","last_became_peered":"2024-02-15T22:56:09.716138+0000","last_unstale":"2024-02-15T22:57:43.167887+0000","last_undegraded":"2024-02-15T22:57:43.167887+0000","last_fullsized":"2024-02-15T22:57:43.167887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:05:17.903871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879203+0000","last_change":"2024-02-15T22:56:11.724665+0000","last_active":"2024-02-15T22:56:45.879203+0000","last_peered":"2024-02-15T22:56:45.879203+0000","last_clean":"2024-02-15T22:56:45.879203+0000","last_became_active":"2024-02-15T22:56:11.724317+0000","last_became_peered":"2024-02-15T22:56:11.724317+0000","last_unstale":"2024-02-15T22:56:45.879203+0000","last_undegraded":"2024-02-15T22:56:45.879203+0000","last_fullsized":"2024-02-15T22:56:45.879203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:06:03.302828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.874077+0000","last_change":"2024-02-15T22:56:13.733414+0000","last_active":"2024-02-15T22:57:29.874077+0000","last_peered":"2024-02-15T22:57:29.874077+0000","last_clean":"2024-02-15T22:57:29.874077+0000","last_became_active":"2024-02-15T22:56:13.733118+0000","last_became_peered":"2024-02-15T22:56:13.733118+0000","last_unstale":"2024-02-15T22:57:29.874077+0000","last_undegraded":"2024-02-15T22:57:29.874077+0000","last_fullsized":"2024-02-15T22:57:29.874077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:38.491982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'20","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.427488+0000","last_change":"2024-02-15T22:56:45.891684+0000","last_active":"2024-02-15T22:56:47.427488+0000","last_peered":"2024-02-15T22:56:47.427488+0000","last_clean":"2024-02-15T22:56:47.427488+0000","last_became_active":"2024-02-15T22:56:45.886248+0000","last_became_peered":"2024-02-15T22:56:45.886248+0000","last_unstale":"2024-02-15T22:56:47.427488+0000","last_undegraded":"2024-02-15T22:56:47.427488+0000","last_fullsized":"2024-02-15T22:56:47.427488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:01.197599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883087+0000","last_change":"2024-02-15T22:56:03.700436+0000","last_active":"2024-02-15T22:56:45.883087+0000","last_peered":"2024-02-15T22:56:45.883087+0000","last_clean":"2024-02-15T22:56:45.883087+0000","last_became_active":"2024-02-15T22:56:03.700087+0000","last_became_peered":"2024-02-15T22:56:03.700087+0000","last_unstale":"2024-02-15T22:56:45.883087+0000","last_undegraded":"2024-02-15T22:56:45.883087+0000","last_fullsized":"2024-02-15T22:56:45.883087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:00.883899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881488+0000","last_change":"2024-02-15T22:56:07.705816+0000","last_active":"2024-02-15T22:56:45.881488+0000","last_peered":"2024-02-15T22:56:45.881488+0000","last_clean":"2024-02-15T22:56:45.881488+0000","last_became_active":"2024-02-15T22:56:07.704502+0000","last_became_peered":"2024-02-15T22:56:07.704502+0000","last_unstale":"2024-02-15T22:56:45.881488+0000","last_undegraded":"2024-02-15T22:56:45.881488+0000","last_fullsized":"2024-02-15T22:56:45.881488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:50.097695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.135060+0000","last_change":"2024-02-15T22:56:09.719447+0000","last_active":"2024-02-15T22:57:43.135060+0000","last_peered":"2024-02-15T22:57:43.135060+0000","last_clean":"2024-02-15T22:57:43.135060+0000","last_became_active":"2024-02-15T22:56:09.717174+0000","last_became_peered":"2024-02-15T22:56:09.717174+0000","last_unstale":"2024-02-15T22:57:43.135060+0000","last_undegraded":"2024-02-15T22:57:43.135060+0000","last_fullsized":"2024-02-15T22:57:43.135060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:00:15.334493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":303,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.046158+0000","last_change":"2024-02-15T22:56:11.724657+0000","last_active":"2024-02-15T22:57:43.046158+0000","last_peered":"2024-02-15T22:57:43.046158+0000","last_clean":"2024-02-15T22:57:43.046158+0000","last_became_active":"2024-02-15T22:56:11.724273+0000","last_became_peered":"2024-02-15T22:56:11.724273+0000","last_unstale":"2024-02-15T22:57:43.046158+0000","last_undegraded":"2024-02-15T22:57:43.046158+0000","last_fullsized":"2024-02-15T22:57:43.046158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:26.704898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880623+0000","last_change":"2024-02-15T22:56:13.727119+0000","last_active":"2024-02-15T22:56:45.880623+0000","last_peered":"2024-02-15T22:56:45.880623+0000","last_clean":"2024-02-15T22:56:45.880623+0000","last_became_active":"2024-02-15T22:56:13.726858+0000","last_became_peered":"2024-02-15T22:56:13.726858+0000","last_unstale":"2024-02-15T22:56:45.880623+0000","last_undegraded":"2024-02-15T22:56:45.880623+0000","last_fullsized":"2024-02-15T22:56:45.880623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:04:07.015848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391133+0000","last_change":"2024-02-15T22:56:05.702296+0000","last_active":"2024-02-15T22:57:35.391133+0000","last_peered":"2024-02-15T22:57:35.391133+0000","last_clean":"2024-02-15T22:57:35.391133+0000","last_became_active":"2024-02-15T22:56:05.701568+0000","last_became_peered":"2024-02-15T22:56:05.701568+0000","last_unstale":"2024-02-15T22:57:35.391133+0000","last_undegraded":"2024-02-15T22:57:35.391133+0000","last_fullsized":"2024-02-15T22:57:35.391133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882522+0000","last_change":"2024-02-15T22:56:03.695726+0000","last_active":"2024-02-15T22:56:45.882522+0000","last_peered":"2024-02-15T22:56:45.882522+0000","last_clean":"2024-02-15T22:56:45.882522+0000","last_became_active":"2024-02-15T22:56:03.694668+0000","last_became_peered":"2024-02-15T22:56:03.694668+0000","last_unstale":"2024-02-15T22:56:45.882522+0000","last_undegraded":"2024-02-15T22:56:45.882522+0000","last_fullsized":"2024-02-15T22:56:45.882522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:14:39.799194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879866+0000","last_change":"2024-02-15T22:56:07.705196+0000","last_active":"2024-02-15T22:56:45.879866+0000","last_peered":"2024-02-15T22:56:45.879866+0000","last_clean":"2024-02-15T22:56:45.879866+0000","last_became_active":"2024-02-15T22:56:07.704054+0000","last_became_peered":"2024-02-15T22:56:07.704054+0000","last_unstale":"2024-02-15T22:56:45.879866+0000","last_undegraded":"2024-02-15T22:56:45.879866+0000","last_fullsized":"2024-02-15T22:56:45.879866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:27:50.211880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'56","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.176511+0000","last_change":"2024-02-15T22:56:09.719365+0000","last_active":"2024-02-15T22:57:43.176511+0000","last_peered":"2024-02-15T22:57:43.176511+0000","last_clean":"2024-02-15T22:57:43.176511+0000","last_became_active":"2024-02-15T22:56:09.717264+0000","last_became_peered":"2024-02-15T22:56:09.717264+0000","last_unstale":"2024-02-15T22:57:43.176511+0000","last_undegraded":"2024-02-15T22:57:43.176511+0000","last_fullsized":"2024-02-15T22:57:43.176511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:35:46.384248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879496+0000","last_change":"2024-02-15T22:56:11.720901+0000","last_active":"2024-02-15T22:56:45.879496+0000","last_peered":"2024-02-15T22:56:45.879496+0000","last_clean":"2024-02-15T22:56:45.879496+0000","last_became_active":"2024-02-15T22:56:11.720616+0000","last_became_peered":"2024-02-15T22:56:11.720616+0000","last_unstale":"2024-02-15T22:56:45.879496+0000","last_undegraded":"2024-02-15T22:56:45.879496+0000","last_fullsized":"2024-02-15T22:56:45.879496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:05.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.431962+0000","last_change":"2024-02-15T22:56:13.729263+0000","last_active":"2024-02-15T22:56:47.431962+0000","last_peered":"2024-02-15T22:56:47.431962+0000","last_clean":"2024-02-15T22:56:47.431962+0000","last_became_active":"2024-02-15T22:56:13.729015+0000","last_became_peered":"2024-02-15T22:56:13.729015+0000","last_unstale":"2024-02-15T22:56:47.431962+0000","last_undegraded":"2024-02-15T22:56:47.431962+0000","last_fullsized":"2024-02-15T22:56:47.431962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:14:21.943618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.882591+0000","last_change":"2024-02-15T22:56:45.898518+0000","last_active":"2024-02-15T22:56:46.882591+0000","last_peered":"2024-02-15T22:56:46.882591+0000","last_clean":"2024-02-15T22:56:46.882591+0000","last_became_active":"2024-02-15T22:56:45.893017+0000","last_became_peered":"2024-02-15T22:56:45.893017+0000","last_unstale":"2024-02-15T22:56:46.882591+0000","last_undegraded":"2024-02-15T22:56:46.882591+0000","last_fullsized":"2024-02-15T22:56:46.882591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:30.466023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886880+0000","last_change":"2024-02-15T22:56:45.886880+0000","last_active":"2024-02-15T22:56:45.886880+0000","last_peered":"2024-02-15T22:56:45.886880+0000","last_clean":"2024-02-15T22:56:45.886880+0000","last_became_active":"2024-02-15T22:56:45.886530+0000","last_became_peered":"2024-02-15T22:56:45.886530+0000","last_unstale":"2024-02-15T22:56:45.886880+0000","last_undegraded":"2024-02-15T22:56:45.886880+0000","last_fullsized":"2024-02-15T22:56:45.886880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:28.547710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885865+0000","last_change":"2024-02-15T22:56:07.707514+0000","last_active":"2024-02-15T22:56:45.885865+0000","last_peered":"2024-02-15T22:56:45.885865+0000","last_clean":"2024-02-15T22:56:45.885865+0000","last_became_active":"2024-02-15T22:56:07.707207+0000","last_became_peered":"2024-02-15T22:56:07.707207+0000","last_unstale":"2024-02-15T22:56:45.885865+0000","last_undegraded":"2024-02-15T22:56:45.885865+0000","last_fullsized":"2024-02-15T22:56:45.885865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:04:07.685154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.179471+0000","last_change":"2024-02-15T22:56:09.714917+0000","last_active":"2024-02-15T22:57:43.179471+0000","last_peered":"2024-02-15T22:57:43.179471+0000","last_clean":"2024-02-15T22:57:43.179471+0000","last_became_active":"2024-02-15T22:56:09.714592+0000","last_became_peered":"2024-02-15T22:56:09.714592+0000","last_unstale":"2024-02-15T22:57:43.179471+0000","last_undegraded":"2024-02-15T22:57:43.179471+0000","last_fullsized":"2024-02-15T22:57:43.179471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:41.601789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883307+0000","last_change":"2024-02-15T22:56:11.723908+0000","last_active":"2024-02-15T22:56:45.883307+0000","last_peered":"2024-02-15T22:56:45.883307+0000","last_clean":"2024-02-15T22:56:45.883307+0000","last_became_active":"2024-02-15T22:56:11.723557+0000","last_became_peered":"2024-02-15T22:56:11.723557+0000","last_unstale":"2024-02-15T22:56:45.883307+0000","last_undegraded":"2024-02-15T22:56:45.883307+0000","last_fullsized":"2024-02-15T22:56:45.883307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:11:50.121452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879474+0000","last_change":"2024-02-15T22:56:13.727205+0000","last_active":"2024-02-15T22:56:45.879474+0000","last_peered":"2024-02-15T22:56:45.879474+0000","last_clean":"2024-02-15T22:56:45.879474+0000","last_became_active":"2024-02-15T22:56:13.726586+0000","last_became_peered":"2024-02-15T22:56:13.726586+0000","last_unstale":"2024-02-15T22:56:45.879474+0000","last_undegraded":"2024-02-15T22:56:45.879474+0000","last_fullsized":"2024-02-15T22:56:45.879474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:34:15.904436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884445+0000","last_change":"2024-02-15T22:56:05.717008+0000","last_active":"2024-02-15T22:56:45.884445+0000","last_peered":"2024-02-15T22:56:45.884445+0000","last_clean":"2024-02-15T22:56:45.884445+0000","last_became_active":"2024-02-15T22:56:05.716590+0000","last_became_peered":"2024-02-15T22:56:05.716590+0000","last_unstale":"2024-02-15T22:56:45.884445+0000","last_undegraded":"2024-02-15T22:56:45.884445+0000","last_fullsized":"2024-02-15T22:56:45.884445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:02:19.362660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884747+0000","last_change":"2024-02-15T22:56:03.703244+0000","last_active":"2024-02-15T22:56:45.884747+0000","last_peered":"2024-02-15T22:56:45.884747+0000","last_clean":"2024-02-15T22:56:45.884747+0000","last_became_active":"2024-02-15T22:56:03.702875+0000","last_became_peered":"2024-02-15T22:56:03.702875+0000","last_unstale":"2024-02-15T22:56:45.884747+0000","last_undegraded":"2024-02-15T22:56:45.884747+0000","last_fullsized":"2024-02-15T22:56:45.884747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:09.868485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881664+0000","last_change":"2024-02-15T22:56:07.704747+0000","last_active":"2024-02-15T22:56:45.881664+0000","last_peered":"2024-02-15T22:56:45.881664+0000","last_clean":"2024-02-15T22:56:45.881664+0000","last_became_active":"2024-02-15T22:56:07.704058+0000","last_became_peered":"2024-02-15T22:56:07.704058+0000","last_unstale":"2024-02-15T22:56:45.881664+0000","last_undegraded":"2024-02-15T22:56:45.881664+0000","last_fullsized":"2024-02-15T22:56:45.881664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:47.729859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'38","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.159068+0000","last_change":"2024-02-15T22:56:09.712396+0000","last_active":"2024-02-15T22:57:43.159068+0000","last_peered":"2024-02-15T22:57:43.159068+0000","last_clean":"2024-02-15T22:57:43.159068+0000","last_became_active":"2024-02-15T22:56:09.712113+0000","last_became_peered":"2024-02-15T22:56:09.712113+0000","last_unstale":"2024-02-15T22:57:43.159068+0000","last_undegraded":"2024-02-15T22:57:43.159068+0000","last_fullsized":"2024-02-15T22:57:43.159068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:37.230068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":334,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.041486+0000","last_change":"2024-02-15T22:56:11.720788+0000","last_active":"2024-02-15T22:57:43.041486+0000","last_peered":"2024-02-15T22:57:43.041486+0000","last_clean":"2024-02-15T22:57:43.041486+0000","last_became_active":"2024-02-15T22:56:11.720390+0000","last_became_peered":"2024-02-15T22:56:11.720390+0000","last_unstale":"2024-02-15T22:57:43.041486+0000","last_undegraded":"2024-02-15T22:57:43.041486+0000","last_fullsized":"2024-02-15T22:57:43.041486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:37.820803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.895237+0000","last_change":"2024-02-15T22:56:13.734537+0000","last_active":"2024-02-15T22:57:29.895237+0000","last_peered":"2024-02-15T22:57:29.895237+0000","last_clean":"2024-02-15T22:57:29.895237+0000","last_became_active":"2024-02-15T22:56:13.734227+0000","last_became_peered":"2024-02-15T22:56:13.734227+0000","last_unstale":"2024-02-15T22:57:29.895237+0000","last_undegraded":"2024-02-15T22:57:29.895237+0000","last_fullsized":"2024-02-15T22:57:29.895237+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:14.942284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887843+0000","last_change":"2024-02-15T22:56:05.706339+0000","last_active":"2024-02-15T22:56:45.887843+0000","last_peered":"2024-02-15T22:56:45.887843+0000","last_clean":"2024-02-15T22:56:45.887843+0000","last_became_active":"2024-02-15T22:56:05.705551+0000","last_became_peered":"2024-02-15T22:56:05.705551+0000","last_unstale":"2024-02-15T22:56:45.887843+0000","last_undegraded":"2024-02-15T22:56:45.887843+0000","last_fullsized":"2024-02-15T22:56:45.887843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.420706+0000","last_change":"2024-02-15T22:56:03.704800+0000","last_active":"2024-02-15T22:56:47.420706+0000","last_peered":"2024-02-15T22:56:47.420706+0000","last_clean":"2024-02-15T22:56:47.420706+0000","last_became_active":"2024-02-15T22:56:03.704526+0000","last_became_peered":"2024-02-15T22:56:03.704526+0000","last_unstale":"2024-02-15T22:56:47.420706+0000","last_undegraded":"2024-02-15T22:56:47.420706+0000","last_fullsized":"2024-02-15T22:56:47.420706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:08:44.767171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'8","reported_seq":536,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.022968+0000","last_change":"2024-02-15T22:56:07.704570+0000","last_active":"2024-02-15T22:57:43.022968+0000","last_peered":"2024-02-15T22:57:43.022968+0000","last_clean":"2024-02-15T22:57:43.022968+0000","last_became_active":"2024-02-15T22:56:07.704281+0000","last_became_peered":"2024-02-15T22:56:07.704281+0000","last_unstale":"2024-02-15T22:57:43.022968+0000","last_undegraded":"2024-02-15T22:57:43.022968+0000","last_fullsized":"2024-02-15T22:57:43.022968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:48:03.804538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":595,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882855+0000","last_change":"2024-02-15T22:56:09.719243+0000","last_active":"2024-02-15T22:56:45.882855+0000","last_peered":"2024-02-15T22:56:45.882855+0000","last_clean":"2024-02-15T22:56:45.882855+0000","last_became_active":"2024-02-15T22:56:09.717735+0000","last_became_peered":"2024-02-15T22:56:09.717735+0000","last_unstale":"2024-02-15T22:56:45.882855+0000","last_undegraded":"2024-02-15T22:56:45.882855+0000","last_fullsized":"2024-02-15T22:56:45.882855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:28:54.383976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":377,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.042612+0000","last_change":"2024-02-15T22:56:11.717718+0000","last_active":"2024-02-15T22:57:43.042612+0000","last_peered":"2024-02-15T22:57:43.042612+0000","last_clean":"2024-02-15T22:57:43.042612+0000","last_became_active":"2024-02-15T22:56:11.717380+0000","last_became_peered":"2024-02-15T22:56:11.717380+0000","last_unstale":"2024-02-15T22:57:43.042612+0000","last_undegraded":"2024-02-15T22:57:43.042612+0000","last_fullsized":"2024-02-15T22:57:43.042612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:49.146038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.381482+0000","last_change":"2024-02-15T22:56:13.729765+0000","last_active":"2024-02-15T22:57:35.381482+0000","last_peered":"2024-02-15T22:57:35.381482+0000","last_clean":"2024-02-15T22:57:35.381482+0000","last_became_active":"2024-02-15T22:56:13.729467+0000","last_became_peered":"2024-02-15T22:56:13.729467+0000","last_unstale":"2024-02-15T22:57:35.381482+0000","last_undegraded":"2024-02-15T22:57:35.381482+0000","last_fullsized":"2024-02-15T22:57:35.381482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:37.969353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"30'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.901891+0000","last_change":"2024-02-15T22:56:45.901463+0000","last_active":"2024-02-15T22:56:45.901891+0000","last_peered":"2024-02-15T22:56:45.901891+0000","last_clean":"2024-02-15T22:56:45.901891+0000","last_became_active":"2024-02-15T22:56:45.892949+0000","last_became_peered":"2024-02-15T22:56:45.892949+0000","last_unstale":"2024-02-15T22:56:45.901891+0000","last_undegraded":"2024-02-15T22:56:45.901891+0000","last_fullsized":"2024-02-15T22:56:45.901891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:07:27.041414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879850+0000","last_change":"2024-02-15T22:56:03.702334+0000","last_active":"2024-02-15T22:56:45.879850+0000","last_peered":"2024-02-15T22:56:45.879850+0000","last_clean":"2024-02-15T22:56:45.879850+0000","last_became_active":"2024-02-15T22:56:03.702035+0000","last_became_peered":"2024-02-15T22:56:03.702035+0000","last_unstale":"2024-02-15T22:56:45.879850+0000","last_undegraded":"2024-02-15T22:56:45.879850+0000","last_fullsized":"2024-02-15T22:56:45.879850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:00.410598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883534+0000","last_change":"2024-02-15T22:56:07.706890+0000","last_active":"2024-02-15T22:56:45.883534+0000","last_peered":"2024-02-15T22:56:45.883534+0000","last_clean":"2024-02-15T22:56:45.883534+0000","last_became_active":"2024-02-15T22:56:07.706615+0000","last_became_peered":"2024-02-15T22:56:07.706615+0000","last_unstale":"2024-02-15T22:56:45.883534+0000","last_undegraded":"2024-02-15T22:56:45.883534+0000","last_fullsized":"2024-02-15T22:56:45.883534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:00.323059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.119649+0000","last_change":"2024-02-15T22:56:09.714286+0000","last_active":"2024-02-15T22:57:43.119649+0000","last_peered":"2024-02-15T22:57:43.119649+0000","last_clean":"2024-02-15T22:57:43.119649+0000","last_became_active":"2024-02-15T22:56:09.713660+0000","last_became_peered":"2024-02-15T22:56:09.713660+0000","last_unstale":"2024-02-15T22:57:43.119649+0000","last_undegraded":"2024-02-15T22:57:43.119649+0000","last_fullsized":"2024-02-15T22:57:43.119649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:40.603660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885416+0000","last_change":"2024-02-15T22:56:11.724920+0000","last_active":"2024-02-15T22:56:45.885416+0000","last_peered":"2024-02-15T22:56:45.885416+0000","last_clean":"2024-02-15T22:56:45.885416+0000","last_became_active":"2024-02-15T22:56:11.724575+0000","last_became_peered":"2024-02-15T22:56:11.724575+0000","last_unstale":"2024-02-15T22:56:45.885416+0000","last_undegraded":"2024-02-15T22:56:45.885416+0000","last_fullsized":"2024-02-15T22:56:45.885416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:32.467517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878828+0000","last_change":"2024-02-15T22:56:13.722807+0000","last_active":"2024-02-15T22:56:45.878828+0000","last_peered":"2024-02-15T22:56:45.878828+0000","last_clean":"2024-02-15T22:56:45.878828+0000","last_became_active":"2024-02-15T22:56:13.722550+0000","last_became_peered":"2024-02-15T22:56:13.722550+0000","last_unstale":"2024-02-15T22:56:45.878828+0000","last_undegraded":"2024-02-15T22:56:45.878828+0000","last_fullsized":"2024-02-15T22:56:45.878828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:07:35.067373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883476+0000","last_change":"2024-02-15T22:56:05.715752+0000","last_active":"2024-02-15T22:56:45.883476+0000","last_peered":"2024-02-15T22:56:45.883476+0000","last_clean":"2024-02-15T22:56:45.883476+0000","last_became_active":"2024-02-15T22:56:05.715513+0000","last_became_peered":"2024-02-15T22:56:05.715513+0000","last_unstale":"2024-02-15T22:56:45.883476+0000","last_undegraded":"2024-02-15T22:56:45.883476+0000","last_fullsized":"2024-02-15T22:56:45.883476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:26.448260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":198,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.877414+0000","last_change":"2024-02-15T22:55:52.658778+0000","last_active":"2024-02-15T22:56:45.877414+0000","last_peered":"2024-02-15T22:56:45.877414+0000","last_clean":"2024-02-15T22:56:45.877414+0000","last_became_active":"2024-02-15T22:55:52.657750+0000","last_became_peered":"2024-02-15T22:55:52.657750+0000","last_unstale":"2024-02-15T22:56:45.877414+0000","last_undegraded":"2024-02-15T22:56:45.877414+0000","last_fullsized":"2024-02-15T22:56:45.877414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_clean_scrub_stamp":"2024-02-15T22:55:51.648340+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:04:26.306952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880599+0000","last_change":"2024-02-15T22:55:57.672733+0000","last_active":"2024-02-15T22:56:45.880599+0000","last_peered":"2024-02-15T22:56:45.880599+0000","last_clean":"2024-02-15T22:56:45.880599+0000","last_became_active":"2024-02-15T22:55:57.672281+0000","last_became_peered":"2024-02-15T22:55:57.672281+0000","last_unstale":"2024-02-15T22:56:45.880599+0000","last_undegraded":"2024-02-15T22:56:45.880599+0000","last_fullsized":"2024-02-15T22:56:45.880599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:16:13.571164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881021+0000","last_change":"2024-02-15T22:56:03.707343+0000","last_active":"2024-02-15T22:56:45.881021+0000","last_peered":"2024-02-15T22:56:45.881021+0000","last_clean":"2024-02-15T22:56:45.881021+0000","last_became_active":"2024-02-15T22:56:03.706721+0000","last_became_peered":"2024-02-15T22:56:03.706721+0000","last_unstale":"2024-02-15T22:56:45.881021+0000","last_undegraded":"2024-02-15T22:56:45.881021+0000","last_fullsized":"2024-02-15T22:56:45.881021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:35.787671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887614+0000","last_change":"2024-02-15T22:56:45.887614+0000","last_active":"2024-02-15T22:56:45.887614+0000","last_peered":"2024-02-15T22:56:45.887614+0000","last_clean":"2024-02-15T22:56:45.887614+0000","last_became_active":"2024-02-15T22:56:45.887260+0000","last_became_peered":"2024-02-15T22:56:45.887260+0000","last_unstale":"2024-02-15T22:56:45.887614+0000","last_undegraded":"2024-02-15T22:56:45.887614+0000","last_fullsized":"2024-02-15T22:56:45.887614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:00:13.328033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'79","reported_seq":159,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.152607+0000","last_change":"2024-02-15T22:56:09.717520+0000","last_active":"2024-02-15T22:57:43.152607+0000","last_peered":"2024-02-15T22:57:43.152607+0000","last_clean":"2024-02-15T22:57:43.152607+0000","last_became_active":"2024-02-15T22:56:09.716109+0000","last_became_peered":"2024-02-15T22:56:09.716109+0000","last_unstale":"2024-02-15T22:57:43.152607+0000","last_undegraded":"2024-02-15T22:57:43.152607+0000","last_fullsized":"2024-02-15T22:57:43.152607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:43:27.838853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881677+0000","last_change":"2024-02-15T22:56:11.722725+0000","last_active":"2024-02-15T22:56:45.881677+0000","last_peered":"2024-02-15T22:56:45.881677+0000","last_clean":"2024-02-15T22:56:45.881677+0000","last_became_active":"2024-02-15T22:56:11.722390+0000","last_became_peered":"2024-02-15T22:56:11.722390+0000","last_unstale":"2024-02-15T22:56:45.881677+0000","last_undegraded":"2024-02-15T22:56:45.881677+0000","last_fullsized":"2024-02-15T22:56:45.881677+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:51:01.453104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.402200+0000","last_change":"2024-02-15T22:56:13.732746+0000","last_active":"2024-02-15T22:57:35.402200+0000","last_peered":"2024-02-15T22:57:35.402200+0000","last_clean":"2024-02-15T22:57:35.402200+0000","last_became_active":"2024-02-15T22:56:13.732437+0000","last_became_peered":"2024-02-15T22:56:13.732437+0000","last_unstale":"2024-02-15T22:57:35.402200+0000","last_undegraded":"2024-02-15T22:57:35.402200+0000","last_fullsized":"2024-02-15T22:57:35.402200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:19:49.186383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883640+0000","last_change":"2024-02-15T22:56:05.700559+0000","last_active":"2024-02-15T22:56:45.883640+0000","last_peered":"2024-02-15T22:56:45.883640+0000","last_clean":"2024-02-15T22:56:45.883640+0000","last_became_active":"2024-02-15T22:56:05.699679+0000","last_became_peered":"2024-02-15T22:56:05.699679+0000","last_unstale":"2024-02-15T22:56:45.883640+0000","last_undegraded":"2024-02-15T22:56:45.883640+0000","last_fullsized":"2024-02-15T22:56:45.883640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:31.801546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879712+0000","last_change":"2024-02-15T22:55:57.673021+0000","last_active":"2024-02-15T22:56:45.879712+0000","last_peered":"2024-02-15T22:56:45.879712+0000","last_clean":"2024-02-15T22:56:45.879712+0000","last_became_active":"2024-02-15T22:55:57.672705+0000","last_became_peered":"2024-02-15T22:55:57.672705+0000","last_unstale":"2024-02-15T22:56:45.879712+0000","last_undegraded":"2024-02-15T22:56:45.879712+0000","last_fullsized":"2024-02-15T22:56:45.879712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:51.539454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879585+0000","last_change":"2024-02-15T22:56:03.700496+0000","last_active":"2024-02-15T22:56:45.879585+0000","last_peered":"2024-02-15T22:56:45.879585+0000","last_clean":"2024-02-15T22:56:45.879585+0000","last_became_active":"2024-02-15T22:56:03.699864+0000","last_became_peered":"2024-02-15T22:56:03.699864+0000","last_unstale":"2024-02-15T22:56:45.879585+0000","last_undegraded":"2024-02-15T22:56:45.879585+0000","last_fullsized":"2024-02-15T22:56:45.879585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:10.357204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884516+0000","last_change":"2024-02-15T22:56:07.707939+0000","last_active":"2024-02-15T22:56:45.884516+0000","last_peered":"2024-02-15T22:56:45.884516+0000","last_clean":"2024-02-15T22:56:45.884516+0000","last_became_active":"2024-02-15T22:56:07.707620+0000","last_became_peered":"2024-02-15T22:56:07.707620+0000","last_unstale":"2024-02-15T22:56:45.884516+0000","last_undegraded":"2024-02-15T22:56:45.884516+0000","last_fullsized":"2024-02-15T22:56:45.884516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:53.492048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'250","reported_seq":431,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.171477+0000","last_change":"2024-02-15T22:56:09.718681+0000","last_active":"2024-02-15T22:57:43.171477+0000","last_peered":"2024-02-15T22:57:43.171477+0000","last_clean":"2024-02-15T22:57:43.171477+0000","last_became_active":"2024-02-15T22:56:09.718396+0000","last_became_peered":"2024-02-15T22:56:09.718396+0000","last_unstale":"2024-02-15T22:57:43.171477+0000","last_undegraded":"2024-02-15T22:57:43.171477+0000","last_fullsized":"2024-02-15T22:57:43.171477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:24.765590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880720+0000","last_change":"2024-02-15T22:56:11.725286+0000","last_active":"2024-02-15T22:56:45.880720+0000","last_peered":"2024-02-15T22:56:45.880720+0000","last_clean":"2024-02-15T22:56:45.880720+0000","last_became_active":"2024-02-15T22:56:11.725005+0000","last_became_peered":"2024-02-15T22:56:11.725005+0000","last_unstale":"2024-02-15T22:56:45.880720+0000","last_undegraded":"2024-02-15T22:56:45.880720+0000","last_fullsized":"2024-02-15T22:56:45.880720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:29.599168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:24.184779+0000","last_change":"2024-02-15T22:56:13.734036+0000","last_active":"2024-02-15T22:57:24.184779+0000","last_peered":"2024-02-15T22:57:24.184779+0000","last_clean":"2024-02-15T22:57:24.184779+0000","last_became_active":"2024-02-15T22:56:13.733760+0000","last_became_peered":"2024-02-15T22:56:13.733760+0000","last_unstale":"2024-02-15T22:57:24.184779+0000","last_undegraded":"2024-02-15T22:57:24.184779+0000","last_fullsized":"2024-02-15T22:57:24.184779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:52.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881842+0000","last_change":"2024-02-15T22:56:05.706098+0000","last_active":"2024-02-15T22:56:45.881842+0000","last_peered":"2024-02-15T22:56:45.881842+0000","last_clean":"2024-02-15T22:56:45.881842+0000","last_became_active":"2024-02-15T22:56:05.704953+0000","last_became_peered":"2024-02-15T22:56:05.704953+0000","last_unstale":"2024-02-15T22:56:45.881842+0000","last_undegraded":"2024-02-15T22:56:45.881842+0000","last_fullsized":"2024-02-15T22:56:45.881842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:08.839506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881265+0000","last_change":"2024-02-15T22:55:57.671425+0000","last_active":"2024-02-15T22:56:45.881265+0000","last_peered":"2024-02-15T22:56:45.881265+0000","last_clean":"2024-02-15T22:56:45.881265+0000","last_became_active":"2024-02-15T22:55:57.671130+0000","last_became_peered":"2024-02-15T22:55:57.671130+0000","last_unstale":"2024-02-15T22:56:45.881265+0000","last_undegraded":"2024-02-15T22:56:45.881265+0000","last_fullsized":"2024-02-15T22:56:45.881265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:07:19.263513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878991+0000","last_change":"2024-02-15T22:56:03.700250+0000","last_active":"2024-02-15T22:56:45.878991+0000","last_peered":"2024-02-15T22:56:45.878991+0000","last_clean":"2024-02-15T22:56:45.878991+0000","last_became_active":"2024-02-15T22:56:03.699598+0000","last_became_peered":"2024-02-15T22:56:03.699598+0000","last_unstale":"2024-02-15T22:56:45.878991+0000","last_undegraded":"2024-02-15T22:56:45.878991+0000","last_fullsized":"2024-02-15T22:56:45.878991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887215+0000","last_change":"2024-02-15T22:56:07.704552+0000","last_active":"2024-02-15T22:56:45.887215+0000","last_peered":"2024-02-15T22:56:45.887215+0000","last_clean":"2024-02-15T22:56:45.887215+0000","last_became_active":"2024-02-15T22:56:07.704107+0000","last_became_peered":"2024-02-15T22:56:07.704107+0000","last_unstale":"2024-02-15T22:56:45.887215+0000","last_undegraded":"2024-02-15T22:56:45.887215+0000","last_fullsized":"2024-02-15T22:56:45.887215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:40.761923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.400847+0000","last_change":"2024-02-15T22:56:09.711955+0000","last_active":"2024-02-15T22:57:35.400847+0000","last_peered":"2024-02-15T22:57:35.400847+0000","last_clean":"2024-02-15T22:57:35.400847+0000","last_became_active":"2024-02-15T22:56:09.711494+0000","last_became_peered":"2024-02-15T22:56:09.711494+0000","last_unstale":"2024-02-15T22:57:35.400847+0000","last_undegraded":"2024-02-15T22:57:35.400847+0000","last_fullsized":"2024-02-15T22:57:35.400847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:59.298944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880617+0000","last_change":"2024-02-15T22:56:11.722621+0000","last_active":"2024-02-15T22:56:45.880617+0000","last_peered":"2024-02-15T22:56:45.880617+0000","last_clean":"2024-02-15T22:56:45.880617+0000","last_became_active":"2024-02-15T22:56:11.722277+0000","last_became_peered":"2024-02-15T22:56:11.722277+0000","last_unstale":"2024-02-15T22:56:45.880617+0000","last_undegraded":"2024-02-15T22:56:45.880617+0000","last_fullsized":"2024-02-15T22:56:45.880617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:26.041161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880049+0000","last_change":"2024-02-15T22:56:13.726439+0000","last_active":"2024-02-15T22:56:45.880049+0000","last_peered":"2024-02-15T22:56:45.880049+0000","last_clean":"2024-02-15T22:56:45.880049+0000","last_became_active":"2024-02-15T22:56:13.726165+0000","last_became_peered":"2024-02-15T22:56:13.726165+0000","last_unstale":"2024-02-15T22:56:45.880049+0000","last_undegraded":"2024-02-15T22:56:45.880049+0000","last_fullsized":"2024-02-15T22:56:45.880049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:04.405292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'7","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214367+0000","last_change":"2024-02-15T22:56:05.707494+0000","last_active":"2024-02-15T22:57:29.214367+0000","last_peered":"2024-02-15T22:57:29.214367+0000","last_clean":"2024-02-15T22:57:29.214367+0000","last_became_active":"2024-02-15T22:56:05.707171+0000","last_became_peered":"2024-02-15T22:56:05.707171+0000","last_unstale":"2024-02-15T22:57:29.214367+0000","last_undegraded":"2024-02-15T22:57:29.214367+0000","last_fullsized":"2024-02-15T22:57:29.214367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:27:41.335097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880918+0000","last_change":"2024-02-15T22:55:57.672717+0000","last_active":"2024-02-15T22:56:45.880918+0000","last_peered":"2024-02-15T22:56:45.880918+0000","last_clean":"2024-02-15T22:56:45.880918+0000","last_became_active":"2024-02-15T22:55:57.672268+0000","last_became_peered":"2024-02-15T22:55:57.672268+0000","last_unstale":"2024-02-15T22:56:45.880918+0000","last_undegraded":"2024-02-15T22:56:45.880918+0000","last_fullsized":"2024-02-15T22:56:45.880918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:32.276372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882540+0000","last_change":"2024-02-15T22:56:03.697249+0000","last_active":"2024-02-15T22:56:45.882540+0000","last_peered":"2024-02-15T22:56:45.882540+0000","last_clean":"2024-02-15T22:56:45.882540+0000","last_became_active":"2024-02-15T22:56:03.693487+0000","last_became_peered":"2024-02-15T22:56:03.693487+0000","last_unstale":"2024-02-15T22:56:45.882540+0000","last_undegraded":"2024-02-15T22:56:45.882540+0000","last_fullsized":"2024-02-15T22:56:45.882540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:50.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880819+0000","last_change":"2024-02-15T22:56:07.707628+0000","last_active":"2024-02-15T22:56:45.880819+0000","last_peered":"2024-02-15T22:56:45.880819+0000","last_clean":"2024-02-15T22:56:45.880819+0000","last_became_active":"2024-02-15T22:56:07.707227+0000","last_became_peered":"2024-02-15T22:56:07.707227+0000","last_unstale":"2024-02-15T22:56:45.880819+0000","last_undegraded":"2024-02-15T22:56:45.880819+0000","last_fullsized":"2024-02-15T22:56:45.880819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:41:38.827598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884038+0000","last_change":"2024-02-15T22:56:09.720954+0000","last_active":"2024-02-15T22:56:45.884038+0000","last_peered":"2024-02-15T22:56:45.884038+0000","last_clean":"2024-02-15T22:56:45.884038+0000","last_became_active":"2024-02-15T22:56:09.719999+0000","last_became_peered":"2024-02-15T22:56:09.719999+0000","last_unstale":"2024-02-15T22:56:45.884038+0000","last_undegraded":"2024-02-15T22:56:45.884038+0000","last_fullsized":"2024-02-15T22:56:45.884038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:57.194342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883698+0000","last_change":"2024-02-15T22:56:11.724029+0000","last_active":"2024-02-15T22:56:45.883698+0000","last_peered":"2024-02-15T22:56:45.883698+0000","last_clean":"2024-02-15T22:56:45.883698+0000","last_became_active":"2024-02-15T22:56:11.723718+0000","last_became_peered":"2024-02-15T22:56:11.723718+0000","last_unstale":"2024-02-15T22:56:45.883698+0000","last_undegraded":"2024-02-15T22:56:45.883698+0000","last_fullsized":"2024-02-15T22:56:45.883698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:43:01.476474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878038+0000","last_change":"2024-02-15T22:56:13.731187+0000","last_active":"2024-02-15T22:56:45.878038+0000","last_peered":"2024-02-15T22:56:45.878038+0000","last_clean":"2024-02-15T22:56:45.878038+0000","last_became_active":"2024-02-15T22:56:13.730551+0000","last_became_peered":"2024-02-15T22:56:13.730551+0000","last_unstale":"2024-02-15T22:56:45.878038+0000","last_undegraded":"2024-02-15T22:56:45.878038+0000","last_fullsized":"2024-02-15T22:56:45.878038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:00.259943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907683+0000","last_change":"2024-02-15T22:56:05.714866+0000","last_active":"2024-02-15T22:56:47.907683+0000","last_peered":"2024-02-15T22:56:47.907683+0000","last_clean":"2024-02-15T22:56:47.907683+0000","last_became_active":"2024-02-15T22:56:05.714389+0000","last_became_peered":"2024-02-15T22:56:05.714389+0000","last_unstale":"2024-02-15T22:56:47.907683+0000","last_undegraded":"2024-02-15T22:56:47.907683+0000","last_fullsized":"2024-02-15T22:56:47.907683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:02.890481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886225+0000","last_change":"2024-02-15T22:56:03.693895+0000","last_active":"2024-02-15T22:56:45.886225+0000","last_peered":"2024-02-15T22:56:45.886225+0000","last_clean":"2024-02-15T22:56:45.886225+0000","last_became_active":"2024-02-15T22:56:03.693005+0000","last_became_peered":"2024-02-15T22:56:03.693005+0000","last_unstale":"2024-02-15T22:56:45.886225+0000","last_undegraded":"2024-02-15T22:56:45.886225+0000","last_fullsized":"2024-02-15T22:56:45.886225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880275+0000","last_change":"2024-02-15T22:55:57.671879+0000","last_active":"2024-02-15T22:56:45.880275+0000","last_peered":"2024-02-15T22:56:45.880275+0000","last_clean":"2024-02-15T22:56:45.880275+0000","last_became_active":"2024-02-15T22:55:57.671524+0000","last_became_peered":"2024-02-15T22:55:57.671524+0000","last_unstale":"2024-02-15T22:56:45.880275+0000","last_undegraded":"2024-02-15T22:56:45.880275+0000","last_fullsized":"2024-02-15T22:56:45.880275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:09:17.624102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880296+0000","last_change":"2024-02-15T22:56:07.707991+0000","last_active":"2024-02-15T22:56:45.880296+0000","last_peered":"2024-02-15T22:56:45.880296+0000","last_clean":"2024-02-15T22:56:45.880296+0000","last_became_active":"2024-02-15T22:56:07.707281+0000","last_became_peered":"2024-02-15T22:56:07.707281+0000","last_unstale":"2024-02-15T22:56:45.880296+0000","last_undegraded":"2024-02-15T22:56:45.880296+0000","last_fullsized":"2024-02-15T22:56:45.880296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:33:01.136377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'62","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.155995+0000","last_change":"2024-02-15T22:56:09.717947+0000","last_active":"2024-02-15T22:57:43.155995+0000","last_peered":"2024-02-15T22:57:43.155995+0000","last_clean":"2024-02-15T22:57:43.155995+0000","last_became_active":"2024-02-15T22:56:09.717692+0000","last_became_peered":"2024-02-15T22:56:09.717692+0000","last_unstale":"2024-02-15T22:57:43.155995+0000","last_undegraded":"2024-02-15T22:57:43.155995+0000","last_fullsized":"2024-02-15T22:57:43.155995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:32.340996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881741+0000","last_change":"2024-02-15T22:56:11.718632+0000","last_active":"2024-02-15T22:56:45.881741+0000","last_peered":"2024-02-15T22:56:45.881741+0000","last_clean":"2024-02-15T22:56:45.881741+0000","last_became_active":"2024-02-15T22:56:11.718332+0000","last_became_peered":"2024-02-15T22:56:11.718332+0000","last_unstale":"2024-02-15T22:56:45.881741+0000","last_undegraded":"2024-02-15T22:56:45.881741+0000","last_fullsized":"2024-02-15T22:56:45.881741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:38.078071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.872820+0000","last_change":"2024-02-15T22:56:13.723843+0000","last_active":"2024-02-15T22:57:29.872820+0000","last_peered":"2024-02-15T22:57:29.872820+0000","last_clean":"2024-02-15T22:57:29.872820+0000","last_became_active":"2024-02-15T22:56:13.723512+0000","last_became_peered":"2024-02-15T22:56:13.723512+0000","last_unstale":"2024-02-15T22:57:29.872820+0000","last_undegraded":"2024-02-15T22:57:29.872820+0000","last_fullsized":"2024-02-15T22:57:29.872820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:05:21.916643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.906030+0000","last_change":"2024-02-15T22:56:05.713346+0000","last_active":"2024-02-15T22:56:47.906030+0000","last_peered":"2024-02-15T22:56:47.906030+0000","last_clean":"2024-02-15T22:56:47.906030+0000","last_became_active":"2024-02-15T22:56:05.713036+0000","last_became_peered":"2024-02-15T22:56:05.713036+0000","last_unstale":"2024-02-15T22:56:47.906030+0000","last_undegraded":"2024-02-15T22:56:47.906030+0000","last_fullsized":"2024-02-15T22:56:47.906030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:53.786957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880599+0000","last_change":"2024-02-15T22:56:03.699990+0000","last_active":"2024-02-15T22:56:45.880599+0000","last_peered":"2024-02-15T22:56:45.880599+0000","last_clean":"2024-02-15T22:56:45.880599+0000","last_became_active":"2024-02-15T22:56:03.699564+0000","last_became_peered":"2024-02-15T22:56:03.699564+0000","last_unstale":"2024-02-15T22:56:45.880599+0000","last_undegraded":"2024-02-15T22:56:45.880599+0000","last_fullsized":"2024-02-15T22:56:45.880599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:50.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882944+0000","last_change":"2024-02-15T22:55:57.672438+0000","last_active":"2024-02-15T22:56:45.882944+0000","last_peered":"2024-02-15T22:56:45.882944+0000","last_clean":"2024-02-15T22:56:45.882944+0000","last_became_active":"2024-02-15T22:55:57.672053+0000","last_became_peered":"2024-02-15T22:55:57.672053+0000","last_unstale":"2024-02-15T22:56:45.882944+0000","last_undegraded":"2024-02-15T22:56:45.882944+0000","last_fullsized":"2024-02-15T22:56:45.882944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:01.363343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.893645+0000","last_change":"2024-02-15T22:56:45.893645+0000","last_active":"2024-02-15T22:56:45.893645+0000","last_peered":"2024-02-15T22:56:45.893645+0000","last_clean":"2024-02-15T22:56:45.893645+0000","last_became_active":"2024-02-15T22:56:45.893109+0000","last_became_peered":"2024-02-15T22:56:45.893109+0000","last_unstale":"2024-02-15T22:56:45.893645+0000","last_undegraded":"2024-02-15T22:56:45.893645+0000","last_fullsized":"2024-02-15T22:56:45.893645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:43:22.299794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878306+0000","last_change":"2024-02-15T22:56:09.721473+0000","last_active":"2024-02-15T22:56:45.878306+0000","last_peered":"2024-02-15T22:56:45.878306+0000","last_clean":"2024-02-15T22:56:45.878306+0000","last_became_active":"2024-02-15T22:56:09.721140+0000","last_became_peered":"2024-02-15T22:56:09.721140+0000","last_unstale":"2024-02-15T22:56:45.878306+0000","last_undegraded":"2024-02-15T22:56:45.878306+0000","last_fullsized":"2024-02-15T22:56:45.878306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:46:35.814733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":280,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.039125+0000","last_change":"2024-02-15T22:56:11.717865+0000","last_active":"2024-02-15T22:57:43.039125+0000","last_peered":"2024-02-15T22:57:43.039125+0000","last_clean":"2024-02-15T22:57:43.039125+0000","last_became_active":"2024-02-15T22:56:11.717544+0000","last_became_peered":"2024-02-15T22:56:11.717544+0000","last_unstale":"2024-02-15T22:57:43.039125+0000","last_undegraded":"2024-02-15T22:57:43.039125+0000","last_fullsized":"2024-02-15T22:57:43.039125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:08.103224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883381+0000","last_change":"2024-02-15T22:56:13.728952+0000","last_active":"2024-02-15T22:56:45.883381+0000","last_peered":"2024-02-15T22:56:45.883381+0000","last_clean":"2024-02-15T22:56:45.883381+0000","last_became_active":"2024-02-15T22:56:13.728228+0000","last_became_peered":"2024-02-15T22:56:13.728228+0000","last_unstale":"2024-02-15T22:56:45.883381+0000","last_undegraded":"2024-02-15T22:56:45.883381+0000","last_fullsized":"2024-02-15T22:56:45.883381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:28.350108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907892+0000","last_change":"2024-02-15T22:56:05.711219+0000","last_active":"2024-02-15T22:56:47.907892+0000","last_peered":"2024-02-15T22:56:47.907892+0000","last_clean":"2024-02-15T22:56:47.907892+0000","last_became_active":"2024-02-15T22:56:05.710924+0000","last_became_peered":"2024-02-15T22:56:05.710924+0000","last_unstale":"2024-02-15T22:56:47.907892+0000","last_undegraded":"2024-02-15T22:56:47.907892+0000","last_fullsized":"2024-02-15T22:56:47.907892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:00.260239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884070+0000","last_change":"2024-02-15T22:56:03.696202+0000","last_active":"2024-02-15T22:56:45.884070+0000","last_peered":"2024-02-15T22:56:45.884070+0000","last_clean":"2024-02-15T22:56:45.884070+0000","last_became_active":"2024-02-15T22:56:03.695921+0000","last_became_peered":"2024-02-15T22:56:03.695921+0000","last_unstale":"2024-02-15T22:56:45.884070+0000","last_undegraded":"2024-02-15T22:56:45.884070+0000","last_fullsized":"2024-02-15T22:56:45.884070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:41:10.975589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880782+0000","last_change":"2024-02-15T22:55:57.671686+0000","last_active":"2024-02-15T22:56:45.880782+0000","last_peered":"2024-02-15T22:56:45.880782+0000","last_clean":"2024-02-15T22:56:45.880782+0000","last_became_active":"2024-02-15T22:55:57.671257+0000","last_became_peered":"2024-02-15T22:55:57.671257+0000","last_unstale":"2024-02-15T22:56:45.880782+0000","last_undegraded":"2024-02-15T22:56:45.880782+0000","last_fullsized":"2024-02-15T22:56:45.880782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:04.954542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882599+0000","last_change":"2024-02-15T22:56:07.705589+0000","last_active":"2024-02-15T22:56:45.882599+0000","last_peered":"2024-02-15T22:56:45.882599+0000","last_clean":"2024-02-15T22:56:45.882599+0000","last_became_active":"2024-02-15T22:56:07.705323+0000","last_became_peered":"2024-02-15T22:56:07.705323+0000","last_unstale":"2024-02-15T22:56:45.882599+0000","last_undegraded":"2024-02-15T22:56:45.882599+0000","last_fullsized":"2024-02-15T22:56:45.882599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:10.810269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'11","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884687+0000","last_change":"2024-02-15T22:56:09.729641+0000","last_active":"2024-02-15T22:56:45.884687+0000","last_peered":"2024-02-15T22:56:45.884687+0000","last_clean":"2024-02-15T22:56:45.884687+0000","last_became_active":"2024-02-15T22:56:09.729131+0000","last_became_peered":"2024-02-15T22:56:09.729131+0000","last_unstale":"2024-02-15T22:56:45.884687+0000","last_undegraded":"2024-02-15T22:56:45.884687+0000","last_fullsized":"2024-02-15T22:56:45.884687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:25:53.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":313,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.044057+0000","last_change":"2024-02-15T22:56:11.720224+0000","last_active":"2024-02-15T22:57:43.044057+0000","last_peered":"2024-02-15T22:57:43.044057+0000","last_clean":"2024-02-15T22:57:43.044057+0000","last_became_active":"2024-02-15T22:56:11.719685+0000","last_became_peered":"2024-02-15T22:56:11.719685+0000","last_unstale":"2024-02-15T22:57:43.044057+0000","last_undegraded":"2024-02-15T22:57:43.044057+0000","last_fullsized":"2024-02-15T22:57:43.044057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:04.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879177+0000","last_change":"2024-02-15T22:56:13.730782+0000","last_active":"2024-02-15T22:56:45.879177+0000","last_peered":"2024-02-15T22:56:45.879177+0000","last_clean":"2024-02-15T22:56:45.879177+0000","last_became_active":"2024-02-15T22:56:13.730494+0000","last_became_peered":"2024-02-15T22:56:13.730494+0000","last_unstale":"2024-02-15T22:56:45.879177+0000","last_undegraded":"2024-02-15T22:56:45.879177+0000","last_fullsized":"2024-02-15T22:56:45.879177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:06:36.344805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'5","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214087+0000","last_change":"2024-02-15T22:56:05.706030+0000","last_active":"2024-02-15T22:57:29.214087+0000","last_peered":"2024-02-15T22:57:29.214087+0000","last_clean":"2024-02-15T22:57:29.214087+0000","last_became_active":"2024-02-15T22:56:05.705764+0000","last_became_peered":"2024-02-15T22:56:05.705764+0000","last_unstale":"2024-02-15T22:57:29.214087+0000","last_undegraded":"2024-02-15T22:57:29.214087+0000","last_fullsized":"2024-02-15T22:57:29.214087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:49.756184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879958+0000","last_change":"2024-02-15T22:56:03.706073+0000","last_active":"2024-02-15T22:56:45.879958+0000","last_peered":"2024-02-15T22:56:45.879958+0000","last_clean":"2024-02-15T22:56:45.879958+0000","last_became_active":"2024-02-15T22:56:03.705783+0000","last_became_peered":"2024-02-15T22:56:03.705783+0000","last_unstale":"2024-02-15T22:56:45.879958+0000","last_undegraded":"2024-02-15T22:56:45.879958+0000","last_fullsized":"2024-02-15T22:56:45.879958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883785+0000","last_change":"2024-02-15T22:55:57.854108+0000","last_active":"2024-02-15T22:56:45.883785+0000","last_peered":"2024-02-15T22:56:45.883785+0000","last_clean":"2024-02-15T22:56:45.883785+0000","last_became_active":"2024-02-15T22:55:57.853714+0000","last_became_peered":"2024-02-15T22:55:57.853714+0000","last_unstale":"2024-02-15T22:56:45.883785+0000","last_undegraded":"2024-02-15T22:56:45.883785+0000","last_fullsized":"2024-02-15T22:56:45.883785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:25:37.860937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881722+0000","last_change":"2024-02-15T22:56:07.705348+0000","last_active":"2024-02-15T22:56:45.881722+0000","last_peered":"2024-02-15T22:56:45.881722+0000","last_clean":"2024-02-15T22:56:45.881722+0000","last_became_active":"2024-02-15T22:56:07.705013+0000","last_became_peered":"2024-02-15T22:56:07.705013+0000","last_unstale":"2024-02-15T22:56:45.881722+0000","last_undegraded":"2024-02-15T22:56:45.881722+0000","last_fullsized":"2024-02-15T22:56:45.881722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:18:54.870237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'85","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.173535+0000","last_change":"2024-02-15T22:56:09.720229+0000","last_active":"2024-02-15T22:57:43.173535+0000","last_peered":"2024-02-15T22:57:43.173535+0000","last_clean":"2024-02-15T22:57:43.173535+0000","last_became_active":"2024-02-15T22:56:09.719916+0000","last_became_peered":"2024-02-15T22:56:09.719916+0000","last_unstale":"2024-02-15T22:57:43.173535+0000","last_undegraded":"2024-02-15T22:57:43.173535+0000","last_fullsized":"2024-02-15T22:57:43.173535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:35:49.736320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879563+0000","last_change":"2024-02-15T22:56:11.718006+0000","last_active":"2024-02-15T22:56:45.879563+0000","last_peered":"2024-02-15T22:56:45.879563+0000","last_clean":"2024-02-15T22:56:45.879563+0000","last_became_active":"2024-02-15T22:56:11.717758+0000","last_became_peered":"2024-02-15T22:56:11.717758+0000","last_unstale":"2024-02-15T22:56:45.879563+0000","last_undegraded":"2024-02-15T22:56:45.879563+0000","last_fullsized":"2024-02-15T22:56:45.879563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:14.822800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885412+0000","last_change":"2024-02-15T22:56:13.732654+0000","last_active":"2024-02-15T22:56:45.885412+0000","last_peered":"2024-02-15T22:56:45.885412+0000","last_clean":"2024-02-15T22:56:45.885412+0000","last_became_active":"2024-02-15T22:56:13.732325+0000","last_became_peered":"2024-02-15T22:56:13.732325+0000","last_unstale":"2024-02-15T22:56:45.885412+0000","last_undegraded":"2024-02-15T22:56:45.885412+0000","last_fullsized":"2024-02-15T22:56:45.885412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:28.711600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886278+0000","last_change":"2024-02-15T22:56:13.732647+0000","last_active":"2024-02-15T22:56:45.886278+0000","last_peered":"2024-02-15T22:56:45.886278+0000","last_clean":"2024-02-15T22:56:45.886278+0000","last_became_active":"2024-02-15T22:56:13.732216+0000","last_became_peered":"2024-02-15T22:56:13.732216+0000","last_unstale":"2024-02-15T22:56:45.886278+0000","last_undegraded":"2024-02-15T22:56:45.886278+0000","last_fullsized":"2024-02-15T22:56:45.886278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:16.829502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882801+0000","last_change":"2024-02-15T22:56:05.705497+0000","last_active":"2024-02-15T22:56:45.882801+0000","last_peered":"2024-02-15T22:56:45.882801+0000","last_clean":"2024-02-15T22:56:45.882801+0000","last_became_active":"2024-02-15T22:56:05.704959+0000","last_became_peered":"2024-02-15T22:56:05.704959+0000","last_unstale":"2024-02-15T22:56:45.882801+0000","last_undegraded":"2024-02-15T22:56:45.882801+0000","last_fullsized":"2024-02-15T22:56:45.882801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882619+0000","last_change":"2024-02-15T22:56:03.705460+0000","last_active":"2024-02-15T22:56:45.882619+0000","last_peered":"2024-02-15T22:56:45.882619+0000","last_clean":"2024-02-15T22:56:45.882619+0000","last_became_active":"2024-02-15T22:56:03.705176+0000","last_became_peered":"2024-02-15T22:56:03.705176+0000","last_unstale":"2024-02-15T22:56:45.882619+0000","last_undegraded":"2024-02-15T22:56:45.882619+0000","last_fullsized":"2024-02-15T22:56:45.882619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:05:19.142672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878857+0000","last_change":"2024-02-15T22:56:07.703334+0000","last_active":"2024-02-15T22:56:45.878857+0000","last_peered":"2024-02-15T22:56:45.878857+0000","last_clean":"2024-02-15T22:56:45.878857+0000","last_became_active":"2024-02-15T22:56:07.703060+0000","last_became_peered":"2024-02-15T22:56:07.703060+0000","last_unstale":"2024-02-15T22:56:45.878857+0000","last_undegraded":"2024-02-15T22:56:45.878857+0000","last_fullsized":"2024-02-15T22:56:45.878857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:26:26.533319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.132370+0000","last_change":"2024-02-15T22:56:09.720950+0000","last_active":"2024-02-15T22:57:43.132370+0000","last_peered":"2024-02-15T22:57:43.132370+0000","last_clean":"2024-02-15T22:57:43.132370+0000","last_became_active":"2024-02-15T22:56:09.720627+0000","last_became_peered":"2024-02-15T22:56:09.720627+0000","last_unstale":"2024-02-15T22:57:43.132370+0000","last_undegraded":"2024-02-15T22:57:43.132370+0000","last_fullsized":"2024-02-15T22:57:43.132370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:22.567556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881531+0000","last_change":"2024-02-15T22:56:11.724993+0000","last_active":"2024-02-15T22:56:45.881531+0000","last_peered":"2024-02-15T22:56:45.881531+0000","last_clean":"2024-02-15T22:56:45.881531+0000","last_became_active":"2024-02-15T22:56:11.724592+0000","last_became_peered":"2024-02-15T22:56:11.724592+0000","last_unstale":"2024-02-15T22:56:45.881531+0000","last_undegraded":"2024-02-15T22:56:45.881531+0000","last_fullsized":"2024-02-15T22:56:45.881531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:15:05.960640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880472+0000","last_change":"2024-02-15T22:56:13.730249+0000","last_active":"2024-02-15T22:56:45.880472+0000","last_peered":"2024-02-15T22:56:45.880472+0000","last_clean":"2024-02-15T22:56:45.880472+0000","last_became_active":"2024-02-15T22:56:13.729931+0000","last_became_peered":"2024-02-15T22:56:13.729931+0000","last_unstale":"2024-02-15T22:56:45.880472+0000","last_undegraded":"2024-02-15T22:56:45.880472+0000","last_fullsized":"2024-02-15T22:56:45.880472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:56.680543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879015+0000","last_change":"2024-02-15T22:56:05.714662+0000","last_active":"2024-02-15T22:56:45.879015+0000","last_peered":"2024-02-15T22:56:45.879015+0000","last_clean":"2024-02-15T22:56:45.879015+0000","last_became_active":"2024-02-15T22:56:05.714024+0000","last_became_peered":"2024-02-15T22:56:05.714024+0000","last_unstale":"2024-02-15T22:56:45.879015+0000","last_undegraded":"2024-02-15T22:56:45.879015+0000","last_fullsized":"2024-02-15T22:56:45.879015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:27:41.335097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886118+0000","last_change":"2024-02-15T22:56:03.698629+0000","last_active":"2024-02-15T22:56:45.886118+0000","last_peered":"2024-02-15T22:56:45.886118+0000","last_clean":"2024-02-15T22:56:45.886118+0000","last_became_active":"2024-02-15T22:56:03.695339+0000","last_became_peered":"2024-02-15T22:56:03.695339+0000","last_unstale":"2024-02-15T22:56:45.886118+0000","last_undegraded":"2024-02-15T22:56:45.886118+0000","last_fullsized":"2024-02-15T22:56:45.886118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882093+0000","last_change":"2024-02-15T22:56:07.708960+0000","last_active":"2024-02-15T22:56:45.882093+0000","last_peered":"2024-02-15T22:56:45.882093+0000","last_clean":"2024-02-15T22:56:45.882093+0000","last_became_active":"2024-02-15T22:56:07.708692+0000","last_became_peered":"2024-02-15T22:56:07.708692+0000","last_unstale":"2024-02-15T22:56:45.882093+0000","last_undegraded":"2024-02-15T22:56:45.882093+0000","last_fullsized":"2024-02-15T22:56:45.882093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:22.028630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"30'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:23.077273+0000","last_change":"2024-02-15T22:56:09.711326+0000","last_active":"2024-02-15T22:57:23.077273+0000","last_peered":"2024-02-15T22:57:23.077273+0000","last_clean":"2024-02-15T22:57:23.077273+0000","last_became_active":"2024-02-15T22:56:09.710942+0000","last_became_peered":"2024-02-15T22:56:09.710942+0000","last_unstale":"2024-02-15T22:57:23.077273+0000","last_undegraded":"2024-02-15T22:57:23.077273+0000","last_fullsized":"2024-02-15T22:57:23.077273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:29:53.380084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881415+0000","last_change":"2024-02-15T22:56:11.724852+0000","last_active":"2024-02-15T22:56:45.881415+0000","last_peered":"2024-02-15T22:56:45.881415+0000","last_clean":"2024-02-15T22:56:45.881415+0000","last_became_active":"2024-02-15T22:56:11.724533+0000","last_became_peered":"2024-02-15T22:56:11.724533+0000","last_unstale":"2024-02-15T22:56:45.881415+0000","last_undegraded":"2024-02-15T22:56:45.881415+0000","last_fullsized":"2024-02-15T22:56:45.881415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:34.347066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.216560+0000","last_change":"2024-02-15T22:56:13.734719+0000","last_active":"2024-02-15T22:56:47.216560+0000","last_peered":"2024-02-15T22:56:47.216560+0000","last_clean":"2024-02-15T22:56:47.216560+0000","last_became_active":"2024-02-15T22:56:13.734428+0000","last_became_peered":"2024-02-15T22:56:13.734428+0000","last_unstale":"2024-02-15T22:56:47.216560+0000","last_undegraded":"2024-02-15T22:56:47.216560+0000","last_fullsized":"2024-02-15T22:56:47.216560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:26:47.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883407+0000","last_change":"2024-02-15T22:56:05.706212+0000","last_active":"2024-02-15T22:57:29.883407+0000","last_peered":"2024-02-15T22:57:29.883407+0000","last_clean":"2024-02-15T22:57:29.883407+0000","last_became_active":"2024-02-15T22:56:05.705385+0000","last_became_peered":"2024-02-15T22:56:05.705385+0000","last_unstale":"2024-02-15T22:57:29.883407+0000","last_undegraded":"2024-02-15T22:57:29.883407+0000","last_fullsized":"2024-02-15T22:57:29.883407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:11.875068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886682+0000","last_change":"2024-02-15T22:56:03.700283+0000","last_active":"2024-02-15T22:56:45.886682+0000","last_peered":"2024-02-15T22:56:45.886682+0000","last_clean":"2024-02-15T22:56:45.886682+0000","last_became_active":"2024-02-15T22:56:03.699626+0000","last_became_peered":"2024-02-15T22:56:03.699626+0000","last_unstale":"2024-02-15T22:56:45.886682+0000","last_undegraded":"2024-02-15T22:56:45.886682+0000","last_fullsized":"2024-02-15T22:56:45.886682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880040+0000","last_change":"2024-02-15T22:56:07.706016+0000","last_active":"2024-02-15T22:56:45.880040+0000","last_peered":"2024-02-15T22:56:45.880040+0000","last_clean":"2024-02-15T22:56:45.880040+0000","last_became_active":"2024-02-15T22:56:07.705705+0000","last_became_peered":"2024-02-15T22:56:07.705705+0000","last_unstale":"2024-02-15T22:56:45.880040+0000","last_undegraded":"2024-02-15T22:56:45.880040+0000","last_fullsized":"2024-02-15T22:56:45.880040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:23:10.160782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'37","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.097324+0000","last_change":"2024-02-15T22:56:09.712570+0000","last_active":"2024-02-15T22:57:43.097324+0000","last_peered":"2024-02-15T22:57:43.097324+0000","last_clean":"2024-02-15T22:57:43.097324+0000","last_became_active":"2024-02-15T22:56:09.712337+0000","last_became_peered":"2024-02-15T22:56:09.712337+0000","last_unstale":"2024-02-15T22:57:43.097324+0000","last_undegraded":"2024-02-15T22:57:43.097324+0000","last_fullsized":"2024-02-15T22:57:43.097324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:42.465797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878361+0000","last_change":"2024-02-15T22:56:11.715966+0000","last_active":"2024-02-15T22:56:45.878361+0000","last_peered":"2024-02-15T22:56:45.878361+0000","last_clean":"2024-02-15T22:56:45.878361+0000","last_became_active":"2024-02-15T22:56:11.715697+0000","last_became_peered":"2024-02-15T22:56:11.715697+0000","last_unstale":"2024-02-15T22:56:45.878361+0000","last_undegraded":"2024-02-15T22:56:45.878361+0000","last_fullsized":"2024-02-15T22:56:45.878361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:26.704898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880177+0000","last_change":"2024-02-15T22:56:13.734867+0000","last_active":"2024-02-15T22:56:45.880177+0000","last_peered":"2024-02-15T22:56:45.880177+0000","last_clean":"2024-02-15T22:56:45.880177+0000","last_became_active":"2024-02-15T22:56:13.734565+0000","last_became_peered":"2024-02-15T22:56:13.734565+0000","last_unstale":"2024-02-15T22:56:45.880177+0000","last_undegraded":"2024-02-15T22:56:45.880177+0000","last_fullsized":"2024-02-15T22:56:45.880177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:44:28.581885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'9","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883753+0000","last_change":"2024-02-15T22:56:05.710863+0000","last_active":"2024-02-15T22:57:29.883753+0000","last_peered":"2024-02-15T22:57:29.883753+0000","last_clean":"2024-02-15T22:57:29.883753+0000","last_became_active":"2024-02-15T22:56:05.710562+0000","last_became_peered":"2024-02-15T22:56:05.710562+0000","last_unstale":"2024-02-15T22:57:29.883753+0000","last_undegraded":"2024-02-15T22:57:29.883753+0000","last_fullsized":"2024-02-15T22:57:29.883753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880178+0000","last_change":"2024-02-15T22:56:03.697251+0000","last_active":"2024-02-15T22:56:45.880178+0000","last_peered":"2024-02-15T22:56:45.880178+0000","last_clean":"2024-02-15T22:56:45.880178+0000","last_became_active":"2024-02-15T22:56:03.696590+0000","last_became_peered":"2024-02-15T22:56:03.696590+0000","last_unstale":"2024-02-15T22:56:45.880178+0000","last_undegraded":"2024-02-15T22:56:45.880178+0000","last_fullsized":"2024-02-15T22:56:45.880178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:32:14.737020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882678+0000","last_change":"2024-02-15T22:56:07.705557+0000","last_active":"2024-02-15T22:56:45.882678+0000","last_peered":"2024-02-15T22:56:45.882678+0000","last_clean":"2024-02-15T22:56:45.882678+0000","last_became_active":"2024-02-15T22:56:07.705239+0000","last_became_peered":"2024-02-15T22:56:07.705239+0000","last_unstale":"2024-02-15T22:56:45.882678+0000","last_undegraded":"2024-02-15T22:56:45.882678+0000","last_fullsized":"2024-02-15T22:56:45.882678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:21:45.133507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.087899+0000","last_change":"2024-02-15T22:56:09.710915+0000","last_active":"2024-02-15T22:57:43.087899+0000","last_peered":"2024-02-15T22:57:43.087899+0000","last_clean":"2024-02-15T22:57:43.087899+0000","last_became_active":"2024-02-15T22:56:09.710616+0000","last_became_peered":"2024-02-15T22:56:09.710616+0000","last_unstale":"2024-02-15T22:57:43.087899+0000","last_undegraded":"2024-02-15T22:57:43.087899+0000","last_fullsized":"2024-02-15T22:57:43.087899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:52.104156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883516+0000","last_change":"2024-02-15T22:56:11.719273+0000","last_active":"2024-02-15T22:56:45.883516+0000","last_peered":"2024-02-15T22:56:45.883516+0000","last_clean":"2024-02-15T22:56:45.883516+0000","last_became_active":"2024-02-15T22:56:11.718995+0000","last_became_peered":"2024-02-15T22:56:11.718995+0000","last_unstale":"2024-02-15T22:56:45.883516+0000","last_undegraded":"2024-02-15T22:56:45.883516+0000","last_fullsized":"2024-02-15T22:56:45.883516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:42.609730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391474+0000","last_change":"2024-02-15T22:56:05.699435+0000","last_active":"2024-02-15T22:57:35.391474+0000","last_peered":"2024-02-15T22:57:35.391474+0000","last_clean":"2024-02-15T22:57:35.391474+0000","last_became_active":"2024-02-15T22:56:05.699196+0000","last_became_peered":"2024-02-15T22:56:05.699196+0000","last_unstale":"2024-02-15T22:57:35.391474+0000","last_undegraded":"2024-02-15T22:57:35.391474+0000","last_fullsized":"2024-02-15T22:57:35.391474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:28.327809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.216627+0000","last_change":"2024-02-15T22:56:03.702280+0000","last_active":"2024-02-15T22:57:29.216627+0000","last_peered":"2024-02-15T22:57:29.216627+0000","last_clean":"2024-02-15T22:57:29.216627+0000","last_became_active":"2024-02-15T22:56:03.702007+0000","last_became_peered":"2024-02-15T22:56:03.702007+0000","last_unstale":"2024-02-15T22:57:29.216627+0000","last_undegraded":"2024-02-15T22:57:29.216627+0000","last_fullsized":"2024-02-15T22:57:29.216627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:17:47.733980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881599+0000","last_change":"2024-02-15T22:56:07.707669+0000","last_active":"2024-02-15T22:56:45.881599+0000","last_peered":"2024-02-15T22:56:45.881599+0000","last_clean":"2024-02-15T22:56:45.881599+0000","last_became_active":"2024-02-15T22:56:07.707124+0000","last_became_peered":"2024-02-15T22:56:07.707124+0000","last_unstale":"2024-02-15T22:56:45.881599+0000","last_undegraded":"2024-02-15T22:56:45.881599+0000","last_fullsized":"2024-02-15T22:56:45.881599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:17:46.212262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'56","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.149743+0000","last_change":"2024-02-15T22:56:09.713405+0000","last_active":"2024-02-15T22:57:43.149743+0000","last_peered":"2024-02-15T22:57:43.149743+0000","last_clean":"2024-02-15T22:57:43.149743+0000","last_became_active":"2024-02-15T22:56:09.713076+0000","last_became_peered":"2024-02-15T22:56:09.713076+0000","last_unstale":"2024-02-15T22:57:43.149743+0000","last_undegraded":"2024-02-15T22:57:43.149743+0000","last_fullsized":"2024-02-15T22:57:43.149743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:36.072001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885912+0000","last_change":"2024-02-15T22:56:11.718389+0000","last_active":"2024-02-15T22:56:45.885912+0000","last_peered":"2024-02-15T22:56:45.885912+0000","last_clean":"2024-02-15T22:56:45.885912+0000","last_became_active":"2024-02-15T22:56:11.718102+0000","last_became_peered":"2024-02-15T22:56:11.718102+0000","last_unstale":"2024-02-15T22:56:45.885912+0000","last_undegraded":"2024-02-15T22:56:45.885912+0000","last_fullsized":"2024-02-15T22:56:45.885912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:26.771661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.339922+0000","last_change":"2024-02-15T22:56:13.734724+0000","last_active":"2024-02-15T22:57:29.339922+0000","last_peered":"2024-02-15T22:57:29.339922+0000","last_clean":"2024-02-15T22:57:29.339922+0000","last_became_active":"2024-02-15T22:56:13.734372+0000","last_became_peered":"2024-02-15T22:56:13.734372+0000","last_unstale":"2024-02-15T22:57:29.339922+0000","last_undegraded":"2024-02-15T22:57:29.339922+0000","last_fullsized":"2024-02-15T22:57:29.339922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:39.885870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391646+0000","last_change":"2024-02-15T22:56:05.705862+0000","last_active":"2024-02-15T22:57:35.391646+0000","last_peered":"2024-02-15T22:57:35.391646+0000","last_clean":"2024-02-15T22:57:35.391646+0000","last_became_active":"2024-02-15T22:56:05.705473+0000","last_became_peered":"2024-02-15T22:56:05.705473+0000","last_unstale":"2024-02-15T22:57:35.391646+0000","last_undegraded":"2024-02-15T22:57:35.391646+0000","last_fullsized":"2024-02-15T22:57:35.391646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:08.053314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.418196+0000","last_change":"2024-02-15T22:56:03.698010+0000","last_active":"2024-02-15T22:56:47.418196+0000","last_peered":"2024-02-15T22:56:47.418196+0000","last_clean":"2024-02-15T22:56:47.418196+0000","last_became_active":"2024-02-15T22:56:03.697691+0000","last_became_peered":"2024-02-15T22:56:03.697691+0000","last_unstale":"2024-02-15T22:56:47.418196+0000","last_undegraded":"2024-02-15T22:56:47.418196+0000","last_fullsized":"2024-02-15T22:56:47.418196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886468+0000","last_change":"2024-02-15T22:56:07.704334+0000","last_active":"2024-02-15T22:56:45.886468+0000","last_peered":"2024-02-15T22:56:45.886468+0000","last_clean":"2024-02-15T22:56:45.886468+0000","last_became_active":"2024-02-15T22:56:07.704018+0000","last_became_peered":"2024-02-15T22:56:07.704018+0000","last_unstale":"2024-02-15T22:56:45.886468+0000","last_undegraded":"2024-02-15T22:56:45.886468+0000","last_fullsized":"2024-02-15T22:56:45.886468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:59.601424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.091310+0000","last_change":"2024-02-15T22:56:09.717626+0000","last_active":"2024-02-15T22:57:43.091310+0000","last_peered":"2024-02-15T22:57:43.091310+0000","last_clean":"2024-02-15T22:57:43.091310+0000","last_became_active":"2024-02-15T22:56:09.717105+0000","last_became_peered":"2024-02-15T22:56:09.717105+0000","last_unstale":"2024-02-15T22:57:43.091310+0000","last_undegraded":"2024-02-15T22:57:43.091310+0000","last_fullsized":"2024-02-15T22:57:43.091310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:04:03.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882499+0000","last_change":"2024-02-15T22:56:11.723141+0000","last_active":"2024-02-15T22:56:45.882499+0000","last_peered":"2024-02-15T22:56:45.882499+0000","last_clean":"2024-02-15T22:56:45.882499+0000","last_became_active":"2024-02-15T22:56:11.722865+0000","last_became_peered":"2024-02-15T22:56:11.722865+0000","last_unstale":"2024-02-15T22:56:45.882499+0000","last_undegraded":"2024-02-15T22:56:45.882499+0000","last_fullsized":"2024-02-15T22:56:45.882499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:05.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879845+0000","last_change":"2024-02-15T22:56:13.727435+0000","last_active":"2024-02-15T22:56:45.879845+0000","last_peered":"2024-02-15T22:56:45.879845+0000","last_clean":"2024-02-15T22:56:45.879845+0000","last_became_active":"2024-02-15T22:56:13.726748+0000","last_became_peered":"2024-02-15T22:56:13.726748+0000","last_unstale":"2024-02-15T22:56:45.879845+0000","last_undegraded":"2024-02-15T22:56:45.879845+0000","last_fullsized":"2024-02-15T22:56:45.879845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:41:50.659346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883279+0000","last_change":"2024-02-15T22:56:05.716925+0000","last_active":"2024-02-15T22:57:29.883279+0000","last_peered":"2024-02-15T22:57:29.883279+0000","last_clean":"2024-02-15T22:57:29.883279+0000","last_became_active":"2024-02-15T22:56:05.716677+0000","last_became_peered":"2024-02-15T22:56:05.716677+0000","last_unstale":"2024-02-15T22:57:29.883279+0000","last_undegraded":"2024-02-15T22:57:29.883279+0000","last_fullsized":"2024-02-15T22:57:29.883279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:37.588602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878559+0000","last_change":"2024-02-15T22:56:03.692964+0000","last_active":"2024-02-15T22:56:45.878559+0000","last_peered":"2024-02-15T22:56:45.878559+0000","last_clean":"2024-02-15T22:56:45.878559+0000","last_became_active":"2024-02-15T22:56:03.692632+0000","last_became_peered":"2024-02-15T22:56:03.692632+0000","last_unstale":"2024-02-15T22:56:45.878559+0000","last_undegraded":"2024-02-15T22:56:45.878559+0000","last_fullsized":"2024-02-15T22:56:45.878559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:06:26.885390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885768+0000","last_change":"2024-02-15T22:56:07.704513+0000","last_active":"2024-02-15T22:56:45.885768+0000","last_peered":"2024-02-15T22:56:45.885768+0000","last_clean":"2024-02-15T22:56:45.885768+0000","last_became_active":"2024-02-15T22:56:07.704208+0000","last_became_peered":"2024-02-15T22:56:07.704208+0000","last_unstale":"2024-02-15T22:56:45.885768+0000","last_undegraded":"2024-02-15T22:56:45.885768+0000","last_fullsized":"2024-02-15T22:56:45.885768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:13:55.637902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'34","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.143756+0000","last_change":"2024-02-15T22:56:09.717007+0000","last_active":"2024-02-15T22:57:43.143756+0000","last_peered":"2024-02-15T22:57:43.143756+0000","last_clean":"2024-02-15T22:57:43.143756+0000","last_became_active":"2024-02-15T22:56:09.716753+0000","last_became_peered":"2024-02-15T22:56:09.716753+0000","last_unstale":"2024-02-15T22:57:43.143756+0000","last_undegraded":"2024-02-15T22:57:43.143756+0000","last_fullsized":"2024-02-15T22:57:43.143756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:06.528782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880705+0000","last_change":"2024-02-15T22:56:11.722996+0000","last_active":"2024-02-15T22:56:45.880705+0000","last_peered":"2024-02-15T22:56:45.880705+0000","last_clean":"2024-02-15T22:56:45.880705+0000","last_became_active":"2024-02-15T22:56:11.722738+0000","last_became_peered":"2024-02-15T22:56:11.722738+0000","last_unstale":"2024-02-15T22:56:45.880705+0000","last_undegraded":"2024-02-15T22:56:45.880705+0000","last_fullsized":"2024-02-15T22:56:45.880705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:45.887455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880053+0000","last_change":"2024-02-15T22:56:13.727522+0000","last_active":"2024-02-15T22:56:45.880053+0000","last_peered":"2024-02-15T22:56:45.880053+0000","last_clean":"2024-02-15T22:56:45.880053+0000","last_became_active":"2024-02-15T22:56:13.727216+0000","last_became_peered":"2024-02-15T22:56:13.727216+0000","last_unstale":"2024-02-15T22:56:45.880053+0000","last_undegraded":"2024-02-15T22:56:45.880053+0000","last_fullsized":"2024-02-15T22:56:45.880053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:39:14.707814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881181+0000","last_change":"2024-02-15T22:56:05.707488+0000","last_active":"2024-02-15T22:56:45.881181+0000","last_peered":"2024-02-15T22:56:45.881181+0000","last_clean":"2024-02-15T22:56:45.881181+0000","last_became_active":"2024-02-15T22:56:05.707154+0000","last_became_peered":"2024-02-15T22:56:05.707154+0000","last_unstale":"2024-02-15T22:56:45.881181+0000","last_undegraded":"2024-02-15T22:56:45.881181+0000","last_fullsized":"2024-02-15T22:56:45.881181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881248+0000","last_change":"2024-02-15T22:56:03.700157+0000","last_active":"2024-02-15T22:56:45.881248+0000","last_peered":"2024-02-15T22:56:45.881248+0000","last_clean":"2024-02-15T22:56:45.881248+0000","last_became_active":"2024-02-15T22:56:03.699843+0000","last_became_peered":"2024-02-15T22:56:03.699843+0000","last_unstale":"2024-02-15T22:56:45.881248+0000","last_undegraded":"2024-02-15T22:56:45.881248+0000","last_fullsized":"2024-02-15T22:56:45.881248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:47.749601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.014173+0000","last_change":"2024-02-15T22:56:07.702631+0000","last_active":"2024-02-15T22:57:43.014173+0000","last_peered":"2024-02-15T22:57:43.014173+0000","last_clean":"2024-02-15T22:57:43.014173+0000","last_became_active":"2024-02-15T22:56:07.702014+0000","last_became_peered":"2024-02-15T22:56:07.702014+0000","last_unstale":"2024-02-15T22:57:43.014173+0000","last_undegraded":"2024-02-15T22:57:43.014173+0000","last_fullsized":"2024-02-15T22:57:43.014173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:02.266965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883138+0000","last_change":"2024-02-15T22:56:09.717362+0000","last_active":"2024-02-15T22:56:45.883138+0000","last_peered":"2024-02-15T22:56:45.883138+0000","last_clean":"2024-02-15T22:56:45.883138+0000","last_became_active":"2024-02-15T22:56:09.715996+0000","last_became_peered":"2024-02-15T22:56:09.715996+0000","last_unstale":"2024-02-15T22:56:45.883138+0000","last_undegraded":"2024-02-15T22:56:45.883138+0000","last_fullsized":"2024-02-15T22:56:45.883138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:10.389319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":292,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.037464+0000","last_change":"2024-02-15T22:56:11.725698+0000","last_active":"2024-02-15T22:57:43.037464+0000","last_peered":"2024-02-15T22:57:43.037464+0000","last_clean":"2024-02-15T22:57:43.037464+0000","last_became_active":"2024-02-15T22:56:11.724520+0000","last_became_peered":"2024-02-15T22:56:11.724520+0000","last_unstale":"2024-02-15T22:57:43.037464+0000","last_undegraded":"2024-02-15T22:57:43.037464+0000","last_fullsized":"2024-02-15T22:57:43.037464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:08.534852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879365+0000","last_change":"2024-02-15T22:56:13.731954+0000","last_active":"2024-02-15T22:56:45.879365+0000","last_peered":"2024-02-15T22:56:45.879365+0000","last_clean":"2024-02-15T22:56:45.879365+0000","last_became_active":"2024-02-15T22:56:13.731683+0000","last_became_peered":"2024-02-15T22:56:13.731683+0000","last_unstale":"2024-02-15T22:56:45.879365+0000","last_undegraded":"2024-02-15T22:56:45.879365+0000","last_fullsized":"2024-02-15T22:56:45.879365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:12:05.571855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882882+0000","last_change":"2024-02-15T22:56:05.701652+0000","last_active":"2024-02-15T22:56:45.882882+0000","last_peered":"2024-02-15T22:56:45.882882+0000","last_clean":"2024-02-15T22:56:45.882882+0000","last_became_active":"2024-02-15T22:56:05.700922+0000","last_became_peered":"2024-02-15T22:56:05.700922+0000","last_unstale":"2024-02-15T22:56:45.882882+0000","last_undegraded":"2024-02-15T22:56:45.882882+0000","last_fullsized":"2024-02-15T22:56:45.882882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:59:11.875068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883283+0000","last_change":"2024-02-15T22:56:03.697064+0000","last_active":"2024-02-15T22:56:45.883283+0000","last_peered":"2024-02-15T22:56:45.883283+0000","last_clean":"2024-02-15T22:56:45.883283+0000","last_became_active":"2024-02-15T22:56:03.696168+0000","last_became_peered":"2024-02-15T22:56:03.696168+0000","last_unstale":"2024-02-15T22:56:45.883283+0000","last_undegraded":"2024-02-15T22:56:45.883283+0000","last_fullsized":"2024-02-15T22:56:45.883283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879369+0000","last_change":"2024-02-15T22:56:07.702419+0000","last_active":"2024-02-15T22:56:45.879369+0000","last_peered":"2024-02-15T22:56:45.879369+0000","last_clean":"2024-02-15T22:56:45.879369+0000","last_became_active":"2024-02-15T22:56:07.701777+0000","last_became_peered":"2024-02-15T22:56:07.701777+0000","last_unstale":"2024-02-15T22:56:45.879369+0000","last_undegraded":"2024-02-15T22:56:45.879369+0000","last_fullsized":"2024-02-15T22:56:45.879369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:35:35.223607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'38","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.162033+0000","last_change":"2024-02-15T22:56:09.713897+0000","last_active":"2024-02-15T22:57:43.162033+0000","last_peered":"2024-02-15T22:57:43.162033+0000","last_clean":"2024-02-15T22:57:43.162033+0000","last_became_active":"2024-02-15T22:56:09.713636+0000","last_became_peered":"2024-02-15T22:56:09.713636+0000","last_unstale":"2024-02-15T22:57:43.162033+0000","last_undegraded":"2024-02-15T22:57:43.162033+0000","last_fullsized":"2024-02-15T22:57:43.162033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:30.461447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878819+0000","last_change":"2024-02-15T22:56:11.722701+0000","last_active":"2024-02-15T22:56:45.878819+0000","last_peered":"2024-02-15T22:56:45.878819+0000","last_clean":"2024-02-15T22:56:45.878819+0000","last_became_active":"2024-02-15T22:56:11.722374+0000","last_became_peered":"2024-02-15T22:56:11.722374+0000","last_unstale":"2024-02-15T22:56:45.878819+0000","last_undegraded":"2024-02-15T22:56:45.878819+0000","last_fullsized":"2024-02-15T22:56:45.878819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:42:08.103224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879392+0000","last_change":"2024-02-15T22:56:13.733861+0000","last_active":"2024-02-15T22:56:45.879392+0000","last_peered":"2024-02-15T22:56:45.879392+0000","last_clean":"2024-02-15T22:56:45.879392+0000","last_became_active":"2024-02-15T22:56:13.733576+0000","last_became_peered":"2024-02-15T22:56:13.733576+0000","last_unstale":"2024-02-15T22:56:45.879392+0000","last_undegraded":"2024-02-15T22:56:45.879392+0000","last_fullsized":"2024-02-15T22:56:45.879392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:39:06.977567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.426850+0000","last_change":"2024-02-15T22:56:05.701307+0000","last_active":"2024-02-15T22:56:47.426850+0000","last_peered":"2024-02-15T22:56:47.426850+0000","last_clean":"2024-02-15T22:56:47.426850+0000","last_became_active":"2024-02-15T22:56:05.701026+0000","last_became_peered":"2024-02-15T22:56:05.701026+0000","last_unstale":"2024-02-15T22:56:47.426850+0000","last_undegraded":"2024-02-15T22:56:47.426850+0000","last_fullsized":"2024-02-15T22:56:47.426850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:08:46.773754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883580+0000","last_change":"2024-02-15T22:56:03.706706+0000","last_active":"2024-02-15T22:56:45.883580+0000","last_peered":"2024-02-15T22:56:45.883580+0000","last_clean":"2024-02-15T22:56:45.883580+0000","last_became_active":"2024-02-15T22:56:03.706422+0000","last_became_peered":"2024-02-15T22:56:03.706422+0000","last_unstale":"2024-02-15T22:56:45.883580+0000","last_undegraded":"2024-02-15T22:56:45.883580+0000","last_fullsized":"2024-02-15T22:56:45.883580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:53.983428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883428+0000","last_change":"2024-02-15T22:56:07.707525+0000","last_active":"2024-02-15T22:56:45.883428+0000","last_peered":"2024-02-15T22:56:45.883428+0000","last_clean":"2024-02-15T22:56:45.883428+0000","last_became_active":"2024-02-15T22:56:07.707265+0000","last_became_peered":"2024-02-15T22:56:07.707265+0000","last_unstale":"2024-02-15T22:56:45.883428+0000","last_undegraded":"2024-02-15T22:56:45.883428+0000","last_fullsized":"2024-02-15T22:56:45.883428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:05:01.076470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'32","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.165123+0000","last_change":"2024-02-15T22:56:09.717128+0000","last_active":"2024-02-15T22:57:43.165123+0000","last_peered":"2024-02-15T22:57:43.165123+0000","last_clean":"2024-02-15T22:57:43.165123+0000","last_became_active":"2024-02-15T22:56:09.716749+0000","last_became_peered":"2024-02-15T22:56:09.716749+0000","last_unstale":"2024-02-15T22:57:43.165123+0000","last_undegraded":"2024-02-15T22:57:43.165123+0000","last_fullsized":"2024-02-15T22:57:43.165123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:31.912815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880224+0000","last_change":"2024-02-15T22:56:11.726028+0000","last_active":"2024-02-15T22:56:45.880224+0000","last_peered":"2024-02-15T22:56:45.880224+0000","last_clean":"2024-02-15T22:56:45.880224+0000","last_became_active":"2024-02-15T22:56:11.725667+0000","last_became_peered":"2024-02-15T22:56:11.725667+0000","last_unstale":"2024-02-15T22:56:45.880224+0000","last_undegraded":"2024-02-15T22:56:45.880224+0000","last_fullsized":"2024-02-15T22:56:45.880224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:33.489028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'8","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881143+0000","last_change":"2024-02-15T22:56:13.729381+0000","last_active":"2024-02-15T22:56:45.881143+0000","last_peered":"2024-02-15T22:56:45.881143+0000","last_clean":"2024-02-15T22:56:45.881143+0000","last_became_active":"2024-02-15T22:56:13.728844+0000","last_became_peered":"2024-02-15T22:56:13.728844+0000","last_unstale":"2024-02-15T22:56:45.881143+0000","last_undegraded":"2024-02-15T22:56:45.881143+0000","last_fullsized":"2024-02-15T22:56:45.881143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:49:08.247734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214122+0000","last_change":"2024-02-15T22:56:05.701351+0000","last_active":"2024-02-15T22:57:29.214122+0000","last_peered":"2024-02-15T22:57:29.214122+0000","last_clean":"2024-02-15T22:57:29.214122+0000","last_became_active":"2024-02-15T22:56:05.700908+0000","last_became_peered":"2024-02-15T22:56:05.700908+0000","last_unstale":"2024-02-15T22:57:29.214122+0000","last_undegraded":"2024-02-15T22:57:29.214122+0000","last_fullsized":"2024-02-15T22:57:29.214122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:41:03.587630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881194+0000","last_change":"2024-02-15T22:56:03.704371+0000","last_active":"2024-02-15T22:56:45.881194+0000","last_peered":"2024-02-15T22:56:45.881194+0000","last_clean":"2024-02-15T22:56:45.881194+0000","last_became_active":"2024-02-15T22:56:03.704081+0000","last_became_peered":"2024-02-15T22:56:03.704081+0000","last_unstale":"2024-02-15T22:56:45.881194+0000","last_undegraded":"2024-02-15T22:56:45.881194+0000","last_fullsized":"2024-02-15T22:56:45.881194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:52.903955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878100+0000","last_change":"2024-02-15T22:56:07.708809+0000","last_active":"2024-02-15T22:56:45.878100+0000","last_peered":"2024-02-15T22:56:45.878100+0000","last_clean":"2024-02-15T22:56:45.878100+0000","last_became_active":"2024-02-15T22:56:07.708530+0000","last_became_peered":"2024-02-15T22:56:07.708530+0000","last_unstale":"2024-02-15T22:56:45.878100+0000","last_undegraded":"2024-02-15T22:56:45.878100+0000","last_fullsized":"2024-02-15T22:56:45.878100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:55:57.292484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'29","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.137793+0000","last_change":"2024-02-15T22:56:09.717300+0000","last_active":"2024-02-15T22:57:43.137793+0000","last_peered":"2024-02-15T22:57:43.137793+0000","last_clean":"2024-02-15T22:57:43.137793+0000","last_became_active":"2024-02-15T22:56:09.716134+0000","last_became_peered":"2024-02-15T22:56:09.716134+0000","last_unstale":"2024-02-15T22:57:43.137793+0000","last_undegraded":"2024-02-15T22:57:43.137793+0000","last_fullsized":"2024-02-15T22:57:43.137793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:52.667771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":49,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880819+0000","last_change":"2024-02-15T22:56:11.725615+0000","last_active":"2024-02-15T22:56:45.880819+0000","last_peered":"2024-02-15T22:56:45.880819+0000","last_clean":"2024-02-15T22:56:45.880819+0000","last_became_active":"2024-02-15T22:56:11.725271+0000","last_became_peered":"2024-02-15T22:56:11.725271+0000","last_unstale":"2024-02-15T22:56:45.880819+0000","last_undegraded":"2024-02-15T22:56:45.880819+0000","last_fullsized":"2024-02-15T22:56:45.880819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:13.922809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880951+0000","last_change":"2024-02-15T22:56:13.735140+0000","last_active":"2024-02-15T22:56:45.880951+0000","last_peered":"2024-02-15T22:56:45.880951+0000","last_clean":"2024-02-15T22:56:45.880951+0000","last_became_active":"2024-02-15T22:56:13.734871+0000","last_became_peered":"2024-02-15T22:56:13.734871+0000","last_unstale":"2024-02-15T22:56:45.880951+0000","last_undegraded":"2024-02-15T22:56:45.880951+0000","last_fullsized":"2024-02-15T22:56:45.880951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:23:54.224082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'15","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.214442+0000","last_change":"2024-02-15T22:56:05.700345+0000","last_active":"2024-02-15T22:57:29.214442+0000","last_peered":"2024-02-15T22:57:29.214442+0000","last_clean":"2024-02-15T22:57:29.214442+0000","last_became_active":"2024-02-15T22:56:05.700066+0000","last_became_peered":"2024-02-15T22:56:05.700066+0000","last_unstale":"2024-02-15T22:57:29.214442+0000","last_undegraded":"2024-02-15T22:57:29.214442+0000","last_fullsized":"2024-02-15T22:57:29.214442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:53.296017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880320+0000","last_change":"2024-02-15T22:56:03.694391+0000","last_active":"2024-02-15T22:56:45.880320+0000","last_peered":"2024-02-15T22:56:45.880320+0000","last_clean":"2024-02-15T22:56:45.880320+0000","last_became_active":"2024-02-15T22:56:03.693300+0000","last_became_peered":"2024-02-15T22:56:03.693300+0000","last_unstale":"2024-02-15T22:56:45.880320+0000","last_undegraded":"2024-02-15T22:56:45.880320+0000","last_fullsized":"2024-02-15T22:56:45.880320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878222+0000","last_change":"2024-02-15T22:56:07.709035+0000","last_active":"2024-02-15T22:56:45.878222+0000","last_peered":"2024-02-15T22:56:45.878222+0000","last_clean":"2024-02-15T22:56:45.878222+0000","last_became_active":"2024-02-15T22:56:07.708720+0000","last_became_peered":"2024-02-15T22:56:07.708720+0000","last_unstale":"2024-02-15T22:56:45.878222+0000","last_undegraded":"2024-02-15T22:56:45.878222+0000","last_fullsized":"2024-02-15T22:56:45.878222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:37.486705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.146601+0000","last_change":"2024-02-15T22:56:09.720664+0000","last_active":"2024-02-15T22:57:43.146601+0000","last_peered":"2024-02-15T22:57:43.146601+0000","last_clean":"2024-02-15T22:57:43.146601+0000","last_became_active":"2024-02-15T22:56:09.717846+0000","last_became_peered":"2024-02-15T22:56:09.717846+0000","last_unstale":"2024-02-15T22:57:43.146601+0000","last_undegraded":"2024-02-15T22:57:43.146601+0000","last_fullsized":"2024-02-15T22:57:43.146601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:14:17.930845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879414+0000","last_change":"2024-02-15T22:56:11.722731+0000","last_active":"2024-02-15T22:56:45.879414+0000","last_peered":"2024-02-15T22:56:45.879414+0000","last_clean":"2024-02-15T22:56:45.879414+0000","last_became_active":"2024-02-15T22:56:11.722402+0000","last_became_peered":"2024-02-15T22:56:11.722402+0000","last_unstale":"2024-02-15T22:56:45.879414+0000","last_undegraded":"2024-02-15T22:56:45.879414+0000","last_fullsized":"2024-02-15T22:56:45.879414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:15:57.504579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882258+0000","last_change":"2024-02-15T22:56:13.733552+0000","last_active":"2024-02-15T22:56:45.882258+0000","last_peered":"2024-02-15T22:56:45.882258+0000","last_clean":"2024-02-15T22:56:45.882258+0000","last_became_active":"2024-02-15T22:56:13.733285+0000","last_became_peered":"2024-02-15T22:56:13.733285+0000","last_unstale":"2024-02-15T22:56:45.882258+0000","last_undegraded":"2024-02-15T22:56:45.882258+0000","last_fullsized":"2024-02-15T22:56:45.882258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:52:36.091970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391114+0000","last_change":"2024-02-15T22:56:05.715894+0000","last_active":"2024-02-15T22:57:35.391114+0000","last_peered":"2024-02-15T22:57:35.391114+0000","last_clean":"2024-02-15T22:57:35.391114+0000","last_became_active":"2024-02-15T22:56:05.715609+0000","last_became_peered":"2024-02-15T22:56:05.715609+0000","last_unstale":"2024-02-15T22:57:35.391114+0000","last_undegraded":"2024-02-15T22:57:35.391114+0000","last_fullsized":"2024-02-15T22:57:35.391114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:59:43.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880575+0000","last_change":"2024-02-15T22:56:03.694275+0000","last_active":"2024-02-15T22:56:45.880575+0000","last_peered":"2024-02-15T22:56:45.880575+0000","last_clean":"2024-02-15T22:56:45.880575+0000","last_became_active":"2024-02-15T22:56:03.691266+0000","last_became_peered":"2024-02-15T22:56:03.691266+0000","last_unstale":"2024-02-15T22:56:45.880575+0000","last_undegraded":"2024-02-15T22:56:45.880575+0000","last_fullsized":"2024-02-15T22:56:45.880575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:27.775050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215026+0000","last_change":"2024-02-15T22:56:05.707825+0000","last_active":"2024-02-15T22:56:47.215026+0000","last_peered":"2024-02-15T22:56:47.215026+0000","last_clean":"2024-02-15T22:56:47.215026+0000","last_became_active":"2024-02-15T22:56:05.707492+0000","last_became_peered":"2024-02-15T22:56:05.707492+0000","last_unstale":"2024-02-15T22:56:47.215026+0000","last_undegraded":"2024-02-15T22:56:47.215026+0000","last_fullsized":"2024-02-15T22:56:47.215026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:53.786957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879050+0000","last_change":"2024-02-15T22:56:03.693256+0000","last_active":"2024-02-15T22:56:45.879050+0000","last_peered":"2024-02-15T22:56:45.879050+0000","last_clean":"2024-02-15T22:56:45.879050+0000","last_became_active":"2024-02-15T22:56:03.692909+0000","last_became_peered":"2024-02-15T22:56:03.692909+0000","last_unstale":"2024-02-15T22:56:45.879050+0000","last_undegraded":"2024-02-15T22:56:45.879050+0000","last_fullsized":"2024-02-15T22:56:45.879050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:56.246566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.215219+0000","last_change":"2024-02-15T22:56:05.710347+0000","last_active":"2024-02-15T22:56:47.215219+0000","last_peered":"2024-02-15T22:56:47.215219+0000","last_clean":"2024-02-15T22:56:47.215219+0000","last_became_active":"2024-02-15T22:56:05.710095+0000","last_became_peered":"2024-02-15T22:56:05.710095+0000","last_unstale":"2024-02-15T22:56:47.215219+0000","last_undegraded":"2024-02-15T22:56:47.215219+0000","last_fullsized":"2024-02-15T22:56:47.215219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:04:20.752404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884346+0000","last_change":"2024-02-15T22:56:03.695701+0000","last_active":"2024-02-15T22:56:45.884346+0000","last_peered":"2024-02-15T22:56:45.884346+0000","last_clean":"2024-02-15T22:56:45.884346+0000","last_became_active":"2024-02-15T22:56:03.695362+0000","last_became_peered":"2024-02-15T22:56:03.695362+0000","last_unstale":"2024-02-15T22:56:45.884346+0000","last_undegraded":"2024-02-15T22:56:45.884346+0000","last_fullsized":"2024-02-15T22:56:45.884346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:11.575998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391183+0000","last_change":"2024-02-15T22:56:05.701633+0000","last_active":"2024-02-15T22:57:35.391183+0000","last_peered":"2024-02-15T22:57:35.391183+0000","last_clean":"2024-02-15T22:57:35.391183+0000","last_became_active":"2024-02-15T22:56:05.701253+0000","last_became_peered":"2024-02-15T22:56:05.701253+0000","last_unstale":"2024-02-15T22:57:35.391183+0000","last_undegraded":"2024-02-15T22:57:35.391183+0000","last_fullsized":"2024-02-15T22:57:35.391183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880157+0000","last_change":"2024-02-15T22:56:03.700366+0000","last_active":"2024-02-15T22:56:45.880157+0000","last_peered":"2024-02-15T22:56:45.880157+0000","last_clean":"2024-02-15T22:56:45.880157+0000","last_became_active":"2024-02-15T22:56:03.699881+0000","last_became_peered":"2024-02-15T22:56:03.699881+0000","last_unstale":"2024-02-15T22:56:45.880157+0000","last_undegraded":"2024-02-15T22:56:45.880157+0000","last_fullsized":"2024-02-15T22:56:45.880157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887346+0000","last_change":"2024-02-15T22:56:45.887346+0000","last_active":"2024-02-15T22:56:45.887346+0000","last_peered":"2024-02-15T22:56:45.887346+0000","last_clean":"2024-02-15T22:56:45.887346+0000","last_became_active":"2024-02-15T22:56:45.886976+0000","last_became_peered":"2024-02-15T22:56:45.886976+0000","last_unstale":"2024-02-15T22:56:45.887346+0000","last_undegraded":"2024-02-15T22:56:45.887346+0000","last_fullsized":"2024-02-15T22:56:45.887346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:43.710640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.878637+0000","last_change":"2024-02-15T22:56:03.693265+0000","last_active":"2024-02-15T22:57:29.878637+0000","last_peered":"2024-02-15T22:57:29.878637+0000","last_clean":"2024-02-15T22:57:29.878637+0000","last_became_active":"2024-02-15T22:56:03.692939+0000","last_became_peered":"2024-02-15T22:56:03.692939+0000","last_unstale":"2024-02-15T22:57:29.878637+0000","last_undegraded":"2024-02-15T22:57:29.878637+0000","last_fullsized":"2024-02-15T22:57:29.878637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878893+0000","last_change":"2024-02-15T22:56:05.714686+0000","last_active":"2024-02-15T22:56:45.878893+0000","last_peered":"2024-02-15T22:56:45.878893+0000","last_clean":"2024-02-15T22:56:45.878893+0000","last_became_active":"2024-02-15T22:56:05.713670+0000","last_became_peered":"2024-02-15T22:56:05.713670+0000","last_unstale":"2024-02-15T22:56:45.878893+0000","last_undegraded":"2024-02-15T22:56:45.878893+0000","last_fullsized":"2024-02-15T22:56:45.878893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:57.594699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882088+0000","last_change":"2024-02-15T22:56:03.697544+0000","last_active":"2024-02-15T22:56:45.882088+0000","last_peered":"2024-02-15T22:56:45.882088+0000","last_clean":"2024-02-15T22:56:45.882088+0000","last_became_active":"2024-02-15T22:56:03.696174+0000","last_became_peered":"2024-02-15T22:56:03.696174+0000","last_unstale":"2024-02-15T22:56:45.882088+0000","last_undegraded":"2024-02-15T22:56:45.882088+0000","last_fullsized":"2024-02-15T22:56:45.882088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:35:03.459908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.426942+0000","last_change":"2024-02-15T22:56:05.703501+0000","last_active":"2024-02-15T22:56:47.426942+0000","last_peered":"2024-02-15T22:56:47.426942+0000","last_clean":"2024-02-15T22:56:47.426942+0000","last_became_active":"2024-02-15T22:56:05.703183+0000","last_became_peered":"2024-02-15T22:56:05.703183+0000","last_unstale":"2024-02-15T22:56:47.426942+0000","last_undegraded":"2024-02-15T22:56:47.426942+0000","last_fullsized":"2024-02-15T22:56:47.426942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:08:55.954762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.415547+0000","last_change":"2024-02-15T22:56:03.700841+0000","last_active":"2024-02-15T22:56:47.415547+0000","last_peered":"2024-02-15T22:56:47.415547+0000","last_clean":"2024-02-15T22:56:47.415547+0000","last_became_active":"2024-02-15T22:56:03.699989+0000","last_became_peered":"2024-02-15T22:56:03.699989+0000","last_unstale":"2024-02-15T22:56:47.415547+0000","last_undegraded":"2024-02-15T22:56:47.415547+0000","last_fullsized":"2024-02-15T22:56:47.415547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:24:52.527970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.883377+0000","last_change":"2024-02-15T22:56:05.701522+0000","last_active":"2024-02-15T22:57:29.883377+0000","last_peered":"2024-02-15T22:57:29.883377+0000","last_clean":"2024-02-15T22:57:29.883377+0000","last_became_active":"2024-02-15T22:56:05.701193+0000","last_became_peered":"2024-02-15T22:56:05.701193+0000","last_unstale":"2024-02-15T22:57:29.883377+0000","last_undegraded":"2024-02-15T22:57:29.883377+0000","last_fullsized":"2024-02-15T22:57:29.883377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:25:28.743304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881646+0000","last_change":"2024-02-15T22:56:03.693252+0000","last_active":"2024-02-15T22:56:45.881646+0000","last_peered":"2024-02-15T22:56:45.881646+0000","last_clean":"2024-02-15T22:56:45.881646+0000","last_became_active":"2024-02-15T22:56:03.692902+0000","last_became_peered":"2024-02-15T22:56:03.692902+0000","last_unstale":"2024-02-15T22:56:45.881646+0000","last_undegraded":"2024-02-15T22:56:45.881646+0000","last_fullsized":"2024-02-15T22:56:45.881646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:05:12.685609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505930+0000","last_change":"2024-02-15T22:56:05.702770+0000","last_active":"2024-02-15T22:57:29.505930+0000","last_peered":"2024-02-15T22:57:29.505930+0000","last_clean":"2024-02-15T22:57:29.505930+0000","last_became_active":"2024-02-15T22:56:05.702455+0000","last_became_peered":"2024-02-15T22:56:05.702455+0000","last_unstale":"2024-02-15T22:57:29.505930+0000","last_undegraded":"2024-02-15T22:57:29.505930+0000","last_fullsized":"2024-02-15T22:57:29.505930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:31.736198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880494+0000","last_change":"2024-02-15T22:56:03.695480+0000","last_active":"2024-02-15T22:56:45.880494+0000","last_peered":"2024-02-15T22:56:45.880494+0000","last_clean":"2024-02-15T22:56:45.880494+0000","last_became_active":"2024-02-15T22:56:03.695149+0000","last_became_peered":"2024-02-15T22:56:03.695149+0000","last_unstale":"2024-02-15T22:56:45.880494+0000","last_undegraded":"2024-02-15T22:56:45.880494+0000","last_fullsized":"2024-02-15T22:56:45.880494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:25:29.596967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883783+0000","last_change":"2024-02-15T22:56:05.704460+0000","last_active":"2024-02-15T22:56:45.883783+0000","last_peered":"2024-02-15T22:56:45.883783+0000","last_clean":"2024-02-15T22:56:45.883783+0000","last_became_active":"2024-02-15T22:56:05.704211+0000","last_became_peered":"2024-02-15T22:56:05.704211+0000","last_unstale":"2024-02-15T22:56:45.883783+0000","last_undegraded":"2024-02-15T22:56:45.883783+0000","last_fullsized":"2024-02-15T22:56:45.883783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:59:32.058815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.412910+0000","last_change":"2024-02-15T22:56:03.700242+0000","last_active":"2024-02-15T22:56:47.412910+0000","last_peered":"2024-02-15T22:56:47.412910+0000","last_clean":"2024-02-15T22:56:47.412910+0000","last_became_active":"2024-02-15T22:56:03.699419+0000","last_became_peered":"2024-02-15T22:56:03.699419+0000","last_unstale":"2024-02-15T22:56:47.412910+0000","last_undegraded":"2024-02-15T22:56:47.412910+0000","last_fullsized":"2024-02-15T22:56:47.412910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:52.582026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880395+0000","last_change":"2024-02-15T22:56:05.711089+0000","last_active":"2024-02-15T22:56:45.880395+0000","last_peered":"2024-02-15T22:56:45.880395+0000","last_clean":"2024-02-15T22:56:45.880395+0000","last_became_active":"2024-02-15T22:56:05.710665+0000","last_became_peered":"2024-02-15T22:56:05.710665+0000","last_unstale":"2024-02-15T22:56:45.880395+0000","last_undegraded":"2024-02-15T22:56:45.880395+0000","last_fullsized":"2024-02-15T22:56:45.880395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878725+0000","last_change":"2024-02-15T22:56:03.706180+0000","last_active":"2024-02-15T22:56:45.878725+0000","last_peered":"2024-02-15T22:56:45.878725+0000","last_clean":"2024-02-15T22:56:45.878725+0000","last_became_active":"2024-02-15T22:56:03.705871+0000","last_became_peered":"2024-02-15T22:56:03.705871+0000","last_unstale":"2024-02-15T22:56:45.878725+0000","last_undegraded":"2024-02-15T22:56:45.878725+0000","last_fullsized":"2024-02-15T22:56:45.878725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:46:27.775050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907691+0000","last_change":"2024-02-15T22:56:05.705174+0000","last_active":"2024-02-15T22:56:47.907691+0000","last_peered":"2024-02-15T22:56:47.907691+0000","last_clean":"2024-02-15T22:56:47.907691+0000","last_became_active":"2024-02-15T22:56:05.704505+0000","last_became_peered":"2024-02-15T22:56:05.704505+0000","last_unstale":"2024-02-15T22:56:47.907691+0000","last_undegraded":"2024-02-15T22:56:47.907691+0000","last_fullsized":"2024-02-15T22:56:47.907691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:45:43.641211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878881+0000","last_change":"2024-02-15T22:56:03.706212+0000","last_active":"2024-02-15T22:56:45.878881+0000","last_peered":"2024-02-15T22:56:45.878881+0000","last_clean":"2024-02-15T22:56:45.878881+0000","last_became_active":"2024-02-15T22:56:03.705904+0000","last_became_peered":"2024-02-15T22:56:03.705904+0000","last_unstale":"2024-02-15T22:56:45.878881+0000","last_undegraded":"2024-02-15T22:56:45.878881+0000","last_fullsized":"2024-02-15T22:56:45.878881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:10.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878616+0000","last_change":"2024-02-15T22:56:05.713346+0000","last_active":"2024-02-15T22:56:45.878616+0000","last_peered":"2024-02-15T22:56:45.878616+0000","last_clean":"2024-02-15T22:56:45.878616+0000","last_became_active":"2024-02-15T22:56:05.713035+0000","last_became_peered":"2024-02-15T22:56:05.713035+0000","last_unstale":"2024-02-15T22:56:45.878616+0000","last_undegraded":"2024-02-15T22:56:45.878616+0000","last_fullsized":"2024-02-15T22:56:45.878616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:46.103470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883260+0000","last_change":"2024-02-15T22:56:03.696317+0000","last_active":"2024-02-15T22:56:45.883260+0000","last_peered":"2024-02-15T22:56:45.883260+0000","last_clean":"2024-02-15T22:56:45.883260+0000","last_became_active":"2024-02-15T22:56:03.696045+0000","last_became_peered":"2024-02-15T22:56:03.696045+0000","last_unstale":"2024-02-15T22:56:45.883260+0000","last_undegraded":"2024-02-15T22:56:45.883260+0000","last_fullsized":"2024-02-15T22:56:45.883260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:41:52.854353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391060+0000","last_change":"2024-02-15T22:56:05.705005+0000","last_active":"2024-02-15T22:57:35.391060+0000","last_peered":"2024-02-15T22:57:35.391060+0000","last_clean":"2024-02-15T22:57:35.391060+0000","last_became_active":"2024-02-15T22:56:05.704733+0000","last_became_peered":"2024-02-15T22:56:05.704733+0000","last_unstale":"2024-02-15T22:57:35.391060+0000","last_undegraded":"2024-02-15T22:57:35.391060+0000","last_fullsized":"2024-02-15T22:57:35.391060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:02.417181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883670+0000","last_change":"2024-02-15T22:56:03.695753+0000","last_active":"2024-02-15T22:56:45.883670+0000","last_peered":"2024-02-15T22:56:45.883670+0000","last_clean":"2024-02-15T22:56:45.883670+0000","last_became_active":"2024-02-15T22:56:03.695454+0000","last_became_peered":"2024-02-15T22:56:03.695454+0000","last_unstale":"2024-02-15T22:56:45.883670+0000","last_undegraded":"2024-02-15T22:56:45.883670+0000","last_fullsized":"2024-02-15T22:56:45.883670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:16:51.780374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391086+0000","last_change":"2024-02-15T22:56:05.707756+0000","last_active":"2024-02-15T22:57:35.391086+0000","last_peered":"2024-02-15T22:57:35.391086+0000","last_clean":"2024-02-15T22:57:35.391086+0000","last_became_active":"2024-02-15T22:56:05.707464+0000","last_became_peered":"2024-02-15T22:56:05.707464+0000","last_unstale":"2024-02-15T22:57:35.391086+0000","last_undegraded":"2024-02-15T22:57:35.391086+0000","last_fullsized":"2024-02-15T22:57:35.391086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:48:01.797813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.386901+0000","last_change":"2024-02-15T22:56:03.696562+0000","last_active":"2024-02-15T22:57:35.386901+0000","last_peered":"2024-02-15T22:57:35.386901+0000","last_clean":"2024-02-15T22:57:35.386901+0000","last_became_active":"2024-02-15T22:56:03.696267+0000","last_became_peered":"2024-02-15T22:56:03.696267+0000","last_unstale":"2024-02-15T22:57:35.386901+0000","last_undegraded":"2024-02-15T22:57:35.386901+0000","last_fullsized":"2024-02-15T22:57:35.386901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:41.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.907693+0000","last_change":"2024-02-15T22:56:05.705880+0000","last_active":"2024-02-15T22:56:47.907693+0000","last_peered":"2024-02-15T22:56:47.907693+0000","last_clean":"2024-02-15T22:56:47.907693+0000","last_became_active":"2024-02-15T22:56:05.705496+0000","last_became_peered":"2024-02-15T22:56:05.705496+0000","last_unstale":"2024-02-15T22:56:47.907693+0000","last_undegraded":"2024-02-15T22:56:47.907693+0000","last_fullsized":"2024-02-15T22:56:47.907693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:55.990011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.375500+0000","last_change":"2024-02-15T22:56:03.707531+0000","last_active":"2024-02-15T22:56:46.375500+0000","last_peered":"2024-02-15T22:56:46.375500+0000","last_clean":"2024-02-15T22:56:46.375500+0000","last_became_active":"2024-02-15T22:56:03.707033+0000","last_became_peered":"2024-02-15T22:56:03.707033+0000","last_unstale":"2024-02-15T22:56:46.375500+0000","last_undegraded":"2024-02-15T22:56:46.375500+0000","last_fullsized":"2024-02-15T22:56:46.375500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:23:06.046731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881067+0000","last_change":"2024-02-15T22:56:03.706143+0000","last_active":"2024-02-15T22:56:45.881067+0000","last_peered":"2024-02-15T22:56:45.881067+0000","last_clean":"2024-02-15T22:56:45.881067+0000","last_became_active":"2024-02-15T22:56:03.705853+0000","last_became_peered":"2024-02-15T22:56:03.705853+0000","last_unstale":"2024-02-15T22:56:45.881067+0000","last_undegraded":"2024-02-15T22:56:45.881067+0000","last_fullsized":"2024-02-15T22:56:45.881067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:41:01.198670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.391176+0000","last_change":"2024-02-15T22:56:05.699396+0000","last_active":"2024-02-15T22:57:35.391176+0000","last_peered":"2024-02-15T22:57:35.391176+0000","last_clean":"2024-02-15T22:57:35.391176+0000","last_became_active":"2024-02-15T22:56:05.699141+0000","last_became_peered":"2024-02-15T22:56:05.699141+0000","last_unstale":"2024-02-15T22:57:35.391176+0000","last_undegraded":"2024-02-15T22:57:35.391176+0000","last_fullsized":"2024-02-15T22:57:35.391176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:03:02.890481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879188+0000","last_change":"2024-02-15T22:56:03.700573+0000","last_active":"2024-02-15T22:56:45.879188+0000","last_peered":"2024-02-15T22:56:45.879188+0000","last_clean":"2024-02-15T22:56:45.879188+0000","last_became_active":"2024-02-15T22:56:03.700107+0000","last_became_peered":"2024-02-15T22:56:03.700107+0000","last_unstale":"2024-02-15T22:56:45.879188+0000","last_undegraded":"2024-02-15T22:56:45.879188+0000","last_fullsized":"2024-02-15T22:56:45.879188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:03.780820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879724+0000","last_change":"2024-02-15T22:56:05.713543+0000","last_active":"2024-02-15T22:56:45.879724+0000","last_peered":"2024-02-15T22:56:45.879724+0000","last_clean":"2024-02-15T22:56:45.879724+0000","last_became_active":"2024-02-15T22:56:05.713142+0000","last_became_peered":"2024-02-15T22:56:05.713142+0000","last_unstale":"2024-02-15T22:56:45.879724+0000","last_undegraded":"2024-02-15T22:56:45.879724+0000","last_fullsized":"2024-02-15T22:56:45.879724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:23:08.154056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1269,"ondisk_log_size":1269,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":46,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672987,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35764,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336076,"statfs":{"total":96636764160,"available":96600141824,"internally_reserved":0,"allocated":438272,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Feb 15 22:56:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.26300000000000001}]}]},{"osd":2,"up_from":10,"seq":42949672988,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":978944,"data_stored":722767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.376}]},{"osd":3,"last update":"Thu Feb 15 22:56:52 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.36299999999999999}]}]},{"osd":1,"up_from":10,"seq":42949672987,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.311}]},{"osd":2,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.254}]},{"osd":3,"last update":"Thu Feb 15 22:56:51 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"last":0.219},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.27000000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705690,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.442}]},{"osd":2,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Feb 15 22:56:53 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.505}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:57:47.717 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.717 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.717 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.717 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.718 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.718 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.718 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.718 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.718 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.718 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.719 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.719 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.719 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.719 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.719 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.719 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.719 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.720 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.720 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.720 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.720 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.720 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.720 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.721 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.721 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.721 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.721 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.721 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.721 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.722 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.722 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.722 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.722 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.722 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.722 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.723 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.723 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.723 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.723 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.723 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.723 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.723 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.724 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.724 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.724 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.724 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.724 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.725 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.725 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.725 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.725 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.725 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.725 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.725 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.726 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.726 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.726 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.726 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.726 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.726 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.727 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.727 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.727 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.727 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.727 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.727 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.728 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.728 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.728 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.728 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.728 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.728 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.729 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.729 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.729 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.729 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.729 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.729 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.730 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.730 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.730 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.730 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.730 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.730 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.730 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.731 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.731 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.731 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.731 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.731 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.731 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.732 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.732 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.732 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.732 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.732 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.732 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.733 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.733 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.733 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.733 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.733 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-15T22:55:51.648340+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=51, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.733 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.734 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.734 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.734 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.734 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.734 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.734 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.735 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.735 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.735 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.735 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.735 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.735 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.736 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.736 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.736 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.736 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.736 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.736 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.737 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.737 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.737 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.737 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.737 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.737 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.738 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.738 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.738 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.738 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.738 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.738 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.739 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.739 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.739 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.739 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.739 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.739 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.740 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.740 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.740 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.740 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.740 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.740 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.741 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.741 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.741 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.741 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.741 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.741 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.742 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.742 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.742 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.742 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.742 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.742 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.742 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.743 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.743 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.743 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.743 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.743 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.743 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.744 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.744 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.744 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.744 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.744 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.744 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.745 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.745 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.745 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.745 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.745 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.745 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.745 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.746 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.746 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.746 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.746 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.746 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.746 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.747 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.747 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.747 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.747 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.747 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.747 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.748 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.748 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.748 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.748 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.748 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.748 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.749 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.749 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.749 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.749 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.749 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.749 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.749 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.750 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.750 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.750 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.750 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.750 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.750 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.751 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.751 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.751 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.751 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.751 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.751 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.752 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.752 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.752 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.752 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.752 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.752 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.753 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.753 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.753 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.753 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.753 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.753 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.753 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.754 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.754 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.754 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.754 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.754 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.754 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.755 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.755 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.755 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.755 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.755 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.755 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.755 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.756 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.756 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.756 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.756 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.756 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.757 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.757 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.757 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.757 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.757 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.757 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.757 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.758 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.758 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.758 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.758 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.758 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.758 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.759 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.759 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.759 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.759 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.759 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.759 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.760 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:57:47.760 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-15T22:57:48.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-02-15T22:58:07.761 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T22:58:07.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.871+0000 7f4dca5f6640 1 Processor -- start 2024-02-15T22:58:07.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.871+0000 7f4dca5f6640 1 -- start start 2024-02-15T22:58:07.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.871+0000 7f4dca5f6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4dc40956a0 0x7f4dc4095a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:07.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.871+0000 7f4dca5f6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc4095270 con 0x7f4dc4127460 2024-02-15T22:58:07.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.871+0000 7f4dca5f6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40954a0 con 0x7f4dc40956a0 2024-02-15T22:58:07.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.871+0000 7f4dc3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4dc40956a0 0x7f4dc4095a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:07.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.871+0000 7f4dc37fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4dc4127460 0x7f4dc4127870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:36086/0 (socket says 172.21.15.52:36086) 2024-02-15T22:58:07.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.871+0000 7f4dc37fe640 1 -- 172.21.15.52:0/2017218492 learned_addr learned my addr 172.21.15.52:0/2017218492 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:58:07.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.872+0000 7f4dc3fff640 1 -- 172.21.15.52:0/2017218492 >> v1:172.21.15.52:6789/0 conn(0x7f4dc4127460 legacy=0x7f4dc4127870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:07.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.872+0000 7f4dc3fff640 1 -- 172.21.15.52:0/2017218492 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4093d90 con 0x7f4dc40956a0 2024-02-15T22:58:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.872+0000 7f4dc3fff640 1 --2- 172.21.15.52:0/2017218492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc40956a0 0x7f4dc4095a80 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009720 tx=0x7f4db802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142c8c41a0a665c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.873+0000 7f4dc2ffd640 1 -- 172.21.15.52:0/2017218492 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db802e070 con 0x7f4dc40956a0 2024-02-15T22:58:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.873+0000 7f4dc2ffd640 1 -- 172.21.15.52:0/2017218492 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db80316d0 con 0x7f4dc40956a0 2024-02-15T22:58:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.873+0000 7f4dc2ffd640 1 -- 172.21.15.52:0/2017218492 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db8031990 con 0x7f4dc40956a0 2024-02-15T22:58:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.873+0000 7f4dca5f6640 1 -- 172.21.15.52:0/2017218492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc40956a0 msgr2=0x7f4dc4095a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.873+0000 7f4dca5f6640 1 --2- 172.21.15.52:0/2017218492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc40956a0 0x7f4dc4095a80 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009720 tx=0x7f4db802b840 comp rx=0 tx=0).stop 2024-02-15T22:58:07.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.873+0000 7f4dca5f6640 1 -- 172.21.15.52:0/2017218492 shutdown_connections 2024-02-15T22:58:07.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.873+0000 7f4dca5f6640 1 --2- 172.21.15.52:0/2017218492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc40956a0 0x7f4dc4095a80 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:07.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.873+0000 7f4dca5f6640 1 -- 172.21.15.52:0/2017218492 >> 172.21.15.52:0/2017218492 conn(0x7f4dc409a300 msgr2=0x7f4dc409a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:07.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.873+0000 7f4dca5f6640 1 -- 172.21.15.52:0/2017218492 shutdown_connections 2024-02-15T22:58:07.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.873+0000 7f4dca5f6640 1 -- 172.21.15.52:0/2017218492 wait complete. 2024-02-15T22:58:07.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.874+0000 7f4dca5f6640 1 Processor -- start 2024-02-15T22:58:07.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.874+0000 7f4dca5f6640 1 -- start start 2024-02-15T22:58:07.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dca5f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc40956a0 0x7f4dc408aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:07.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dca5f6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4097f20 con 0x7f4dc40956a0 2024-02-15T22:58:07.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc40956a0 0x7f4dc408aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:07.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc40956a0 0x7f4dc408aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36144/0 (socket says 172.21.15.52:36144) 2024-02-15T22:58:07.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dc3fff640 1 -- 172.21.15.52:0/1958310968 learned_addr learned my addr 172.21.15.52:0/1958310968 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:58:07.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dc3fff640 1 -- 172.21.15.52:0/1958310968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8009400 con 0x7f4dc40956a0 2024-02-15T22:58:07.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dc3fff640 1 --2- 172.21.15.52:0/1958310968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc40956a0 0x7f4dc408aa60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009840 tx=0x7f4db80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:07.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dc0ff9640 1 -- 172.21.15.52:0/1958310968 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db80328b0 con 0x7f4dc40956a0 2024-02-15T22:58:07.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dc0ff9640 1 -- 172.21.15.52:0/1958310968 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8032a10 con 0x7f4dc40956a0 2024-02-15T22:58:07.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dc0ff9640 1 -- 172.21.15.52:0/1958310968 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db8032cf0 con 0x7f4dc40956a0 2024-02-15T22:58:07.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dca5f6640 1 -- 172.21.15.52:0/1958310968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc408de00 con 0x7f4dc40956a0 2024-02-15T22:58:07.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.875+0000 7f4dca5f6640 1 -- 172.21.15.52:0/1958310968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc408d030 con 0x7f4dc40956a0 2024-02-15T22:58:07.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.876+0000 7f4dc0ff9640 1 -- 172.21.15.52:0/1958310968 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4db804d3f0 con 0x7f4dc40956a0 2024-02-15T22:58:07.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.877+0000 7f4dc0ff9640 1 --2- 172.21.15.52:0/1958310968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4db0037ef0 0x7f4db003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:07.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.877+0000 7f4dca5f6640 1 -- 172.21.15.52:0/1958310968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc408dc60 con 0x7f4dc40956a0 2024-02-15T22:58:07.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.877+0000 7f4dc0ff9640 1 -- 172.21.15.52:0/1958310968 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f4db806d350 con 0x7f4dc40956a0 2024-02-15T22:58:07.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.877+0000 7f4dc37fe640 1 --2- 172.21.15.52:0/1958310968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4db0037ef0 0x7f4db003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:07.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.877+0000 7f4dc37fe640 1 --2- 172.21.15.52:0/1958310968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4db0037ef0 0x7f4db003a3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4db4007fd0 tx=0x7f4db4007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:07.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:07.881+0000 7f4dc0ff9640 1 -- 172.21.15.52:0/1958310968 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4dc408dc60 con 0x7f4dc40956a0 2024-02-15T22:58:08.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.059+0000 7f4dca5f6640 1 -- 172.21.15.52:0/1958310968 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4dc4093ba0 con 0x7f4db0037ef0 2024-02-15T22:58:08.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.075+0000 7f4dc0ff9640 1 -- 172.21.15.52:0/1958310968 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+665984 (secure 0 0 0) 0x7f4dc4093ba0 con 0x7f4db0037ef0 2024-02-15T22:58:08.085 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:58:08.091 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-02-15T22:58:08.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.080+0000 7f4dca5f6640 1 -- 172.21.15.52:0/1958310968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4db0037ef0 msgr2=0x7f4db003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:08.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.080+0000 7f4dca5f6640 1 --2- 172.21.15.52:0/1958310968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4db0037ef0 0x7f4db003a3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4db4007fd0 tx=0x7f4db4007ac0 comp rx=0 tx=0).stop 2024-02-15T22:58:08.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.080+0000 7f4dca5f6640 1 -- 172.21.15.52:0/1958310968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc40956a0 msgr2=0x7f4dc408aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:08.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.080+0000 7f4dca5f6640 1 --2- 172.21.15.52:0/1958310968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc40956a0 0x7f4dc408aa60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009840 tx=0x7f4db80046c0 comp rx=0 tx=0).stop 2024-02-15T22:58:08.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.080+0000 7f4dca5f6640 1 -- 172.21.15.52:0/1958310968 shutdown_connections 2024-02-15T22:58:08.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.080+0000 7f4dca5f6640 1 --2- 172.21.15.52:0/1958310968 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f4db0037ef0 0x7f4db003a3b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:08.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.080+0000 7f4dca5f6640 1 --2- 172.21.15.52:0/1958310968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc40956a0 0x7f4dc408aa60 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:08.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.080+0000 7f4dca5f6640 1 -- 172.21.15.52:0/1958310968 >> 172.21.15.52:0/1958310968 conn(0x7f4dc409a300 msgr2=0x7f4dc4094160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:08.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.080+0000 7f4dca5f6640 1 -- 172.21.15.52:0/1958310968 shutdown_connections 2024-02-15T22:58:08.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:08.080+0000 7f4dca5f6640 1 -- 172.21.15.52:0/1958310968 wait complete. 2024-02-15T22:58:08.095 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-02-15T22:58:06.840617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4011,"num_read_kb":3661,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3912,"ondisk_log_size":3912,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135792,"kb_used_data":2768,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351568,"statfs":{"total":386547056640,"available":386408005632,"internally_reserved":0,"allocated":2834432,"data_stored":1715324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004053"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887059+0000","last_change":"2024-02-15T22:56:03.700271+0000","last_active":"2024-02-15T22:56:45.887059+0000","last_peered":"2024-02-15T22:56:45.887059+0000","last_clean":"2024-02-15T22:56:45.887059+0000","last_became_active":"2024-02-15T22:56:03.699163+0000","last_became_peered":"2024-02-15T22:56:03.699163+0000","last_unstale":"2024-02-15T22:56:45.887059+0000","last_undegraded":"2024-02-15T22:56:45.887059+0000","last_fullsized":"2024-02-15T22:56:45.887059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398722+0000","last_change":"2024-02-15T22:56:05.708737+0000","last_active":"2024-02-15T22:57:35.398722+0000","last_peered":"2024-02-15T22:57:35.398722+0000","last_clean":"2024-02-15T22:57:35.398722+0000","last_became_active":"2024-02-15T22:56:05.708415+0000","last_became_peered":"2024-02-15T22:56:05.708415+0000","last_unstale":"2024-02-15T22:57:35.398722+0000","last_undegraded":"2024-02-15T22:57:35.398722+0000","last_fullsized":"2024-02-15T22:57:35.398722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881114+0000","last_change":"2024-02-15T22:56:03.704350+0000","last_active":"2024-02-15T22:56:45.881114+0000","last_peered":"2024-02-15T22:56:45.881114+0000","last_clean":"2024-02-15T22:56:45.881114+0000","last_became_active":"2024-02-15T22:56:03.704043+0000","last_became_peered":"2024-02-15T22:56:03.704043+0000","last_unstale":"2024-02-15T22:56:45.881114+0000","last_undegraded":"2024-02-15T22:56:45.881114+0000","last_fullsized":"2024-02-15T22:56:45.881114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882501+0000","last_change":"2024-02-15T22:56:05.703860+0000","last_active":"2024-02-15T22:56:45.882501+0000","last_peered":"2024-02-15T22:56:45.882501+0000","last_clean":"2024-02-15T22:56:45.882501+0000","last_became_active":"2024-02-15T22:56:05.703587+0000","last_became_peered":"2024-02-15T22:56:05.703587+0000","last_unstale":"2024-02-15T22:56:45.882501+0000","last_undegraded":"2024-02-15T22:56:45.882501+0000","last_fullsized":"2024-02-15T22:56:45.882501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884314+0000","last_change":"2024-02-15T22:56:03.703994+0000","last_active":"2024-02-15T22:56:45.884314+0000","last_peered":"2024-02-15T22:56:45.884314+0000","last_clean":"2024-02-15T22:56:45.884314+0000","last_became_active":"2024-02-15T22:56:03.703702+0000","last_became_peered":"2024-02-15T22:56:03.703702+0000","last_unstale":"2024-02-15T22:56:45.884314+0000","last_undegraded":"2024-02-15T22:56:45.884314+0000","last_fullsized":"2024-02-15T22:56:45.884314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.891477+0000","last_change":"2024-02-15T22:56:05.709355+0000","last_active":"2024-02-15T22:57:29.891477+0000","last_peered":"2024-02-15T22:57:29.891477+0000","last_clean":"2024-02-15T22:57:29.891477+0000","last_became_active":"2024-02-15T22:56:05.709003+0000","last_became_peered":"2024-02-15T22:56:05.709003+0000","last_unstale":"2024-02-15T22:57:29.891477+0000","last_undegraded":"2024-02-15T22:57:29.891477+0000","last_fullsized":"2024-02-15T22:57:29.891477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.930742+0000","last_change":"2024-02-15T22:56:03.692040+0000","last_active":"2024-02-15T22:57:46.930742+0000","last_peered":"2024-02-15T22:57:46.930742+0000","last_clean":"2024-02-15T22:57:46.930742+0000","last_became_active":"2024-02-15T22:56:03.691753+0000","last_became_peered":"2024-02-15T22:56:03.691753+0000","last_unstale":"2024-02-15T22:57:46.930742+0000","last_undegraded":"2024-02-15T22:57:46.930742+0000","last_fullsized":"2024-02-15T22:57:46.930742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505752+0000","last_change":"2024-02-15T22:56:05.703818+0000","last_active":"2024-02-15T22:57:29.505752+0000","last_peered":"2024-02-15T22:57:29.505752+0000","last_clean":"2024-02-15T22:57:29.505752+0000","last_became_active":"2024-02-15T22:56:05.703541+0000","last_became_peered":"2024-02-15T22:56:05.703541+0000","last_unstale":"2024-02-15T22:57:29.505752+0000","last_undegraded":"2024-02-15T22:57:29.505752+0000","last_fullsized":"2024-02-15T22:57:29.505752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881575+0000","last_change":"2024-02-15T22:56:03.694830+0000","last_active":"2024-02-15T22:56:45.881575+0000","last_peered":"2024-02-15T22:56:45.881575+0000","last_clean":"2024-02-15T22:56:45.881575+0000","last_became_active":"2024-02-15T22:56:03.694522+0000","last_became_peered":"2024-02-15T22:56:03.694522+0000","last_unstale":"2024-02-15T22:56:45.881575+0000","last_undegraded":"2024-02-15T22:56:45.881575+0000","last_fullsized":"2024-02-15T22:56:45.881575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491949+0000","last_change":"2024-02-15T22:56:05.705402+0000","last_active":"2024-02-15T22:57:46.491949+0000","last_peered":"2024-02-15T22:57:46.491949+0000","last_clean":"2024-02-15T22:57:46.491949+0000","last_became_active":"2024-02-15T22:56:05.704411+0000","last_became_peered":"2024-02-15T22:56:05.704411+0000","last_unstale":"2024-02-15T22:57:46.491949+0000","last_undegraded":"2024-02-15T22:57:46.491949+0000","last_fullsized":"2024-02-15T22:57:46.491949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882255+0000","last_change":"2024-02-15T22:56:03.692633+0000","last_active":"2024-02-15T22:56:45.882255+0000","last_peered":"2024-02-15T22:56:45.882255+0000","last_clean":"2024-02-15T22:56:45.882255+0000","last_became_active":"2024-02-15T22:56:03.692316+0000","last_became_peered":"2024-02-15T22:56:03.692316+0000","last_unstale":"2024-02-15T22:56:45.882255+0000","last_undegraded":"2024-02-15T22:56:45.882255+0000","last_fullsized":"2024-02-15T22:56:45.882255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.226188+0000","last_change":"2024-02-15T22:58:04.226214+0000","last_active":"2024-02-15T22:58:04.226188+0000","last_peered":"2024-02-15T22:58:04.226188+0000","last_clean":"2024-02-15T22:58:04.226188+0000","last_became_active":"2024-02-15T22:56:05.715460+0000","last_became_peered":"2024-02-15T22:56:05.715460+0000","last_unstale":"2024-02-15T22:58:04.226188+0000","last_undegraded":"2024-02-15T22:58:04.226188+0000","last_fullsized":"2024-02-15T22:58:04.226188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:04.226104+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:04.226104+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.226104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:09.713529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.860448+0000","last_change":"2024-02-15T22:56:03.701184+0000","last_active":"2024-02-15T22:56:46.860448+0000","last_peered":"2024-02-15T22:56:46.860448+0000","last_clean":"2024-02-15T22:56:46.860448+0000","last_became_active":"2024-02-15T22:56:03.700908+0000","last_became_peered":"2024-02-15T22:56:03.700908+0000","last_unstale":"2024-02-15T22:56:46.860448+0000","last_undegraded":"2024-02-15T22:56:46.860448+0000","last_fullsized":"2024-02-15T22:56:46.860448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.891589+0000","last_change":"2024-02-15T22:56:05.706807+0000","last_active":"2024-02-15T22:57:29.891589+0000","last_peered":"2024-02-15T22:57:29.891589+0000","last_clean":"2024-02-15T22:57:29.891589+0000","last_became_active":"2024-02-15T22:56:05.706078+0000","last_became_peered":"2024-02-15T22:56:05.706078+0000","last_unstale":"2024-02-15T22:57:29.891589+0000","last_undegraded":"2024-02-15T22:57:29.891589+0000","last_fullsized":"2024-02-15T22:57:29.891589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879256+0000","last_change":"2024-02-15T22:56:03.697612+0000","last_active":"2024-02-15T22:56:45.879256+0000","last_peered":"2024-02-15T22:56:45.879256+0000","last_clean":"2024-02-15T22:56:45.879256+0000","last_became_active":"2024-02-15T22:56:03.697327+0000","last_became_peered":"2024-02-15T22:56:03.697327+0000","last_unstale":"2024-02-15T22:56:45.879256+0000","last_undegraded":"2024-02-15T22:56:45.879256+0000","last_fullsized":"2024-02-15T22:56:45.879256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886779+0000","last_change":"2024-02-15T22:56:05.705497+0000","last_active":"2024-02-15T22:56:45.886779+0000","last_peered":"2024-02-15T22:56:45.886779+0000","last_clean":"2024-02-15T22:56:45.886779+0000","last_became_active":"2024-02-15T22:56:05.705173+0000","last_became_peered":"2024-02-15T22:56:05.705173+0000","last_unstale":"2024-02-15T22:56:45.886779+0000","last_undegraded":"2024-02-15T22:56:45.886779+0000","last_fullsized":"2024-02-15T22:56:45.886779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.220181+0000","last_change":"2024-02-15T22:56:05.704020+0000","last_active":"2024-02-15T22:56:47.220181+0000","last_peered":"2024-02-15T22:56:47.220181+0000","last_clean":"2024-02-15T22:56:47.220181+0000","last_became_active":"2024-02-15T22:56:05.703708+0000","last_became_peered":"2024-02-15T22:56:05.703708+0000","last_unstale":"2024-02-15T22:56:47.220181+0000","last_undegraded":"2024-02-15T22:56:47.220181+0000","last_fullsized":"2024-02-15T22:56:47.220181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880482+0000","last_change":"2024-02-15T22:56:03.697488+0000","last_active":"2024-02-15T22:56:45.880482+0000","last_peered":"2024-02-15T22:56:45.880482+0000","last_clean":"2024-02-15T22:56:45.880482+0000","last_became_active":"2024-02-15T22:56:03.696959+0000","last_became_peered":"2024-02-15T22:56:03.696959+0000","last_unstale":"2024-02-15T22:56:45.880482+0000","last_undegraded":"2024-02-15T22:56:45.880482+0000","last_fullsized":"2024-02-15T22:56:45.880482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.891876+0000","last_change":"2024-02-15T22:56:05.700345+0000","last_active":"2024-02-15T22:57:29.891876+0000","last_peered":"2024-02-15T22:57:29.891876+0000","last_clean":"2024-02-15T22:57:29.891876+0000","last_became_active":"2024-02-15T22:56:05.700071+0000","last_became_peered":"2024-02-15T22:56:05.700071+0000","last_unstale":"2024-02-15T22:57:29.891876+0000","last_undegraded":"2024-02-15T22:57:29.891876+0000","last_fullsized":"2024-02-15T22:57:29.891876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887157+0000","last_change":"2024-02-15T22:56:03.700009+0000","last_active":"2024-02-15T22:56:45.887157+0000","last_peered":"2024-02-15T22:56:45.887157+0000","last_clean":"2024-02-15T22:56:45.887157+0000","last_became_active":"2024-02-15T22:56:03.699574+0000","last_became_peered":"2024-02-15T22:56:03.699574+0000","last_unstale":"2024-02-15T22:56:45.887157+0000","last_undegraded":"2024-02-15T22:56:45.887157+0000","last_fullsized":"2024-02-15T22:56:45.887157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398857+0000","last_change":"2024-02-15T22:56:05.702837+0000","last_active":"2024-02-15T22:57:35.398857+0000","last_peered":"2024-02-15T22:57:35.398857+0000","last_clean":"2024-02-15T22:57:35.398857+0000","last_became_active":"2024-02-15T22:56:05.702488+0000","last_became_peered":"2024-02-15T22:56:05.702488+0000","last_unstale":"2024-02-15T22:57:35.398857+0000","last_undegraded":"2024-02-15T22:57:35.398857+0000","last_fullsized":"2024-02-15T22:57:35.398857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887888+0000","last_change":"2024-02-15T22:56:45.886045+0000","last_active":"2024-02-15T22:56:45.887888+0000","last_peered":"2024-02-15T22:56:45.887888+0000","last_clean":"2024-02-15T22:56:45.887888+0000","last_became_active":"2024-02-15T22:56:45.885555+0000","last_became_peered":"2024-02-15T22:56:45.885555+0000","last_unstale":"2024-02-15T22:56:45.887888+0000","last_undegraded":"2024-02-15T22:56:45.887888+0000","last_fullsized":"2024-02-15T22:56:45.887888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'1","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505769+0000","last_change":"2024-02-15T22:56:05.706693+0000","last_active":"2024-02-15T22:57:29.505769+0000","last_peered":"2024-02-15T22:57:29.505769+0000","last_clean":"2024-02-15T22:57:29.505769+0000","last_became_active":"2024-02-15T22:56:05.705386+0000","last_became_peered":"2024-02-15T22:56:05.705386+0000","last_unstale":"2024-02-15T22:57:29.505769+0000","last_undegraded":"2024-02-15T22:57:29.505769+0000","last_fullsized":"2024-02-15T22:57:29.505769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879873+0000","last_change":"2024-02-15T22:56:03.693697+0000","last_active":"2024-02-15T22:56:45.879873+0000","last_peered":"2024-02-15T22:56:45.879873+0000","last_clean":"2024-02-15T22:56:45.879873+0000","last_became_active":"2024-02-15T22:56:03.693329+0000","last_became_peered":"2024-02-15T22:56:03.693329+0000","last_unstale":"2024-02-15T22:56:45.879873+0000","last_undegraded":"2024-02-15T22:56:45.879873+0000","last_fullsized":"2024-02-15T22:56:45.879873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505735+0000","last_change":"2024-02-15T22:56:05.705032+0000","last_active":"2024-02-15T22:57:29.505735+0000","last_peered":"2024-02-15T22:57:29.505735+0000","last_clean":"2024-02-15T22:57:29.505735+0000","last_became_active":"2024-02-15T22:56:05.704729+0000","last_became_peered":"2024-02-15T22:56:05.704729+0000","last_unstale":"2024-02-15T22:57:29.505735+0000","last_undegraded":"2024-02-15T22:57:29.505735+0000","last_fullsized":"2024-02-15T22:57:29.505735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880463+0000","last_change":"2024-02-15T22:56:03.704183+0000","last_active":"2024-02-15T22:56:45.880463+0000","last_peered":"2024-02-15T22:56:45.880463+0000","last_clean":"2024-02-15T22:56:45.880463+0000","last_became_active":"2024-02-15T22:56:03.703885+0000","last_became_peered":"2024-02-15T22:56:03.703885+0000","last_unstale":"2024-02-15T22:56:45.880463+0000","last_undegraded":"2024-02-15T22:56:45.880463+0000","last_fullsized":"2024-02-15T22:56:45.880463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505793+0000","last_change":"2024-02-15T22:56:05.698851+0000","last_active":"2024-02-15T22:57:29.505793+0000","last_peered":"2024-02-15T22:57:29.505793+0000","last_clean":"2024-02-15T22:57:29.505793+0000","last_became_active":"2024-02-15T22:56:05.698553+0000","last_became_peered":"2024-02-15T22:56:05.698553+0000","last_unstale":"2024-02-15T22:57:29.505793+0000","last_undegraded":"2024-02-15T22:57:29.505793+0000","last_fullsized":"2024-02-15T22:57:29.505793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883791+0000","last_change":"2024-02-15T22:56:03.702268+0000","last_active":"2024-02-15T22:56:45.883791+0000","last_peered":"2024-02-15T22:56:45.883791+0000","last_clean":"2024-02-15T22:56:45.883791+0000","last_became_active":"2024-02-15T22:56:03.701819+0000","last_became_peered":"2024-02-15T22:56:03.701819+0000","last_unstale":"2024-02-15T22:56:45.883791+0000","last_undegraded":"2024-02-15T22:56:45.883791+0000","last_fullsized":"2024-02-15T22:56:45.883791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.408889+0000","last_change":"2024-02-15T22:56:13.731342+0000","last_active":"2024-02-15T22:57:35.408889+0000","last_peered":"2024-02-15T22:57:35.408889+0000","last_clean":"2024-02-15T22:57:35.408889+0000","last_became_active":"2024-02-15T22:56:13.730499+0000","last_became_peered":"2024-02-15T22:56:13.730499+0000","last_unstale":"2024-02-15T22:57:35.408889+0000","last_undegraded":"2024-02-15T22:57:35.408889+0000","last_fullsized":"2024-02-15T22:57:35.408889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.885049+0000","last_change":"2024-02-15T22:56:05.700054+0000","last_active":"2024-02-15T22:56:46.885049+0000","last_peered":"2024-02-15T22:56:46.885049+0000","last_clean":"2024-02-15T22:56:46.885049+0000","last_became_active":"2024-02-15T22:56:05.699821+0000","last_became_peered":"2024-02-15T22:56:05.699821+0000","last_unstale":"2024-02-15T22:56:46.885049+0000","last_undegraded":"2024-02-15T22:56:46.885049+0000","last_fullsized":"2024-02-15T22:56:46.885049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881135+0000","last_change":"2024-02-15T22:56:03.706199+0000","last_active":"2024-02-15T22:56:45.881135+0000","last_peered":"2024-02-15T22:56:45.881135+0000","last_clean":"2024-02-15T22:56:45.881135+0000","last_became_active":"2024-02-15T22:56:03.705881+0000","last_became_peered":"2024-02-15T22:56:03.705881+0000","last_unstale":"2024-02-15T22:56:45.881135+0000","last_undegraded":"2024-02-15T22:56:45.881135+0000","last_fullsized":"2024-02-15T22:56:45.881135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.895502+0000","last_change":"2024-02-15T22:56:45.893437+0000","last_active":"2024-02-15T22:56:45.895502+0000","last_peered":"2024-02-15T22:56:45.895502+0000","last_clean":"2024-02-15T22:56:45.895502+0000","last_became_active":"2024-02-15T22:56:45.893067+0000","last_became_peered":"2024-02-15T22:56:45.893067+0000","last_unstale":"2024-02-15T22:56:45.895502+0000","last_undegraded":"2024-02-15T22:56:45.895502+0000","last_fullsized":"2024-02-15T22:56:45.895502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.887502+0000","last_change":"2024-02-15T22:57:48.887564+0000","last_active":"2024-02-15T22:57:48.887502+0000","last_peered":"2024-02-15T22:57:48.887502+0000","last_clean":"2024-02-15T22:57:48.887502+0000","last_became_active":"2024-02-15T22:56:09.714201+0000","last_became_peered":"2024-02-15T22:56:09.714201+0000","last_unstale":"2024-02-15T22:57:48.887502+0000","last_undegraded":"2024-02-15T22:57:48.887502+0000","last_fullsized":"2024-02-15T22:57:48.887502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:48.887402+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:48.887402+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.887402+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:20.076360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.920874+0000","last_change":"2024-02-15T22:57:56.920914+0000","last_active":"2024-02-15T22:57:56.920874+0000","last_peered":"2024-02-15T22:57:56.920874+0000","last_clean":"2024-02-15T22:57:56.920874+0000","last_became_active":"2024-02-15T22:56:11.722257+0000","last_became_peered":"2024-02-15T22:56:11.722257+0000","last_unstale":"2024-02-15T22:57:56.920874+0000","last_undegraded":"2024-02-15T22:57:56.920874+0000","last_fullsized":"2024-02-15T22:57:56.920874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.920756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.920756+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.920756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:24:37.182344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.679445+0000","last_change":"2024-02-15T22:56:13.729349+0000","last_active":"2024-02-15T22:57:29.679445+0000","last_peered":"2024-02-15T22:57:29.679445+0000","last_clean":"2024-02-15T22:57:29.679445+0000","last_became_active":"2024-02-15T22:56:13.729067+0000","last_became_peered":"2024-02-15T22:56:13.729067+0000","last_unstale":"2024-02-15T22:57:29.679445+0000","last_undegraded":"2024-02-15T22:57:29.679445+0000","last_fullsized":"2024-02-15T22:57:29.679445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.433785+0000","last_change":"2024-02-15T22:56:05.709930+0000","last_active":"2024-02-15T22:56:47.433785+0000","last_peered":"2024-02-15T22:56:47.433785+0000","last_clean":"2024-02-15T22:56:47.433785+0000","last_became_active":"2024-02-15T22:56:05.709632+0000","last_became_peered":"2024-02-15T22:56:05.709632+0000","last_unstale":"2024-02-15T22:56:47.433785+0000","last_undegraded":"2024-02-15T22:56:47.433785+0000","last_fullsized":"2024-02-15T22:56:47.433785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882404+0000","last_change":"2024-02-15T22:56:03.699568+0000","last_active":"2024-02-15T22:56:45.882404+0000","last_peered":"2024-02-15T22:56:45.882404+0000","last_clean":"2024-02-15T22:56:45.882404+0000","last_became_active":"2024-02-15T22:56:03.699250+0000","last_became_peered":"2024-02-15T22:56:03.699250+0000","last_unstale":"2024-02-15T22:56:45.882404+0000","last_undegraded":"2024-02-15T22:56:45.882404+0000","last_fullsized":"2024-02-15T22:56:45.882404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880191+0000","last_change":"2024-02-15T22:56:07.706255+0000","last_active":"2024-02-15T22:56:45.880191+0000","last_peered":"2024-02-15T22:56:45.880191+0000","last_clean":"2024-02-15T22:56:45.880191+0000","last_became_active":"2024-02-15T22:56:07.705828+0000","last_became_peered":"2024-02-15T22:56:07.705828+0000","last_unstale":"2024-02-15T22:56:45.880191+0000","last_undegraded":"2024-02-15T22:56:45.880191+0000","last_fullsized":"2024-02-15T22:56:45.880191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.924856+0000","last_change":"2024-02-15T22:57:55.924930+0000","last_active":"2024-02-15T22:57:55.924856+0000","last_peered":"2024-02-15T22:57:55.924856+0000","last_clean":"2024-02-15T22:57:55.924856+0000","last_became_active":"2024-02-15T22:56:09.712812+0000","last_became_peered":"2024-02-15T22:56:09.712812+0000","last_unstale":"2024-02-15T22:57:55.924856+0000","last_undegraded":"2024-02-15T22:57:55.924856+0000","last_fullsized":"2024-02-15T22:57:55.924856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-15T22:57:55.924760+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-15T22:57:55.924760+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.924760+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:30.496577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.900609+0000","last_change":"2024-02-15T22:57:52.900635+0000","last_active":"2024-02-15T22:57:52.900609+0000","last_peered":"2024-02-15T22:57:52.900609+0000","last_clean":"2024-02-15T22:57:52.900609+0000","last_became_active":"2024-02-15T22:56:11.721486+0000","last_became_peered":"2024-02-15T22:56:11.721486+0000","last_unstale":"2024-02-15T22:57:52.900609+0000","last_undegraded":"2024-02-15T22:57:52.900609+0000","last_fullsized":"2024-02-15T22:57:52.900609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.900511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.900511+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.900511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:44.599545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879190+0000","last_change":"2024-02-15T22:56:13.734756+0000","last_active":"2024-02-15T22:56:45.879190+0000","last_peered":"2024-02-15T22:56:45.879190+0000","last_clean":"2024-02-15T22:56:45.879190+0000","last_became_active":"2024-02-15T22:56:13.734418+0000","last_became_peered":"2024-02-15T22:56:13.734418+0000","last_unstale":"2024-02-15T22:56:45.879190+0000","last_undegraded":"2024-02-15T22:56:45.879190+0000","last_fullsized":"2024-02-15T22:56:45.879190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398933+0000","last_change":"2024-02-15T22:56:05.700314+0000","last_active":"2024-02-15T22:57:35.398933+0000","last_peered":"2024-02-15T22:57:35.398933+0000","last_clean":"2024-02-15T22:57:35.398933+0000","last_became_active":"2024-02-15T22:56:05.699398+0000","last_became_peered":"2024-02-15T22:56:05.699398+0000","last_unstale":"2024-02-15T22:57:35.398933+0000","last_undegraded":"2024-02-15T22:57:35.398933+0000","last_fullsized":"2024-02-15T22:57:35.398933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882032+0000","last_change":"2024-02-15T22:56:03.707100+0000","last_active":"2024-02-15T22:56:45.882032+0000","last_peered":"2024-02-15T22:56:45.882032+0000","last_clean":"2024-02-15T22:56:45.882032+0000","last_became_active":"2024-02-15T22:56:03.706818+0000","last_became_peered":"2024-02-15T22:56:03.706818+0000","last_unstale":"2024-02-15T22:56:45.882032+0000","last_undegraded":"2024-02-15T22:56:45.882032+0000","last_fullsized":"2024-02-15T22:56:45.882032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882341+0000","last_change":"2024-02-15T22:56:07.704992+0000","last_active":"2024-02-15T22:56:45.882341+0000","last_peered":"2024-02-15T22:56:45.882341+0000","last_clean":"2024-02-15T22:56:45.882341+0000","last_became_active":"2024-02-15T22:56:07.704168+0000","last_became_peered":"2024-02-15T22:56:07.704168+0000","last_unstale":"2024-02-15T22:56:45.882341+0000","last_undegraded":"2024-02-15T22:56:45.882341+0000","last_fullsized":"2024-02-15T22:56:45.882341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.998935+0000","last_change":"2024-02-15T22:57:54.998999+0000","last_active":"2024-02-15T22:57:54.998935+0000","last_peered":"2024-02-15T22:57:54.998935+0000","last_clean":"2024-02-15T22:57:54.998935+0000","last_became_active":"2024-02-15T22:56:09.718326+0000","last_became_peered":"2024-02-15T22:56:09.718326+0000","last_unstale":"2024-02-15T22:57:54.998935+0000","last_undegraded":"2024-02-15T22:57:54.998935+0000","last_fullsized":"2024-02-15T22:57:54.998935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:57:54.998836+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:57:54.998836+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.998836+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:33:48.011800+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'243","reported_seq":305,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.185332+0000","last_change":"2024-02-15T22:56:11.726498+0000","last_active":"2024-02-15T22:57:43.185332+0000","last_peered":"2024-02-15T22:57:43.185332+0000","last_clean":"2024-02-15T22:57:43.185332+0000","last_became_active":"2024-02-15T22:56:11.724138+0000","last_became_peered":"2024-02-15T22:56:11.724138+0000","last_unstale":"2024-02-15T22:57:43.185332+0000","last_undegraded":"2024-02-15T22:57:43.185332+0000","last_fullsized":"2024-02-15T22:57:43.185332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882352+0000","last_change":"2024-02-15T22:56:13.733123+0000","last_active":"2024-02-15T22:56:45.882352+0000","last_peered":"2024-02-15T22:56:45.882352+0000","last_clean":"2024-02-15T22:56:45.882352+0000","last_became_active":"2024-02-15T22:56:13.732762+0000","last_became_peered":"2024-02-15T22:56:13.732762+0000","last_unstale":"2024-02-15T22:56:45.882352+0000","last_undegraded":"2024-02-15T22:56:45.882352+0000","last_fullsized":"2024-02-15T22:56:45.882352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.220707+0000","last_change":"2024-02-15T22:56:05.705807+0000","last_active":"2024-02-15T22:56:47.220707+0000","last_peered":"2024-02-15T22:56:47.220707+0000","last_clean":"2024-02-15T22:56:47.220707+0000","last_became_active":"2024-02-15T22:56:05.705360+0000","last_became_peered":"2024-02-15T22:56:05.705360+0000","last_unstale":"2024-02-15T22:56:47.220707+0000","last_undegraded":"2024-02-15T22:56:47.220707+0000","last_fullsized":"2024-02-15T22:56:47.220707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.877577+0000","last_change":"2024-02-15T22:56:03.698653+0000","last_active":"2024-02-15T22:56:45.877577+0000","last_peered":"2024-02-15T22:56:45.877577+0000","last_clean":"2024-02-15T22:56:45.877577+0000","last_became_active":"2024-02-15T22:56:03.698225+0000","last_became_peered":"2024-02-15T22:56:03.698225+0000","last_unstale":"2024-02-15T22:56:45.877577+0000","last_undegraded":"2024-02-15T22:56:45.877577+0000","last_fullsized":"2024-02-15T22:56:45.877577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.851903+0000","last_change":"2024-02-15T22:57:47.851925+0000","last_active":"2024-02-15T22:57:47.851903+0000","last_peered":"2024-02-15T22:57:47.851903+0000","last_clean":"2024-02-15T22:57:47.851903+0000","last_became_active":"2024-02-15T22:56:07.709236+0000","last_became_peered":"2024-02-15T22:56:07.709236+0000","last_unstale":"2024-02-15T22:57:47.851903+0000","last_undegraded":"2024-02-15T22:57:47.851903+0000","last_fullsized":"2024-02-15T22:57:47.851903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.851815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.851815+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.851815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:42.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.002972+0000","last_change":"2024-02-15T22:57:53.003016+0000","last_active":"2024-02-15T22:57:53.002972+0000","last_peered":"2024-02-15T22:57:53.002972+0000","last_clean":"2024-02-15T22:57:53.002972+0000","last_became_active":"2024-02-15T22:56:09.729556+0000","last_became_peered":"2024-02-15T22:56:09.729556+0000","last_unstale":"2024-02-15T22:57:53.002972+0000","last_undegraded":"2024-02-15T22:57:53.002972+0000","last_fullsized":"2024-02-15T22:57:53.002972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:53.002893+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:53.002893+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.002893+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:27:11.902505+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":341,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.310087+0000","last_change":"2024-02-15T22:57:53.310138+0000","last_active":"2024-02-15T22:57:53.310087+0000","last_peered":"2024-02-15T22:57:53.310087+0000","last_clean":"2024-02-15T22:57:53.310087+0000","last_became_active":"2024-02-15T22:56:11.719588+0000","last_became_peered":"2024-02-15T22:56:11.719588+0000","last_unstale":"2024-02-15T22:57:53.310087+0000","last_undegraded":"2024-02-15T22:57:53.310087+0000","last_fullsized":"2024-02-15T22:57:53.310087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:53.309962+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:53.309962+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.309962+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:05.319309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881220+0000","last_change":"2024-02-15T22:56:05.711111+0000","last_active":"2024-02-15T22:56:45.881220+0000","last_peered":"2024-02-15T22:56:45.881220+0000","last_clean":"2024-02-15T22:56:45.881220+0000","last_became_active":"2024-02-15T22:56:05.710578+0000","last_became_peered":"2024-02-15T22:56:05.710578+0000","last_unstale":"2024-02-15T22:56:45.881220+0000","last_undegraded":"2024-02-15T22:56:45.881220+0000","last_fullsized":"2024-02-15T22:56:45.881220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.374424+0000","last_change":"2024-02-15T22:56:03.702464+0000","last_active":"2024-02-15T22:56:46.374424+0000","last_peered":"2024-02-15T22:56:46.374424+0000","last_clean":"2024-02-15T22:56:46.374424+0000","last_became_active":"2024-02-15T22:56:03.702187+0000","last_became_peered":"2024-02-15T22:56:03.702187+0000","last_unstale":"2024-02-15T22:56:46.374424+0000","last_undegraded":"2024-02-15T22:56:46.374424+0000","last_fullsized":"2024-02-15T22:56:46.374424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.884891+0000","last_change":"2024-02-15T22:57:59.884933+0000","last_active":"2024-02-15T22:57:59.884891+0000","last_peered":"2024-02-15T22:57:59.884891+0000","last_clean":"2024-02-15T22:57:59.884891+0000","last_became_active":"2024-02-15T22:56:07.707328+0000","last_became_peered":"2024-02-15T22:56:07.707328+0000","last_unstale":"2024-02-15T22:57:59.884891+0000","last_undegraded":"2024-02-15T22:57:59.884891+0000","last_fullsized":"2024-02-15T22:57:59.884891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:59.884790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:59.884790+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.884790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:05.894308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.000856+0000","last_change":"2024-02-15T22:57:57.000916+0000","last_active":"2024-02-15T22:57:57.000856+0000","last_peered":"2024-02-15T22:57:57.000856+0000","last_clean":"2024-02-15T22:57:57.000856+0000","last_became_active":"2024-02-15T22:56:09.715019+0000","last_became_peered":"2024-02-15T22:56:09.715019+0000","last_unstale":"2024-02-15T22:57:57.000856+0000","last_undegraded":"2024-02-15T22:57:57.000856+0000","last_fullsized":"2024-02-15T22:57:57.000856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-15T22:57:57.000759+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-15T22:57:57.000759+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.000759+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:45:12.812634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.357116+0000","last_change":"2024-02-15T22:57:50.357140+0000","last_active":"2024-02-15T22:57:50.357116+0000","last_peered":"2024-02-15T22:57:50.357116+0000","last_clean":"2024-02-15T22:57:50.357116+0000","last_became_active":"2024-02-15T22:56:11.719845+0000","last_became_peered":"2024-02-15T22:56:11.719845+0000","last_unstale":"2024-02-15T22:57:50.357116+0000","last_undegraded":"2024-02-15T22:57:50.357116+0000","last_fullsized":"2024-02-15T22:57:50.357116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.357021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.357021+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.357021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:06.000871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.681211+0000","last_change":"2024-02-15T22:56:13.732667+0000","last_active":"2024-02-15T22:57:29.681211+0000","last_peered":"2024-02-15T22:57:29.681211+0000","last_clean":"2024-02-15T22:57:29.681211+0000","last_became_active":"2024-02-15T22:56:13.732321+0000","last_became_peered":"2024-02-15T22:56:13.732321+0000","last_unstale":"2024-02-15T22:57:29.681211+0000","last_undegraded":"2024-02-15T22:57:29.681211+0000","last_fullsized":"2024-02-15T22:57:29.681211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.435805+0000","last_change":"2024-02-15T22:56:05.698607+0000","last_active":"2024-02-15T22:56:47.435805+0000","last_peered":"2024-02-15T22:56:47.435805+0000","last_clean":"2024-02-15T22:56:47.435805+0000","last_became_active":"2024-02-15T22:56:05.697834+0000","last_became_peered":"2024-02-15T22:56:05.697834+0000","last_unstale":"2024-02-15T22:56:47.435805+0000","last_undegraded":"2024-02-15T22:56:47.435805+0000","last_fullsized":"2024-02-15T22:56:47.435805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887597+0000","last_change":"2024-02-15T22:56:03.702616+0000","last_active":"2024-02-15T22:56:45.887597+0000","last_peered":"2024-02-15T22:56:45.887597+0000","last_clean":"2024-02-15T22:56:45.887597+0000","last_became_active":"2024-02-15T22:56:03.702353+0000","last_became_peered":"2024-02-15T22:56:03.702353+0000","last_unstale":"2024-02-15T22:56:45.887597+0000","last_undegraded":"2024-02-15T22:56:45.887597+0000","last_fullsized":"2024-02-15T22:56:45.887597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880111+0000","last_change":"2024-02-15T22:56:07.707046+0000","last_active":"2024-02-15T22:56:45.880111+0000","last_peered":"2024-02-15T22:56:45.880111+0000","last_clean":"2024-02-15T22:56:45.880111+0000","last_became_active":"2024-02-15T22:56:07.706656+0000","last_became_peered":"2024-02-15T22:56:07.706656+0000","last_unstale":"2024-02-15T22:56:45.880111+0000","last_undegraded":"2024-02-15T22:56:45.880111+0000","last_fullsized":"2024-02-15T22:56:45.880111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.993226+0000","last_change":"2024-02-15T22:57:52.993269+0000","last_active":"2024-02-15T22:57:52.993226+0000","last_peered":"2024-02-15T22:57:52.993226+0000","last_clean":"2024-02-15T22:57:52.993226+0000","last_became_active":"2024-02-15T22:56:09.716138+0000","last_became_peered":"2024-02-15T22:56:09.716138+0000","last_unstale":"2024-02-15T22:57:52.993226+0000","last_undegraded":"2024-02-15T22:57:52.993226+0000","last_fullsized":"2024-02-15T22:57:52.993226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:52.993117+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:52.993117+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.993117+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:16.156318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879261+0000","last_change":"2024-02-15T22:56:11.724665+0000","last_active":"2024-02-15T22:56:45.879261+0000","last_peered":"2024-02-15T22:56:45.879261+0000","last_clean":"2024-02-15T22:56:45.879261+0000","last_became_active":"2024-02-15T22:56:11.724317+0000","last_became_peered":"2024-02-15T22:56:11.724317+0000","last_unstale":"2024-02-15T22:56:45.879261+0000","last_undegraded":"2024-02-15T22:56:45.879261+0000","last_fullsized":"2024-02-15T22:56:45.879261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.889667+0000","last_change":"2024-02-15T22:56:13.733414+0000","last_active":"2024-02-15T22:57:29.889667+0000","last_peered":"2024-02-15T22:57:29.889667+0000","last_clean":"2024-02-15T22:57:29.889667+0000","last_became_active":"2024-02-15T22:56:13.733118+0000","last_became_peered":"2024-02-15T22:56:13.733118+0000","last_unstale":"2024-02-15T22:57:29.889667+0000","last_undegraded":"2024-02-15T22:57:29.889667+0000","last_fullsized":"2024-02-15T22:57:29.889667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'20","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.434259+0000","last_change":"2024-02-15T22:56:45.891684+0000","last_active":"2024-02-15T22:56:47.434259+0000","last_peered":"2024-02-15T22:56:47.434259+0000","last_clean":"2024-02-15T22:56:47.434259+0000","last_became_active":"2024-02-15T22:56:45.886248+0000","last_became_peered":"2024-02-15T22:56:45.886248+0000","last_unstale":"2024-02-15T22:56:47.434259+0000","last_undegraded":"2024-02-15T22:56:47.434259+0000","last_fullsized":"2024-02-15T22:56:47.434259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883408+0000","last_change":"2024-02-15T22:56:03.700436+0000","last_active":"2024-02-15T22:56:45.883408+0000","last_peered":"2024-02-15T22:56:45.883408+0000","last_clean":"2024-02-15T22:56:45.883408+0000","last_became_active":"2024-02-15T22:56:03.700087+0000","last_became_peered":"2024-02-15T22:56:03.700087+0000","last_unstale":"2024-02-15T22:56:45.883408+0000","last_undegraded":"2024-02-15T22:56:45.883408+0000","last_fullsized":"2024-02-15T22:56:45.883408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881547+0000","last_change":"2024-02-15T22:56:07.705816+0000","last_active":"2024-02-15T22:56:45.881547+0000","last_peered":"2024-02-15T22:56:45.881547+0000","last_clean":"2024-02-15T22:56:45.881547+0000","last_became_active":"2024-02-15T22:56:07.704502+0000","last_became_peered":"2024-02-15T22:56:07.704502+0000","last_unstale":"2024-02-15T22:56:45.881547+0000","last_undegraded":"2024-02-15T22:56:45.881547+0000","last_fullsized":"2024-02-15T22:56:45.881547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'37","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.135890+0000","last_change":"2024-02-15T22:56:09.719447+0000","last_active":"2024-02-15T22:57:43.135890+0000","last_peered":"2024-02-15T22:57:43.135890+0000","last_clean":"2024-02-15T22:57:43.135890+0000","last_became_active":"2024-02-15T22:56:09.717174+0000","last_became_peered":"2024-02-15T22:56:09.717174+0000","last_unstale":"2024-02-15T22:57:43.135890+0000","last_undegraded":"2024-02-15T22:57:43.135890+0000","last_fullsized":"2024-02-15T22:57:43.135890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":312,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.299499+0000","last_change":"2024-02-15T22:58:00.299547+0000","last_active":"2024-02-15T22:58:00.299499+0000","last_peered":"2024-02-15T22:58:00.299499+0000","last_clean":"2024-02-15T22:58:00.299499+0000","last_became_active":"2024-02-15T22:56:11.724273+0000","last_became_peered":"2024-02-15T22:56:11.724273+0000","last_unstale":"2024-02-15T22:58:00.299499+0000","last_undegraded":"2024-02-15T22:58:00.299499+0000","last_fullsized":"2024-02-15T22:58:00.299499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:58:00.299415+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:58:00.299415+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.299415+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:33.226403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880705+0000","last_change":"2024-02-15T22:56:13.727119+0000","last_active":"2024-02-15T22:56:45.880705+0000","last_peered":"2024-02-15T22:56:45.880705+0000","last_clean":"2024-02-15T22:56:45.880705+0000","last_became_active":"2024-02-15T22:56:13.726858+0000","last_became_peered":"2024-02-15T22:56:13.726858+0000","last_unstale":"2024-02-15T22:56:45.880705+0000","last_undegraded":"2024-02-15T22:56:45.880705+0000","last_fullsized":"2024-02-15T22:56:45.880705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398266+0000","last_change":"2024-02-15T22:56:05.702296+0000","last_active":"2024-02-15T22:57:35.398266+0000","last_peered":"2024-02-15T22:57:35.398266+0000","last_clean":"2024-02-15T22:57:35.398266+0000","last_became_active":"2024-02-15T22:56:05.701568+0000","last_became_peered":"2024-02-15T22:56:05.701568+0000","last_unstale":"2024-02-15T22:57:35.398266+0000","last_undegraded":"2024-02-15T22:57:35.398266+0000","last_fullsized":"2024-02-15T22:57:35.398266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882564+0000","last_change":"2024-02-15T22:56:03.695726+0000","last_active":"2024-02-15T22:56:45.882564+0000","last_peered":"2024-02-15T22:56:45.882564+0000","last_clean":"2024-02-15T22:56:45.882564+0000","last_became_active":"2024-02-15T22:56:03.694668+0000","last_became_peered":"2024-02-15T22:56:03.694668+0000","last_unstale":"2024-02-15T22:56:45.882564+0000","last_undegraded":"2024-02-15T22:56:45.882564+0000","last_fullsized":"2024-02-15T22:56:45.882564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879915+0000","last_change":"2024-02-15T22:56:07.705196+0000","last_active":"2024-02-15T22:56:45.879915+0000","last_peered":"2024-02-15T22:56:45.879915+0000","last_clean":"2024-02-15T22:56:45.879915+0000","last_became_active":"2024-02-15T22:56:07.704054+0000","last_became_peered":"2024-02-15T22:56:07.704054+0000","last_unstale":"2024-02-15T22:56:45.879915+0000","last_undegraded":"2024-02-15T22:56:45.879915+0000","last_fullsized":"2024-02-15T22:56:45.879915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'56","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.177393+0000","last_change":"2024-02-15T22:56:09.719365+0000","last_active":"2024-02-15T22:57:43.177393+0000","last_peered":"2024-02-15T22:57:43.177393+0000","last_clean":"2024-02-15T22:57:43.177393+0000","last_became_active":"2024-02-15T22:56:09.717264+0000","last_became_peered":"2024-02-15T22:56:09.717264+0000","last_unstale":"2024-02-15T22:57:43.177393+0000","last_undegraded":"2024-02-15T22:57:43.177393+0000","last_fullsized":"2024-02-15T22:57:43.177393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.388835+0000","last_change":"2024-02-15T22:57:49.388857+0000","last_active":"2024-02-15T22:57:49.388835+0000","last_peered":"2024-02-15T22:57:49.388835+0000","last_clean":"2024-02-15T22:57:49.388835+0000","last_became_active":"2024-02-15T22:56:11.720616+0000","last_became_peered":"2024-02-15T22:56:11.720616+0000","last_unstale":"2024-02-15T22:57:49.388835+0000","last_undegraded":"2024-02-15T22:57:49.388835+0000","last_fullsized":"2024-02-15T22:57:49.388835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.388740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.388740+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.388740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:41.087774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.403837+0000","last_change":"2024-02-15T22:56:13.729263+0000","last_active":"2024-02-15T22:57:35.403837+0000","last_peered":"2024-02-15T22:57:35.403837+0000","last_clean":"2024-02-15T22:57:35.403837+0000","last_became_active":"2024-02-15T22:56:13.729015+0000","last_became_peered":"2024-02-15T22:56:13.729015+0000","last_unstale":"2024-02-15T22:57:35.403837+0000","last_undegraded":"2024-02-15T22:57:35.403837+0000","last_fullsized":"2024-02-15T22:57:35.403837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:49.868551+0000","last_change":"2024-02-15T22:56:45.898518+0000","last_active":"2024-02-15T22:56:49.868551+0000","last_peered":"2024-02-15T22:56:49.868551+0000","last_clean":"2024-02-15T22:56:49.868551+0000","last_became_active":"2024-02-15T22:56:45.893017+0000","last_became_peered":"2024-02-15T22:56:45.893017+0000","last_unstale":"2024-02-15T22:56:49.868551+0000","last_undegraded":"2024-02-15T22:56:49.868551+0000","last_fullsized":"2024-02-15T22:56:49.868551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887559+0000","last_change":"2024-02-15T22:56:45.886880+0000","last_active":"2024-02-15T22:56:45.887559+0000","last_peered":"2024-02-15T22:56:45.887559+0000","last_clean":"2024-02-15T22:56:45.887559+0000","last_became_active":"2024-02-15T22:56:45.886530+0000","last_became_peered":"2024-02-15T22:56:45.886530+0000","last_unstale":"2024-02-15T22:56:45.887559+0000","last_undegraded":"2024-02-15T22:56:45.887559+0000","last_fullsized":"2024-02-15T22:56:45.887559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.012837+0000","last_change":"2024-02-15T22:58:03.012863+0000","last_active":"2024-02-15T22:58:03.012837+0000","last_peered":"2024-02-15T22:58:03.012837+0000","last_clean":"2024-02-15T22:58:03.012837+0000","last_became_active":"2024-02-15T22:56:07.707207+0000","last_became_peered":"2024-02-15T22:56:07.707207+0000","last_unstale":"2024-02-15T22:58:03.012837+0000","last_undegraded":"2024-02-15T22:58:03.012837+0000","last_fullsized":"2024-02-15T22:58:03.012837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:03.012756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:03.012756+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.012756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:24.662100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.911811+0000","last_change":"2024-02-15T22:57:51.911848+0000","last_active":"2024-02-15T22:57:51.911811+0000","last_peered":"2024-02-15T22:57:51.911811+0000","last_clean":"2024-02-15T22:57:51.911811+0000","last_became_active":"2024-02-15T22:56:09.714592+0000","last_became_peered":"2024-02-15T22:56:09.714592+0000","last_unstale":"2024-02-15T22:57:51.911811+0000","last_undegraded":"2024-02-15T22:57:51.911811+0000","last_fullsized":"2024-02-15T22:57:51.911811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-15T22:57:51.911723+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-15T22:57:51.911723+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.911723+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:55.109902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883637+0000","last_change":"2024-02-15T22:56:11.723908+0000","last_active":"2024-02-15T22:56:45.883637+0000","last_peered":"2024-02-15T22:56:45.883637+0000","last_clean":"2024-02-15T22:56:45.883637+0000","last_became_active":"2024-02-15T22:56:11.723557+0000","last_became_peered":"2024-02-15T22:56:11.723557+0000","last_unstale":"2024-02-15T22:56:45.883637+0000","last_undegraded":"2024-02-15T22:56:45.883637+0000","last_fullsized":"2024-02-15T22:56:45.883637+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879519+0000","last_change":"2024-02-15T22:56:13.727205+0000","last_active":"2024-02-15T22:56:45.879519+0000","last_peered":"2024-02-15T22:56:45.879519+0000","last_clean":"2024-02-15T22:56:45.879519+0000","last_became_active":"2024-02-15T22:56:13.726586+0000","last_became_peered":"2024-02-15T22:56:13.726586+0000","last_unstale":"2024-02-15T22:56:45.879519+0000","last_undegraded":"2024-02-15T22:56:45.879519+0000","last_fullsized":"2024-02-15T22:56:45.879519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.049577+0000","last_change":"2024-02-15T22:57:59.049602+0000","last_active":"2024-02-15T22:57:59.049577+0000","last_peered":"2024-02-15T22:57:59.049577+0000","last_clean":"2024-02-15T22:57:59.049577+0000","last_became_active":"2024-02-15T22:56:05.716590+0000","last_became_peered":"2024-02-15T22:56:05.716590+0000","last_unstale":"2024-02-15T22:57:59.049577+0000","last_undegraded":"2024-02-15T22:57:59.049577+0000","last_fullsized":"2024-02-15T22:57:59.049577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-15T22:57:59.049477+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-15T22:57:59.049477+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.049477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:05.045262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884793+0000","last_change":"2024-02-15T22:56:03.703244+0000","last_active":"2024-02-15T22:56:45.884793+0000","last_peered":"2024-02-15T22:56:45.884793+0000","last_clean":"2024-02-15T22:56:45.884793+0000","last_became_active":"2024-02-15T22:56:03.702875+0000","last_became_peered":"2024-02-15T22:56:03.702875+0000","last_unstale":"2024-02-15T22:56:45.884793+0000","last_undegraded":"2024-02-15T22:56:45.884793+0000","last_fullsized":"2024-02-15T22:56:45.884793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881713+0000","last_change":"2024-02-15T22:56:07.704747+0000","last_active":"2024-02-15T22:56:45.881713+0000","last_peered":"2024-02-15T22:56:45.881713+0000","last_clean":"2024-02-15T22:56:45.881713+0000","last_became_active":"2024-02-15T22:56:07.704058+0000","last_became_peered":"2024-02-15T22:56:07.704058+0000","last_unstale":"2024-02-15T22:56:45.881713+0000","last_undegraded":"2024-02-15T22:56:45.881713+0000","last_fullsized":"2024-02-15T22:56:45.881713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'44","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.970226+0000","last_change":"2024-02-15T22:57:57.970287+0000","last_active":"2024-02-15T22:57:57.970226+0000","last_peered":"2024-02-15T22:57:57.970226+0000","last_clean":"2024-02-15T22:57:57.970226+0000","last_became_active":"2024-02-15T22:56:09.712113+0000","last_became_peered":"2024-02-15T22:56:09.712113+0000","last_unstale":"2024-02-15T22:57:57.970226+0000","last_undegraded":"2024-02-15T22:57:57.970226+0000","last_fullsized":"2024-02-15T22:57:57.970226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:57:57.970127+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:57:57.970127+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.970127+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:59.472492+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":343,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.871395+0000","last_change":"2024-02-15T22:57:47.871443+0000","last_active":"2024-02-15T22:57:47.871395+0000","last_peered":"2024-02-15T22:57:47.871395+0000","last_clean":"2024-02-15T22:57:47.871395+0000","last_became_active":"2024-02-15T22:56:11.720390+0000","last_became_peered":"2024-02-15T22:56:11.720390+0000","last_unstale":"2024-02-15T22:57:47.871395+0000","last_undegraded":"2024-02-15T22:57:47.871395+0000","last_fullsized":"2024-02-15T22:57:47.871395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:47.871285+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:47.871285+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.871285+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:51.713747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.898559+0000","last_change":"2024-02-15T22:56:13.734537+0000","last_active":"2024-02-15T22:57:29.898559+0000","last_peered":"2024-02-15T22:57:29.898559+0000","last_clean":"2024-02-15T22:57:29.898559+0000","last_became_active":"2024-02-15T22:56:13.734227+0000","last_became_peered":"2024-02-15T22:56:13.734227+0000","last_unstale":"2024-02-15T22:57:29.898559+0000","last_undegraded":"2024-02-15T22:57:29.898559+0000","last_fullsized":"2024-02-15T22:57:29.898559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887882+0000","last_change":"2024-02-15T22:56:05.706339+0000","last_active":"2024-02-15T22:56:45.887882+0000","last_peered":"2024-02-15T22:56:45.887882+0000","last_clean":"2024-02-15T22:56:45.887882+0000","last_became_active":"2024-02-15T22:56:05.705551+0000","last_became_peered":"2024-02-15T22:56:05.705551+0000","last_unstale":"2024-02-15T22:56:45.887882+0000","last_undegraded":"2024-02-15T22:56:45.887882+0000","last_fullsized":"2024-02-15T22:56:45.887882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.422793+0000","last_change":"2024-02-15T22:56:03.704800+0000","last_active":"2024-02-15T22:56:47.422793+0000","last_peered":"2024-02-15T22:56:47.422793+0000","last_clean":"2024-02-15T22:56:47.422793+0000","last_became_active":"2024-02-15T22:56:03.704526+0000","last_became_peered":"2024-02-15T22:56:03.704526+0000","last_unstale":"2024-02-15T22:56:47.422793+0000","last_undegraded":"2024-02-15T22:56:47.422793+0000","last_fullsized":"2024-02-15T22:56:47.422793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'9","reported_seq":546,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.866068+0000","last_change":"2024-02-15T22:58:01.866099+0000","last_active":"2024-02-15T22:58:01.866068+0000","last_peered":"2024-02-15T22:58:01.866068+0000","last_clean":"2024-02-15T22:58:01.866068+0000","last_became_active":"2024-02-15T22:56:07.704281+0000","last_became_peered":"2024-02-15T22:56:07.704281+0000","last_unstale":"2024-02-15T22:58:01.866068+0000","last_undegraded":"2024-02-15T22:58:01.866068+0000","last_fullsized":"2024-02-15T22:58:01.866068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-15T22:58:01.865973+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-15T22:58:01.865973+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.865973+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:28.422958+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":595,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882901+0000","last_change":"2024-02-15T22:56:09.719243+0000","last_active":"2024-02-15T22:56:45.882901+0000","last_peered":"2024-02-15T22:56:45.882901+0000","last_clean":"2024-02-15T22:56:45.882901+0000","last_became_active":"2024-02-15T22:56:09.717735+0000","last_became_peered":"2024-02-15T22:56:09.717735+0000","last_unstale":"2024-02-15T22:56:45.882901+0000","last_undegraded":"2024-02-15T22:56:45.882901+0000","last_fullsized":"2024-02-15T22:56:45.882901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":386,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.877212+0000","last_change":"2024-02-15T22:57:46.877265+0000","last_active":"2024-02-15T22:57:46.877212+0000","last_peered":"2024-02-15T22:57:46.877212+0000","last_clean":"2024-02-15T22:57:46.877212+0000","last_became_active":"2024-02-15T22:56:11.717380+0000","last_became_peered":"2024-02-15T22:56:11.717380+0000","last_unstale":"2024-02-15T22:57:46.877212+0000","last_undegraded":"2024-02-15T22:57:46.877212+0000","last_fullsized":"2024-02-15T22:57:46.877212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:46.877108+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:46.877108+0000","last_clean_scrub_stamp":"2024-02-15T22:57:46.877108+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:13:26.299004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.974693+0000","last_change":"2024-02-15T22:58:03.974720+0000","last_active":"2024-02-15T22:58:03.974693+0000","last_peered":"2024-02-15T22:58:03.974693+0000","last_clean":"2024-02-15T22:58:03.974693+0000","last_became_active":"2024-02-15T22:56:13.729467+0000","last_became_peered":"2024-02-15T22:56:13.729467+0000","last_unstale":"2024-02-15T22:58:03.974693+0000","last_undegraded":"2024-02-15T22:58:03.974693+0000","last_fullsized":"2024-02-15T22:58:03.974693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:03.974606+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:03.974606+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.974606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:15.983952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"30'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:49.868665+0000","last_change":"2024-02-15T22:56:45.901463+0000","last_active":"2024-02-15T22:56:49.868665+0000","last_peered":"2024-02-15T22:56:49.868665+0000","last_clean":"2024-02-15T22:56:49.868665+0000","last_became_active":"2024-02-15T22:56:45.892949+0000","last_became_peered":"2024-02-15T22:56:45.892949+0000","last_unstale":"2024-02-15T22:56:49.868665+0000","last_undegraded":"2024-02-15T22:56:49.868665+0000","last_fullsized":"2024-02-15T22:56:49.868665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.374646+0000","last_change":"2024-02-15T22:56:03.702334+0000","last_active":"2024-02-15T22:56:46.374646+0000","last_peered":"2024-02-15T22:56:46.374646+0000","last_clean":"2024-02-15T22:56:46.374646+0000","last_became_active":"2024-02-15T22:56:03.702035+0000","last_became_peered":"2024-02-15T22:56:03.702035+0000","last_unstale":"2024-02-15T22:56:46.374646+0000","last_undegraded":"2024-02-15T22:56:46.374646+0000","last_fullsized":"2024-02-15T22:56:46.374646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.003911+0000","last_change":"2024-02-15T22:57:52.003934+0000","last_active":"2024-02-15T22:57:52.003911+0000","last_peered":"2024-02-15T22:57:52.003911+0000","last_clean":"2024-02-15T22:57:52.003911+0000","last_became_active":"2024-02-15T22:56:07.706615+0000","last_became_peered":"2024-02-15T22:56:07.706615+0000","last_unstale":"2024-02-15T22:57:52.003911+0000","last_undegraded":"2024-02-15T22:57:52.003911+0000","last_fullsized":"2024-02-15T22:57:52.003911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.003831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.003831+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.003831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:06.405461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.860596+0000","last_change":"2024-02-15T22:57:53.860641+0000","last_active":"2024-02-15T22:57:53.860596+0000","last_peered":"2024-02-15T22:57:53.860596+0000","last_clean":"2024-02-15T22:57:53.860596+0000","last_became_active":"2024-02-15T22:56:09.713660+0000","last_became_peered":"2024-02-15T22:56:09.713660+0000","last_unstale":"2024-02-15T22:57:53.860596+0000","last_undegraded":"2024-02-15T22:57:53.860596+0000","last_fullsized":"2024-02-15T22:57:53.860596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-02-15T22:57:53.860514+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-02-15T22:57:53.860514+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.860514+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:09.504364+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.953570+0000","last_change":"2024-02-15T22:57:51.953591+0000","last_active":"2024-02-15T22:57:51.953570+0000","last_peered":"2024-02-15T22:57:51.953570+0000","last_clean":"2024-02-15T22:57:51.953570+0000","last_became_active":"2024-02-15T22:56:11.724575+0000","last_became_peered":"2024-02-15T22:56:11.724575+0000","last_unstale":"2024-02-15T22:57:51.953570+0000","last_undegraded":"2024-02-15T22:57:51.953570+0000","last_fullsized":"2024-02-15T22:57:51.953570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:51.953487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:51.953487+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.953487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:47.214571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.822623+0000","last_change":"2024-02-15T22:58:04.822668+0000","last_active":"2024-02-15T22:58:04.822623+0000","last_peered":"2024-02-15T22:58:04.822623+0000","last_clean":"2024-02-15T22:58:04.822623+0000","last_became_active":"2024-02-15T22:56:13.722550+0000","last_became_peered":"2024-02-15T22:56:13.722550+0000","last_unstale":"2024-02-15T22:58:04.822623+0000","last_undegraded":"2024-02-15T22:58:04.822623+0000","last_fullsized":"2024-02-15T22:58:04.822623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:04.822525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:04.822525+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.822525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:19.922383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.150441+0000","last_change":"2024-02-15T22:58:02.150482+0000","last_active":"2024-02-15T22:58:02.150441+0000","last_peered":"2024-02-15T22:58:02.150441+0000","last_clean":"2024-02-15T22:58:02.150441+0000","last_became_active":"2024-02-15T22:56:05.715513+0000","last_became_peered":"2024-02-15T22:56:05.715513+0000","last_unstale":"2024-02-15T22:58:02.150441+0000","last_undegraded":"2024-02-15T22:58:02.150441+0000","last_fullsized":"2024-02-15T22:58:02.150441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-15T22:58:02.150334+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-15T22:58:02.150334+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.150334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:52:56.881211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":200,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491275+0000","last_change":"2024-02-15T22:55:52.658778+0000","last_active":"2024-02-15T22:57:46.491275+0000","last_peered":"2024-02-15T22:57:46.491275+0000","last_clean":"2024-02-15T22:57:46.491275+0000","last_became_active":"2024-02-15T22:55:52.657750+0000","last_became_peered":"2024-02-15T22:55:52.657750+0000","last_unstale":"2024-02-15T22:57:46.491275+0000","last_undegraded":"2024-02-15T22:57:46.491275+0000","last_fullsized":"2024-02-15T22:57:46.491275+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_clean_scrub_stamp":"2024-02-15T22:55:51.648340+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371230+0000","last_change":"2024-02-15T22:55:57.672733+0000","last_active":"2024-02-15T22:57:47.371230+0000","last_peered":"2024-02-15T22:57:47.371230+0000","last_clean":"2024-02-15T22:57:47.371230+0000","last_became_active":"2024-02-15T22:55:57.672281+0000","last_became_peered":"2024-02-15T22:55:57.672281+0000","last_unstale":"2024-02-15T22:57:47.371230+0000","last_undegraded":"2024-02-15T22:57:47.371230+0000","last_fullsized":"2024-02-15T22:57:47.371230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881061+0000","last_change":"2024-02-15T22:56:03.707343+0000","last_active":"2024-02-15T22:56:45.881061+0000","last_peered":"2024-02-15T22:56:45.881061+0000","last_clean":"2024-02-15T22:56:45.881061+0000","last_became_active":"2024-02-15T22:56:03.706721+0000","last_became_peered":"2024-02-15T22:56:03.706721+0000","last_unstale":"2024-02-15T22:56:45.881061+0000","last_undegraded":"2024-02-15T22:56:45.881061+0000","last_fullsized":"2024-02-15T22:56:45.881061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.889691+0000","last_change":"2024-02-15T22:56:45.887614+0000","last_active":"2024-02-15T22:56:45.889691+0000","last_peered":"2024-02-15T22:56:45.889691+0000","last_clean":"2024-02-15T22:56:45.889691+0000","last_became_active":"2024-02-15T22:56:45.887260+0000","last_became_peered":"2024-02-15T22:56:45.887260+0000","last_unstale":"2024-02-15T22:56:45.889691+0000","last_undegraded":"2024-02-15T22:56:45.889691+0000","last_fullsized":"2024-02-15T22:56:45.889691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'81","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.126917+0000","last_change":"2024-02-15T22:58:01.126986+0000","last_active":"2024-02-15T22:58:01.126917+0000","last_peered":"2024-02-15T22:58:01.126917+0000","last_clean":"2024-02-15T22:58:01.126917+0000","last_became_active":"2024-02-15T22:56:09.716109+0000","last_became_peered":"2024-02-15T22:56:09.716109+0000","last_unstale":"2024-02-15T22:58:01.126917+0000","last_undegraded":"2024-02-15T22:58:01.126917+0000","last_fullsized":"2024-02-15T22:58:01.126917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-02-15T22:58:01.126822+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-02-15T22:58:01.126822+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.126822+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:24.668741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.351151+0000","last_change":"2024-02-15T22:57:52.351175+0000","last_active":"2024-02-15T22:57:52.351151+0000","last_peered":"2024-02-15T22:57:52.351151+0000","last_clean":"2024-02-15T22:57:52.351151+0000","last_became_active":"2024-02-15T22:56:11.722390+0000","last_became_peered":"2024-02-15T22:56:11.722390+0000","last_unstale":"2024-02-15T22:57:52.351151+0000","last_undegraded":"2024-02-15T22:57:52.351151+0000","last_fullsized":"2024-02-15T22:57:52.351151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.351041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.351041+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.351041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:26.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.407132+0000","last_change":"2024-02-15T22:56:13.732746+0000","last_active":"2024-02-15T22:57:35.407132+0000","last_peered":"2024-02-15T22:57:35.407132+0000","last_clean":"2024-02-15T22:57:35.407132+0000","last_became_active":"2024-02-15T22:56:13.732437+0000","last_became_peered":"2024-02-15T22:56:13.732437+0000","last_unstale":"2024-02-15T22:57:35.407132+0000","last_undegraded":"2024-02-15T22:57:35.407132+0000","last_fullsized":"2024-02-15T22:57:35.407132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883692+0000","last_change":"2024-02-15T22:56:05.700559+0000","last_active":"2024-02-15T22:56:45.883692+0000","last_peered":"2024-02-15T22:56:45.883692+0000","last_clean":"2024-02-15T22:56:45.883692+0000","last_became_active":"2024-02-15T22:56:05.699679+0000","last_became_peered":"2024-02-15T22:56:05.699679+0000","last_unstale":"2024-02-15T22:56:45.883692+0000","last_undegraded":"2024-02-15T22:56:45.883692+0000","last_fullsized":"2024-02-15T22:56:45.883692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371221+0000","last_change":"2024-02-15T22:55:57.673021+0000","last_active":"2024-02-15T22:57:47.371221+0000","last_peered":"2024-02-15T22:57:47.371221+0000","last_clean":"2024-02-15T22:57:47.371221+0000","last_became_active":"2024-02-15T22:55:57.672705+0000","last_became_peered":"2024-02-15T22:55:57.672705+0000","last_unstale":"2024-02-15T22:57:47.371221+0000","last_undegraded":"2024-02-15T22:57:47.371221+0000","last_fullsized":"2024-02-15T22:57:47.371221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879632+0000","last_change":"2024-02-15T22:56:03.700496+0000","last_active":"2024-02-15T22:56:45.879632+0000","last_peered":"2024-02-15T22:56:45.879632+0000","last_clean":"2024-02-15T22:56:45.879632+0000","last_became_active":"2024-02-15T22:56:03.699864+0000","last_became_peered":"2024-02-15T22:56:03.699864+0000","last_unstale":"2024-02-15T22:56:45.879632+0000","last_undegraded":"2024-02-15T22:56:45.879632+0000","last_fullsized":"2024-02-15T22:56:45.879632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.977622+0000","last_change":"2024-02-15T22:57:50.977656+0000","last_active":"2024-02-15T22:57:50.977622+0000","last_peered":"2024-02-15T22:57:50.977622+0000","last_clean":"2024-02-15T22:57:50.977622+0000","last_became_active":"2024-02-15T22:56:07.707620+0000","last_became_peered":"2024-02-15T22:56:07.707620+0000","last_unstale":"2024-02-15T22:57:50.977622+0000","last_undegraded":"2024-02-15T22:57:50.977622+0000","last_fullsized":"2024-02-15T22:57:50.977622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.977533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.977533+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.977533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:06:57.198666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":446,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.870229+0000","last_change":"2024-02-15T22:57:50.870292+0000","last_active":"2024-02-15T22:57:50.870229+0000","last_peered":"2024-02-15T22:57:50.870229+0000","last_clean":"2024-02-15T22:57:50.870229+0000","last_became_active":"2024-02-15T22:56:09.718396+0000","last_became_peered":"2024-02-15T22:56:09.718396+0000","last_unstale":"2024-02-15T22:57:50.870229+0000","last_undegraded":"2024-02-15T22:57:50.870229+0000","last_fullsized":"2024-02-15T22:57:50.870229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-02-15T22:57:50.870120+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-02-15T22:57:50.870120+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.870120+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:52.372485+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880761+0000","last_change":"2024-02-15T22:56:11.725286+0000","last_active":"2024-02-15T22:56:45.880761+0000","last_peered":"2024-02-15T22:56:45.880761+0000","last_clean":"2024-02-15T22:56:45.880761+0000","last_became_active":"2024-02-15T22:56:11.725005+0000","last_became_peered":"2024-02-15T22:56:11.725005+0000","last_unstale":"2024-02-15T22:56:45.880761+0000","last_undegraded":"2024-02-15T22:56:45.880761+0000","last_fullsized":"2024-02-15T22:56:45.880761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.677801+0000","last_change":"2024-02-15T22:56:13.734036+0000","last_active":"2024-02-15T22:57:29.677801+0000","last_peered":"2024-02-15T22:57:29.677801+0000","last_clean":"2024-02-15T22:57:29.677801+0000","last_became_active":"2024-02-15T22:56:13.733760+0000","last_became_peered":"2024-02-15T22:56:13.733760+0000","last_unstale":"2024-02-15T22:57:29.677801+0000","last_undegraded":"2024-02-15T22:57:29.677801+0000","last_fullsized":"2024-02-15T22:57:29.677801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881868+0000","last_change":"2024-02-15T22:56:05.706098+0000","last_active":"2024-02-15T22:56:45.881868+0000","last_peered":"2024-02-15T22:56:45.881868+0000","last_clean":"2024-02-15T22:56:45.881868+0000","last_became_active":"2024-02-15T22:56:05.704953+0000","last_became_peered":"2024-02-15T22:56:05.704953+0000","last_unstale":"2024-02-15T22:56:45.881868+0000","last_undegraded":"2024-02-15T22:56:45.881868+0000","last_fullsized":"2024-02-15T22:56:45.881868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.930540+0000","last_change":"2024-02-15T22:55:57.671425+0000","last_active":"2024-02-15T22:57:46.930540+0000","last_peered":"2024-02-15T22:57:46.930540+0000","last_clean":"2024-02-15T22:57:46.930540+0000","last_became_active":"2024-02-15T22:55:57.671130+0000","last_became_peered":"2024-02-15T22:55:57.671130+0000","last_unstale":"2024-02-15T22:57:46.930540+0000","last_undegraded":"2024-02-15T22:57:46.930540+0000","last_fullsized":"2024-02-15T22:57:46.930540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053283+0000","last_change":"2024-02-15T22:56:03.700250+0000","last_active":"2024-02-15T22:57:46.053283+0000","last_peered":"2024-02-15T22:57:46.053283+0000","last_clean":"2024-02-15T22:57:46.053283+0000","last_became_active":"2024-02-15T22:56:03.699598+0000","last_became_peered":"2024-02-15T22:56:03.699598+0000","last_unstale":"2024-02-15T22:57:46.053283+0000","last_undegraded":"2024-02-15T22:57:46.053283+0000","last_fullsized":"2024-02-15T22:57:46.053283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887263+0000","last_change":"2024-02-15T22:56:07.704552+0000","last_active":"2024-02-15T22:56:45.887263+0000","last_peered":"2024-02-15T22:56:45.887263+0000","last_clean":"2024-02-15T22:56:45.887263+0000","last_became_active":"2024-02-15T22:56:07.704107+0000","last_became_peered":"2024-02-15T22:56:07.704107+0000","last_unstale":"2024-02-15T22:56:45.887263+0000","last_undegraded":"2024-02-15T22:56:45.887263+0000","last_fullsized":"2024-02-15T22:56:45.887263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.971944+0000","last_change":"2024-02-15T22:57:58.972000+0000","last_active":"2024-02-15T22:57:58.971944+0000","last_peered":"2024-02-15T22:57:58.971944+0000","last_clean":"2024-02-15T22:57:58.971944+0000","last_became_active":"2024-02-15T22:56:09.711494+0000","last_became_peered":"2024-02-15T22:56:09.711494+0000","last_unstale":"2024-02-15T22:57:58.971944+0000","last_undegraded":"2024-02-15T22:57:58.971944+0000","last_fullsized":"2024-02-15T22:57:58.971944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-02-15T22:57:58.971860+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-02-15T22:57:58.971860+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.971860+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:36:02.170038+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.345754+0000","last_change":"2024-02-15T22:57:47.345803+0000","last_active":"2024-02-15T22:57:47.345754+0000","last_peered":"2024-02-15T22:57:47.345754+0000","last_clean":"2024-02-15T22:57:47.345754+0000","last_became_active":"2024-02-15T22:56:11.722277+0000","last_became_peered":"2024-02-15T22:56:11.722277+0000","last_unstale":"2024-02-15T22:57:47.345754+0000","last_undegraded":"2024-02-15T22:57:47.345754+0000","last_fullsized":"2024-02-15T22:57:47.345754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.345669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.345669+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.345669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:53:30.201838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880111+0000","last_change":"2024-02-15T22:56:13.726439+0000","last_active":"2024-02-15T22:56:45.880111+0000","last_peered":"2024-02-15T22:56:45.880111+0000","last_clean":"2024-02-15T22:56:45.880111+0000","last_became_active":"2024-02-15T22:56:13.726165+0000","last_became_peered":"2024-02-15T22:56:13.726165+0000","last_unstale":"2024-02-15T22:56:45.880111+0000","last_undegraded":"2024-02-15T22:56:45.880111+0000","last_fullsized":"2024-02-15T22:56:45.880111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'7","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505843+0000","last_change":"2024-02-15T22:56:05.707494+0000","last_active":"2024-02-15T22:57:29.505843+0000","last_peered":"2024-02-15T22:57:29.505843+0000","last_clean":"2024-02-15T22:57:29.505843+0000","last_became_active":"2024-02-15T22:56:05.707171+0000","last_became_peered":"2024-02-15T22:56:05.707171+0000","last_unstale":"2024-02-15T22:57:29.505843+0000","last_undegraded":"2024-02-15T22:57:29.505843+0000","last_fullsized":"2024-02-15T22:57:29.505843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371190+0000","last_change":"2024-02-15T22:55:57.672717+0000","last_active":"2024-02-15T22:57:47.371190+0000","last_peered":"2024-02-15T22:57:47.371190+0000","last_clean":"2024-02-15T22:57:47.371190+0000","last_became_active":"2024-02-15T22:55:57.672268+0000","last_became_peered":"2024-02-15T22:55:57.672268+0000","last_unstale":"2024-02-15T22:57:47.371190+0000","last_undegraded":"2024-02-15T22:57:47.371190+0000","last_fullsized":"2024-02-15T22:57:47.371190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882583+0000","last_change":"2024-02-15T22:56:03.697249+0000","last_active":"2024-02-15T22:56:45.882583+0000","last_peered":"2024-02-15T22:56:45.882583+0000","last_clean":"2024-02-15T22:56:45.882583+0000","last_became_active":"2024-02-15T22:56:03.693487+0000","last_became_peered":"2024-02-15T22:56:03.693487+0000","last_unstale":"2024-02-15T22:56:45.882583+0000","last_undegraded":"2024-02-15T22:56:45.882583+0000","last_fullsized":"2024-02-15T22:56:45.882583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880862+0000","last_change":"2024-02-15T22:56:07.707628+0000","last_active":"2024-02-15T22:56:45.880862+0000","last_peered":"2024-02-15T22:56:45.880862+0000","last_clean":"2024-02-15T22:56:45.880862+0000","last_became_active":"2024-02-15T22:56:07.707227+0000","last_became_peered":"2024-02-15T22:56:07.707227+0000","last_unstale":"2024-02-15T22:56:45.880862+0000","last_undegraded":"2024-02-15T22:56:45.880862+0000","last_fullsized":"2024-02-15T22:56:45.880862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:36.650553+0000","last_change":"2024-02-15T22:56:09.720954+0000","last_active":"2024-02-15T22:57:36.650553+0000","last_peered":"2024-02-15T22:57:36.650553+0000","last_clean":"2024-02-15T22:57:36.650553+0000","last_became_active":"2024-02-15T22:56:09.719999+0000","last_became_peered":"2024-02-15T22:56:09.719999+0000","last_unstale":"2024-02-15T22:57:36.650553+0000","last_undegraded":"2024-02-15T22:57:36.650553+0000","last_fullsized":"2024-02-15T22:57:36.650553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883809+0000","last_change":"2024-02-15T22:56:11.724029+0000","last_active":"2024-02-15T22:56:45.883809+0000","last_peered":"2024-02-15T22:56:45.883809+0000","last_clean":"2024-02-15T22:56:45.883809+0000","last_became_active":"2024-02-15T22:56:11.723718+0000","last_became_peered":"2024-02-15T22:56:11.723718+0000","last_unstale":"2024-02-15T22:56:45.883809+0000","last_undegraded":"2024-02-15T22:56:45.883809+0000","last_fullsized":"2024-02-15T22:56:45.883809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878110+0000","last_change":"2024-02-15T22:56:13.731187+0000","last_active":"2024-02-15T22:56:45.878110+0000","last_peered":"2024-02-15T22:56:45.878110+0000","last_clean":"2024-02-15T22:56:45.878110+0000","last_became_active":"2024-02-15T22:56:13.730551+0000","last_became_peered":"2024-02-15T22:56:13.730551+0000","last_unstale":"2024-02-15T22:56:45.878110+0000","last_undegraded":"2024-02-15T22:56:45.878110+0000","last_fullsized":"2024-02-15T22:56:45.878110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.913487+0000","last_change":"2024-02-15T22:56:05.714866+0000","last_active":"2024-02-15T22:56:47.913487+0000","last_peered":"2024-02-15T22:56:47.913487+0000","last_clean":"2024-02-15T22:56:47.913487+0000","last_became_active":"2024-02-15T22:56:05.714389+0000","last_became_peered":"2024-02-15T22:56:05.714389+0000","last_unstale":"2024-02-15T22:56:47.913487+0000","last_undegraded":"2024-02-15T22:56:47.913487+0000","last_fullsized":"2024-02-15T22:56:47.913487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886271+0000","last_change":"2024-02-15T22:56:03.693895+0000","last_active":"2024-02-15T22:56:45.886271+0000","last_peered":"2024-02-15T22:56:45.886271+0000","last_clean":"2024-02-15T22:56:45.886271+0000","last_became_active":"2024-02-15T22:56:03.693005+0000","last_became_peered":"2024-02-15T22:56:03.693005+0000","last_unstale":"2024-02-15T22:56:45.886271+0000","last_undegraded":"2024-02-15T22:56:45.886271+0000","last_fullsized":"2024-02-15T22:56:45.886271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053260+0000","last_change":"2024-02-15T22:55:57.671879+0000","last_active":"2024-02-15T22:57:46.053260+0000","last_peered":"2024-02-15T22:57:46.053260+0000","last_clean":"2024-02-15T22:57:46.053260+0000","last_became_active":"2024-02-15T22:55:57.671524+0000","last_became_peered":"2024-02-15T22:55:57.671524+0000","last_unstale":"2024-02-15T22:57:46.053260+0000","last_undegraded":"2024-02-15T22:57:46.053260+0000","last_fullsized":"2024-02-15T22:57:46.053260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.254673+0000","last_change":"2024-02-15T22:58:03.254714+0000","last_active":"2024-02-15T22:58:03.254673+0000","last_peered":"2024-02-15T22:58:03.254673+0000","last_clean":"2024-02-15T22:58:03.254673+0000","last_became_active":"2024-02-15T22:56:07.707281+0000","last_became_peered":"2024-02-15T22:56:07.707281+0000","last_unstale":"2024-02-15T22:58:03.254673+0000","last_undegraded":"2024-02-15T22:58:03.254673+0000","last_fullsized":"2024-02-15T22:58:03.254673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:03.254575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:03.254575+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.254575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:31.078756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":143,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.385562+0000","last_change":"2024-02-15T22:57:55.385601+0000","last_active":"2024-02-15T22:57:55.385562+0000","last_peered":"2024-02-15T22:57:55.385562+0000","last_clean":"2024-02-15T22:57:55.385562+0000","last_became_active":"2024-02-15T22:56:09.717692+0000","last_became_peered":"2024-02-15T22:56:09.717692+0000","last_unstale":"2024-02-15T22:57:55.385562+0000","last_undegraded":"2024-02-15T22:57:55.385562+0000","last_fullsized":"2024-02-15T22:57:55.385562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-02-15T22:57:55.385469+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-02-15T22:57:55.385469+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.385469+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:24.974853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.917386+0000","last_change":"2024-02-15T22:57:49.917439+0000","last_active":"2024-02-15T22:57:49.917386+0000","last_peered":"2024-02-15T22:57:49.917386+0000","last_clean":"2024-02-15T22:57:49.917386+0000","last_became_active":"2024-02-15T22:56:11.718332+0000","last_became_peered":"2024-02-15T22:56:11.718332+0000","last_unstale":"2024-02-15T22:57:49.917386+0000","last_undegraded":"2024-02-15T22:57:49.917386+0000","last_fullsized":"2024-02-15T22:57:49.917386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.917248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.917248+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.917248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:48.180880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.900193+0000","last_change":"2024-02-15T22:56:13.723843+0000","last_active":"2024-02-15T22:57:29.900193+0000","last_peered":"2024-02-15T22:57:29.900193+0000","last_clean":"2024-02-15T22:57:29.900193+0000","last_became_active":"2024-02-15T22:56:13.723512+0000","last_became_peered":"2024-02-15T22:56:13.723512+0000","last_unstale":"2024-02-15T22:57:29.900193+0000","last_undegraded":"2024-02-15T22:57:29.900193+0000","last_fullsized":"2024-02-15T22:57:29.900193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.913781+0000","last_change":"2024-02-15T22:56:05.713346+0000","last_active":"2024-02-15T22:56:47.913781+0000","last_peered":"2024-02-15T22:56:47.913781+0000","last_clean":"2024-02-15T22:56:47.913781+0000","last_became_active":"2024-02-15T22:56:05.713036+0000","last_became_peered":"2024-02-15T22:56:05.713036+0000","last_unstale":"2024-02-15T22:56:47.913781+0000","last_undegraded":"2024-02-15T22:56:47.913781+0000","last_fullsized":"2024-02-15T22:56:47.913781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880645+0000","last_change":"2024-02-15T22:56:03.699990+0000","last_active":"2024-02-15T22:56:45.880645+0000","last_peered":"2024-02-15T22:56:45.880645+0000","last_clean":"2024-02-15T22:56:45.880645+0000","last_became_active":"2024-02-15T22:56:03.699564+0000","last_became_peered":"2024-02-15T22:56:03.699564+0000","last_unstale":"2024-02-15T22:56:45.880645+0000","last_undegraded":"2024-02-15T22:56:45.880645+0000","last_fullsized":"2024-02-15T22:56:45.880645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371220+0000","last_change":"2024-02-15T22:55:57.672438+0000","last_active":"2024-02-15T22:57:47.371220+0000","last_peered":"2024-02-15T22:57:47.371220+0000","last_clean":"2024-02-15T22:57:47.371220+0000","last_became_active":"2024-02-15T22:55:57.672053+0000","last_became_peered":"2024-02-15T22:55:57.672053+0000","last_unstale":"2024-02-15T22:57:47.371220+0000","last_undegraded":"2024-02-15T22:57:47.371220+0000","last_fullsized":"2024-02-15T22:57:47.371220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.895618+0000","last_change":"2024-02-15T22:56:45.893645+0000","last_active":"2024-02-15T22:56:45.895618+0000","last_peered":"2024-02-15T22:56:45.895618+0000","last_clean":"2024-02-15T22:56:45.895618+0000","last_became_active":"2024-02-15T22:56:45.893109+0000","last_became_peered":"2024-02-15T22:56:45.893109+0000","last_unstale":"2024-02-15T22:56:45.895618+0000","last_undegraded":"2024-02-15T22:56:45.895618+0000","last_fullsized":"2024-02-15T22:56:45.895618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.859156+0000","last_change":"2024-02-15T22:57:49.859195+0000","last_active":"2024-02-15T22:57:49.859156+0000","last_peered":"2024-02-15T22:57:49.859156+0000","last_clean":"2024-02-15T22:57:49.859156+0000","last_became_active":"2024-02-15T22:56:09.721140+0000","last_became_peered":"2024-02-15T22:56:09.721140+0000","last_unstale":"2024-02-15T22:57:49.859156+0000","last_undegraded":"2024-02-15T22:57:49.859156+0000","last_fullsized":"2024-02-15T22:57:49.859156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-02-15T22:57:49.859068+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-02-15T22:57:49.859068+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.859068+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:24:17.693114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":289,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.831716+0000","last_change":"2024-02-15T22:57:48.831746+0000","last_active":"2024-02-15T22:57:48.831716+0000","last_peered":"2024-02-15T22:57:48.831716+0000","last_clean":"2024-02-15T22:57:48.831716+0000","last_became_active":"2024-02-15T22:56:11.717544+0000","last_became_peered":"2024-02-15T22:56:11.717544+0000","last_unstale":"2024-02-15T22:57:48.831716+0000","last_undegraded":"2024-02-15T22:57:48.831716+0000","last_fullsized":"2024-02-15T22:57:48.831716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:48.831614+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:48.831614+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.831614+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:25.818844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883730+0000","last_change":"2024-02-15T22:56:13.728952+0000","last_active":"2024-02-15T22:56:45.883730+0000","last_peered":"2024-02-15T22:56:45.883730+0000","last_clean":"2024-02-15T22:56:45.883730+0000","last_became_active":"2024-02-15T22:56:13.728228+0000","last_became_peered":"2024-02-15T22:56:13.728228+0000","last_unstale":"2024-02-15T22:56:45.883730+0000","last_undegraded":"2024-02-15T22:56:45.883730+0000","last_fullsized":"2024-02-15T22:56:45.883730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371648+0000","last_change":"2024-02-15T22:56:05.711219+0000","last_active":"2024-02-15T22:57:47.371648+0000","last_peered":"2024-02-15T22:57:47.371648+0000","last_clean":"2024-02-15T22:57:47.371648+0000","last_became_active":"2024-02-15T22:56:05.710924+0000","last_became_peered":"2024-02-15T22:56:05.710924+0000","last_unstale":"2024-02-15T22:57:47.371648+0000","last_undegraded":"2024-02-15T22:57:47.371648+0000","last_fullsized":"2024-02-15T22:57:47.371648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.374803+0000","last_change":"2024-02-15T22:56:03.696202+0000","last_active":"2024-02-15T22:56:46.374803+0000","last_peered":"2024-02-15T22:56:46.374803+0000","last_clean":"2024-02-15T22:56:46.374803+0000","last_became_active":"2024-02-15T22:56:03.695921+0000","last_became_peered":"2024-02-15T22:56:03.695921+0000","last_unstale":"2024-02-15T22:56:46.374803+0000","last_undegraded":"2024-02-15T22:56:46.374803+0000","last_fullsized":"2024-02-15T22:56:46.374803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880843+0000","last_change":"2024-02-15T22:55:57.671686+0000","last_active":"2024-02-15T22:56:45.880843+0000","last_peered":"2024-02-15T22:56:45.880843+0000","last_clean":"2024-02-15T22:56:45.880843+0000","last_became_active":"2024-02-15T22:55:57.671257+0000","last_became_peered":"2024-02-15T22:55:57.671257+0000","last_unstale":"2024-02-15T22:56:45.880843+0000","last_undegraded":"2024-02-15T22:56:45.880843+0000","last_fullsized":"2024-02-15T22:56:45.880843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.993246+0000","last_change":"2024-02-15T22:57:53.993271+0000","last_active":"2024-02-15T22:57:53.993246+0000","last_peered":"2024-02-15T22:57:53.993246+0000","last_clean":"2024-02-15T22:57:53.993246+0000","last_became_active":"2024-02-15T22:56:07.705323+0000","last_became_peered":"2024-02-15T22:56:07.705323+0000","last_unstale":"2024-02-15T22:57:53.993246+0000","last_undegraded":"2024-02-15T22:57:53.993246+0000","last_fullsized":"2024-02-15T22:57:53.993246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:53.993161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:53.993161+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.993161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:37.548413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.886640+0000","last_change":"2024-02-15T22:56:09.729641+0000","last_active":"2024-02-15T22:56:46.886640+0000","last_peered":"2024-02-15T22:56:46.886640+0000","last_clean":"2024-02-15T22:56:46.886640+0000","last_became_active":"2024-02-15T22:56:09.729131+0000","last_became_peered":"2024-02-15T22:56:09.729131+0000","last_unstale":"2024-02-15T22:56:46.886640+0000","last_undegraded":"2024-02-15T22:56:46.886640+0000","last_fullsized":"2024-02-15T22:56:46.886640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":322,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.400029+0000","last_change":"2024-02-15T22:57:51.400056+0000","last_active":"2024-02-15T22:57:51.400029+0000","last_peered":"2024-02-15T22:57:51.400029+0000","last_clean":"2024-02-15T22:57:51.400029+0000","last_became_active":"2024-02-15T22:56:11.719685+0000","last_became_peered":"2024-02-15T22:56:11.719685+0000","last_unstale":"2024-02-15T22:57:51.400029+0000","last_undegraded":"2024-02-15T22:57:51.400029+0000","last_fullsized":"2024-02-15T22:57:51.400029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:51.399947+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:51.399947+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.399947+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:14.785659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879236+0000","last_change":"2024-02-15T22:56:13.730782+0000","last_active":"2024-02-15T22:56:45.879236+0000","last_peered":"2024-02-15T22:56:45.879236+0000","last_clean":"2024-02-15T22:56:45.879236+0000","last_became_active":"2024-02-15T22:56:13.730494+0000","last_became_peered":"2024-02-15T22:56:13.730494+0000","last_unstale":"2024-02-15T22:56:45.879236+0000","last_undegraded":"2024-02-15T22:56:45.879236+0000","last_fullsized":"2024-02-15T22:56:45.879236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505735+0000","last_change":"2024-02-15T22:56:05.706030+0000","last_active":"2024-02-15T22:57:29.505735+0000","last_peered":"2024-02-15T22:57:29.505735+0000","last_clean":"2024-02-15T22:57:29.505735+0000","last_became_active":"2024-02-15T22:56:05.705764+0000","last_became_peered":"2024-02-15T22:56:05.705764+0000","last_unstale":"2024-02-15T22:57:29.505735+0000","last_undegraded":"2024-02-15T22:57:29.505735+0000","last_fullsized":"2024-02-15T22:57:29.505735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880010+0000","last_change":"2024-02-15T22:56:03.706073+0000","last_active":"2024-02-15T22:56:45.880010+0000","last_peered":"2024-02-15T22:56:45.880010+0000","last_clean":"2024-02-15T22:56:45.880010+0000","last_became_active":"2024-02-15T22:56:03.705783+0000","last_became_peered":"2024-02-15T22:56:03.705783+0000","last_unstale":"2024-02-15T22:56:45.880010+0000","last_undegraded":"2024-02-15T22:56:45.880010+0000","last_fullsized":"2024-02-15T22:56:45.880010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883954+0000","last_change":"2024-02-15T22:55:57.854108+0000","last_active":"2024-02-15T22:56:45.883954+0000","last_peered":"2024-02-15T22:56:45.883954+0000","last_clean":"2024-02-15T22:56:45.883954+0000","last_became_active":"2024-02-15T22:55:57.853714+0000","last_became_peered":"2024-02-15T22:55:57.853714+0000","last_unstale":"2024-02-15T22:56:45.883954+0000","last_undegraded":"2024-02-15T22:56:45.883954+0000","last_fullsized":"2024-02-15T22:56:45.883954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.020370+0000","last_change":"2024-02-15T22:57:58.020401+0000","last_active":"2024-02-15T22:57:58.020370+0000","last_peered":"2024-02-15T22:57:58.020370+0000","last_clean":"2024-02-15T22:57:58.020370+0000","last_became_active":"2024-02-15T22:56:07.705013+0000","last_became_peered":"2024-02-15T22:56:07.705013+0000","last_unstale":"2024-02-15T22:57:58.020370+0000","last_undegraded":"2024-02-15T22:57:58.020370+0000","last_fullsized":"2024-02-15T22:57:58.020370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:58.020263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:58.020263+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.020263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:46.435941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":182,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.962216+0000","last_change":"2024-02-15T22:57:53.962295+0000","last_active":"2024-02-15T22:57:53.962216+0000","last_peered":"2024-02-15T22:57:53.962216+0000","last_clean":"2024-02-15T22:57:53.962216+0000","last_became_active":"2024-02-15T22:56:09.719916+0000","last_became_peered":"2024-02-15T22:56:09.719916+0000","last_unstale":"2024-02-15T22:57:53.962216+0000","last_undegraded":"2024-02-15T22:57:53.962216+0000","last_fullsized":"2024-02-15T22:57:53.962216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-02-15T22:57:53.962112+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-02-15T22:57:53.962112+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.962112+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:13:33.384008+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.358234+0000","last_change":"2024-02-15T22:57:54.358256+0000","last_active":"2024-02-15T22:57:54.358234+0000","last_peered":"2024-02-15T22:57:54.358234+0000","last_clean":"2024-02-15T22:57:54.358234+0000","last_became_active":"2024-02-15T22:56:11.717758+0000","last_became_peered":"2024-02-15T22:56:11.717758+0000","last_unstale":"2024-02-15T22:57:54.358234+0000","last_undegraded":"2024-02-15T22:57:54.358234+0000","last_fullsized":"2024-02-15T22:57:54.358234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:54.358148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:54.358148+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.358148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:29.880821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885476+0000","last_change":"2024-02-15T22:56:13.732654+0000","last_active":"2024-02-15T22:56:45.885476+0000","last_peered":"2024-02-15T22:56:45.885476+0000","last_clean":"2024-02-15T22:56:45.885476+0000","last_became_active":"2024-02-15T22:56:13.732325+0000","last_became_peered":"2024-02-15T22:56:13.732325+0000","last_unstale":"2024-02-15T22:56:45.885476+0000","last_undegraded":"2024-02-15T22:56:45.885476+0000","last_fullsized":"2024-02-15T22:56:45.885476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886332+0000","last_change":"2024-02-15T22:56:13.732647+0000","last_active":"2024-02-15T22:56:45.886332+0000","last_peered":"2024-02-15T22:56:45.886332+0000","last_clean":"2024-02-15T22:56:45.886332+0000","last_became_active":"2024-02-15T22:56:13.732216+0000","last_became_peered":"2024-02-15T22:56:13.732216+0000","last_unstale":"2024-02-15T22:56:45.886332+0000","last_undegraded":"2024-02-15T22:56:45.886332+0000","last_fullsized":"2024-02-15T22:56:45.886332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883211+0000","last_change":"2024-02-15T22:56:05.705497+0000","last_active":"2024-02-15T22:56:45.883211+0000","last_peered":"2024-02-15T22:56:45.883211+0000","last_clean":"2024-02-15T22:56:45.883211+0000","last_became_active":"2024-02-15T22:56:05.704959+0000","last_became_peered":"2024-02-15T22:56:05.704959+0000","last_unstale":"2024-02-15T22:56:45.883211+0000","last_undegraded":"2024-02-15T22:56:45.883211+0000","last_fullsized":"2024-02-15T22:56:45.883211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883173+0000","last_change":"2024-02-15T22:56:03.705460+0000","last_active":"2024-02-15T22:56:45.883173+0000","last_peered":"2024-02-15T22:56:45.883173+0000","last_clean":"2024-02-15T22:56:45.883173+0000","last_became_active":"2024-02-15T22:56:03.705176+0000","last_became_peered":"2024-02-15T22:56:03.705176+0000","last_unstale":"2024-02-15T22:56:45.883173+0000","last_undegraded":"2024-02-15T22:56:45.883173+0000","last_fullsized":"2024-02-15T22:56:45.883173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.818364+0000","last_change":"2024-02-15T22:58:02.818396+0000","last_active":"2024-02-15T22:58:02.818364+0000","last_peered":"2024-02-15T22:58:02.818364+0000","last_clean":"2024-02-15T22:58:02.818364+0000","last_became_active":"2024-02-15T22:56:07.703060+0000","last_became_peered":"2024-02-15T22:56:07.703060+0000","last_unstale":"2024-02-15T22:58:02.818364+0000","last_undegraded":"2024-02-15T22:58:02.818364+0000","last_fullsized":"2024-02-15T22:58:02.818364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:02.818259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:02.818259+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.818259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:34.242902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.133211+0000","last_change":"2024-02-15T22:56:09.720950+0000","last_active":"2024-02-15T22:57:43.133211+0000","last_peered":"2024-02-15T22:57:43.133211+0000","last_clean":"2024-02-15T22:57:43.133211+0000","last_became_active":"2024-02-15T22:56:09.720627+0000","last_became_peered":"2024-02-15T22:56:09.720627+0000","last_unstale":"2024-02-15T22:57:43.133211+0000","last_undegraded":"2024-02-15T22:57:43.133211+0000","last_fullsized":"2024-02-15T22:57:43.133211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881570+0000","last_change":"2024-02-15T22:56:11.724993+0000","last_active":"2024-02-15T22:56:45.881570+0000","last_peered":"2024-02-15T22:56:45.881570+0000","last_clean":"2024-02-15T22:56:45.881570+0000","last_became_active":"2024-02-15T22:56:11.724592+0000","last_became_peered":"2024-02-15T22:56:11.724592+0000","last_unstale":"2024-02-15T22:56:45.881570+0000","last_undegraded":"2024-02-15T22:56:45.881570+0000","last_fullsized":"2024-02-15T22:56:45.881570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880547+0000","last_change":"2024-02-15T22:56:13.730249+0000","last_active":"2024-02-15T22:56:45.880547+0000","last_peered":"2024-02-15T22:56:45.880547+0000","last_clean":"2024-02-15T22:56:45.880547+0000","last_became_active":"2024-02-15T22:56:13.729931+0000","last_became_peered":"2024-02-15T22:56:13.729931+0000","last_unstale":"2024-02-15T22:56:45.880547+0000","last_undegraded":"2024-02-15T22:56:45.880547+0000","last_fullsized":"2024-02-15T22:56:45.880547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879057+0000","last_change":"2024-02-15T22:56:05.714662+0000","last_active":"2024-02-15T22:56:45.879057+0000","last_peered":"2024-02-15T22:56:45.879057+0000","last_clean":"2024-02-15T22:56:45.879057+0000","last_became_active":"2024-02-15T22:56:05.714024+0000","last_became_peered":"2024-02-15T22:56:05.714024+0000","last_unstale":"2024-02-15T22:56:45.879057+0000","last_undegraded":"2024-02-15T22:56:45.879057+0000","last_fullsized":"2024-02-15T22:56:45.879057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886161+0000","last_change":"2024-02-15T22:56:03.698629+0000","last_active":"2024-02-15T22:56:45.886161+0000","last_peered":"2024-02-15T22:56:45.886161+0000","last_clean":"2024-02-15T22:56:45.886161+0000","last_became_active":"2024-02-15T22:56:03.695339+0000","last_became_peered":"2024-02-15T22:56:03.695339+0000","last_unstale":"2024-02-15T22:56:45.886161+0000","last_undegraded":"2024-02-15T22:56:45.886161+0000","last_fullsized":"2024-02-15T22:56:45.886161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.932675+0000","last_change":"2024-02-15T22:57:49.932729+0000","last_active":"2024-02-15T22:57:49.932675+0000","last_peered":"2024-02-15T22:57:49.932675+0000","last_clean":"2024-02-15T22:57:49.932675+0000","last_became_active":"2024-02-15T22:56:07.708692+0000","last_became_peered":"2024-02-15T22:56:07.708692+0000","last_unstale":"2024-02-15T22:57:49.932675+0000","last_undegraded":"2024-02-15T22:57:49.932675+0000","last_fullsized":"2024-02-15T22:57:49.932675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.932578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.932578+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.932578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:19:08.744146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.213007+0000","last_change":"2024-02-15T22:58:02.213042+0000","last_active":"2024-02-15T22:58:02.213007+0000","last_peered":"2024-02-15T22:58:02.213007+0000","last_clean":"2024-02-15T22:58:02.213007+0000","last_became_active":"2024-02-15T22:56:09.710942+0000","last_became_peered":"2024-02-15T22:56:09.710942+0000","last_unstale":"2024-02-15T22:58:02.213007+0000","last_undegraded":"2024-02-15T22:58:02.213007+0000","last_fullsized":"2024-02-15T22:58:02.213007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:02.212917+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:02.212917+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.212917+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:41.461653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.958914+0000","last_change":"2024-02-15T22:57:55.958962+0000","last_active":"2024-02-15T22:57:55.958914+0000","last_peered":"2024-02-15T22:57:55.958914+0000","last_clean":"2024-02-15T22:57:55.958914+0000","last_became_active":"2024-02-15T22:56:11.724533+0000","last_became_peered":"2024-02-15T22:56:11.724533+0000","last_unstale":"2024-02-15T22:57:55.958914+0000","last_undegraded":"2024-02-15T22:57:55.958914+0000","last_fullsized":"2024-02-15T22:57:55.958914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:55.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:55.958822+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:16:29.483298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.223131+0000","last_change":"2024-02-15T22:56:13.734719+0000","last_active":"2024-02-15T22:56:47.223131+0000","last_peered":"2024-02-15T22:56:47.223131+0000","last_clean":"2024-02-15T22:56:47.223131+0000","last_became_active":"2024-02-15T22:56:13.734428+0000","last_became_peered":"2024-02-15T22:56:13.734428+0000","last_unstale":"2024-02-15T22:56:47.223131+0000","last_undegraded":"2024-02-15T22:56:47.223131+0000","last_fullsized":"2024-02-15T22:56:47.223131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.891735+0000","last_change":"2024-02-15T22:56:05.706212+0000","last_active":"2024-02-15T22:57:29.891735+0000","last_peered":"2024-02-15T22:57:29.891735+0000","last_clean":"2024-02-15T22:57:29.891735+0000","last_became_active":"2024-02-15T22:56:05.705385+0000","last_became_peered":"2024-02-15T22:56:05.705385+0000","last_unstale":"2024-02-15T22:57:29.891735+0000","last_undegraded":"2024-02-15T22:57:29.891735+0000","last_fullsized":"2024-02-15T22:57:29.891735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886724+0000","last_change":"2024-02-15T22:56:03.700283+0000","last_active":"2024-02-15T22:56:45.886724+0000","last_peered":"2024-02-15T22:56:45.886724+0000","last_clean":"2024-02-15T22:56:45.886724+0000","last_became_active":"2024-02-15T22:56:03.699626+0000","last_became_peered":"2024-02-15T22:56:03.699626+0000","last_unstale":"2024-02-15T22:56:45.886724+0000","last_undegraded":"2024-02-15T22:56:45.886724+0000","last_fullsized":"2024-02-15T22:56:45.886724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880088+0000","last_change":"2024-02-15T22:56:07.706016+0000","last_active":"2024-02-15T22:56:45.880088+0000","last_peered":"2024-02-15T22:56:45.880088+0000","last_clean":"2024-02-15T22:56:45.880088+0000","last_became_active":"2024-02-15T22:56:07.705705+0000","last_became_peered":"2024-02-15T22:56:07.705705+0000","last_unstale":"2024-02-15T22:56:45.880088+0000","last_undegraded":"2024-02-15T22:56:45.880088+0000","last_fullsized":"2024-02-15T22:56:45.880088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'41","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.256507+0000","last_change":"2024-02-15T22:58:01.256585+0000","last_active":"2024-02-15T22:58:01.256507+0000","last_peered":"2024-02-15T22:58:01.256507+0000","last_clean":"2024-02-15T22:58:01.256507+0000","last_became_active":"2024-02-15T22:56:09.712337+0000","last_became_peered":"2024-02-15T22:56:09.712337+0000","last_unstale":"2024-02-15T22:58:01.256507+0000","last_undegraded":"2024-02-15T22:58:01.256507+0000","last_fullsized":"2024-02-15T22:58:01.256507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-02-15T22:58:01.256409+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-02-15T22:58:01.256409+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.256409+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:16.356268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.870060+0000","last_change":"2024-02-15T22:57:47.870103+0000","last_active":"2024-02-15T22:57:47.870060+0000","last_peered":"2024-02-15T22:57:47.870060+0000","last_clean":"2024-02-15T22:57:47.870060+0000","last_became_active":"2024-02-15T22:56:11.715697+0000","last_became_peered":"2024-02-15T22:56:11.715697+0000","last_unstale":"2024-02-15T22:57:47.870060+0000","last_undegraded":"2024-02-15T22:57:47.870060+0000","last_fullsized":"2024-02-15T22:57:47.870060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.869954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.869954+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.869954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:54.471463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880226+0000","last_change":"2024-02-15T22:56:13.734867+0000","last_active":"2024-02-15T22:56:45.880226+0000","last_peered":"2024-02-15T22:56:45.880226+0000","last_clean":"2024-02-15T22:56:45.880226+0000","last_became_active":"2024-02-15T22:56:13.734565+0000","last_became_peered":"2024-02-15T22:56:13.734565+0000","last_unstale":"2024-02-15T22:56:45.880226+0000","last_undegraded":"2024-02-15T22:56:45.880226+0000","last_fullsized":"2024-02-15T22:56:45.880226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'9","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.892323+0000","last_change":"2024-02-15T22:56:05.710863+0000","last_active":"2024-02-15T22:57:29.892323+0000","last_peered":"2024-02-15T22:57:29.892323+0000","last_clean":"2024-02-15T22:57:29.892323+0000","last_became_active":"2024-02-15T22:56:05.710562+0000","last_became_peered":"2024-02-15T22:56:05.710562+0000","last_unstale":"2024-02-15T22:57:29.892323+0000","last_undegraded":"2024-02-15T22:57:29.892323+0000","last_fullsized":"2024-02-15T22:57:29.892323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880219+0000","last_change":"2024-02-15T22:56:03.697251+0000","last_active":"2024-02-15T22:56:45.880219+0000","last_peered":"2024-02-15T22:56:45.880219+0000","last_clean":"2024-02-15T22:56:45.880219+0000","last_became_active":"2024-02-15T22:56:03.696590+0000","last_became_peered":"2024-02-15T22:56:03.696590+0000","last_unstale":"2024-02-15T22:56:45.880219+0000","last_undegraded":"2024-02-15T22:56:45.880219+0000","last_fullsized":"2024-02-15T22:56:45.880219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.041195+0000","last_change":"2024-02-15T22:57:56.041220+0000","last_active":"2024-02-15T22:57:56.041195+0000","last_peered":"2024-02-15T22:57:56.041195+0000","last_clean":"2024-02-15T22:57:56.041195+0000","last_became_active":"2024-02-15T22:56:07.705239+0000","last_became_peered":"2024-02-15T22:56:07.705239+0000","last_unstale":"2024-02-15T22:57:56.041195+0000","last_undegraded":"2024-02-15T22:57:56.041195+0000","last_fullsized":"2024-02-15T22:57:56.041195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.041105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.041105+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.041105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:22.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.989258+0000","last_change":"2024-02-15T22:58:00.989290+0000","last_active":"2024-02-15T22:58:00.989258+0000","last_peered":"2024-02-15T22:58:00.989258+0000","last_clean":"2024-02-15T22:58:00.989258+0000","last_became_active":"2024-02-15T22:56:09.710616+0000","last_became_peered":"2024-02-15T22:56:09.710616+0000","last_unstale":"2024-02-15T22:58:00.989258+0000","last_undegraded":"2024-02-15T22:58:00.989258+0000","last_fullsized":"2024-02-15T22:58:00.989258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:58:00.989160+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:58:00.989160+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.989160+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:16.633010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.881742+0000","last_change":"2024-02-15T22:57:48.881779+0000","last_active":"2024-02-15T22:57:48.881742+0000","last_peered":"2024-02-15T22:57:48.881742+0000","last_clean":"2024-02-15T22:57:48.881742+0000","last_became_active":"2024-02-15T22:56:11.718995+0000","last_became_peered":"2024-02-15T22:56:11.718995+0000","last_unstale":"2024-02-15T22:57:48.881742+0000","last_undegraded":"2024-02-15T22:57:48.881742+0000","last_fullsized":"2024-02-15T22:57:48.881742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:48.881655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:48.881655+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.881655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:00:14.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.399065+0000","last_change":"2024-02-15T22:56:05.699435+0000","last_active":"2024-02-15T22:57:35.399065+0000","last_peered":"2024-02-15T22:57:35.399065+0000","last_clean":"2024-02-15T22:57:35.399065+0000","last_became_active":"2024-02-15T22:56:05.699196+0000","last_became_peered":"2024-02-15T22:56:05.699196+0000","last_unstale":"2024-02-15T22:57:35.399065+0000","last_undegraded":"2024-02-15T22:57:35.399065+0000","last_fullsized":"2024-02-15T22:57:35.399065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.507535+0000","last_change":"2024-02-15T22:56:03.702280+0000","last_active":"2024-02-15T22:57:29.507535+0000","last_peered":"2024-02-15T22:57:29.507535+0000","last_clean":"2024-02-15T22:57:29.507535+0000","last_became_active":"2024-02-15T22:56:03.702007+0000","last_became_peered":"2024-02-15T22:56:03.702007+0000","last_unstale":"2024-02-15T22:57:29.507535+0000","last_undegraded":"2024-02-15T22:57:29.507535+0000","last_fullsized":"2024-02-15T22:57:29.507535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881672+0000","last_change":"2024-02-15T22:56:07.707669+0000","last_active":"2024-02-15T22:56:45.881672+0000","last_peered":"2024-02-15T22:56:45.881672+0000","last_clean":"2024-02-15T22:56:45.881672+0000","last_became_active":"2024-02-15T22:56:07.707124+0000","last_became_peered":"2024-02-15T22:56:07.707124+0000","last_unstale":"2024-02-15T22:56:45.881672+0000","last_undegraded":"2024-02-15T22:56:45.881672+0000","last_fullsized":"2024-02-15T22:56:45.881672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'59","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.341791+0000","last_change":"2024-02-15T22:57:59.341829+0000","last_active":"2024-02-15T22:57:59.341791+0000","last_peered":"2024-02-15T22:57:59.341791+0000","last_clean":"2024-02-15T22:57:59.341791+0000","last_became_active":"2024-02-15T22:56:09.713076+0000","last_became_peered":"2024-02-15T22:56:09.713076+0000","last_unstale":"2024-02-15T22:57:59.341791+0000","last_undegraded":"2024-02-15T22:57:59.341791+0000","last_fullsized":"2024-02-15T22:57:59.341791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-15T22:57:59.341704+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-15T22:57:59.341704+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.341704+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:30.766347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.956024+0000","last_change":"2024-02-15T22:57:50.956049+0000","last_active":"2024-02-15T22:57:50.956024+0000","last_peered":"2024-02-15T22:57:50.956024+0000","last_clean":"2024-02-15T22:57:50.956024+0000","last_became_active":"2024-02-15T22:56:11.718102+0000","last_became_peered":"2024-02-15T22:56:11.718102+0000","last_unstale":"2024-02-15T22:57:50.956024+0000","last_undegraded":"2024-02-15T22:57:50.956024+0000","last_fullsized":"2024-02-15T22:57:50.956024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.955925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.955925+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.955925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:28.393475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.896944+0000","last_change":"2024-02-15T22:56:13.734724+0000","last_active":"2024-02-15T22:57:29.896944+0000","last_peered":"2024-02-15T22:57:29.896944+0000","last_clean":"2024-02-15T22:57:29.896944+0000","last_became_active":"2024-02-15T22:56:13.734372+0000","last_became_peered":"2024-02-15T22:56:13.734372+0000","last_unstale":"2024-02-15T22:57:29.896944+0000","last_undegraded":"2024-02-15T22:57:29.896944+0000","last_fullsized":"2024-02-15T22:57:29.896944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398786+0000","last_change":"2024-02-15T22:56:05.705862+0000","last_active":"2024-02-15T22:57:35.398786+0000","last_peered":"2024-02-15T22:57:35.398786+0000","last_clean":"2024-02-15T22:57:35.398786+0000","last_became_active":"2024-02-15T22:56:05.705473+0000","last_became_peered":"2024-02-15T22:56:05.705473+0000","last_unstale":"2024-02-15T22:57:35.398786+0000","last_undegraded":"2024-02-15T22:57:35.398786+0000","last_fullsized":"2024-02-15T22:57:35.398786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.420402+0000","last_change":"2024-02-15T22:56:03.698010+0000","last_active":"2024-02-15T22:56:47.420402+0000","last_peered":"2024-02-15T22:56:47.420402+0000","last_clean":"2024-02-15T22:56:47.420402+0000","last_became_active":"2024-02-15T22:56:03.697691+0000","last_became_peered":"2024-02-15T22:56:03.697691+0000","last_unstale":"2024-02-15T22:56:47.420402+0000","last_undegraded":"2024-02-15T22:56:47.420402+0000","last_fullsized":"2024-02-15T22:56:47.420402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886515+0000","last_change":"2024-02-15T22:56:07.704334+0000","last_active":"2024-02-15T22:56:45.886515+0000","last_peered":"2024-02-15T22:56:45.886515+0000","last_clean":"2024-02-15T22:56:45.886515+0000","last_became_active":"2024-02-15T22:56:07.704018+0000","last_became_peered":"2024-02-15T22:56:07.704018+0000","last_unstale":"2024-02-15T22:56:45.886515+0000","last_undegraded":"2024-02-15T22:56:45.886515+0000","last_fullsized":"2024-02-15T22:56:45.886515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.180811+0000","last_change":"2024-02-15T22:58:03.180851+0000","last_active":"2024-02-15T22:58:03.180811+0000","last_peered":"2024-02-15T22:58:03.180811+0000","last_clean":"2024-02-15T22:58:03.180811+0000","last_became_active":"2024-02-15T22:56:09.717105+0000","last_became_peered":"2024-02-15T22:56:09.717105+0000","last_unstale":"2024-02-15T22:58:03.180811+0000","last_undegraded":"2024-02-15T22:58:03.180811+0000","last_fullsized":"2024-02-15T22:58:03.180811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-15T22:58:03.180724+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-15T22:58:03.180724+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.180724+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.050134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.879963+0000","last_change":"2024-02-15T22:58:00.880001+0000","last_active":"2024-02-15T22:58:00.879963+0000","last_peered":"2024-02-15T22:58:00.879963+0000","last_clean":"2024-02-15T22:58:00.879963+0000","last_became_active":"2024-02-15T22:56:11.722865+0000","last_became_peered":"2024-02-15T22:56:11.722865+0000","last_unstale":"2024-02-15T22:58:00.879963+0000","last_undegraded":"2024-02-15T22:58:00.879963+0000","last_fullsized":"2024-02-15T22:58:00.879963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:00.879874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:00.879874+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.879874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:59.902356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880456+0000","last_change":"2024-02-15T22:56:13.727435+0000","last_active":"2024-02-15T22:56:45.880456+0000","last_peered":"2024-02-15T22:56:45.880456+0000","last_clean":"2024-02-15T22:56:45.880456+0000","last_became_active":"2024-02-15T22:56:13.726748+0000","last_became_peered":"2024-02-15T22:56:13.726748+0000","last_unstale":"2024-02-15T22:56:45.880456+0000","last_undegraded":"2024-02-15T22:56:45.880456+0000","last_fullsized":"2024-02-15T22:56:45.880456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.092867+0000","last_change":"2024-02-15T22:58:00.092893+0000","last_active":"2024-02-15T22:58:00.092867+0000","last_peered":"2024-02-15T22:58:00.092867+0000","last_clean":"2024-02-15T22:58:00.092867+0000","last_became_active":"2024-02-15T22:56:05.716677+0000","last_became_peered":"2024-02-15T22:56:05.716677+0000","last_unstale":"2024-02-15T22:58:00.092867+0000","last_undegraded":"2024-02-15T22:58:00.092867+0000","last_fullsized":"2024-02-15T22:58:00.092867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:00.092774+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:00.092774+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.092774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:55:49.382293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878610+0000","last_change":"2024-02-15T22:56:03.692964+0000","last_active":"2024-02-15T22:56:45.878610+0000","last_peered":"2024-02-15T22:56:45.878610+0000","last_clean":"2024-02-15T22:56:45.878610+0000","last_became_active":"2024-02-15T22:56:03.692632+0000","last_became_peered":"2024-02-15T22:56:03.692632+0000","last_unstale":"2024-02-15T22:56:45.878610+0000","last_undegraded":"2024-02-15T22:56:45.878610+0000","last_fullsized":"2024-02-15T22:56:45.878610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885832+0000","last_change":"2024-02-15T22:56:07.704513+0000","last_active":"2024-02-15T22:56:45.885832+0000","last_peered":"2024-02-15T22:56:45.885832+0000","last_clean":"2024-02-15T22:56:45.885832+0000","last_became_active":"2024-02-15T22:56:07.704208+0000","last_became_peered":"2024-02-15T22:56:07.704208+0000","last_unstale":"2024-02-15T22:56:45.885832+0000","last_undegraded":"2024-02-15T22:56:45.885832+0000","last_fullsized":"2024-02-15T22:56:45.885832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.383646+0000","last_change":"2024-02-15T22:57:58.383705+0000","last_active":"2024-02-15T22:57:58.383646+0000","last_peered":"2024-02-15T22:57:58.383646+0000","last_clean":"2024-02-15T22:57:58.383646+0000","last_became_active":"2024-02-15T22:56:09.716753+0000","last_became_peered":"2024-02-15T22:56:09.716753+0000","last_unstale":"2024-02-15T22:57:58.383646+0000","last_undegraded":"2024-02-15T22:57:58.383646+0000","last_fullsized":"2024-02-15T22:57:58.383646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-15T22:57:58.383553+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-15T22:57:58.383553+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.383553+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:24.940537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.373555+0000","last_change":"2024-02-15T22:57:56.373579+0000","last_active":"2024-02-15T22:57:56.373555+0000","last_peered":"2024-02-15T22:57:56.373555+0000","last_clean":"2024-02-15T22:57:56.373555+0000","last_became_active":"2024-02-15T22:56:11.722738+0000","last_became_peered":"2024-02-15T22:56:11.722738+0000","last_unstale":"2024-02-15T22:57:56.373555+0000","last_undegraded":"2024-02-15T22:57:56.373555+0000","last_fullsized":"2024-02-15T22:57:56.373555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.373469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.373469+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.373469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:02.382987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882740+0000","last_change":"2024-02-15T22:56:13.727522+0000","last_active":"2024-02-15T22:56:45.882740+0000","last_peered":"2024-02-15T22:56:45.882740+0000","last_clean":"2024-02-15T22:56:45.882740+0000","last_became_active":"2024-02-15T22:56:13.727216+0000","last_became_peered":"2024-02-15T22:56:13.727216+0000","last_unstale":"2024-02-15T22:56:45.882740+0000","last_undegraded":"2024-02-15T22:56:45.882740+0000","last_fullsized":"2024-02-15T22:56:45.882740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881261+0000","last_change":"2024-02-15T22:56:05.707488+0000","last_active":"2024-02-15T22:56:45.881261+0000","last_peered":"2024-02-15T22:56:45.881261+0000","last_clean":"2024-02-15T22:56:45.881261+0000","last_became_active":"2024-02-15T22:56:05.707154+0000","last_became_peered":"2024-02-15T22:56:05.707154+0000","last_unstale":"2024-02-15T22:56:45.881261+0000","last_undegraded":"2024-02-15T22:56:45.881261+0000","last_fullsized":"2024-02-15T22:56:45.881261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881290+0000","last_change":"2024-02-15T22:56:03.700157+0000","last_active":"2024-02-15T22:56:45.881290+0000","last_peered":"2024-02-15T22:56:45.881290+0000","last_clean":"2024-02-15T22:56:45.881290+0000","last_became_active":"2024-02-15T22:56:03.699843+0000","last_became_peered":"2024-02-15T22:56:03.699843+0000","last_unstale":"2024-02-15T22:56:45.881290+0000","last_undegraded":"2024-02-15T22:56:45.881290+0000","last_fullsized":"2024-02-15T22:56:45.881290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.845172+0000","last_change":"2024-02-15T22:58:03.845209+0000","last_active":"2024-02-15T22:58:03.845172+0000","last_peered":"2024-02-15T22:58:03.845172+0000","last_clean":"2024-02-15T22:58:03.845172+0000","last_became_active":"2024-02-15T22:56:07.702014+0000","last_became_peered":"2024-02-15T22:56:07.702014+0000","last_unstale":"2024-02-15T22:58:03.845172+0000","last_undegraded":"2024-02-15T22:58:03.845172+0000","last_fullsized":"2024-02-15T22:58:03.845172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:03.845081+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:03.845081+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.845081+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:36.772070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.010455+0000","last_change":"2024-02-15T22:57:55.010523+0000","last_active":"2024-02-15T22:57:55.010455+0000","last_peered":"2024-02-15T22:57:55.010455+0000","last_clean":"2024-02-15T22:57:55.010455+0000","last_became_active":"2024-02-15T22:56:09.715996+0000","last_became_peered":"2024-02-15T22:56:09.715996+0000","last_unstale":"2024-02-15T22:57:55.010455+0000","last_undegraded":"2024-02-15T22:57:55.010455+0000","last_fullsized":"2024-02-15T22:57:55.010455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:57:55.010359+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:57:55.010359+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.010359+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:25.907925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":301,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.998904+0000","last_change":"2024-02-15T22:57:59.998940+0000","last_active":"2024-02-15T22:57:59.998904+0000","last_peered":"2024-02-15T22:57:59.998904+0000","last_clean":"2024-02-15T22:57:59.998904+0000","last_became_active":"2024-02-15T22:56:11.724520+0000","last_became_peered":"2024-02-15T22:56:11.724520+0000","last_unstale":"2024-02-15T22:57:59.998904+0000","last_undegraded":"2024-02-15T22:57:59.998904+0000","last_fullsized":"2024-02-15T22:57:59.998904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:59.998810+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:59.998810+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.998810+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:37.951898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879418+0000","last_change":"2024-02-15T22:56:13.731954+0000","last_active":"2024-02-15T22:56:45.879418+0000","last_peered":"2024-02-15T22:56:45.879418+0000","last_clean":"2024-02-15T22:56:45.879418+0000","last_became_active":"2024-02-15T22:56:13.731683+0000","last_became_peered":"2024-02-15T22:56:13.731683+0000","last_unstale":"2024-02-15T22:56:45.879418+0000","last_undegraded":"2024-02-15T22:56:45.879418+0000","last_fullsized":"2024-02-15T22:56:45.879418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884183+0000","last_change":"2024-02-15T22:56:05.701652+0000","last_active":"2024-02-15T22:56:45.884183+0000","last_peered":"2024-02-15T22:56:45.884183+0000","last_clean":"2024-02-15T22:56:45.884183+0000","last_became_active":"2024-02-15T22:56:05.700922+0000","last_became_peered":"2024-02-15T22:56:05.700922+0000","last_unstale":"2024-02-15T22:56:45.884183+0000","last_undegraded":"2024-02-15T22:56:45.884183+0000","last_fullsized":"2024-02-15T22:56:45.884183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883322+0000","last_change":"2024-02-15T22:56:03.697064+0000","last_active":"2024-02-15T22:56:45.883322+0000","last_peered":"2024-02-15T22:56:45.883322+0000","last_clean":"2024-02-15T22:56:45.883322+0000","last_became_active":"2024-02-15T22:56:03.696168+0000","last_became_peered":"2024-02-15T22:56:03.696168+0000","last_unstale":"2024-02-15T22:56:45.883322+0000","last_undegraded":"2024-02-15T22:56:45.883322+0000","last_fullsized":"2024-02-15T22:56:45.883322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879413+0000","last_change":"2024-02-15T22:56:07.702419+0000","last_active":"2024-02-15T22:56:45.879413+0000","last_peered":"2024-02-15T22:56:45.879413+0000","last_clean":"2024-02-15T22:56:45.879413+0000","last_became_active":"2024-02-15T22:56:07.701777+0000","last_became_peered":"2024-02-15T22:56:07.701777+0000","last_unstale":"2024-02-15T22:56:45.879413+0000","last_undegraded":"2024-02-15T22:56:45.879413+0000","last_fullsized":"2024-02-15T22:56:45.879413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'44","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.877626+0000","last_change":"2024-02-15T22:57:54.877670+0000","last_active":"2024-02-15T22:57:54.877626+0000","last_peered":"2024-02-15T22:57:54.877626+0000","last_clean":"2024-02-15T22:57:54.877626+0000","last_became_active":"2024-02-15T22:56:09.713636+0000","last_became_peered":"2024-02-15T22:56:09.713636+0000","last_unstale":"2024-02-15T22:57:54.877626+0000","last_undegraded":"2024-02-15T22:57:54.877626+0000","last_fullsized":"2024-02-15T22:57:54.877626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:57:54.877538+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:57:54.877538+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.877538+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:18.263250+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.331402+0000","last_change":"2024-02-15T22:57:46.331421+0000","last_active":"2024-02-15T22:57:46.331402+0000","last_peered":"2024-02-15T22:57:46.331402+0000","last_clean":"2024-02-15T22:57:46.331402+0000","last_became_active":"2024-02-15T22:56:11.722374+0000","last_became_peered":"2024-02-15T22:56:11.722374+0000","last_unstale":"2024-02-15T22:57:46.331402+0000","last_undegraded":"2024-02-15T22:57:46.331402+0000","last_fullsized":"2024-02-15T22:57:46.331402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:46.331332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:46.331332+0000","last_clean_scrub_stamp":"2024-02-15T22:57:46.331332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:32.555922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879445+0000","last_change":"2024-02-15T22:56:13.733861+0000","last_active":"2024-02-15T22:56:45.879445+0000","last_peered":"2024-02-15T22:56:45.879445+0000","last_clean":"2024-02-15T22:56:45.879445+0000","last_became_active":"2024-02-15T22:56:13.733576+0000","last_became_peered":"2024-02-15T22:56:13.733576+0000","last_unstale":"2024-02-15T22:56:45.879445+0000","last_undegraded":"2024-02-15T22:56:45.879445+0000","last_fullsized":"2024-02-15T22:56:45.879445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.433171+0000","last_change":"2024-02-15T22:56:05.701307+0000","last_active":"2024-02-15T22:56:47.433171+0000","last_peered":"2024-02-15T22:56:47.433171+0000","last_clean":"2024-02-15T22:56:47.433171+0000","last_became_active":"2024-02-15T22:56:05.701026+0000","last_became_peered":"2024-02-15T22:56:05.701026+0000","last_unstale":"2024-02-15T22:56:47.433171+0000","last_undegraded":"2024-02-15T22:56:47.433171+0000","last_fullsized":"2024-02-15T22:56:47.433171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883620+0000","last_change":"2024-02-15T22:56:03.706706+0000","last_active":"2024-02-15T22:56:45.883620+0000","last_peered":"2024-02-15T22:56:45.883620+0000","last_clean":"2024-02-15T22:56:45.883620+0000","last_became_active":"2024-02-15T22:56:03.706422+0000","last_became_peered":"2024-02-15T22:56:03.706422+0000","last_unstale":"2024-02-15T22:56:45.883620+0000","last_undegraded":"2024-02-15T22:56:45.883620+0000","last_fullsized":"2024-02-15T22:56:45.883620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.004935+0000","last_change":"2024-02-15T22:58:02.004957+0000","last_active":"2024-02-15T22:58:02.004935+0000","last_peered":"2024-02-15T22:58:02.004935+0000","last_clean":"2024-02-15T22:58:02.004935+0000","last_became_active":"2024-02-15T22:56:07.707265+0000","last_became_peered":"2024-02-15T22:56:07.707265+0000","last_unstale":"2024-02-15T22:58:02.004935+0000","last_undegraded":"2024-02-15T22:58:02.004935+0000","last_fullsized":"2024-02-15T22:58:02.004935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:02.004846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:02.004846+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.004846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:25.390557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'35","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.350840+0000","last_change":"2024-02-15T22:57:57.350886+0000","last_active":"2024-02-15T22:57:57.350840+0000","last_peered":"2024-02-15T22:57:57.350840+0000","last_clean":"2024-02-15T22:57:57.350840+0000","last_became_active":"2024-02-15T22:56:09.716749+0000","last_became_peered":"2024-02-15T22:56:09.716749+0000","last_unstale":"2024-02-15T22:57:57.350840+0000","last_undegraded":"2024-02-15T22:57:57.350840+0000","last_fullsized":"2024-02-15T22:57:57.350840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-02-15T22:57:57.350743+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-02-15T22:57:57.350743+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.350743+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:56.373225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880644+0000","last_change":"2024-02-15T22:56:11.726028+0000","last_active":"2024-02-15T22:56:45.880644+0000","last_peered":"2024-02-15T22:56:45.880644+0000","last_clean":"2024-02-15T22:56:45.880644+0000","last_became_active":"2024-02-15T22:56:11.725667+0000","last_became_peered":"2024-02-15T22:56:11.725667+0000","last_unstale":"2024-02-15T22:56:45.880644+0000","last_undegraded":"2024-02-15T22:56:45.880644+0000","last_fullsized":"2024-02-15T22:56:45.880644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'8","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.880803+0000","last_change":"2024-02-15T22:56:13.729381+0000","last_active":"2024-02-15T22:56:46.880803+0000","last_peered":"2024-02-15T22:56:46.880803+0000","last_clean":"2024-02-15T22:56:46.880803+0000","last_became_active":"2024-02-15T22:56:13.728844+0000","last_became_peered":"2024-02-15T22:56:13.728844+0000","last_unstale":"2024-02-15T22:56:46.880803+0000","last_undegraded":"2024-02-15T22:56:46.880803+0000","last_fullsized":"2024-02-15T22:56:46.880803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'1","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505750+0000","last_change":"2024-02-15T22:56:05.701351+0000","last_active":"2024-02-15T22:57:29.505750+0000","last_peered":"2024-02-15T22:57:29.505750+0000","last_clean":"2024-02-15T22:57:29.505750+0000","last_became_active":"2024-02-15T22:56:05.700908+0000","last_became_peered":"2024-02-15T22:56:05.700908+0000","last_unstale":"2024-02-15T22:57:29.505750+0000","last_undegraded":"2024-02-15T22:57:29.505750+0000","last_fullsized":"2024-02-15T22:57:29.505750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053361+0000","last_change":"2024-02-15T22:56:03.704371+0000","last_active":"2024-02-15T22:57:46.053361+0000","last_peered":"2024-02-15T22:57:46.053361+0000","last_clean":"2024-02-15T22:57:46.053361+0000","last_became_active":"2024-02-15T22:56:03.704081+0000","last_became_peered":"2024-02-15T22:56:03.704081+0000","last_unstale":"2024-02-15T22:57:46.053361+0000","last_undegraded":"2024-02-15T22:57:46.053361+0000","last_fullsized":"2024-02-15T22:57:46.053361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.886331+0000","last_change":"2024-02-15T22:57:58.886355+0000","last_active":"2024-02-15T22:57:58.886331+0000","last_peered":"2024-02-15T22:57:58.886331+0000","last_clean":"2024-02-15T22:57:58.886331+0000","last_became_active":"2024-02-15T22:56:07.708530+0000","last_became_peered":"2024-02-15T22:56:07.708530+0000","last_unstale":"2024-02-15T22:57:58.886331+0000","last_undegraded":"2024-02-15T22:57:58.886331+0000","last_fullsized":"2024-02-15T22:57:58.886331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:58.886242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:58.886242+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.886242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:28.475625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.000846+0000","last_change":"2024-02-15T22:57:57.000899+0000","last_active":"2024-02-15T22:57:57.000846+0000","last_peered":"2024-02-15T22:57:57.000846+0000","last_clean":"2024-02-15T22:57:57.000846+0000","last_became_active":"2024-02-15T22:56:09.716134+0000","last_became_peered":"2024-02-15T22:56:09.716134+0000","last_unstale":"2024-02-15T22:57:57.000846+0000","last_undegraded":"2024-02-15T22:57:57.000846+0000","last_fullsized":"2024-02-15T22:57:57.000846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-02-15T22:57:57.000753+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-02-15T22:57:57.000753+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.000753+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:47.478957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":49,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880864+0000","last_change":"2024-02-15T22:56:11.725615+0000","last_active":"2024-02-15T22:56:45.880864+0000","last_peered":"2024-02-15T22:56:45.880864+0000","last_clean":"2024-02-15T22:56:45.880864+0000","last_became_active":"2024-02-15T22:56:11.725271+0000","last_became_peered":"2024-02-15T22:56:11.725271+0000","last_unstale":"2024-02-15T22:56:45.880864+0000","last_undegraded":"2024-02-15T22:56:45.880864+0000","last_fullsized":"2024-02-15T22:56:45.880864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:10.699556+0000","last_clean_scrub_stamp":"2024-02-15T22:56:10.699556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881014+0000","last_change":"2024-02-15T22:56:13.735140+0000","last_active":"2024-02-15T22:56:45.881014+0000","last_peered":"2024-02-15T22:56:45.881014+0000","last_clean":"2024-02-15T22:56:45.881014+0000","last_became_active":"2024-02-15T22:56:13.734871+0000","last_became_peered":"2024-02-15T22:56:13.734871+0000","last_unstale":"2024-02-15T22:56:45.881014+0000","last_undegraded":"2024-02-15T22:56:45.881014+0000","last_fullsized":"2024-02-15T22:56:45.881014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'15","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505794+0000","last_change":"2024-02-15T22:56:05.700345+0000","last_active":"2024-02-15T22:57:29.505794+0000","last_peered":"2024-02-15T22:57:29.505794+0000","last_clean":"2024-02-15T22:57:29.505794+0000","last_became_active":"2024-02-15T22:56:05.700066+0000","last_became_peered":"2024-02-15T22:56:05.700066+0000","last_unstale":"2024-02-15T22:57:29.505794+0000","last_undegraded":"2024-02-15T22:57:29.505794+0000","last_fullsized":"2024-02-15T22:57:29.505794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.374102+0000","last_change":"2024-02-15T22:56:03.694391+0000","last_active":"2024-02-15T22:56:46.374102+0000","last_peered":"2024-02-15T22:56:46.374102+0000","last_clean":"2024-02-15T22:56:46.374102+0000","last_became_active":"2024-02-15T22:56:03.693300+0000","last_became_peered":"2024-02-15T22:56:03.693300+0000","last_unstale":"2024-02-15T22:56:46.374102+0000","last_undegraded":"2024-02-15T22:56:46.374102+0000","last_fullsized":"2024-02-15T22:56:46.374102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.879638+0000","last_change":"2024-02-15T22:57:57.879672+0000","last_active":"2024-02-15T22:57:57.879638+0000","last_peered":"2024-02-15T22:57:57.879638+0000","last_clean":"2024-02-15T22:57:57.879638+0000","last_became_active":"2024-02-15T22:56:07.708720+0000","last_became_peered":"2024-02-15T22:56:07.708720+0000","last_unstale":"2024-02-15T22:57:57.879638+0000","last_undegraded":"2024-02-15T22:57:57.879638+0000","last_fullsized":"2024-02-15T22:57:57.879638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:57:57.879545+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:57:57.879545+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.879545+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:33.402218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:43.147461+0000","last_change":"2024-02-15T22:56:09.720664+0000","last_active":"2024-02-15T22:57:43.147461+0000","last_peered":"2024-02-15T22:57:43.147461+0000","last_clean":"2024-02-15T22:57:43.147461+0000","last_became_active":"2024-02-15T22:56:09.717846+0000","last_became_peered":"2024-02-15T22:56:09.717846+0000","last_unstale":"2024-02-15T22:57:43.147461+0000","last_undegraded":"2024-02-15T22:57:43.147461+0000","last_fullsized":"2024-02-15T22:57:43.147461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:08.693485+0000","last_clean_scrub_stamp":"2024-02-15T22:56:08.693485+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.339561+0000","last_change":"2024-02-15T22:57:48.339582+0000","last_active":"2024-02-15T22:57:48.339561+0000","last_peered":"2024-02-15T22:57:48.339561+0000","last_clean":"2024-02-15T22:57:48.339561+0000","last_became_active":"2024-02-15T22:56:11.722402+0000","last_became_peered":"2024-02-15T22:56:11.722402+0000","last_unstale":"2024-02-15T22:57:48.339561+0000","last_undegraded":"2024-02-15T22:57:48.339561+0000","last_fullsized":"2024-02-15T22:57:48.339561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:48.339482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:48.339482+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.339482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:51.537660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882303+0000","last_change":"2024-02-15T22:56:13.733552+0000","last_active":"2024-02-15T22:56:45.882303+0000","last_peered":"2024-02-15T22:56:45.882303+0000","last_clean":"2024-02-15T22:56:45.882303+0000","last_became_active":"2024-02-15T22:56:13.733285+0000","last_became_peered":"2024-02-15T22:56:13.733285+0000","last_unstale":"2024-02-15T22:56:45.882303+0000","last_undegraded":"2024-02-15T22:56:45.882303+0000","last_fullsized":"2024-02-15T22:56:45.882303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398533+0000","last_change":"2024-02-15T22:56:05.715894+0000","last_active":"2024-02-15T22:57:35.398533+0000","last_peered":"2024-02-15T22:57:35.398533+0000","last_clean":"2024-02-15T22:57:35.398533+0000","last_became_active":"2024-02-15T22:56:05.715609+0000","last_became_peered":"2024-02-15T22:56:05.715609+0000","last_unstale":"2024-02-15T22:57:35.398533+0000","last_undegraded":"2024-02-15T22:57:35.398533+0000","last_fullsized":"2024-02-15T22:57:35.398533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880616+0000","last_change":"2024-02-15T22:56:03.694275+0000","last_active":"2024-02-15T22:56:45.880616+0000","last_peered":"2024-02-15T22:56:45.880616+0000","last_clean":"2024-02-15T22:56:45.880616+0000","last_became_active":"2024-02-15T22:56:03.691266+0000","last_became_peered":"2024-02-15T22:56:03.691266+0000","last_unstale":"2024-02-15T22:56:45.880616+0000","last_undegraded":"2024-02-15T22:56:45.880616+0000","last_fullsized":"2024-02-15T22:56:45.880616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.220213+0000","last_change":"2024-02-15T22:56:05.707825+0000","last_active":"2024-02-15T22:56:47.220213+0000","last_peered":"2024-02-15T22:56:47.220213+0000","last_clean":"2024-02-15T22:56:47.220213+0000","last_became_active":"2024-02-15T22:56:05.707492+0000","last_became_peered":"2024-02-15T22:56:05.707492+0000","last_unstale":"2024-02-15T22:56:47.220213+0000","last_undegraded":"2024-02-15T22:56:47.220213+0000","last_fullsized":"2024-02-15T22:56:47.220213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879121+0000","last_change":"2024-02-15T22:56:03.693256+0000","last_active":"2024-02-15T22:56:45.879121+0000","last_peered":"2024-02-15T22:56:45.879121+0000","last_clean":"2024-02-15T22:56:45.879121+0000","last_became_active":"2024-02-15T22:56:03.692909+0000","last_became_peered":"2024-02-15T22:56:03.692909+0000","last_unstale":"2024-02-15T22:56:45.879121+0000","last_undegraded":"2024-02-15T22:56:45.879121+0000","last_fullsized":"2024-02-15T22:56:45.879121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.220638+0000","last_change":"2024-02-15T22:56:05.710347+0000","last_active":"2024-02-15T22:56:47.220638+0000","last_peered":"2024-02-15T22:56:47.220638+0000","last_clean":"2024-02-15T22:56:47.220638+0000","last_became_active":"2024-02-15T22:56:05.710095+0000","last_became_peered":"2024-02-15T22:56:05.710095+0000","last_unstale":"2024-02-15T22:56:47.220638+0000","last_undegraded":"2024-02-15T22:56:47.220638+0000","last_fullsized":"2024-02-15T22:56:47.220638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.884750+0000","last_change":"2024-02-15T22:56:03.695701+0000","last_active":"2024-02-15T22:56:45.884750+0000","last_peered":"2024-02-15T22:56:45.884750+0000","last_clean":"2024-02-15T22:56:45.884750+0000","last_became_active":"2024-02-15T22:56:03.695362+0000","last_became_peered":"2024-02-15T22:56:03.695362+0000","last_unstale":"2024-02-15T22:56:45.884750+0000","last_undegraded":"2024-02-15T22:56:45.884750+0000","last_fullsized":"2024-02-15T22:56:45.884750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398656+0000","last_change":"2024-02-15T22:56:05.701633+0000","last_active":"2024-02-15T22:57:35.398656+0000","last_peered":"2024-02-15T22:57:35.398656+0000","last_clean":"2024-02-15T22:57:35.398656+0000","last_became_active":"2024-02-15T22:56:05.701253+0000","last_became_peered":"2024-02-15T22:56:05.701253+0000","last_unstale":"2024-02-15T22:57:35.398656+0000","last_undegraded":"2024-02-15T22:57:35.398656+0000","last_fullsized":"2024-02-15T22:57:35.398656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880214+0000","last_change":"2024-02-15T22:56:03.700366+0000","last_active":"2024-02-15T22:56:45.880214+0000","last_peered":"2024-02-15T22:56:45.880214+0000","last_clean":"2024-02-15T22:56:45.880214+0000","last_became_active":"2024-02-15T22:56:03.699881+0000","last_became_peered":"2024-02-15T22:56:03.699881+0000","last_unstale":"2024-02-15T22:56:45.880214+0000","last_undegraded":"2024-02-15T22:56:45.880214+0000","last_fullsized":"2024-02-15T22:56:45.880214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887794+0000","last_change":"2024-02-15T22:56:45.887346+0000","last_active":"2024-02-15T22:56:45.887794+0000","last_peered":"2024-02-15T22:56:45.887794+0000","last_clean":"2024-02-15T22:56:45.887794+0000","last_became_active":"2024-02-15T22:56:45.886976+0000","last_became_peered":"2024-02-15T22:56:45.886976+0000","last_unstale":"2024-02-15T22:56:45.887794+0000","last_undegraded":"2024-02-15T22:56:45.887794+0000","last_fullsized":"2024-02-15T22:56:45.887794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.881229+0000","last_change":"2024-02-15T22:56:03.693265+0000","last_active":"2024-02-15T22:57:29.881229+0000","last_peered":"2024-02-15T22:57:29.881229+0000","last_clean":"2024-02-15T22:57:29.881229+0000","last_became_active":"2024-02-15T22:56:03.692939+0000","last_became_peered":"2024-02-15T22:56:03.692939+0000","last_unstale":"2024-02-15T22:57:29.881229+0000","last_undegraded":"2024-02-15T22:57:29.881229+0000","last_fullsized":"2024-02-15T22:57:29.881229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878938+0000","last_change":"2024-02-15T22:56:05.714686+0000","last_active":"2024-02-15T22:56:45.878938+0000","last_peered":"2024-02-15T22:56:45.878938+0000","last_clean":"2024-02-15T22:56:45.878938+0000","last_became_active":"2024-02-15T22:56:05.713670+0000","last_became_peered":"2024-02-15T22:56:05.713670+0000","last_unstale":"2024-02-15T22:56:45.878938+0000","last_undegraded":"2024-02-15T22:56:45.878938+0000","last_fullsized":"2024-02-15T22:56:45.878938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882130+0000","last_change":"2024-02-15T22:56:03.697544+0000","last_active":"2024-02-15T22:56:45.882130+0000","last_peered":"2024-02-15T22:56:45.882130+0000","last_clean":"2024-02-15T22:56:45.882130+0000","last_became_active":"2024-02-15T22:56:03.696174+0000","last_became_peered":"2024-02-15T22:56:03.696174+0000","last_unstale":"2024-02-15T22:56:45.882130+0000","last_undegraded":"2024-02-15T22:56:45.882130+0000","last_fullsized":"2024-02-15T22:56:45.882130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.436080+0000","last_change":"2024-02-15T22:56:05.703501+0000","last_active":"2024-02-15T22:56:47.436080+0000","last_peered":"2024-02-15T22:56:47.436080+0000","last_clean":"2024-02-15T22:56:47.436080+0000","last_became_active":"2024-02-15T22:56:05.703183+0000","last_became_peered":"2024-02-15T22:56:05.703183+0000","last_unstale":"2024-02-15T22:56:47.436080+0000","last_undegraded":"2024-02-15T22:56:47.436080+0000","last_fullsized":"2024-02-15T22:56:47.436080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.417870+0000","last_change":"2024-02-15T22:56:03.700841+0000","last_active":"2024-02-15T22:56:47.417870+0000","last_peered":"2024-02-15T22:56:47.417870+0000","last_clean":"2024-02-15T22:56:47.417870+0000","last_became_active":"2024-02-15T22:56:03.699989+0000","last_became_peered":"2024-02-15T22:56:03.699989+0000","last_unstale":"2024-02-15T22:56:47.417870+0000","last_undegraded":"2024-02-15T22:56:47.417870+0000","last_fullsized":"2024-02-15T22:56:47.417870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.891343+0000","last_change":"2024-02-15T22:56:05.701522+0000","last_active":"2024-02-15T22:57:29.891343+0000","last_peered":"2024-02-15T22:57:29.891343+0000","last_clean":"2024-02-15T22:57:29.891343+0000","last_became_active":"2024-02-15T22:56:05.701193+0000","last_became_peered":"2024-02-15T22:56:05.701193+0000","last_unstale":"2024-02-15T22:57:29.891343+0000","last_undegraded":"2024-02-15T22:57:29.891343+0000","last_fullsized":"2024-02-15T22:57:29.891343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881711+0000","last_change":"2024-02-15T22:56:03.693252+0000","last_active":"2024-02-15T22:56:45.881711+0000","last_peered":"2024-02-15T22:56:45.881711+0000","last_clean":"2024-02-15T22:56:45.881711+0000","last_became_active":"2024-02-15T22:56:03.692902+0000","last_became_peered":"2024-02-15T22:56:03.692902+0000","last_unstale":"2024-02-15T22:56:45.881711+0000","last_undegraded":"2024-02-15T22:56:45.881711+0000","last_fullsized":"2024-02-15T22:56:45.881711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.506139+0000","last_change":"2024-02-15T22:56:05.702770+0000","last_active":"2024-02-15T22:57:29.506139+0000","last_peered":"2024-02-15T22:57:29.506139+0000","last_clean":"2024-02-15T22:57:29.506139+0000","last_became_active":"2024-02-15T22:56:05.702455+0000","last_became_peered":"2024-02-15T22:56:05.702455+0000","last_unstale":"2024-02-15T22:57:29.506139+0000","last_undegraded":"2024-02-15T22:57:29.506139+0000","last_fullsized":"2024-02-15T22:57:29.506139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880532+0000","last_change":"2024-02-15T22:56:03.695480+0000","last_active":"2024-02-15T22:56:45.880532+0000","last_peered":"2024-02-15T22:56:45.880532+0000","last_clean":"2024-02-15T22:56:45.880532+0000","last_became_active":"2024-02-15T22:56:03.695149+0000","last_became_peered":"2024-02-15T22:56:03.695149+0000","last_unstale":"2024-02-15T22:56:45.880532+0000","last_undegraded":"2024-02-15T22:56:45.880532+0000","last_fullsized":"2024-02-15T22:56:45.880532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883835+0000","last_change":"2024-02-15T22:56:05.704460+0000","last_active":"2024-02-15T22:56:45.883835+0000","last_peered":"2024-02-15T22:56:45.883835+0000","last_clean":"2024-02-15T22:56:45.883835+0000","last_became_active":"2024-02-15T22:56:05.704211+0000","last_became_peered":"2024-02-15T22:56:05.704211+0000","last_unstale":"2024-02-15T22:56:45.883835+0000","last_undegraded":"2024-02-15T22:56:45.883835+0000","last_fullsized":"2024-02-15T22:56:45.883835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.415151+0000","last_change":"2024-02-15T22:56:03.700242+0000","last_active":"2024-02-15T22:56:47.415151+0000","last_peered":"2024-02-15T22:56:47.415151+0000","last_clean":"2024-02-15T22:56:47.415151+0000","last_became_active":"2024-02-15T22:56:03.699419+0000","last_became_peered":"2024-02-15T22:56:03.699419+0000","last_unstale":"2024-02-15T22:56:47.415151+0000","last_undegraded":"2024-02-15T22:56:47.415151+0000","last_fullsized":"2024-02-15T22:56:47.415151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880451+0000","last_change":"2024-02-15T22:56:05.711089+0000","last_active":"2024-02-15T22:56:45.880451+0000","last_peered":"2024-02-15T22:56:45.880451+0000","last_clean":"2024-02-15T22:56:45.880451+0000","last_became_active":"2024-02-15T22:56:05.710665+0000","last_became_peered":"2024-02-15T22:56:05.710665+0000","last_unstale":"2024-02-15T22:56:45.880451+0000","last_undegraded":"2024-02-15T22:56:45.880451+0000","last_fullsized":"2024-02-15T22:56:45.880451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878767+0000","last_change":"2024-02-15T22:56:03.706180+0000","last_active":"2024-02-15T22:56:45.878767+0000","last_peered":"2024-02-15T22:56:45.878767+0000","last_clean":"2024-02-15T22:56:45.878767+0000","last_became_active":"2024-02-15T22:56:03.705871+0000","last_became_peered":"2024-02-15T22:56:03.705871+0000","last_unstale":"2024-02-15T22:56:45.878767+0000","last_undegraded":"2024-02-15T22:56:45.878767+0000","last_fullsized":"2024-02-15T22:56:45.878767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.913140+0000","last_change":"2024-02-15T22:56:05.705174+0000","last_active":"2024-02-15T22:56:47.913140+0000","last_peered":"2024-02-15T22:56:47.913140+0000","last_clean":"2024-02-15T22:56:47.913140+0000","last_became_active":"2024-02-15T22:56:05.704505+0000","last_became_peered":"2024-02-15T22:56:05.704505+0000","last_unstale":"2024-02-15T22:56:47.913140+0000","last_undegraded":"2024-02-15T22:56:47.913140+0000","last_fullsized":"2024-02-15T22:56:47.913140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878919+0000","last_change":"2024-02-15T22:56:03.706212+0000","last_active":"2024-02-15T22:56:45.878919+0000","last_peered":"2024-02-15T22:56:45.878919+0000","last_clean":"2024-02-15T22:56:45.878919+0000","last_became_active":"2024-02-15T22:56:03.705904+0000","last_became_peered":"2024-02-15T22:56:03.705904+0000","last_unstale":"2024-02-15T22:56:45.878919+0000","last_undegraded":"2024-02-15T22:56:45.878919+0000","last_fullsized":"2024-02-15T22:56:45.878919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878664+0000","last_change":"2024-02-15T22:56:05.713346+0000","last_active":"2024-02-15T22:56:45.878664+0000","last_peered":"2024-02-15T22:56:45.878664+0000","last_clean":"2024-02-15T22:56:45.878664+0000","last_became_active":"2024-02-15T22:56:05.713035+0000","last_became_peered":"2024-02-15T22:56:05.713035+0000","last_unstale":"2024-02-15T22:56:45.878664+0000","last_undegraded":"2024-02-15T22:56:45.878664+0000","last_fullsized":"2024-02-15T22:56:45.878664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883311+0000","last_change":"2024-02-15T22:56:03.696317+0000","last_active":"2024-02-15T22:56:45.883311+0000","last_peered":"2024-02-15T22:56:45.883311+0000","last_clean":"2024-02-15T22:56:45.883311+0000","last_became_active":"2024-02-15T22:56:03.696045+0000","last_became_peered":"2024-02-15T22:56:03.696045+0000","last_unstale":"2024-02-15T22:56:45.883311+0000","last_undegraded":"2024-02-15T22:56:45.883311+0000","last_fullsized":"2024-02-15T22:56:45.883311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398661+0000","last_change":"2024-02-15T22:56:05.705005+0000","last_active":"2024-02-15T22:57:35.398661+0000","last_peered":"2024-02-15T22:57:35.398661+0000","last_clean":"2024-02-15T22:57:35.398661+0000","last_became_active":"2024-02-15T22:56:05.704733+0000","last_became_peered":"2024-02-15T22:56:05.704733+0000","last_unstale":"2024-02-15T22:57:35.398661+0000","last_undegraded":"2024-02-15T22:57:35.398661+0000","last_fullsized":"2024-02-15T22:57:35.398661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883776+0000","last_change":"2024-02-15T22:56:03.695753+0000","last_active":"2024-02-15T22:56:45.883776+0000","last_peered":"2024-02-15T22:56:45.883776+0000","last_clean":"2024-02-15T22:56:45.883776+0000","last_became_active":"2024-02-15T22:56:03.695454+0000","last_became_peered":"2024-02-15T22:56:03.695454+0000","last_unstale":"2024-02-15T22:56:45.883776+0000","last_undegraded":"2024-02-15T22:56:45.883776+0000","last_fullsized":"2024-02-15T22:56:45.883776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398659+0000","last_change":"2024-02-15T22:56:05.707756+0000","last_active":"2024-02-15T22:57:35.398659+0000","last_peered":"2024-02-15T22:57:35.398659+0000","last_clean":"2024-02-15T22:57:35.398659+0000","last_became_active":"2024-02-15T22:56:05.707464+0000","last_became_peered":"2024-02-15T22:56:05.707464+0000","last_unstale":"2024-02-15T22:57:35.398659+0000","last_undegraded":"2024-02-15T22:57:35.398659+0000","last_fullsized":"2024-02-15T22:57:35.398659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.389037+0000","last_change":"2024-02-15T22:56:03.696562+0000","last_active":"2024-02-15T22:57:35.389037+0000","last_peered":"2024-02-15T22:57:35.389037+0000","last_clean":"2024-02-15T22:57:35.389037+0000","last_became_active":"2024-02-15T22:56:03.696267+0000","last_became_peered":"2024-02-15T22:56:03.696267+0000","last_unstale":"2024-02-15T22:57:35.389037+0000","last_undegraded":"2024-02-15T22:57:35.389037+0000","last_fullsized":"2024-02-15T22:57:35.389037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.913508+0000","last_change":"2024-02-15T22:56:05.705880+0000","last_active":"2024-02-15T22:56:47.913508+0000","last_peered":"2024-02-15T22:56:47.913508+0000","last_clean":"2024-02-15T22:56:47.913508+0000","last_became_active":"2024-02-15T22:56:05.705496+0000","last_became_peered":"2024-02-15T22:56:05.705496+0000","last_unstale":"2024-02-15T22:56:47.913508+0000","last_undegraded":"2024-02-15T22:56:47.913508+0000","last_fullsized":"2024-02-15T22:56:47.913508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.375759+0000","last_change":"2024-02-15T22:56:03.707531+0000","last_active":"2024-02-15T22:56:46.375759+0000","last_peered":"2024-02-15T22:56:46.375759+0000","last_clean":"2024-02-15T22:56:46.375759+0000","last_became_active":"2024-02-15T22:56:03.707033+0000","last_became_peered":"2024-02-15T22:56:03.707033+0000","last_unstale":"2024-02-15T22:56:46.375759+0000","last_undegraded":"2024-02-15T22:56:46.375759+0000","last_fullsized":"2024-02-15T22:56:46.375759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881109+0000","last_change":"2024-02-15T22:56:03.706143+0000","last_active":"2024-02-15T22:56:45.881109+0000","last_peered":"2024-02-15T22:56:45.881109+0000","last_clean":"2024-02-15T22:56:45.881109+0000","last_became_active":"2024-02-15T22:56:03.705853+0000","last_became_peered":"2024-02-15T22:56:03.705853+0000","last_unstale":"2024-02-15T22:56:45.881109+0000","last_undegraded":"2024-02-15T22:56:45.881109+0000","last_fullsized":"2024-02-15T22:56:45.881109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398741+0000","last_change":"2024-02-15T22:56:05.699396+0000","last_active":"2024-02-15T22:57:35.398741+0000","last_peered":"2024-02-15T22:57:35.398741+0000","last_clean":"2024-02-15T22:57:35.398741+0000","last_became_active":"2024-02-15T22:56:05.699141+0000","last_became_peered":"2024-02-15T22:56:05.699141+0000","last_unstale":"2024-02-15T22:57:35.398741+0000","last_undegraded":"2024-02-15T22:57:35.398741+0000","last_fullsized":"2024-02-15T22:57:35.398741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879231+0000","last_change":"2024-02-15T22:56:03.700573+0000","last_active":"2024-02-15T22:56:45.879231+0000","last_peered":"2024-02-15T22:56:45.879231+0000","last_clean":"2024-02-15T22:56:45.879231+0000","last_became_active":"2024-02-15T22:56:03.700107+0000","last_became_peered":"2024-02-15T22:56:03.700107+0000","last_unstale":"2024-02-15T22:56:45.879231+0000","last_undegraded":"2024-02-15T22:56:45.879231+0000","last_fullsized":"2024-02-15T22:56:45.879231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880049+0000","last_change":"2024-02-15T22:56:05.713543+0000","last_active":"2024-02-15T22:56:45.880049+0000","last_peered":"2024-02-15T22:56:45.880049+0000","last_clean":"2024-02-15T22:56:45.880049+0000","last_became_active":"2024-02-15T22:56:05.713142+0000","last_became_peered":"2024-02-15T22:56:05.713142+0000","last_unstale":"2024-02-15T22:56:45.880049+0000","last_undegraded":"2024-02-15T22:56:45.880049+0000","last_fullsized":"2024-02-15T22:56:45.880049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1382,"ondisk_log_size":1382,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":46,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672991,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35764,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336076,"statfs":{"total":96636764160,"available":96600141824,"internally_reserved":0,"allocated":438272,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.41999999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.435},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Feb 15 22:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.316,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.41299999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.24099999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46300000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Feb 15 22:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35199999999999998,"15min":0.35599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.432,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.32400000000000001,"15min":0.32800000000000001},"min":{"1min":0.23699999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.44800000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.374}]}]},{"osd":2,"up_from":10,"seq":42949672992,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":978944,"data_stored":722767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.52700000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.54700000000000004,"5min":0.623,"15min":0.623},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Feb 15 22:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30299999999999999,"15min":0.30399999999999999},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41799999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.313,"15min":0.311},"min":{"1min":0.19500000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.48799999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.313}]},{"osd":3,"last update":"Thu Feb 15 22:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.33000000000000002,"15min":0.33200000000000002},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.433,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.255},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46300000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.27200000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672991,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.311,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52500000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Feb 15 22:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.192,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.44},{"interface":"front","average":{"1min":0.311,"5min":0.30299999999999999,"15min":0.30199999999999999},"min":{"1min":0.23499999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.38}]},{"osd":3,"last update":"Thu Feb 15 22:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.311,"15min":0.309},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34799999999999998,"15min":0.34699999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.40100000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:57:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.48899999999999999},"min":{"1min":0.377,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68400000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.36099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67600000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Feb 15 22:57:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69099999999999995,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.502,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.63100000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Feb 15 22:57:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.33400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.313,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70099999999999996,"5min":0.75,"15min":0.75},"last":0.5}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:58:08.105 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.106 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.106 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.106 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.106 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.106 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.106 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.107 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.107 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.107 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.107 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.107 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.107 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.108 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.108 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.108 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.108 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.108 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.108 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.109 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.109 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.109 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.109 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.109 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.109 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.109 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.110 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.110 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.110 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.110 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.110 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.110 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.111 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.111 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.111 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.111 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.111 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.111 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.112 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.112 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.112 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.112 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.112 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.113 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.113 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.113 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.113 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.113 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.113 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.114 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.114 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.114 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.114 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.114 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.114 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.115 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.115 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.115 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.115 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.115 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.115 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.116 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.116 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.116 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.116 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.116 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.116 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.117 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.117 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.117 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.117 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.117 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.117 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.118 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-15T22:55:51.648340+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=51, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.118 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.118 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.118 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.118 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.118 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.119 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.119 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.119 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.119 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.119 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.119 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.120 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.120 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.120 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.120 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.120 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.120 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.121 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.121 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.121 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.121 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.121 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.121 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.121 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.122 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.122 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.122 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.122 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.122 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.123 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.123 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.123 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.123 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.123 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.123 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.124 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.124 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.124 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.124 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.124 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.124 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.125 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.125 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.125 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.125 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.125 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.125 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.126 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.126 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.126 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.126 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.126 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.126 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.127 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.127 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.127 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.127 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.128 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.128 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.128 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.128 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.128 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.129 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.129 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.129 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.129 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.129 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.129 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.130 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.130 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.130 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.130 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.130 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.131 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.131 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.131 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.131 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.131 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.131 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-15T22:56:10.699556+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.131 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.132 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.132 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.132 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-02-15T22:56:08.693485+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=8, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.132 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.132 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.133 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.133 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.133 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.133 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.133 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.133 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.134 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.134 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.134 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.134 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.134 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.134 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.135 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.135 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.135 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.135 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.135 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.135 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.135 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.136 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.136 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.136 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.136 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.136 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.136 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.137 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.137 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.137 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.137 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.137 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.137 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.137 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.138 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.138 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.138 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:08.138 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-15T22:58:28.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T22:58:28.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.251+0000 7fe2e426e640 1 Processor -- start 2024-02-15T22:58:28.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.251+0000 7fe2e426e640 1 -- start start 2024-02-15T22:58:28.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.251+0000 7fe2e426e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe2dc06dc20 0x7fe2dc1332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:28.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.251+0000 7fe2e426e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc09b170 con 0x7fe2dc06d130 2024-02-15T22:58:28.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.251+0000 7fe2e426e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc09dd00 con 0x7fe2dc06dc20 2024-02-15T22:58:28.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.251+0000 7fe2e1809640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe2dc06dc20 0x7fe2dc1332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:28.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.251+0000 7fe2e200a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe2dc06d130 0x7fe2dc06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43816/0 (socket says 172.21.15.52:43816) 2024-02-15T22:58:28.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.251+0000 7fe2e200a640 1 -- 172.21.15.52:0/2636503011 learned_addr learned my addr 172.21.15.52:0/2636503011 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:58:28.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.252+0000 7fe2e1809640 1 -- 172.21.15.52:0/2636503011 >> v1:172.21.15.52:6789/0 conn(0x7fe2dc06d130 legacy=0x7fe2dc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.252+0000 7fe2e1809640 1 -- 172.21.15.52:0/2636503011 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc09b510 con 0x7fe2dc06dc20 2024-02-15T22:58:28.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.252+0000 7fe2e1809640 1 --2- 172.21.15.52:0/2636503011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2dc06dc20 0x7fe2dc1332a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009720 tx=0x7fe2cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c925993362470234 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:28.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.253+0000 7fe2e1008640 1 -- 172.21.15.52:0/2636503011 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc02e070 con 0x7fe2dc06dc20 2024-02-15T22:58:28.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.253+0000 7fe2e1008640 1 -- 172.21.15.52:0/2636503011 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0316d0 con 0x7fe2dc06dc20 2024-02-15T22:58:28.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.253+0000 7fe2e1008640 1 -- 172.21.15.52:0/2636503011 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc031990 con 0x7fe2dc06dc20 2024-02-15T22:58:28.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.253+0000 7fe2e426e640 1 -- 172.21.15.52:0/2636503011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2dc06dc20 msgr2=0x7fe2dc1332a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.253+0000 7fe2e426e640 1 --2- 172.21.15.52:0/2636503011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2dc06dc20 0x7fe2dc1332a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009720 tx=0x7fe2cc02b840 comp rx=0 tx=0).stop 2024-02-15T22:58:28.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.253+0000 7fe2e426e640 1 -- 172.21.15.52:0/2636503011 shutdown_connections 2024-02-15T22:58:28.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.253+0000 7fe2e426e640 1 --2- 172.21.15.52:0/2636503011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2dc06dc20 0x7fe2dc1332a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.253+0000 7fe2e426e640 1 -- 172.21.15.52:0/2636503011 >> 172.21.15.52:0/2636503011 conn(0x7fe2dc09c210 msgr2=0x7fe2dc071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:28.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.253+0000 7fe2e426e640 1 -- 172.21.15.52:0/2636503011 shutdown_connections 2024-02-15T22:58:28.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.253+0000 7fe2e426e640 1 -- 172.21.15.52:0/2636503011 wait complete. 2024-02-15T22:58:28.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.254+0000 7fe2e426e640 1 Processor -- start 2024-02-15T22:58:28.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.254+0000 7fe2e426e640 1 -- start start 2024-02-15T22:58:28.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2e426e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2dc06d130 0x7fe2dc12f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:28.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2e426e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc121930 con 0x7fe2dc06d130 2024-02-15T22:58:28.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2e200a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2dc06d130 0x7fe2dc12f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:28.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2e200a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2dc06d130 0x7fe2dc12f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57506/0 (socket says 172.21.15.52:57506) 2024-02-15T22:58:28.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2e200a640 1 -- 172.21.15.52:0/2449408427 learned_addr learned my addr 172.21.15.52:0/2449408427 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:58:28.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2e200a640 1 -- 172.21.15.52:0/2449408427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc009400 con 0x7fe2dc06d130 2024-02-15T22:58:28.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2e200a640 1 --2- 172.21.15.52:0/2449408427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2dc06d130 0x7fe2dc12f500 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800c4a0 tx=0x7fe2d800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:28.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2d2ffd640 1 -- 172.21.15.52:0/2449408427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2d8005c10 con 0x7fe2dc06d130 2024-02-15T22:58:28.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2d2ffd640 1 -- 172.21.15.52:0/2449408427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d8005d70 con 0x7fe2dc06d130 2024-02-15T22:58:28.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2e426e640 1 -- 172.21.15.52:0/2449408427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc121680 con 0x7fe2dc06d130 2024-02-15T22:58:28.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2d2ffd640 1 -- 172.21.15.52:0/2449408427 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2d80071a0 con 0x7fe2dc06d130 2024-02-15T22:58:28.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.255+0000 7fe2e426e640 1 -- 172.21.15.52:0/2449408427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc122310 con 0x7fe2dc06d130 2024-02-15T22:58:28.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.256+0000 7fe2d2ffd640 1 -- 172.21.15.52:0/2449408427 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe2d8007300 con 0x7fe2dc06d130 2024-02-15T22:58:28.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.256+0000 7fe2e426e640 1 -- 172.21.15.52:0/2449408427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc0627b0 con 0x7fe2dc06d130 2024-02-15T22:58:28.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.256+0000 7fe2d2ffd640 1 --2- 172.21.15.52:0/2449408427 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2c0037ef0 0x7fe2c003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:28.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.256+0000 7fe2d2ffd640 1 -- 172.21.15.52:0/2449408427 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fe2d804a850 con 0x7fe2dc06d130 2024-02-15T22:58:28.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.257+0000 7fe2e1809640 1 --2- 172.21.15.52:0/2449408427 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2c0037ef0 0x7fe2c003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:28.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.257+0000 7fe2e1809640 1 --2- 172.21.15.52:0/2449408427 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2c0037ef0 0x7fe2c003a3b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc036000 tx=0x7fe2cc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:28.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.261+0000 7fe2d2ffd640 1 -- 172.21.15.52:0/2449408427 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe2d8010c20 con 0x7fe2dc06d130 2024-02-15T22:58:28.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.438+0000 7fe2e426e640 1 -- 172.21.15.52:0/2449408427 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2dc06eb70 con 0x7fe2c0037ef0 2024-02-15T22:58:28.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.454+0000 7fe2d2ffd640 1 -- 172.21.15.52:0/2449408427 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+669099 (secure 0 0 0) 0x7fe2cc031c00 con 0x7fe2c0037ef0 2024-02-15T22:58:28.464 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:58:28.469 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-02-15T22:58:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.458+0000 7fe2e426e640 1 -- 172.21.15.52:0/2449408427 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2c0037ef0 msgr2=0x7fe2c003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.458+0000 7fe2e426e640 1 --2- 172.21.15.52:0/2449408427 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2c0037ef0 0x7fe2c003a3b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc036000 tx=0x7fe2cc008030 comp rx=0 tx=0).stop 2024-02-15T22:58:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.458+0000 7fe2e426e640 1 -- 172.21.15.52:0/2449408427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2dc06d130 msgr2=0x7fe2dc12f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.458+0000 7fe2e426e640 1 --2- 172.21.15.52:0/2449408427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2dc06d130 0x7fe2dc12f500 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800c4a0 tx=0x7fe2d800c960 comp rx=0 tx=0).stop 2024-02-15T22:58:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.458+0000 7fe2e426e640 1 -- 172.21.15.52:0/2449408427 shutdown_connections 2024-02-15T22:58:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.458+0000 7fe2e426e640 1 --2- 172.21.15.52:0/2449408427 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7fe2c0037ef0 0x7fe2c003a3b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.458+0000 7fe2e426e640 1 --2- 172.21.15.52:0/2449408427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2dc06d130 0x7fe2dc12f500 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.458+0000 7fe2e426e640 1 -- 172.21.15.52:0/2449408427 >> 172.21.15.52:0/2449408427 conn(0x7fe2dc09c210 msgr2=0x7fe2dc118d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.459+0000 7fe2e426e640 1 -- 172.21.15.52:0/2449408427 shutdown_connections 2024-02-15T22:58:28.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:28.459+0000 7fe2e426e640 1 -- 172.21.15.52:0/2449408427 wait complete. 2024-02-15T22:58:28.473 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-02-15T22:58:26.847654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4011,"num_read_kb":3661,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1709,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3959,"ondisk_log_size":3959,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135792,"kb_used_data":2768,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351568,"statfs":{"total":386547056640,"available":386408005632,"internally_reserved":0,"allocated":2834432,"data_stored":1715324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1459,"num_omap_keys":7,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004322"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.912061+0000","last_change":"2024-02-15T22:58:20.912083+0000","last_active":"2024-02-15T22:58:20.912061+0000","last_peered":"2024-02-15T22:58:20.912061+0000","last_clean":"2024-02-15T22:58:20.912061+0000","last_became_active":"2024-02-15T22:56:03.699163+0000","last_became_peered":"2024-02-15T22:56:03.699163+0000","last_unstale":"2024-02-15T22:58:20.912061+0000","last_undegraded":"2024-02-15T22:58:20.912061+0000","last_fullsized":"2024-02-15T22:58:20.912061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:20.911968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:20.911968+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.911968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:40.922588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398722+0000","last_change":"2024-02-15T22:56:05.708737+0000","last_active":"2024-02-15T22:57:35.398722+0000","last_peered":"2024-02-15T22:57:35.398722+0000","last_clean":"2024-02-15T22:57:35.398722+0000","last_became_active":"2024-02-15T22:56:05.708415+0000","last_became_peered":"2024-02-15T22:56:05.708415+0000","last_unstale":"2024-02-15T22:57:35.398722+0000","last_undegraded":"2024-02-15T22:57:35.398722+0000","last_fullsized":"2024-02-15T22:57:35.398722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.335594+0000","last_change":"2024-02-15T22:58:23.335618+0000","last_active":"2024-02-15T22:58:23.335594+0000","last_peered":"2024-02-15T22:58:23.335594+0000","last_clean":"2024-02-15T22:58:23.335594+0000","last_became_active":"2024-02-15T22:56:03.704043+0000","last_became_peered":"2024-02-15T22:56:03.704043+0000","last_unstale":"2024-02-15T22:58:23.335594+0000","last_undegraded":"2024-02-15T22:58:23.335594+0000","last_fullsized":"2024-02-15T22:58:23.335594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.335501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.335501+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.335501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:18.066378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882501+0000","last_change":"2024-02-15T22:56:05.703860+0000","last_active":"2024-02-15T22:56:45.882501+0000","last_peered":"2024-02-15T22:56:45.882501+0000","last_clean":"2024-02-15T22:56:45.882501+0000","last_became_active":"2024-02-15T22:56:05.703587+0000","last_became_peered":"2024-02-15T22:56:05.703587+0000","last_unstale":"2024-02-15T22:56:45.882501+0000","last_undegraded":"2024-02-15T22:56:45.882501+0000","last_fullsized":"2024-02-15T22:56:45.882501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371601+0000","last_change":"2024-02-15T22:56:03.703994+0000","last_active":"2024-02-15T22:57:47.371601+0000","last_peered":"2024-02-15T22:57:47.371601+0000","last_clean":"2024-02-15T22:57:47.371601+0000","last_became_active":"2024-02-15T22:56:03.703702+0000","last_became_peered":"2024-02-15T22:56:03.703702+0000","last_unstale":"2024-02-15T22:57:47.371601+0000","last_undegraded":"2024-02-15T22:57:47.371601+0000","last_fullsized":"2024-02-15T22:57:47.371601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.151621+0000","last_change":"2024-02-15T22:58:24.151651+0000","last_active":"2024-02-15T22:58:24.151621+0000","last_peered":"2024-02-15T22:58:24.151621+0000","last_clean":"2024-02-15T22:58:24.151621+0000","last_became_active":"2024-02-15T22:56:05.709003+0000","last_became_peered":"2024-02-15T22:56:05.709003+0000","last_unstale":"2024-02-15T22:58:24.151621+0000","last_undegraded":"2024-02-15T22:58:24.151621+0000","last_fullsized":"2024-02-15T22:58:24.151621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:24.151517+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:24.151517+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.151517+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:49:20.993618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.930742+0000","last_change":"2024-02-15T22:56:03.692040+0000","last_active":"2024-02-15T22:57:46.930742+0000","last_peered":"2024-02-15T22:57:46.930742+0000","last_clean":"2024-02-15T22:57:46.930742+0000","last_became_active":"2024-02-15T22:56:03.691753+0000","last_became_peered":"2024-02-15T22:56:03.691753+0000","last_unstale":"2024-02-15T22:57:46.930742+0000","last_undegraded":"2024-02-15T22:57:46.930742+0000","last_fullsized":"2024-02-15T22:57:46.930742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505752+0000","last_change":"2024-02-15T22:56:05.703818+0000","last_active":"2024-02-15T22:57:29.505752+0000","last_peered":"2024-02-15T22:57:29.505752+0000","last_clean":"2024-02-15T22:57:29.505752+0000","last_became_active":"2024-02-15T22:56:05.703541+0000","last_became_peered":"2024-02-15T22:56:05.703541+0000","last_unstale":"2024-02-15T22:57:29.505752+0000","last_undegraded":"2024-02-15T22:57:29.505752+0000","last_fullsized":"2024-02-15T22:57:29.505752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881575+0000","last_change":"2024-02-15T22:56:03.694830+0000","last_active":"2024-02-15T22:56:45.881575+0000","last_peered":"2024-02-15T22:56:45.881575+0000","last_clean":"2024-02-15T22:56:45.881575+0000","last_became_active":"2024-02-15T22:56:03.694522+0000","last_became_peered":"2024-02-15T22:56:03.694522+0000","last_unstale":"2024-02-15T22:56:45.881575+0000","last_undegraded":"2024-02-15T22:56:45.881575+0000","last_fullsized":"2024-02-15T22:56:45.881575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491949+0000","last_change":"2024-02-15T22:56:05.705402+0000","last_active":"2024-02-15T22:57:46.491949+0000","last_peered":"2024-02-15T22:57:46.491949+0000","last_clean":"2024-02-15T22:57:46.491949+0000","last_became_active":"2024-02-15T22:56:05.704411+0000","last_became_peered":"2024-02-15T22:56:05.704411+0000","last_unstale":"2024-02-15T22:57:46.491949+0000","last_undegraded":"2024-02-15T22:57:46.491949+0000","last_fullsized":"2024-02-15T22:57:46.491949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882255+0000","last_change":"2024-02-15T22:56:03.692633+0000","last_active":"2024-02-15T22:56:45.882255+0000","last_peered":"2024-02-15T22:56:45.882255+0000","last_clean":"2024-02-15T22:56:45.882255+0000","last_became_active":"2024-02-15T22:56:03.692316+0000","last_became_peered":"2024-02-15T22:56:03.692316+0000","last_unstale":"2024-02-15T22:56:45.882255+0000","last_undegraded":"2024-02-15T22:56:45.882255+0000","last_fullsized":"2024-02-15T22:56:45.882255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.226214+0000","last_change":"2024-02-15T22:58:04.226214+0000","last_active":"2024-02-15T22:58:04.226214+0000","last_peered":"2024-02-15T22:58:04.226214+0000","last_clean":"2024-02-15T22:58:04.226214+0000","last_became_active":"2024-02-15T22:56:05.715460+0000","last_became_peered":"2024-02-15T22:56:05.715460+0000","last_unstale":"2024-02-15T22:58:04.226214+0000","last_undegraded":"2024-02-15T22:58:04.226214+0000","last_fullsized":"2024-02-15T22:58:04.226214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:04.226104+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:04.226104+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.226104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:09.713529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.860448+0000","last_change":"2024-02-15T22:56:03.701184+0000","last_active":"2024-02-15T22:56:46.860448+0000","last_peered":"2024-02-15T22:56:46.860448+0000","last_clean":"2024-02-15T22:56:46.860448+0000","last_became_active":"2024-02-15T22:56:03.700908+0000","last_became_peered":"2024-02-15T22:56:03.700908+0000","last_unstale":"2024-02-15T22:56:46.860448+0000","last_undegraded":"2024-02-15T22:56:46.860448+0000","last_fullsized":"2024-02-15T22:56:46.860448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.931040+0000","last_change":"2024-02-15T22:56:05.706807+0000","last_active":"2024-02-15T22:57:46.931040+0000","last_peered":"2024-02-15T22:57:46.931040+0000","last_clean":"2024-02-15T22:57:46.931040+0000","last_became_active":"2024-02-15T22:56:05.706078+0000","last_became_peered":"2024-02-15T22:56:05.706078+0000","last_unstale":"2024-02-15T22:57:46.931040+0000","last_undegraded":"2024-02-15T22:57:46.931040+0000","last_fullsized":"2024-02-15T22:57:46.931040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879256+0000","last_change":"2024-02-15T22:56:03.697612+0000","last_active":"2024-02-15T22:56:45.879256+0000","last_peered":"2024-02-15T22:56:45.879256+0000","last_clean":"2024-02-15T22:56:45.879256+0000","last_became_active":"2024-02-15T22:56:03.697327+0000","last_became_peered":"2024-02-15T22:56:03.697327+0000","last_unstale":"2024-02-15T22:56:45.879256+0000","last_undegraded":"2024-02-15T22:56:45.879256+0000","last_fullsized":"2024-02-15T22:56:45.879256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.901912+0000","last_change":"2024-02-15T22:58:17.901959+0000","last_active":"2024-02-15T22:58:17.901912+0000","last_peered":"2024-02-15T22:58:17.901912+0000","last_clean":"2024-02-15T22:58:17.901912+0000","last_became_active":"2024-02-15T22:56:05.705173+0000","last_became_peered":"2024-02-15T22:56:05.705173+0000","last_unstale":"2024-02-15T22:58:17.901912+0000","last_undegraded":"2024-02-15T22:58:17.901912+0000","last_fullsized":"2024-02-15T22:58:17.901912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:17.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:17.901806+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:43.081246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371916+0000","last_change":"2024-02-15T22:56:05.704020+0000","last_active":"2024-02-15T22:57:47.371916+0000","last_peered":"2024-02-15T22:57:47.371916+0000","last_clean":"2024-02-15T22:57:47.371916+0000","last_became_active":"2024-02-15T22:56:05.703708+0000","last_became_peered":"2024-02-15T22:56:05.703708+0000","last_unstale":"2024-02-15T22:57:47.371916+0000","last_undegraded":"2024-02-15T22:57:47.371916+0000","last_fullsized":"2024-02-15T22:57:47.371916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880482+0000","last_change":"2024-02-15T22:56:03.697488+0000","last_active":"2024-02-15T22:56:45.880482+0000","last_peered":"2024-02-15T22:56:45.880482+0000","last_clean":"2024-02-15T22:56:45.880482+0000","last_became_active":"2024-02-15T22:56:03.696959+0000","last_became_peered":"2024-02-15T22:56:03.696959+0000","last_unstale":"2024-02-15T22:56:45.880482+0000","last_undegraded":"2024-02-15T22:56:45.880482+0000","last_fullsized":"2024-02-15T22:56:45.880482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.876807+0000","last_change":"2024-02-15T22:58:15.876807+0000","last_active":"2024-02-15T22:58:15.876807+0000","last_peered":"2024-02-15T22:58:15.876807+0000","last_clean":"2024-02-15T22:58:15.876807+0000","last_became_active":"2024-02-15T22:56:05.700071+0000","last_became_peered":"2024-02-15T22:56:05.700071+0000","last_unstale":"2024-02-15T22:58:15.876807+0000","last_undegraded":"2024-02-15T22:58:15.876807+0000","last_fullsized":"2024-02-15T22:58:15.876807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:15.876691+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:15.876691+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.876691+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:07:22.097823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.942780+0000","last_change":"2024-02-15T22:58:22.942805+0000","last_active":"2024-02-15T22:58:22.942780+0000","last_peered":"2024-02-15T22:58:22.942780+0000","last_clean":"2024-02-15T22:58:22.942780+0000","last_became_active":"2024-02-15T22:56:03.699574+0000","last_became_peered":"2024-02-15T22:56:03.699574+0000","last_unstale":"2024-02-15T22:58:22.942780+0000","last_undegraded":"2024-02-15T22:58:22.942780+0000","last_fullsized":"2024-02-15T22:58:22.942780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:22.942683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:22.942683+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.942683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:12:51.398096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.860710+0000","last_change":"2024-02-15T22:58:18.860710+0000","last_active":"2024-02-15T22:58:18.860710+0000","last_peered":"2024-02-15T22:58:18.860710+0000","last_clean":"2024-02-15T22:58:18.860710+0000","last_became_active":"2024-02-15T22:56:05.702488+0000","last_became_peered":"2024-02-15T22:56:05.702488+0000","last_unstale":"2024-02-15T22:58:18.860710+0000","last_undegraded":"2024-02-15T22:58:18.860710+0000","last_fullsized":"2024-02-15T22:58:18.860710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:18.860532+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:18.860532+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.860532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:34:02.415784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.887888+0000","last_change":"2024-02-15T22:56:45.886045+0000","last_active":"2024-02-15T22:56:45.887888+0000","last_peered":"2024-02-15T22:56:45.887888+0000","last_clean":"2024-02-15T22:56:45.887888+0000","last_became_active":"2024-02-15T22:56:45.885555+0000","last_became_peered":"2024-02-15T22:56:45.885555+0000","last_unstale":"2024-02-15T22:56:45.887888+0000","last_undegraded":"2024-02-15T22:56:45.887888+0000","last_fullsized":"2024-02-15T22:56:45.887888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'1","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505769+0000","last_change":"2024-02-15T22:56:05.706693+0000","last_active":"2024-02-15T22:57:29.505769+0000","last_peered":"2024-02-15T22:57:29.505769+0000","last_clean":"2024-02-15T22:57:29.505769+0000","last_became_active":"2024-02-15T22:56:05.705386+0000","last_became_peered":"2024-02-15T22:56:05.705386+0000","last_unstale":"2024-02-15T22:57:29.505769+0000","last_undegraded":"2024-02-15T22:57:29.505769+0000","last_fullsized":"2024-02-15T22:57:29.505769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879873+0000","last_change":"2024-02-15T22:56:03.693697+0000","last_active":"2024-02-15T22:56:45.879873+0000","last_peered":"2024-02-15T22:56:45.879873+0000","last_clean":"2024-02-15T22:56:45.879873+0000","last_became_active":"2024-02-15T22:56:03.693329+0000","last_became_peered":"2024-02-15T22:56:03.693329+0000","last_unstale":"2024-02-15T22:56:45.879873+0000","last_undegraded":"2024-02-15T22:56:45.879873+0000","last_fullsized":"2024-02-15T22:56:45.879873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.936255+0000","last_change":"2024-02-15T22:58:15.936285+0000","last_active":"2024-02-15T22:58:15.936255+0000","last_peered":"2024-02-15T22:58:15.936255+0000","last_clean":"2024-02-15T22:58:15.936255+0000","last_became_active":"2024-02-15T22:56:05.704729+0000","last_became_peered":"2024-02-15T22:56:05.704729+0000","last_unstale":"2024-02-15T22:58:15.936255+0000","last_undegraded":"2024-02-15T22:58:15.936255+0000","last_fullsized":"2024-02-15T22:58:15.936255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:15.936168+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:15.936168+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.936168+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:39:13.873642+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880463+0000","last_change":"2024-02-15T22:56:03.704183+0000","last_active":"2024-02-15T22:56:45.880463+0000","last_peered":"2024-02-15T22:56:45.880463+0000","last_clean":"2024-02-15T22:56:45.880463+0000","last_became_active":"2024-02-15T22:56:03.703885+0000","last_became_peered":"2024-02-15T22:56:03.703885+0000","last_unstale":"2024-02-15T22:56:45.880463+0000","last_undegraded":"2024-02-15T22:56:45.880463+0000","last_fullsized":"2024-02-15T22:56:45.880463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.872412+0000","last_change":"2024-02-15T22:58:17.872443+0000","last_active":"2024-02-15T22:58:17.872412+0000","last_peered":"2024-02-15T22:58:17.872412+0000","last_clean":"2024-02-15T22:58:17.872412+0000","last_became_active":"2024-02-15T22:56:05.698553+0000","last_became_peered":"2024-02-15T22:56:05.698553+0000","last_unstale":"2024-02-15T22:58:17.872412+0000","last_undegraded":"2024-02-15T22:58:17.872412+0000","last_fullsized":"2024-02-15T22:58:17.872412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:17.872326+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:17.872326+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.872326+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:41.035527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371519+0000","last_change":"2024-02-15T22:56:03.702268+0000","last_active":"2024-02-15T22:57:47.371519+0000","last_peered":"2024-02-15T22:57:47.371519+0000","last_clean":"2024-02-15T22:57:47.371519+0000","last_became_active":"2024-02-15T22:56:03.701819+0000","last_became_peered":"2024-02-15T22:56:03.701819+0000","last_unstale":"2024-02-15T22:57:47.371519+0000","last_undegraded":"2024-02-15T22:57:47.371519+0000","last_fullsized":"2024-02-15T22:57:47.371519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.408889+0000","last_change":"2024-02-15T22:56:13.731342+0000","last_active":"2024-02-15T22:57:35.408889+0000","last_peered":"2024-02-15T22:57:35.408889+0000","last_clean":"2024-02-15T22:57:35.408889+0000","last_became_active":"2024-02-15T22:56:13.730499+0000","last_became_peered":"2024-02-15T22:56:13.730499+0000","last_unstale":"2024-02-15T22:57:35.408889+0000","last_undegraded":"2024-02-15T22:57:35.408889+0000","last_fullsized":"2024-02-15T22:57:35.408889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371741+0000","last_change":"2024-02-15T22:56:05.700054+0000","last_active":"2024-02-15T22:57:47.371741+0000","last_peered":"2024-02-15T22:57:47.371741+0000","last_clean":"2024-02-15T22:57:47.371741+0000","last_became_active":"2024-02-15T22:56:05.699821+0000","last_became_peered":"2024-02-15T22:56:05.699821+0000","last_unstale":"2024-02-15T22:57:47.371741+0000","last_undegraded":"2024-02-15T22:57:47.371741+0000","last_fullsized":"2024-02-15T22:57:47.371741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371412+0000","last_change":"2024-02-15T22:56:03.706199+0000","last_active":"2024-02-15T22:57:47.371412+0000","last_peered":"2024-02-15T22:57:47.371412+0000","last_clean":"2024-02-15T22:57:47.371412+0000","last_became_active":"2024-02-15T22:56:03.705881+0000","last_became_peered":"2024-02-15T22:56:03.705881+0000","last_unstale":"2024-02-15T22:57:47.371412+0000","last_undegraded":"2024-02-15T22:57:47.371412+0000","last_fullsized":"2024-02-15T22:57:47.371412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.895502+0000","last_change":"2024-02-15T22:56:45.893437+0000","last_active":"2024-02-15T22:56:45.895502+0000","last_peered":"2024-02-15T22:56:45.895502+0000","last_clean":"2024-02-15T22:56:45.895502+0000","last_became_active":"2024-02-15T22:56:45.893067+0000","last_became_peered":"2024-02-15T22:56:45.893067+0000","last_unstale":"2024-02-15T22:56:45.895502+0000","last_undegraded":"2024-02-15T22:56:45.895502+0000","last_fullsized":"2024-02-15T22:56:45.895502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.887502+0000","last_change":"2024-02-15T22:57:48.887564+0000","last_active":"2024-02-15T22:57:48.887502+0000","last_peered":"2024-02-15T22:57:48.887502+0000","last_clean":"2024-02-15T22:57:48.887502+0000","last_became_active":"2024-02-15T22:56:09.714201+0000","last_became_peered":"2024-02-15T22:56:09.714201+0000","last_unstale":"2024-02-15T22:57:48.887502+0000","last_undegraded":"2024-02-15T22:57:48.887502+0000","last_fullsized":"2024-02-15T22:57:48.887502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:48.887402+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:48.887402+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.887402+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:20.076360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.920874+0000","last_change":"2024-02-15T22:57:56.920914+0000","last_active":"2024-02-15T22:57:56.920874+0000","last_peered":"2024-02-15T22:57:56.920874+0000","last_clean":"2024-02-15T22:57:56.920874+0000","last_became_active":"2024-02-15T22:56:11.722257+0000","last_became_peered":"2024-02-15T22:56:11.722257+0000","last_unstale":"2024-02-15T22:57:56.920874+0000","last_undegraded":"2024-02-15T22:57:56.920874+0000","last_fullsized":"2024-02-15T22:57:56.920874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.920756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.920756+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.920756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:24:37.182344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.844489+0000","last_change":"2024-02-15T22:58:08.844517+0000","last_active":"2024-02-15T22:58:08.844489+0000","last_peered":"2024-02-15T22:58:08.844489+0000","last_clean":"2024-02-15T22:58:08.844489+0000","last_became_active":"2024-02-15T22:56:13.729067+0000","last_became_peered":"2024-02-15T22:56:13.729067+0000","last_unstale":"2024-02-15T22:58:08.844489+0000","last_undegraded":"2024-02-15T22:58:08.844489+0000","last_fullsized":"2024-02-15T22:58:08.844489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-02-15T22:58:08.844397+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-02-15T22:58:08.844397+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.844397+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:59.059018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.151049+0000","last_change":"2024-02-15T22:58:23.151094+0000","last_active":"2024-02-15T22:58:23.151049+0000","last_peered":"2024-02-15T22:58:23.151049+0000","last_clean":"2024-02-15T22:58:23.151049+0000","last_became_active":"2024-02-15T22:56:05.709632+0000","last_became_peered":"2024-02-15T22:56:05.709632+0000","last_unstale":"2024-02-15T22:58:23.151049+0000","last_undegraded":"2024-02-15T22:58:23.151049+0000","last_fullsized":"2024-02-15T22:58:23.151049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:23.150930+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:23.150930+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.150930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:00:49.803296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.930624+0000","last_change":"2024-02-15T22:56:03.699568+0000","last_active":"2024-02-15T22:57:46.930624+0000","last_peered":"2024-02-15T22:57:46.930624+0000","last_clean":"2024-02-15T22:57:46.930624+0000","last_became_active":"2024-02-15T22:56:03.699250+0000","last_became_peered":"2024-02-15T22:56:03.699250+0000","last_unstale":"2024-02-15T22:57:46.930624+0000","last_undegraded":"2024-02-15T22:57:46.930624+0000","last_fullsized":"2024-02-15T22:57:46.930624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.213680+0000","last_change":"2024-02-15T22:58:09.213704+0000","last_active":"2024-02-15T22:58:09.213680+0000","last_peered":"2024-02-15T22:58:09.213680+0000","last_clean":"2024-02-15T22:58:09.213680+0000","last_became_active":"2024-02-15T22:56:07.705828+0000","last_became_peered":"2024-02-15T22:56:07.705828+0000","last_unstale":"2024-02-15T22:58:09.213680+0000","last_undegraded":"2024-02-15T22:58:09.213680+0000","last_fullsized":"2024-02-15T22:58:09.213680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:09.213585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:09.213585+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.213585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:09.634712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.924856+0000","last_change":"2024-02-15T22:57:55.924930+0000","last_active":"2024-02-15T22:57:55.924856+0000","last_peered":"2024-02-15T22:57:55.924856+0000","last_clean":"2024-02-15T22:57:55.924856+0000","last_became_active":"2024-02-15T22:56:09.712812+0000","last_became_peered":"2024-02-15T22:56:09.712812+0000","last_unstale":"2024-02-15T22:57:55.924856+0000","last_undegraded":"2024-02-15T22:57:55.924856+0000","last_fullsized":"2024-02-15T22:57:55.924856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-15T22:57:55.924760+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-15T22:57:55.924760+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.924760+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:30.496577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.900609+0000","last_change":"2024-02-15T22:57:52.900635+0000","last_active":"2024-02-15T22:57:52.900609+0000","last_peered":"2024-02-15T22:57:52.900609+0000","last_clean":"2024-02-15T22:57:52.900609+0000","last_became_active":"2024-02-15T22:56:11.721486+0000","last_became_peered":"2024-02-15T22:56:11.721486+0000","last_unstale":"2024-02-15T22:57:52.900609+0000","last_undegraded":"2024-02-15T22:57:52.900609+0000","last_fullsized":"2024-02-15T22:57:52.900609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.900511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.900511+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.900511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:44.599545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879190+0000","last_change":"2024-02-15T22:56:13.734756+0000","last_active":"2024-02-15T22:56:45.879190+0000","last_peered":"2024-02-15T22:56:45.879190+0000","last_clean":"2024-02-15T22:56:45.879190+0000","last_became_active":"2024-02-15T22:56:13.734418+0000","last_became_peered":"2024-02-15T22:56:13.734418+0000","last_unstale":"2024-02-15T22:56:45.879190+0000","last_undegraded":"2024-02-15T22:56:45.879190+0000","last_fullsized":"2024-02-15T22:56:45.879190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:35.398933+0000","last_change":"2024-02-15T22:56:05.700314+0000","last_active":"2024-02-15T22:57:35.398933+0000","last_peered":"2024-02-15T22:57:35.398933+0000","last_clean":"2024-02-15T22:57:35.398933+0000","last_became_active":"2024-02-15T22:56:05.699398+0000","last_became_peered":"2024-02-15T22:56:05.699398+0000","last_unstale":"2024-02-15T22:57:35.398933+0000","last_undegraded":"2024-02-15T22:57:35.398933+0000","last_fullsized":"2024-02-15T22:57:35.398933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371457+0000","last_change":"2024-02-15T22:56:03.707100+0000","last_active":"2024-02-15T22:57:47.371457+0000","last_peered":"2024-02-15T22:57:47.371457+0000","last_clean":"2024-02-15T22:57:47.371457+0000","last_became_active":"2024-02-15T22:56:03.706818+0000","last_became_peered":"2024-02-15T22:56:03.706818+0000","last_unstale":"2024-02-15T22:57:47.371457+0000","last_undegraded":"2024-02-15T22:57:47.371457+0000","last_fullsized":"2024-02-15T22:57:47.371457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.225462+0000","last_change":"2024-02-15T22:58:14.225506+0000","last_active":"2024-02-15T22:58:14.225462+0000","last_peered":"2024-02-15T22:58:14.225462+0000","last_clean":"2024-02-15T22:58:14.225462+0000","last_became_active":"2024-02-15T22:56:07.704168+0000","last_became_peered":"2024-02-15T22:56:07.704168+0000","last_unstale":"2024-02-15T22:58:14.225462+0000","last_undegraded":"2024-02-15T22:58:14.225462+0000","last_fullsized":"2024-02-15T22:58:14.225462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:14.225364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:14.225364+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.225364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:37.388564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.998935+0000","last_change":"2024-02-15T22:57:54.998999+0000","last_active":"2024-02-15T22:57:54.998935+0000","last_peered":"2024-02-15T22:57:54.998935+0000","last_clean":"2024-02-15T22:57:54.998935+0000","last_became_active":"2024-02-15T22:56:09.718326+0000","last_became_peered":"2024-02-15T22:56:09.718326+0000","last_unstale":"2024-02-15T22:57:54.998935+0000","last_undegraded":"2024-02-15T22:57:54.998935+0000","last_fullsized":"2024-02-15T22:57:54.998935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:57:54.998836+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:57:54.998836+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.998836+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:33:48.011800+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":314,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.156323+0000","last_change":"2024-02-15T22:58:21.156370+0000","last_active":"2024-02-15T22:58:21.156323+0000","last_peered":"2024-02-15T22:58:21.156323+0000","last_clean":"2024-02-15T22:58:21.156323+0000","last_became_active":"2024-02-15T22:56:11.724138+0000","last_became_peered":"2024-02-15T22:56:11.724138+0000","last_unstale":"2024-02-15T22:58:21.156323+0000","last_undegraded":"2024-02-15T22:58:21.156323+0000","last_fullsized":"2024-02-15T22:58:21.156323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-02-15T22:58:21.156191+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-02-15T22:58:21.156191+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.156191+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:39:40.871645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882352+0000","last_change":"2024-02-15T22:56:13.733123+0000","last_active":"2024-02-15T22:56:45.882352+0000","last_peered":"2024-02-15T22:56:45.882352+0000","last_clean":"2024-02-15T22:56:45.882352+0000","last_became_active":"2024-02-15T22:56:13.732762+0000","last_became_peered":"2024-02-15T22:56:13.732762+0000","last_unstale":"2024-02-15T22:56:45.882352+0000","last_undegraded":"2024-02-15T22:56:45.882352+0000","last_fullsized":"2024-02-15T22:56:45.882352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.294964+0000","last_change":"2024-02-15T22:58:22.295013+0000","last_active":"2024-02-15T22:58:22.294964+0000","last_peered":"2024-02-15T22:58:22.294964+0000","last_clean":"2024-02-15T22:58:22.294964+0000","last_became_active":"2024-02-15T22:56:05.705360+0000","last_became_peered":"2024-02-15T22:56:05.705360+0000","last_unstale":"2024-02-15T22:58:22.294964+0000","last_undegraded":"2024-02-15T22:58:22.294964+0000","last_fullsized":"2024-02-15T22:58:22.294964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:22.294850+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:22.294850+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.294850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:21:05.771908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491275+0000","last_change":"2024-02-15T22:56:03.698653+0000","last_active":"2024-02-15T22:57:46.491275+0000","last_peered":"2024-02-15T22:57:46.491275+0000","last_clean":"2024-02-15T22:57:46.491275+0000","last_became_active":"2024-02-15T22:56:03.698225+0000","last_became_peered":"2024-02-15T22:56:03.698225+0000","last_unstale":"2024-02-15T22:57:46.491275+0000","last_undegraded":"2024-02-15T22:57:46.491275+0000","last_fullsized":"2024-02-15T22:57:46.491275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.851903+0000","last_change":"2024-02-15T22:57:47.851925+0000","last_active":"2024-02-15T22:57:47.851903+0000","last_peered":"2024-02-15T22:57:47.851903+0000","last_clean":"2024-02-15T22:57:47.851903+0000","last_became_active":"2024-02-15T22:56:07.709236+0000","last_became_peered":"2024-02-15T22:56:07.709236+0000","last_unstale":"2024-02-15T22:57:47.851903+0000","last_undegraded":"2024-02-15T22:57:47.851903+0000","last_fullsized":"2024-02-15T22:57:47.851903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.851815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.851815+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.851815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:42.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.002972+0000","last_change":"2024-02-15T22:57:53.003016+0000","last_active":"2024-02-15T22:57:53.002972+0000","last_peered":"2024-02-15T22:57:53.002972+0000","last_clean":"2024-02-15T22:57:53.002972+0000","last_became_active":"2024-02-15T22:56:09.729556+0000","last_became_peered":"2024-02-15T22:56:09.729556+0000","last_unstale":"2024-02-15T22:57:53.002972+0000","last_undegraded":"2024-02-15T22:57:53.002972+0000","last_fullsized":"2024-02-15T22:57:53.002972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:53.002893+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:53.002893+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.002893+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:27:11.902505+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":341,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.310087+0000","last_change":"2024-02-15T22:57:53.310138+0000","last_active":"2024-02-15T22:57:53.310087+0000","last_peered":"2024-02-15T22:57:53.310087+0000","last_clean":"2024-02-15T22:57:53.310087+0000","last_became_active":"2024-02-15T22:56:11.719588+0000","last_became_peered":"2024-02-15T22:56:11.719588+0000","last_unstale":"2024-02-15T22:57:53.310087+0000","last_undegraded":"2024-02-15T22:57:53.310087+0000","last_fullsized":"2024-02-15T22:57:53.310087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:53.309962+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:53.309962+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.309962+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:05.319309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.137427+0000","last_change":"2024-02-15T22:58:07.137427+0000","last_active":"2024-02-15T22:58:07.137427+0000","last_peered":"2024-02-15T22:58:07.137427+0000","last_clean":"2024-02-15T22:58:07.137427+0000","last_became_active":"2024-02-15T22:56:05.710578+0000","last_became_peered":"2024-02-15T22:56:05.710578+0000","last_unstale":"2024-02-15T22:58:07.137427+0000","last_undegraded":"2024-02-15T22:58:07.137427+0000","last_fullsized":"2024-02-15T22:58:07.137427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.137300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.137300+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.137300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:02:26.024097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.890089+0000","last_change":"2024-02-15T22:58:14.890089+0000","last_active":"2024-02-15T22:58:14.890089+0000","last_peered":"2024-02-15T22:58:14.890089+0000","last_clean":"2024-02-15T22:58:14.890089+0000","last_became_active":"2024-02-15T22:56:03.702187+0000","last_became_peered":"2024-02-15T22:56:03.702187+0000","last_unstale":"2024-02-15T22:58:14.890089+0000","last_undegraded":"2024-02-15T22:58:14.890089+0000","last_fullsized":"2024-02-15T22:58:14.890089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:14.889959+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:14.889959+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.889959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:33.400014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.884933+0000","last_change":"2024-02-15T22:57:59.884933+0000","last_active":"2024-02-15T22:57:59.884933+0000","last_peered":"2024-02-15T22:57:59.884933+0000","last_clean":"2024-02-15T22:57:59.884933+0000","last_became_active":"2024-02-15T22:56:07.707328+0000","last_became_peered":"2024-02-15T22:56:07.707328+0000","last_unstale":"2024-02-15T22:57:59.884933+0000","last_undegraded":"2024-02-15T22:57:59.884933+0000","last_fullsized":"2024-02-15T22:57:59.884933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:59.884790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:59.884790+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.884790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:05.894308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.000916+0000","last_change":"2024-02-15T22:57:57.000916+0000","last_active":"2024-02-15T22:57:57.000916+0000","last_peered":"2024-02-15T22:57:57.000916+0000","last_clean":"2024-02-15T22:57:57.000916+0000","last_became_active":"2024-02-15T22:56:09.715019+0000","last_became_peered":"2024-02-15T22:56:09.715019+0000","last_unstale":"2024-02-15T22:57:57.000916+0000","last_undegraded":"2024-02-15T22:57:57.000916+0000","last_fullsized":"2024-02-15T22:57:57.000916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-15T22:57:57.000759+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-15T22:57:57.000759+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.000759+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:45:12.812634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.357116+0000","last_change":"2024-02-15T22:57:50.357140+0000","last_active":"2024-02-15T22:57:50.357116+0000","last_peered":"2024-02-15T22:57:50.357116+0000","last_clean":"2024-02-15T22:57:50.357116+0000","last_became_active":"2024-02-15T22:56:11.719845+0000","last_became_peered":"2024-02-15T22:56:11.719845+0000","last_unstale":"2024-02-15T22:57:50.357116+0000","last_undegraded":"2024-02-15T22:57:50.357116+0000","last_fullsized":"2024-02-15T22:57:50.357116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.357021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.357021+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.357021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:06.000871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.931536+0000","last_change":"2024-02-15T22:56:13.732667+0000","last_active":"2024-02-15T22:57:46.931536+0000","last_peered":"2024-02-15T22:57:46.931536+0000","last_clean":"2024-02-15T22:57:46.931536+0000","last_became_active":"2024-02-15T22:56:13.732321+0000","last_became_peered":"2024-02-15T22:56:13.732321+0000","last_unstale":"2024-02-15T22:57:46.931536+0000","last_undegraded":"2024-02-15T22:57:46.931536+0000","last_fullsized":"2024-02-15T22:57:46.931536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.868943+0000","last_change":"2024-02-15T22:58:19.869033+0000","last_active":"2024-02-15T22:58:19.868943+0000","last_peered":"2024-02-15T22:58:19.868943+0000","last_clean":"2024-02-15T22:58:19.868943+0000","last_became_active":"2024-02-15T22:56:05.697834+0000","last_became_peered":"2024-02-15T22:56:05.697834+0000","last_unstale":"2024-02-15T22:58:19.868943+0000","last_undegraded":"2024-02-15T22:58:19.868943+0000","last_fullsized":"2024-02-15T22:58:19.868943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:19.868817+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:19.868817+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.868817+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:50.766383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.855300+0000","last_change":"2024-02-15T22:58:12.855300+0000","last_active":"2024-02-15T22:58:12.855300+0000","last_peered":"2024-02-15T22:58:12.855300+0000","last_clean":"2024-02-15T22:58:12.855300+0000","last_became_active":"2024-02-15T22:56:03.702353+0000","last_became_peered":"2024-02-15T22:56:03.702353+0000","last_unstale":"2024-02-15T22:58:12.855300+0000","last_undegraded":"2024-02-15T22:58:12.855300+0000","last_fullsized":"2024-02-15T22:58:12.855300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.855162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.855162+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.855162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:40.679343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.208925+0000","last_change":"2024-02-15T22:58:07.208925+0000","last_active":"2024-02-15T22:58:07.208925+0000","last_peered":"2024-02-15T22:58:07.208925+0000","last_clean":"2024-02-15T22:58:07.208925+0000","last_became_active":"2024-02-15T22:56:07.706656+0000","last_became_peered":"2024-02-15T22:56:07.706656+0000","last_unstale":"2024-02-15T22:58:07.208925+0000","last_undegraded":"2024-02-15T22:58:07.208925+0000","last_fullsized":"2024-02-15T22:58:07.208925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.208777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.208777+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.208777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:31.806933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.993269+0000","last_change":"2024-02-15T22:57:52.993269+0000","last_active":"2024-02-15T22:57:52.993269+0000","last_peered":"2024-02-15T22:57:52.993269+0000","last_clean":"2024-02-15T22:57:52.993269+0000","last_became_active":"2024-02-15T22:56:09.716138+0000","last_became_peered":"2024-02-15T22:56:09.716138+0000","last_unstale":"2024-02-15T22:57:52.993269+0000","last_undegraded":"2024-02-15T22:57:52.993269+0000","last_fullsized":"2024-02-15T22:57:52.993269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:52.993117+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:52.993117+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.993117+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:16.156318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.238737+0000","last_change":"2024-02-15T22:58:04.238737+0000","last_active":"2024-02-15T22:58:04.238737+0000","last_peered":"2024-02-15T22:58:04.238737+0000","last_clean":"2024-02-15T22:58:04.238737+0000","last_became_active":"2024-02-15T22:56:11.724317+0000","last_became_peered":"2024-02-15T22:56:11.724317+0000","last_unstale":"2024-02-15T22:58:04.238737+0000","last_undegraded":"2024-02-15T22:58:04.238737+0000","last_fullsized":"2024-02-15T22:58:04.238737+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:04.238614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:04.238614+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.238614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:27.604291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.492389+0000","last_change":"2024-02-15T22:56:13.733414+0000","last_active":"2024-02-15T22:57:46.492389+0000","last_peered":"2024-02-15T22:57:46.492389+0000","last_clean":"2024-02-15T22:57:46.492389+0000","last_became_active":"2024-02-15T22:56:13.733118+0000","last_became_peered":"2024-02-15T22:56:13.733118+0000","last_unstale":"2024-02-15T22:57:46.492389+0000","last_undegraded":"2024-02-15T22:57:46.492389+0000","last_fullsized":"2024-02-15T22:57:46.492389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'20","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.930812+0000","last_change":"2024-02-15T22:56:45.891684+0000","last_active":"2024-02-15T22:57:46.930812+0000","last_peered":"2024-02-15T22:57:46.930812+0000","last_clean":"2024-02-15T22:57:46.930812+0000","last_became_active":"2024-02-15T22:56:45.886248+0000","last_became_peered":"2024-02-15T22:56:45.886248+0000","last_unstale":"2024-02-15T22:57:46.930812+0000","last_undegraded":"2024-02-15T22:57:46.930812+0000","last_fullsized":"2024-02-15T22:57:46.930812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371408+0000","last_change":"2024-02-15T22:56:03.700436+0000","last_active":"2024-02-15T22:57:47.371408+0000","last_peered":"2024-02-15T22:57:47.371408+0000","last_clean":"2024-02-15T22:57:47.371408+0000","last_became_active":"2024-02-15T22:56:03.700087+0000","last_became_peered":"2024-02-15T22:56:03.700087+0000","last_unstale":"2024-02-15T22:57:47.371408+0000","last_undegraded":"2024-02-15T22:57:47.371408+0000","last_fullsized":"2024-02-15T22:57:47.371408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.176919+0000","last_change":"2024-02-15T22:58:10.176919+0000","last_active":"2024-02-15T22:58:10.176919+0000","last_peered":"2024-02-15T22:58:10.176919+0000","last_clean":"2024-02-15T22:58:10.176919+0000","last_became_active":"2024-02-15T22:56:07.704502+0000","last_became_peered":"2024-02-15T22:56:07.704502+0000","last_unstale":"2024-02-15T22:58:10.176919+0000","last_undegraded":"2024-02-15T22:58:10.176919+0000","last_fullsized":"2024-02-15T22:58:10.176919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:10.176806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:10.176806+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.176806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:13.375626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'44","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.182521+0000","last_change":"2024-02-15T22:58:22.182562+0000","last_active":"2024-02-15T22:58:22.182521+0000","last_peered":"2024-02-15T22:58:22.182521+0000","last_clean":"2024-02-15T22:58:22.182521+0000","last_became_active":"2024-02-15T22:56:09.717174+0000","last_became_peered":"2024-02-15T22:56:09.717174+0000","last_unstale":"2024-02-15T22:58:22.182521+0000","last_undegraded":"2024-02-15T22:58:22.182521+0000","last_fullsized":"2024-02-15T22:58:22.182521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:58:22.182437+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:58:22.182437+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.182437+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:01.680145+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":313,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.299547+0000","last_change":"2024-02-15T22:58:00.299547+0000","last_active":"2024-02-15T22:58:00.299547+0000","last_peered":"2024-02-15T22:58:00.299547+0000","last_clean":"2024-02-15T22:58:00.299547+0000","last_became_active":"2024-02-15T22:56:11.724273+0000","last_became_peered":"2024-02-15T22:56:11.724273+0000","last_unstale":"2024-02-15T22:58:00.299547+0000","last_undegraded":"2024-02-15T22:58:00.299547+0000","last_fullsized":"2024-02-15T22:58:00.299547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:58:00.299415+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:58:00.299415+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.299415+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:33.226403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.241434+0000","last_change":"2024-02-15T22:58:12.241434+0000","last_active":"2024-02-15T22:58:12.241434+0000","last_peered":"2024-02-15T22:58:12.241434+0000","last_clean":"2024-02-15T22:58:12.241434+0000","last_became_active":"2024-02-15T22:56:13.726858+0000","last_became_peered":"2024-02-15T22:56:13.726858+0000","last_unstale":"2024-02-15T22:58:12.241434+0000","last_undegraded":"2024-02-15T22:58:12.241434+0000","last_fullsized":"2024-02-15T22:58:12.241434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.241315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.241315+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.241315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:07:18.462448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.889358+0000","last_change":"2024-02-15T22:58:13.889358+0000","last_active":"2024-02-15T22:58:13.889358+0000","last_peered":"2024-02-15T22:58:13.889358+0000","last_clean":"2024-02-15T22:58:13.889358+0000","last_became_active":"2024-02-15T22:56:05.701568+0000","last_became_peered":"2024-02-15T22:56:05.701568+0000","last_unstale":"2024-02-15T22:58:13.889358+0000","last_undegraded":"2024-02-15T22:58:13.889358+0000","last_fullsized":"2024-02-15T22:58:13.889358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:13.889250+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:13.889250+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.889250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:22.586047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371304+0000","last_change":"2024-02-15T22:56:03.695726+0000","last_active":"2024-02-15T22:57:47.371304+0000","last_peered":"2024-02-15T22:57:47.371304+0000","last_clean":"2024-02-15T22:57:47.371304+0000","last_became_active":"2024-02-15T22:56:03.694668+0000","last_became_peered":"2024-02-15T22:56:03.694668+0000","last_unstale":"2024-02-15T22:57:47.371304+0000","last_undegraded":"2024-02-15T22:57:47.371304+0000","last_fullsized":"2024-02-15T22:57:47.371304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.212958+0000","last_change":"2024-02-15T22:58:13.212958+0000","last_active":"2024-02-15T22:58:13.212958+0000","last_peered":"2024-02-15T22:58:13.212958+0000","last_clean":"2024-02-15T22:58:13.212958+0000","last_became_active":"2024-02-15T22:56:07.704054+0000","last_became_peered":"2024-02-15T22:56:07.704054+0000","last_unstale":"2024-02-15T22:58:13.212958+0000","last_undegraded":"2024-02-15T22:58:13.212958+0000","last_fullsized":"2024-02-15T22:58:13.212958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:13.212847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:13.212847+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.212847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:27.614478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.173318+0000","last_change":"2024-02-15T22:58:09.173318+0000","last_active":"2024-02-15T22:58:09.173318+0000","last_peered":"2024-02-15T22:58:09.173318+0000","last_clean":"2024-02-15T22:58:09.173318+0000","last_became_active":"2024-02-15T22:56:09.717264+0000","last_became_peered":"2024-02-15T22:56:09.717264+0000","last_unstale":"2024-02-15T22:58:09.173318+0000","last_undegraded":"2024-02-15T22:58:09.173318+0000","last_fullsized":"2024-02-15T22:58:09.173318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-15T22:58:09.173193+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-15T22:58:09.173193+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.173193+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:35:38.023140+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.388857+0000","last_change":"2024-02-15T22:57:49.388857+0000","last_active":"2024-02-15T22:57:49.388857+0000","last_peered":"2024-02-15T22:57:49.388857+0000","last_clean":"2024-02-15T22:57:49.388857+0000","last_became_active":"2024-02-15T22:56:11.720616+0000","last_became_peered":"2024-02-15T22:56:11.720616+0000","last_unstale":"2024-02-15T22:57:49.388857+0000","last_undegraded":"2024-02-15T22:57:49.388857+0000","last_fullsized":"2024-02-15T22:57:49.388857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.388740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.388740+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.388740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:41.087774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.231314+0000","last_change":"2024-02-15T22:58:16.231314+0000","last_active":"2024-02-15T22:58:16.231314+0000","last_peered":"2024-02-15T22:58:16.231314+0000","last_clean":"2024-02-15T22:58:16.231314+0000","last_became_active":"2024-02-15T22:56:13.729015+0000","last_became_peered":"2024-02-15T22:56:13.729015+0000","last_unstale":"2024-02-15T22:58:16.231314+0000","last_undegraded":"2024-02-15T22:58:16.231314+0000","last_fullsized":"2024-02-15T22:58:16.231314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:16.231166+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:16.231166+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.231166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:47.128732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:49.868551+0000","last_change":"2024-02-15T22:56:45.898518+0000","last_active":"2024-02-15T22:56:49.868551+0000","last_peered":"2024-02-15T22:56:49.868551+0000","last_clean":"2024-02-15T22:56:49.868551+0000","last_became_active":"2024-02-15T22:56:45.893017+0000","last_became_peered":"2024-02-15T22:56:45.893017+0000","last_unstale":"2024-02-15T22:56:49.868551+0000","last_undegraded":"2024-02-15T22:56:49.868551+0000","last_fullsized":"2024-02-15T22:56:49.868551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053369+0000","last_change":"2024-02-15T22:56:45.886880+0000","last_active":"2024-02-15T22:57:46.053369+0000","last_peered":"2024-02-15T22:57:46.053369+0000","last_clean":"2024-02-15T22:57:46.053369+0000","last_became_active":"2024-02-15T22:56:45.886530+0000","last_became_peered":"2024-02-15T22:56:45.886530+0000","last_unstale":"2024-02-15T22:57:46.053369+0000","last_undegraded":"2024-02-15T22:57:46.053369+0000","last_fullsized":"2024-02-15T22:57:46.053369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.012863+0000","last_change":"2024-02-15T22:58:03.012863+0000","last_active":"2024-02-15T22:58:03.012863+0000","last_peered":"2024-02-15T22:58:03.012863+0000","last_clean":"2024-02-15T22:58:03.012863+0000","last_became_active":"2024-02-15T22:56:07.707207+0000","last_became_peered":"2024-02-15T22:56:07.707207+0000","last_unstale":"2024-02-15T22:58:03.012863+0000","last_undegraded":"2024-02-15T22:58:03.012863+0000","last_fullsized":"2024-02-15T22:58:03.012863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:03.012756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:03.012756+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.012756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:24.662100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.911848+0000","last_change":"2024-02-15T22:57:51.911848+0000","last_active":"2024-02-15T22:57:51.911848+0000","last_peered":"2024-02-15T22:57:51.911848+0000","last_clean":"2024-02-15T22:57:51.911848+0000","last_became_active":"2024-02-15T22:56:09.714592+0000","last_became_peered":"2024-02-15T22:56:09.714592+0000","last_unstale":"2024-02-15T22:57:51.911848+0000","last_undegraded":"2024-02-15T22:57:51.911848+0000","last_fullsized":"2024-02-15T22:57:51.911848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-15T22:57:51.911723+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-15T22:57:51.911723+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.911723+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:55.109902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.119596+0000","last_change":"2024-02-15T22:58:15.119618+0000","last_active":"2024-02-15T22:58:15.119596+0000","last_peered":"2024-02-15T22:58:15.119596+0000","last_clean":"2024-02-15T22:58:15.119596+0000","last_became_active":"2024-02-15T22:56:11.723557+0000","last_became_peered":"2024-02-15T22:56:11.723557+0000","last_unstale":"2024-02-15T22:58:15.119596+0000","last_undegraded":"2024-02-15T22:58:15.119596+0000","last_fullsized":"2024-02-15T22:58:15.119596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:15.119498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:15.119498+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.119498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:26.132469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372516+0000","last_change":"2024-02-15T22:56:13.727205+0000","last_active":"2024-02-15T22:57:47.372516+0000","last_peered":"2024-02-15T22:57:47.372516+0000","last_clean":"2024-02-15T22:57:47.372516+0000","last_became_active":"2024-02-15T22:56:13.726586+0000","last_became_peered":"2024-02-15T22:56:13.726586+0000","last_unstale":"2024-02-15T22:57:47.372516+0000","last_undegraded":"2024-02-15T22:57:47.372516+0000","last_fullsized":"2024-02-15T22:57:47.372516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.049602+0000","last_change":"2024-02-15T22:57:59.049602+0000","last_active":"2024-02-15T22:57:59.049602+0000","last_peered":"2024-02-15T22:57:59.049602+0000","last_clean":"2024-02-15T22:57:59.049602+0000","last_became_active":"2024-02-15T22:56:05.716590+0000","last_became_peered":"2024-02-15T22:56:05.716590+0000","last_unstale":"2024-02-15T22:57:59.049602+0000","last_undegraded":"2024-02-15T22:57:59.049602+0000","last_fullsized":"2024-02-15T22:57:59.049602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-15T22:57:59.049477+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-15T22:57:59.049477+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.049477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:05.045262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371318+0000","last_change":"2024-02-15T22:56:03.703244+0000","last_active":"2024-02-15T22:57:47.371318+0000","last_peered":"2024-02-15T22:57:47.371318+0000","last_clean":"2024-02-15T22:57:47.371318+0000","last_became_active":"2024-02-15T22:56:03.702875+0000","last_became_peered":"2024-02-15T22:56:03.702875+0000","last_unstale":"2024-02-15T22:57:47.371318+0000","last_undegraded":"2024-02-15T22:57:47.371318+0000","last_fullsized":"2024-02-15T22:57:47.371318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.194271+0000","last_change":"2024-02-15T22:58:11.194271+0000","last_active":"2024-02-15T22:58:11.194271+0000","last_peered":"2024-02-15T22:58:11.194271+0000","last_clean":"2024-02-15T22:58:11.194271+0000","last_became_active":"2024-02-15T22:56:07.704058+0000","last_became_peered":"2024-02-15T22:56:07.704058+0000","last_unstale":"2024-02-15T22:58:11.194271+0000","last_undegraded":"2024-02-15T22:58:11.194271+0000","last_fullsized":"2024-02-15T22:58:11.194271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.194159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.194159+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.194159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:19:30.005727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'44","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.970287+0000","last_change":"2024-02-15T22:57:57.970287+0000","last_active":"2024-02-15T22:57:57.970287+0000","last_peered":"2024-02-15T22:57:57.970287+0000","last_clean":"2024-02-15T22:57:57.970287+0000","last_became_active":"2024-02-15T22:56:09.712113+0000","last_became_peered":"2024-02-15T22:56:09.712113+0000","last_unstale":"2024-02-15T22:57:57.970287+0000","last_undegraded":"2024-02-15T22:57:57.970287+0000","last_fullsized":"2024-02-15T22:57:57.970287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:57:57.970127+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:57:57.970127+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.970127+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:59.472492+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":343,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.871395+0000","last_change":"2024-02-15T22:57:47.871443+0000","last_active":"2024-02-15T22:57:47.871395+0000","last_peered":"2024-02-15T22:57:47.871395+0000","last_clean":"2024-02-15T22:57:47.871395+0000","last_became_active":"2024-02-15T22:56:11.720390+0000","last_became_peered":"2024-02-15T22:56:11.720390+0000","last_unstale":"2024-02-15T22:57:47.871395+0000","last_undegraded":"2024-02-15T22:57:47.871395+0000","last_fullsized":"2024-02-15T22:57:47.871395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:47.871285+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:47.871285+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.871285+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:51.713747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.054234+0000","last_change":"2024-02-15T22:56:13.734537+0000","last_active":"2024-02-15T22:57:46.054234+0000","last_peered":"2024-02-15T22:57:46.054234+0000","last_clean":"2024-02-15T22:57:46.054234+0000","last_became_active":"2024-02-15T22:56:13.734227+0000","last_became_peered":"2024-02-15T22:56:13.734227+0000","last_unstale":"2024-02-15T22:57:46.054234+0000","last_undegraded":"2024-02-15T22:57:46.054234+0000","last_fullsized":"2024-02-15T22:57:46.054234+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.945487+0000","last_change":"2024-02-15T22:58:23.945528+0000","last_active":"2024-02-15T22:58:23.945487+0000","last_peered":"2024-02-15T22:58:23.945487+0000","last_clean":"2024-02-15T22:58:23.945487+0000","last_became_active":"2024-02-15T22:56:05.705551+0000","last_became_peered":"2024-02-15T22:56:05.705551+0000","last_unstale":"2024-02-15T22:58:23.945487+0000","last_undegraded":"2024-02-15T22:58:23.945487+0000","last_fullsized":"2024-02-15T22:58:23.945487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.945394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.945394+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.945394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:34:07.500646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371332+0000","last_change":"2024-02-15T22:56:03.704800+0000","last_active":"2024-02-15T22:57:47.371332+0000","last_peered":"2024-02-15T22:57:47.371332+0000","last_clean":"2024-02-15T22:57:47.371332+0000","last_became_active":"2024-02-15T22:56:03.704526+0000","last_became_peered":"2024-02-15T22:56:03.704526+0000","last_unstale":"2024-02-15T22:57:47.371332+0000","last_undegraded":"2024-02-15T22:57:47.371332+0000","last_fullsized":"2024-02-15T22:57:47.371332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'9","reported_seq":547,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.866099+0000","last_change":"2024-02-15T22:58:01.866099+0000","last_active":"2024-02-15T22:58:01.866099+0000","last_peered":"2024-02-15T22:58:01.866099+0000","last_clean":"2024-02-15T22:58:01.866099+0000","last_became_active":"2024-02-15T22:56:07.704281+0000","last_became_peered":"2024-02-15T22:56:07.704281+0000","last_unstale":"2024-02-15T22:58:01.866099+0000","last_undegraded":"2024-02-15T22:58:01.866099+0000","last_fullsized":"2024-02-15T22:58:01.866099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-15T22:58:01.865973+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-15T22:58:01.865973+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.865973+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:28.422958+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":595,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.204666+0000","last_change":"2024-02-15T22:58:05.204666+0000","last_active":"2024-02-15T22:58:05.204666+0000","last_peered":"2024-02-15T22:58:05.204666+0000","last_clean":"2024-02-15T22:58:05.204666+0000","last_became_active":"2024-02-15T22:56:09.717735+0000","last_became_peered":"2024-02-15T22:56:09.717735+0000","last_unstale":"2024-02-15T22:58:05.204666+0000","last_undegraded":"2024-02-15T22:58:05.204666+0000","last_fullsized":"2024-02-15T22:58:05.204666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:58:05.204500+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:58:05.204500+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.204500+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:17:36.367930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":386,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.877212+0000","last_change":"2024-02-15T22:57:46.877265+0000","last_active":"2024-02-15T22:57:46.877212+0000","last_peered":"2024-02-15T22:57:46.877212+0000","last_clean":"2024-02-15T22:57:46.877212+0000","last_became_active":"2024-02-15T22:56:11.717380+0000","last_became_peered":"2024-02-15T22:56:11.717380+0000","last_unstale":"2024-02-15T22:57:46.877212+0000","last_undegraded":"2024-02-15T22:57:46.877212+0000","last_fullsized":"2024-02-15T22:57:46.877212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:46.877108+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:46.877108+0000","last_clean_scrub_stamp":"2024-02-15T22:57:46.877108+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:13:26.299004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.974720+0000","last_change":"2024-02-15T22:58:03.974720+0000","last_active":"2024-02-15T22:58:03.974720+0000","last_peered":"2024-02-15T22:58:03.974720+0000","last_clean":"2024-02-15T22:58:03.974720+0000","last_became_active":"2024-02-15T22:56:13.729467+0000","last_became_peered":"2024-02-15T22:56:13.729467+0000","last_unstale":"2024-02-15T22:58:03.974720+0000","last_undegraded":"2024-02-15T22:58:03.974720+0000","last_fullsized":"2024-02-15T22:58:03.974720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:03.974606+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:03.974606+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.974606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:15.983952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"30'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:49.868665+0000","last_change":"2024-02-15T22:56:45.901463+0000","last_active":"2024-02-15T22:56:49.868665+0000","last_peered":"2024-02-15T22:56:49.868665+0000","last_clean":"2024-02-15T22:56:49.868665+0000","last_became_active":"2024-02-15T22:56:45.892949+0000","last_became_peered":"2024-02-15T22:56:45.892949+0000","last_unstale":"2024-02-15T22:56:49.868665+0000","last_undegraded":"2024-02-15T22:56:49.868665+0000","last_fullsized":"2024-02-15T22:56:49.868665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371333+0000","last_change":"2024-02-15T22:56:03.702334+0000","last_active":"2024-02-15T22:57:47.371333+0000","last_peered":"2024-02-15T22:57:47.371333+0000","last_clean":"2024-02-15T22:57:47.371333+0000","last_became_active":"2024-02-15T22:56:03.702035+0000","last_became_peered":"2024-02-15T22:56:03.702035+0000","last_unstale":"2024-02-15T22:57:47.371333+0000","last_undegraded":"2024-02-15T22:57:47.371333+0000","last_fullsized":"2024-02-15T22:57:47.371333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.003934+0000","last_change":"2024-02-15T22:57:52.003934+0000","last_active":"2024-02-15T22:57:52.003934+0000","last_peered":"2024-02-15T22:57:52.003934+0000","last_clean":"2024-02-15T22:57:52.003934+0000","last_became_active":"2024-02-15T22:56:07.706615+0000","last_became_peered":"2024-02-15T22:56:07.706615+0000","last_unstale":"2024-02-15T22:57:52.003934+0000","last_undegraded":"2024-02-15T22:57:52.003934+0000","last_fullsized":"2024-02-15T22:57:52.003934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.003831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.003831+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.003831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:06.405461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.860641+0000","last_change":"2024-02-15T22:57:53.860641+0000","last_active":"2024-02-15T22:57:53.860641+0000","last_peered":"2024-02-15T22:57:53.860641+0000","last_clean":"2024-02-15T22:57:53.860641+0000","last_became_active":"2024-02-15T22:56:09.713660+0000","last_became_peered":"2024-02-15T22:56:09.713660+0000","last_unstale":"2024-02-15T22:57:53.860641+0000","last_undegraded":"2024-02-15T22:57:53.860641+0000","last_fullsized":"2024-02-15T22:57:53.860641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-02-15T22:57:53.860514+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-02-15T22:57:53.860514+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.860514+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:09.504364+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.953570+0000","last_change":"2024-02-15T22:57:51.953591+0000","last_active":"2024-02-15T22:57:51.953570+0000","last_peered":"2024-02-15T22:57:51.953570+0000","last_clean":"2024-02-15T22:57:51.953570+0000","last_became_active":"2024-02-15T22:56:11.724575+0000","last_became_peered":"2024-02-15T22:56:11.724575+0000","last_unstale":"2024-02-15T22:57:51.953570+0000","last_undegraded":"2024-02-15T22:57:51.953570+0000","last_fullsized":"2024-02-15T22:57:51.953570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:51.953487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:51.953487+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.953487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:47.214571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.822668+0000","last_change":"2024-02-15T22:58:04.822668+0000","last_active":"2024-02-15T22:58:04.822668+0000","last_peered":"2024-02-15T22:58:04.822668+0000","last_clean":"2024-02-15T22:58:04.822668+0000","last_became_active":"2024-02-15T22:56:13.722550+0000","last_became_peered":"2024-02-15T22:56:13.722550+0000","last_unstale":"2024-02-15T22:58:04.822668+0000","last_undegraded":"2024-02-15T22:58:04.822668+0000","last_fullsized":"2024-02-15T22:58:04.822668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:04.822525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:04.822525+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.822525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:19.922383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.150482+0000","last_change":"2024-02-15T22:58:02.150482+0000","last_active":"2024-02-15T22:58:02.150482+0000","last_peered":"2024-02-15T22:58:02.150482+0000","last_clean":"2024-02-15T22:58:02.150482+0000","last_became_active":"2024-02-15T22:56:05.715513+0000","last_became_peered":"2024-02-15T22:56:05.715513+0000","last_unstale":"2024-02-15T22:58:02.150482+0000","last_undegraded":"2024-02-15T22:58:02.150482+0000","last_fullsized":"2024-02-15T22:58:02.150482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-15T22:58:02.150334+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-15T22:58:02.150334+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.150334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:52:56.881211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":200,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491275+0000","last_change":"2024-02-15T22:55:52.658778+0000","last_active":"2024-02-15T22:57:46.491275+0000","last_peered":"2024-02-15T22:57:46.491275+0000","last_clean":"2024-02-15T22:57:46.491275+0000","last_became_active":"2024-02-15T22:55:52.657750+0000","last_became_peered":"2024-02-15T22:55:52.657750+0000","last_unstale":"2024-02-15T22:57:46.491275+0000","last_undegraded":"2024-02-15T22:57:46.491275+0000","last_fullsized":"2024-02-15T22:57:46.491275+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:51.648340+0000","last_clean_scrub_stamp":"2024-02-15T22:55:51.648340+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371230+0000","last_change":"2024-02-15T22:55:57.672733+0000","last_active":"2024-02-15T22:57:47.371230+0000","last_peered":"2024-02-15T22:57:47.371230+0000","last_clean":"2024-02-15T22:57:47.371230+0000","last_became_active":"2024-02-15T22:55:57.672281+0000","last_became_peered":"2024-02-15T22:55:57.672281+0000","last_unstale":"2024-02-15T22:57:47.371230+0000","last_undegraded":"2024-02-15T22:57:47.371230+0000","last_fullsized":"2024-02-15T22:57:47.371230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371269+0000","last_change":"2024-02-15T22:56:03.707343+0000","last_active":"2024-02-15T22:57:47.371269+0000","last_peered":"2024-02-15T22:57:47.371269+0000","last_clean":"2024-02-15T22:57:47.371269+0000","last_became_active":"2024-02-15T22:56:03.706721+0000","last_became_peered":"2024-02-15T22:56:03.706721+0000","last_unstale":"2024-02-15T22:57:47.371269+0000","last_undegraded":"2024-02-15T22:57:47.371269+0000","last_fullsized":"2024-02-15T22:57:47.371269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491985+0000","last_change":"2024-02-15T22:56:45.887614+0000","last_active":"2024-02-15T22:57:46.491985+0000","last_peered":"2024-02-15T22:57:46.491985+0000","last_clean":"2024-02-15T22:57:46.491985+0000","last_became_active":"2024-02-15T22:56:45.887260+0000","last_became_peered":"2024-02-15T22:56:45.887260+0000","last_unstale":"2024-02-15T22:57:46.491985+0000","last_undegraded":"2024-02-15T22:57:46.491985+0000","last_fullsized":"2024-02-15T22:57:46.491985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'81","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.126986+0000","last_change":"2024-02-15T22:58:01.126986+0000","last_active":"2024-02-15T22:58:01.126986+0000","last_peered":"2024-02-15T22:58:01.126986+0000","last_clean":"2024-02-15T22:58:01.126986+0000","last_became_active":"2024-02-15T22:56:09.716109+0000","last_became_peered":"2024-02-15T22:56:09.716109+0000","last_unstale":"2024-02-15T22:58:01.126986+0000","last_undegraded":"2024-02-15T22:58:01.126986+0000","last_fullsized":"2024-02-15T22:58:01.126986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-02-15T22:58:01.126822+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-02-15T22:58:01.126822+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.126822+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:24.668741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.351175+0000","last_change":"2024-02-15T22:57:52.351175+0000","last_active":"2024-02-15T22:57:52.351175+0000","last_peered":"2024-02-15T22:57:52.351175+0000","last_clean":"2024-02-15T22:57:52.351175+0000","last_became_active":"2024-02-15T22:56:11.722390+0000","last_became_peered":"2024-02-15T22:56:11.722390+0000","last_unstale":"2024-02-15T22:57:52.351175+0000","last_undegraded":"2024-02-15T22:57:52.351175+0000","last_fullsized":"2024-02-15T22:57:52.351175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.351041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.351041+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.351041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:26.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.931558+0000","last_change":"2024-02-15T22:56:13.732746+0000","last_active":"2024-02-15T22:57:46.931558+0000","last_peered":"2024-02-15T22:57:46.931558+0000","last_clean":"2024-02-15T22:57:46.931558+0000","last_became_active":"2024-02-15T22:56:13.732437+0000","last_became_peered":"2024-02-15T22:56:13.732437+0000","last_unstale":"2024-02-15T22:57:46.931558+0000","last_undegraded":"2024-02-15T22:57:46.931558+0000","last_fullsized":"2024-02-15T22:57:46.931558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371698+0000","last_change":"2024-02-15T22:56:05.700559+0000","last_active":"2024-02-15T22:57:47.371698+0000","last_peered":"2024-02-15T22:57:47.371698+0000","last_clean":"2024-02-15T22:57:47.371698+0000","last_became_active":"2024-02-15T22:56:05.699679+0000","last_became_peered":"2024-02-15T22:56:05.699679+0000","last_unstale":"2024-02-15T22:57:47.371698+0000","last_undegraded":"2024-02-15T22:57:47.371698+0000","last_fullsized":"2024-02-15T22:57:47.371698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371221+0000","last_change":"2024-02-15T22:55:57.673021+0000","last_active":"2024-02-15T22:57:47.371221+0000","last_peered":"2024-02-15T22:57:47.371221+0000","last_clean":"2024-02-15T22:57:47.371221+0000","last_became_active":"2024-02-15T22:55:57.672705+0000","last_became_peered":"2024-02-15T22:55:57.672705+0000","last_unstale":"2024-02-15T22:57:47.371221+0000","last_undegraded":"2024-02-15T22:57:47.371221+0000","last_fullsized":"2024-02-15T22:57:47.371221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053307+0000","last_change":"2024-02-15T22:56:03.700496+0000","last_active":"2024-02-15T22:57:46.053307+0000","last_peered":"2024-02-15T22:57:46.053307+0000","last_clean":"2024-02-15T22:57:46.053307+0000","last_became_active":"2024-02-15T22:56:03.699864+0000","last_became_peered":"2024-02-15T22:56:03.699864+0000","last_unstale":"2024-02-15T22:57:46.053307+0000","last_undegraded":"2024-02-15T22:57:46.053307+0000","last_fullsized":"2024-02-15T22:57:46.053307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.977656+0000","last_change":"2024-02-15T22:57:50.977656+0000","last_active":"2024-02-15T22:57:50.977656+0000","last_peered":"2024-02-15T22:57:50.977656+0000","last_clean":"2024-02-15T22:57:50.977656+0000","last_became_active":"2024-02-15T22:56:07.707620+0000","last_became_peered":"2024-02-15T22:56:07.707620+0000","last_unstale":"2024-02-15T22:57:50.977656+0000","last_undegraded":"2024-02-15T22:57:50.977656+0000","last_fullsized":"2024-02-15T22:57:50.977656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.977533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.977533+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.977533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:06:57.198666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":447,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.870292+0000","last_change":"2024-02-15T22:57:50.870292+0000","last_active":"2024-02-15T22:57:50.870292+0000","last_peered":"2024-02-15T22:57:50.870292+0000","last_clean":"2024-02-15T22:57:50.870292+0000","last_became_active":"2024-02-15T22:56:09.718396+0000","last_became_peered":"2024-02-15T22:56:09.718396+0000","last_unstale":"2024-02-15T22:57:50.870292+0000","last_undegraded":"2024-02-15T22:57:50.870292+0000","last_fullsized":"2024-02-15T22:57:50.870292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-02-15T22:57:50.870120+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-02-15T22:57:50.870120+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.870120+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:52.372485+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.133283+0000","last_change":"2024-02-15T22:58:11.133283+0000","last_active":"2024-02-15T22:58:11.133283+0000","last_peered":"2024-02-15T22:58:11.133283+0000","last_clean":"2024-02-15T22:58:11.133283+0000","last_became_active":"2024-02-15T22:56:11.725005+0000","last_became_peered":"2024-02-15T22:56:11.725005+0000","last_unstale":"2024-02-15T22:58:11.133283+0000","last_undegraded":"2024-02-15T22:58:11.133283+0000","last_fullsized":"2024-02-15T22:58:11.133283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.133157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.133157+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.133157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:19:51.739962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.492400+0000","last_change":"2024-02-15T22:56:13.734036+0000","last_active":"2024-02-15T22:57:46.492400+0000","last_peered":"2024-02-15T22:57:46.492400+0000","last_clean":"2024-02-15T22:57:46.492400+0000","last_became_active":"2024-02-15T22:56:13.733760+0000","last_became_peered":"2024-02-15T22:56:13.733760+0000","last_unstale":"2024-02-15T22:57:46.492400+0000","last_undegraded":"2024-02-15T22:57:46.492400+0000","last_fullsized":"2024-02-15T22:57:46.492400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053554+0000","last_change":"2024-02-15T22:56:05.706098+0000","last_active":"2024-02-15T22:57:46.053554+0000","last_peered":"2024-02-15T22:57:46.053554+0000","last_clean":"2024-02-15T22:57:46.053554+0000","last_became_active":"2024-02-15T22:56:05.704953+0000","last_became_peered":"2024-02-15T22:56:05.704953+0000","last_unstale":"2024-02-15T22:57:46.053554+0000","last_undegraded":"2024-02-15T22:57:46.053554+0000","last_fullsized":"2024-02-15T22:57:46.053554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.930540+0000","last_change":"2024-02-15T22:55:57.671425+0000","last_active":"2024-02-15T22:57:46.930540+0000","last_peered":"2024-02-15T22:57:46.930540+0000","last_clean":"2024-02-15T22:57:46.930540+0000","last_became_active":"2024-02-15T22:55:57.671130+0000","last_became_peered":"2024-02-15T22:55:57.671130+0000","last_unstale":"2024-02-15T22:57:46.930540+0000","last_undegraded":"2024-02-15T22:57:46.930540+0000","last_fullsized":"2024-02-15T22:57:46.930540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053283+0000","last_change":"2024-02-15T22:56:03.700250+0000","last_active":"2024-02-15T22:57:46.053283+0000","last_peered":"2024-02-15T22:57:46.053283+0000","last_clean":"2024-02-15T22:57:46.053283+0000","last_became_active":"2024-02-15T22:56:03.699598+0000","last_became_peered":"2024-02-15T22:56:03.699598+0000","last_unstale":"2024-02-15T22:57:46.053283+0000","last_undegraded":"2024-02-15T22:57:46.053283+0000","last_fullsized":"2024-02-15T22:57:46.053283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.962853+0000","last_change":"2024-02-15T22:58:05.962853+0000","last_active":"2024-02-15T22:58:05.962853+0000","last_peered":"2024-02-15T22:58:05.962853+0000","last_clean":"2024-02-15T22:58:05.962853+0000","last_became_active":"2024-02-15T22:56:07.704107+0000","last_became_peered":"2024-02-15T22:56:07.704107+0000","last_unstale":"2024-02-15T22:58:05.962853+0000","last_undegraded":"2024-02-15T22:58:05.962853+0000","last_fullsized":"2024-02-15T22:58:05.962853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:05.962670+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:05.962670+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.962670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:35.552053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.972000+0000","last_change":"2024-02-15T22:57:58.972000+0000","last_active":"2024-02-15T22:57:58.972000+0000","last_peered":"2024-02-15T22:57:58.972000+0000","last_clean":"2024-02-15T22:57:58.972000+0000","last_became_active":"2024-02-15T22:56:09.711494+0000","last_became_peered":"2024-02-15T22:56:09.711494+0000","last_unstale":"2024-02-15T22:57:58.972000+0000","last_undegraded":"2024-02-15T22:57:58.972000+0000","last_fullsized":"2024-02-15T22:57:58.972000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-02-15T22:57:58.971860+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-02-15T22:57:58.971860+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.971860+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:36:02.170038+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.345803+0000","last_change":"2024-02-15T22:57:47.345803+0000","last_active":"2024-02-15T22:57:47.345803+0000","last_peered":"2024-02-15T22:57:47.345803+0000","last_clean":"2024-02-15T22:57:47.345803+0000","last_became_active":"2024-02-15T22:56:11.722277+0000","last_became_peered":"2024-02-15T22:56:11.722277+0000","last_unstale":"2024-02-15T22:57:47.345803+0000","last_undegraded":"2024-02-15T22:57:47.345803+0000","last_fullsized":"2024-02-15T22:57:47.345803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.345669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.345669+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.345669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:53:30.201838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880111+0000","last_change":"2024-02-15T22:56:13.726439+0000","last_active":"2024-02-15T22:56:45.880111+0000","last_peered":"2024-02-15T22:56:45.880111+0000","last_clean":"2024-02-15T22:56:45.880111+0000","last_became_active":"2024-02-15T22:56:13.726165+0000","last_became_peered":"2024-02-15T22:56:13.726165+0000","last_unstale":"2024-02-15T22:56:45.880111+0000","last_undegraded":"2024-02-15T22:56:45.880111+0000","last_fullsized":"2024-02-15T22:56:45.880111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'7","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053551+0000","last_change":"2024-02-15T22:56:05.707494+0000","last_active":"2024-02-15T22:57:46.053551+0000","last_peered":"2024-02-15T22:57:46.053551+0000","last_clean":"2024-02-15T22:57:46.053551+0000","last_became_active":"2024-02-15T22:56:05.707171+0000","last_became_peered":"2024-02-15T22:56:05.707171+0000","last_unstale":"2024-02-15T22:57:46.053551+0000","last_undegraded":"2024-02-15T22:57:46.053551+0000","last_fullsized":"2024-02-15T22:57:46.053551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371190+0000","last_change":"2024-02-15T22:55:57.672717+0000","last_active":"2024-02-15T22:57:47.371190+0000","last_peered":"2024-02-15T22:57:47.371190+0000","last_clean":"2024-02-15T22:57:47.371190+0000","last_became_active":"2024-02-15T22:55:57.672268+0000","last_became_peered":"2024-02-15T22:55:57.672268+0000","last_unstale":"2024-02-15T22:57:47.371190+0000","last_undegraded":"2024-02-15T22:57:47.371190+0000","last_fullsized":"2024-02-15T22:57:47.371190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.930566+0000","last_change":"2024-02-15T22:56:03.697249+0000","last_active":"2024-02-15T22:57:46.930566+0000","last_peered":"2024-02-15T22:57:46.930566+0000","last_clean":"2024-02-15T22:57:46.930566+0000","last_became_active":"2024-02-15T22:56:03.693487+0000","last_became_peered":"2024-02-15T22:56:03.693487+0000","last_unstale":"2024-02-15T22:57:46.930566+0000","last_undegraded":"2024-02-15T22:57:46.930566+0000","last_fullsized":"2024-02-15T22:57:46.930566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.228589+0000","last_change":"2024-02-15T22:58:06.228589+0000","last_active":"2024-02-15T22:58:06.228589+0000","last_peered":"2024-02-15T22:58:06.228589+0000","last_clean":"2024-02-15T22:58:06.228589+0000","last_became_active":"2024-02-15T22:56:07.707227+0000","last_became_peered":"2024-02-15T22:56:07.707227+0000","last_unstale":"2024-02-15T22:58:06.228589+0000","last_undegraded":"2024-02-15T22:58:06.228589+0000","last_fullsized":"2024-02-15T22:58:06.228589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:06.228482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:06.228482+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.228482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:24:36.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.146475+0000","last_change":"2024-02-15T22:58:18.146475+0000","last_active":"2024-02-15T22:58:18.146475+0000","last_peered":"2024-02-15T22:58:18.146475+0000","last_clean":"2024-02-15T22:58:18.146475+0000","last_became_active":"2024-02-15T22:56:09.719999+0000","last_became_peered":"2024-02-15T22:56:09.719999+0000","last_unstale":"2024-02-15T22:58:18.146475+0000","last_undegraded":"2024-02-15T22:58:18.146475+0000","last_fullsized":"2024-02-15T22:58:18.146475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-02-15T22:58:18.146343+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-02-15T22:58:18.146343+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.146343+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:46:00.908693+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.141146+0000","last_change":"2024-02-15T22:58:14.141146+0000","last_active":"2024-02-15T22:58:14.141146+0000","last_peered":"2024-02-15T22:58:14.141146+0000","last_clean":"2024-02-15T22:58:14.141146+0000","last_became_active":"2024-02-15T22:56:11.723718+0000","last_became_peered":"2024-02-15T22:56:11.723718+0000","last_unstale":"2024-02-15T22:58:14.141146+0000","last_undegraded":"2024-02-15T22:58:14.141146+0000","last_fullsized":"2024-02-15T22:58:14.141146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:14.141029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:14.141029+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.141029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:54:12.738246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.492374+0000","last_change":"2024-02-15T22:56:13.731187+0000","last_active":"2024-02-15T22:57:46.492374+0000","last_peered":"2024-02-15T22:57:46.492374+0000","last_clean":"2024-02-15T22:57:46.492374+0000","last_became_active":"2024-02-15T22:56:13.730551+0000","last_became_peered":"2024-02-15T22:56:13.730551+0000","last_unstale":"2024-02-15T22:57:46.492374+0000","last_undegraded":"2024-02-15T22:57:46.492374+0000","last_fullsized":"2024-02-15T22:57:46.492374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.886211+0000","last_change":"2024-02-15T22:58:07.886211+0000","last_active":"2024-02-15T22:58:07.886211+0000","last_peered":"2024-02-15T22:58:07.886211+0000","last_clean":"2024-02-15T22:58:07.886211+0000","last_became_active":"2024-02-15T22:56:05.714389+0000","last_became_peered":"2024-02-15T22:56:05.714389+0000","last_unstale":"2024-02-15T22:58:07.886211+0000","last_undegraded":"2024-02-15T22:58:07.886211+0000","last_fullsized":"2024-02-15T22:58:07.886211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:07.886088+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:07.886088+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.886088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:31.251765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.930562+0000","last_change":"2024-02-15T22:56:03.693895+0000","last_active":"2024-02-15T22:57:46.930562+0000","last_peered":"2024-02-15T22:57:46.930562+0000","last_clean":"2024-02-15T22:57:46.930562+0000","last_became_active":"2024-02-15T22:56:03.693005+0000","last_became_peered":"2024-02-15T22:56:03.693005+0000","last_unstale":"2024-02-15T22:57:46.930562+0000","last_undegraded":"2024-02-15T22:57:46.930562+0000","last_fullsized":"2024-02-15T22:57:46.930562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053260+0000","last_change":"2024-02-15T22:55:57.671879+0000","last_active":"2024-02-15T22:57:46.053260+0000","last_peered":"2024-02-15T22:57:46.053260+0000","last_clean":"2024-02-15T22:57:46.053260+0000","last_became_active":"2024-02-15T22:55:57.671524+0000","last_became_peered":"2024-02-15T22:55:57.671524+0000","last_unstale":"2024-02-15T22:57:46.053260+0000","last_undegraded":"2024-02-15T22:57:46.053260+0000","last_fullsized":"2024-02-15T22:57:46.053260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.254714+0000","last_change":"2024-02-15T22:58:03.254714+0000","last_active":"2024-02-15T22:58:03.254714+0000","last_peered":"2024-02-15T22:58:03.254714+0000","last_clean":"2024-02-15T22:58:03.254714+0000","last_became_active":"2024-02-15T22:56:07.707281+0000","last_became_peered":"2024-02-15T22:56:07.707281+0000","last_unstale":"2024-02-15T22:58:03.254714+0000","last_undegraded":"2024-02-15T22:58:03.254714+0000","last_fullsized":"2024-02-15T22:58:03.254714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:03.254575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:03.254575+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.254575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:31.078756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.385601+0000","last_change":"2024-02-15T22:57:55.385601+0000","last_active":"2024-02-15T22:57:55.385601+0000","last_peered":"2024-02-15T22:57:55.385601+0000","last_clean":"2024-02-15T22:57:55.385601+0000","last_became_active":"2024-02-15T22:56:09.717692+0000","last_became_peered":"2024-02-15T22:56:09.717692+0000","last_unstale":"2024-02-15T22:57:55.385601+0000","last_undegraded":"2024-02-15T22:57:55.385601+0000","last_fullsized":"2024-02-15T22:57:55.385601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-02-15T22:57:55.385469+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-02-15T22:57:55.385469+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.385469+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:24.974853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.917439+0000","last_change":"2024-02-15T22:57:49.917439+0000","last_active":"2024-02-15T22:57:49.917439+0000","last_peered":"2024-02-15T22:57:49.917439+0000","last_clean":"2024-02-15T22:57:49.917439+0000","last_became_active":"2024-02-15T22:56:11.718332+0000","last_became_peered":"2024-02-15T22:56:11.718332+0000","last_unstale":"2024-02-15T22:57:49.917439+0000","last_undegraded":"2024-02-15T22:57:49.917439+0000","last_fullsized":"2024-02-15T22:57:49.917439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.917248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.917248+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.917248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:48.180880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.184605+0000","last_change":"2024-02-15T22:58:08.184633+0000","last_active":"2024-02-15T22:58:08.184605+0000","last_peered":"2024-02-15T22:58:08.184605+0000","last_clean":"2024-02-15T22:58:08.184605+0000","last_became_active":"2024-02-15T22:56:13.723512+0000","last_became_peered":"2024-02-15T22:56:13.723512+0000","last_unstale":"2024-02-15T22:58:08.184605+0000","last_undegraded":"2024-02-15T22:58:08.184605+0000","last_fullsized":"2024-02-15T22:58:08.184605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-02-15T22:58:08.184528+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-02-15T22:58:08.184528+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.184528+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:33.363968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491575+0000","last_change":"2024-02-15T22:56:05.713346+0000","last_active":"2024-02-15T22:57:46.491575+0000","last_peered":"2024-02-15T22:57:46.491575+0000","last_clean":"2024-02-15T22:57:46.491575+0000","last_became_active":"2024-02-15T22:56:05.713036+0000","last_became_peered":"2024-02-15T22:56:05.713036+0000","last_unstale":"2024-02-15T22:57:46.491575+0000","last_undegraded":"2024-02-15T22:57:46.491575+0000","last_fullsized":"2024-02-15T22:57:46.491575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053414+0000","last_change":"2024-02-15T22:56:03.699990+0000","last_active":"2024-02-15T22:57:46.053414+0000","last_peered":"2024-02-15T22:57:46.053414+0000","last_clean":"2024-02-15T22:57:46.053414+0000","last_became_active":"2024-02-15T22:56:03.699564+0000","last_became_peered":"2024-02-15T22:56:03.699564+0000","last_unstale":"2024-02-15T22:57:46.053414+0000","last_undegraded":"2024-02-15T22:57:46.053414+0000","last_fullsized":"2024-02-15T22:57:46.053414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371220+0000","last_change":"2024-02-15T22:55:57.672438+0000","last_active":"2024-02-15T22:57:47.371220+0000","last_peered":"2024-02-15T22:57:47.371220+0000","last_clean":"2024-02-15T22:57:47.371220+0000","last_became_active":"2024-02-15T22:55:57.672053+0000","last_became_peered":"2024-02-15T22:55:57.672053+0000","last_unstale":"2024-02-15T22:57:47.371220+0000","last_undegraded":"2024-02-15T22:57:47.371220+0000","last_fullsized":"2024-02-15T22:57:47.371220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372046+0000","last_change":"2024-02-15T22:56:45.893645+0000","last_active":"2024-02-15T22:57:47.372046+0000","last_peered":"2024-02-15T22:57:47.372046+0000","last_clean":"2024-02-15T22:57:47.372046+0000","last_became_active":"2024-02-15T22:56:45.893109+0000","last_became_peered":"2024-02-15T22:56:45.893109+0000","last_unstale":"2024-02-15T22:57:47.372046+0000","last_undegraded":"2024-02-15T22:57:47.372046+0000","last_fullsized":"2024-02-15T22:57:47.372046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.859195+0000","last_change":"2024-02-15T22:57:49.859195+0000","last_active":"2024-02-15T22:57:49.859195+0000","last_peered":"2024-02-15T22:57:49.859195+0000","last_clean":"2024-02-15T22:57:49.859195+0000","last_became_active":"2024-02-15T22:56:09.721140+0000","last_became_peered":"2024-02-15T22:56:09.721140+0000","last_unstale":"2024-02-15T22:57:49.859195+0000","last_undegraded":"2024-02-15T22:57:49.859195+0000","last_fullsized":"2024-02-15T22:57:49.859195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-02-15T22:57:49.859068+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-02-15T22:57:49.859068+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.859068+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:24:17.693114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":290,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.831746+0000","last_change":"2024-02-15T22:57:48.831746+0000","last_active":"2024-02-15T22:57:48.831746+0000","last_peered":"2024-02-15T22:57:48.831746+0000","last_clean":"2024-02-15T22:57:48.831746+0000","last_became_active":"2024-02-15T22:56:11.717544+0000","last_became_peered":"2024-02-15T22:56:11.717544+0000","last_unstale":"2024-02-15T22:57:48.831746+0000","last_undegraded":"2024-02-15T22:57:48.831746+0000","last_fullsized":"2024-02-15T22:57:48.831746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:48.831614+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:48.831614+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.831614+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:25.818844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883730+0000","last_change":"2024-02-15T22:56:13.728952+0000","last_active":"2024-02-15T22:56:45.883730+0000","last_peered":"2024-02-15T22:56:45.883730+0000","last_clean":"2024-02-15T22:56:45.883730+0000","last_became_active":"2024-02-15T22:56:13.728228+0000","last_became_peered":"2024-02-15T22:56:13.728228+0000","last_unstale":"2024-02-15T22:56:45.883730+0000","last_undegraded":"2024-02-15T22:56:45.883730+0000","last_fullsized":"2024-02-15T22:56:45.883730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.164396+0000","last_change":"2024-02-15T22:58:06.164425+0000","last_active":"2024-02-15T22:58:06.164396+0000","last_peered":"2024-02-15T22:58:06.164396+0000","last_clean":"2024-02-15T22:58:06.164396+0000","last_became_active":"2024-02-15T22:56:05.710924+0000","last_became_peered":"2024-02-15T22:56:05.710924+0000","last_unstale":"2024-02-15T22:58:06.164396+0000","last_undegraded":"2024-02-15T22:58:06.164396+0000","last_fullsized":"2024-02-15T22:58:06.164396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:06.164305+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:06.164305+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.164305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:46.445946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371250+0000","last_change":"2024-02-15T22:56:03.696202+0000","last_active":"2024-02-15T22:57:47.371250+0000","last_peered":"2024-02-15T22:57:47.371250+0000","last_clean":"2024-02-15T22:57:47.371250+0000","last_became_active":"2024-02-15T22:56:03.695921+0000","last_became_peered":"2024-02-15T22:56:03.695921+0000","last_unstale":"2024-02-15T22:57:47.371250+0000","last_undegraded":"2024-02-15T22:57:47.371250+0000","last_fullsized":"2024-02-15T22:57:47.371250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053260+0000","last_change":"2024-02-15T22:55:57.671686+0000","last_active":"2024-02-15T22:57:46.053260+0000","last_peered":"2024-02-15T22:57:46.053260+0000","last_clean":"2024-02-15T22:57:46.053260+0000","last_became_active":"2024-02-15T22:55:57.671257+0000","last_became_peered":"2024-02-15T22:55:57.671257+0000","last_unstale":"2024-02-15T22:57:46.053260+0000","last_undegraded":"2024-02-15T22:57:46.053260+0000","last_fullsized":"2024-02-15T22:57:46.053260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.993271+0000","last_change":"2024-02-15T22:57:53.993271+0000","last_active":"2024-02-15T22:57:53.993271+0000","last_peered":"2024-02-15T22:57:53.993271+0000","last_clean":"2024-02-15T22:57:53.993271+0000","last_became_active":"2024-02-15T22:56:07.705323+0000","last_became_peered":"2024-02-15T22:56:07.705323+0000","last_unstale":"2024-02-15T22:57:53.993271+0000","last_undegraded":"2024-02-15T22:57:53.993271+0000","last_fullsized":"2024-02-15T22:57:53.993271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:53.993161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:53.993161+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.993161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:37.548413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.097818+0000","last_change":"2024-02-15T22:58:16.097856+0000","last_active":"2024-02-15T22:58:16.097818+0000","last_peered":"2024-02-15T22:58:16.097818+0000","last_clean":"2024-02-15T22:58:16.097818+0000","last_became_active":"2024-02-15T22:56:09.729131+0000","last_became_peered":"2024-02-15T22:56:09.729131+0000","last_unstale":"2024-02-15T22:58:16.097818+0000","last_undegraded":"2024-02-15T22:58:16.097818+0000","last_fullsized":"2024-02-15T22:58:16.097818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-15T22:58:16.097737+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-15T22:58:16.097737+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.097737+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:35:13.613365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":323,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.400056+0000","last_change":"2024-02-15T22:57:51.400056+0000","last_active":"2024-02-15T22:57:51.400056+0000","last_peered":"2024-02-15T22:57:51.400056+0000","last_clean":"2024-02-15T22:57:51.400056+0000","last_became_active":"2024-02-15T22:56:11.719685+0000","last_became_peered":"2024-02-15T22:56:11.719685+0000","last_unstale":"2024-02-15T22:57:51.400056+0000","last_undegraded":"2024-02-15T22:57:51.400056+0000","last_fullsized":"2024-02-15T22:57:51.400056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:51.399947+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:51.399947+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.399947+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:14.785659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.892658+0000","last_change":"2024-02-15T22:58:12.892686+0000","last_active":"2024-02-15T22:58:12.892658+0000","last_peered":"2024-02-15T22:58:12.892658+0000","last_clean":"2024-02-15T22:58:12.892658+0000","last_became_active":"2024-02-15T22:56:13.730494+0000","last_became_peered":"2024-02-15T22:56:13.730494+0000","last_unstale":"2024-02-15T22:58:12.892658+0000","last_undegraded":"2024-02-15T22:58:12.892658+0000","last_fullsized":"2024-02-15T22:58:12.892658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-15T22:58:12.892569+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-15T22:58:12.892569+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.892569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:13.313696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.895931+0000","last_change":"2024-02-15T22:58:21.895961+0000","last_active":"2024-02-15T22:58:21.895931+0000","last_peered":"2024-02-15T22:58:21.895931+0000","last_clean":"2024-02-15T22:58:21.895931+0000","last_became_active":"2024-02-15T22:56:05.705764+0000","last_became_peered":"2024-02-15T22:56:05.705764+0000","last_unstale":"2024-02-15T22:58:21.895931+0000","last_undegraded":"2024-02-15T22:58:21.895931+0000","last_fullsized":"2024-02-15T22:58:21.895931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:21.895840+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:21.895840+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.895840+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:12.132052+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491325+0000","last_change":"2024-02-15T22:56:03.706073+0000","last_active":"2024-02-15T22:57:46.491325+0000","last_peered":"2024-02-15T22:57:46.491325+0000","last_clean":"2024-02-15T22:57:46.491325+0000","last_became_active":"2024-02-15T22:56:03.705783+0000","last_became_peered":"2024-02-15T22:56:03.705783+0000","last_unstale":"2024-02-15T22:57:46.491325+0000","last_undegraded":"2024-02-15T22:57:46.491325+0000","last_fullsized":"2024-02-15T22:57:46.491325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371211+0000","last_change":"2024-02-15T22:55:57.854108+0000","last_active":"2024-02-15T22:57:47.371211+0000","last_peered":"2024-02-15T22:57:47.371211+0000","last_clean":"2024-02-15T22:57:47.371211+0000","last_became_active":"2024-02-15T22:55:57.853714+0000","last_became_peered":"2024-02-15T22:55:57.853714+0000","last_unstale":"2024-02-15T22:57:47.371211+0000","last_undegraded":"2024-02-15T22:57:47.371211+0000","last_fullsized":"2024-02-15T22:57:47.371211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.020401+0000","last_change":"2024-02-15T22:57:58.020401+0000","last_active":"2024-02-15T22:57:58.020401+0000","last_peered":"2024-02-15T22:57:58.020401+0000","last_clean":"2024-02-15T22:57:58.020401+0000","last_became_active":"2024-02-15T22:56:07.705013+0000","last_became_peered":"2024-02-15T22:56:07.705013+0000","last_unstale":"2024-02-15T22:57:58.020401+0000","last_undegraded":"2024-02-15T22:57:58.020401+0000","last_fullsized":"2024-02-15T22:57:58.020401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:58.020263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:58.020263+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.020263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:46.435941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.962295+0000","last_change":"2024-02-15T22:57:53.962295+0000","last_active":"2024-02-15T22:57:53.962295+0000","last_peered":"2024-02-15T22:57:53.962295+0000","last_clean":"2024-02-15T22:57:53.962295+0000","last_became_active":"2024-02-15T22:56:09.719916+0000","last_became_peered":"2024-02-15T22:56:09.719916+0000","last_unstale":"2024-02-15T22:57:53.962295+0000","last_undegraded":"2024-02-15T22:57:53.962295+0000","last_fullsized":"2024-02-15T22:57:53.962295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-02-15T22:57:53.962112+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-02-15T22:57:53.962112+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.962112+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:13:33.384008+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.358256+0000","last_change":"2024-02-15T22:57:54.358256+0000","last_active":"2024-02-15T22:57:54.358256+0000","last_peered":"2024-02-15T22:57:54.358256+0000","last_clean":"2024-02-15T22:57:54.358256+0000","last_became_active":"2024-02-15T22:56:11.717758+0000","last_became_peered":"2024-02-15T22:56:11.717758+0000","last_unstale":"2024-02-15T22:57:54.358256+0000","last_undegraded":"2024-02-15T22:57:54.358256+0000","last_fullsized":"2024-02-15T22:57:54.358256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:54.358148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:54.358148+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.358148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:29.880821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.885476+0000","last_change":"2024-02-15T22:56:13.732654+0000","last_active":"2024-02-15T22:56:45.885476+0000","last_peered":"2024-02-15T22:56:45.885476+0000","last_clean":"2024-02-15T22:56:45.885476+0000","last_became_active":"2024-02-15T22:56:13.732325+0000","last_became_peered":"2024-02-15T22:56:13.732325+0000","last_unstale":"2024-02-15T22:56:45.885476+0000","last_undegraded":"2024-02-15T22:56:45.885476+0000","last_fullsized":"2024-02-15T22:56:45.885476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.926533+0000","last_change":"2024-02-15T22:58:07.926533+0000","last_active":"2024-02-15T22:58:07.926533+0000","last_peered":"2024-02-15T22:58:07.926533+0000","last_clean":"2024-02-15T22:58:07.926533+0000","last_became_active":"2024-02-15T22:56:13.732216+0000","last_became_peered":"2024-02-15T22:56:13.732216+0000","last_unstale":"2024-02-15T22:58:07.926533+0000","last_undegraded":"2024-02-15T22:58:07.926533+0000","last_fullsized":"2024-02-15T22:58:07.926533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.926378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.926378+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.926378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:00.958886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.897351+0000","last_change":"2024-02-15T22:58:19.897351+0000","last_active":"2024-02-15T22:58:19.897351+0000","last_peered":"2024-02-15T22:58:19.897351+0000","last_clean":"2024-02-15T22:58:19.897351+0000","last_became_active":"2024-02-15T22:56:05.704959+0000","last_became_peered":"2024-02-15T22:56:05.704959+0000","last_unstale":"2024-02-15T22:58:19.897351+0000","last_undegraded":"2024-02-15T22:58:19.897351+0000","last_fullsized":"2024-02-15T22:58:19.897351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:19.897173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:19.897173+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.897173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:28:13.350809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371392+0000","last_change":"2024-02-15T22:56:03.705460+0000","last_active":"2024-02-15T22:57:47.371392+0000","last_peered":"2024-02-15T22:57:47.371392+0000","last_clean":"2024-02-15T22:57:47.371392+0000","last_became_active":"2024-02-15T22:56:03.705176+0000","last_became_peered":"2024-02-15T22:56:03.705176+0000","last_unstale":"2024-02-15T22:57:47.371392+0000","last_undegraded":"2024-02-15T22:57:47.371392+0000","last_fullsized":"2024-02-15T22:57:47.371392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.818364+0000","last_change":"2024-02-15T22:58:02.818396+0000","last_active":"2024-02-15T22:58:02.818364+0000","last_peered":"2024-02-15T22:58:02.818364+0000","last_clean":"2024-02-15T22:58:02.818364+0000","last_became_active":"2024-02-15T22:56:07.703060+0000","last_became_peered":"2024-02-15T22:56:07.703060+0000","last_unstale":"2024-02-15T22:58:02.818364+0000","last_undegraded":"2024-02-15T22:58:02.818364+0000","last_fullsized":"2024-02-15T22:58:02.818364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:02.818259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:02.818259+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.818259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:34.242902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.172272+0000","last_change":"2024-02-15T22:58:19.172307+0000","last_active":"2024-02-15T22:58:19.172272+0000","last_peered":"2024-02-15T22:58:19.172272+0000","last_clean":"2024-02-15T22:58:19.172272+0000","last_became_active":"2024-02-15T22:56:09.720627+0000","last_became_peered":"2024-02-15T22:56:09.720627+0000","last_unstale":"2024-02-15T22:58:19.172272+0000","last_undegraded":"2024-02-15T22:58:19.172272+0000","last_fullsized":"2024-02-15T22:58:19.172272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-15T22:58:19.172190+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-15T22:58:19.172190+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.172190+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:17.898821+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.182796+0000","last_change":"2024-02-15T22:58:12.182843+0000","last_active":"2024-02-15T22:58:12.182796+0000","last_peered":"2024-02-15T22:58:12.182796+0000","last_clean":"2024-02-15T22:58:12.182796+0000","last_became_active":"2024-02-15T22:56:11.724592+0000","last_became_peered":"2024-02-15T22:56:11.724592+0000","last_unstale":"2024-02-15T22:58:12.182796+0000","last_undegraded":"2024-02-15T22:58:12.182796+0000","last_fullsized":"2024-02-15T22:58:12.182796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.182689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.182689+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.182689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:17:50.255923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.054357+0000","last_change":"2024-02-15T22:56:13.730249+0000","last_active":"2024-02-15T22:57:46.054357+0000","last_peered":"2024-02-15T22:57:46.054357+0000","last_clean":"2024-02-15T22:57:46.054357+0000","last_became_active":"2024-02-15T22:56:13.729931+0000","last_became_peered":"2024-02-15T22:56:13.729931+0000","last_unstale":"2024-02-15T22:57:46.054357+0000","last_undegraded":"2024-02-15T22:57:46.054357+0000","last_fullsized":"2024-02-15T22:57:46.054357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.873645+0000","last_change":"2024-02-15T22:58:10.873645+0000","last_active":"2024-02-15T22:58:10.873645+0000","last_peered":"2024-02-15T22:58:10.873645+0000","last_clean":"2024-02-15T22:58:10.873645+0000","last_became_active":"2024-02-15T22:56:05.714024+0000","last_became_peered":"2024-02-15T22:56:05.714024+0000","last_unstale":"2024-02-15T22:58:10.873645+0000","last_undegraded":"2024-02-15T22:58:10.873645+0000","last_fullsized":"2024-02-15T22:58:10.873645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:10.873523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:10.873523+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.873523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:35.471679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.886161+0000","last_change":"2024-02-15T22:56:03.698629+0000","last_active":"2024-02-15T22:56:45.886161+0000","last_peered":"2024-02-15T22:56:45.886161+0000","last_clean":"2024-02-15T22:56:45.886161+0000","last_became_active":"2024-02-15T22:56:03.695339+0000","last_became_peered":"2024-02-15T22:56:03.695339+0000","last_unstale":"2024-02-15T22:56:45.886161+0000","last_undegraded":"2024-02-15T22:56:45.886161+0000","last_fullsized":"2024-02-15T22:56:45.886161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.932675+0000","last_change":"2024-02-15T22:57:49.932729+0000","last_active":"2024-02-15T22:57:49.932675+0000","last_peered":"2024-02-15T22:57:49.932675+0000","last_clean":"2024-02-15T22:57:49.932675+0000","last_became_active":"2024-02-15T22:56:07.708692+0000","last_became_peered":"2024-02-15T22:56:07.708692+0000","last_unstale":"2024-02-15T22:57:49.932675+0000","last_undegraded":"2024-02-15T22:57:49.932675+0000","last_fullsized":"2024-02-15T22:57:49.932675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.932578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.932578+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.932578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:19:08.744146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.213007+0000","last_change":"2024-02-15T22:58:02.213042+0000","last_active":"2024-02-15T22:58:02.213007+0000","last_peered":"2024-02-15T22:58:02.213007+0000","last_clean":"2024-02-15T22:58:02.213007+0000","last_became_active":"2024-02-15T22:56:09.710942+0000","last_became_peered":"2024-02-15T22:56:09.710942+0000","last_unstale":"2024-02-15T22:58:02.213007+0000","last_undegraded":"2024-02-15T22:58:02.213007+0000","last_fullsized":"2024-02-15T22:58:02.213007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:02.212917+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:02.212917+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.212917+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:41.461653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.958914+0000","last_change":"2024-02-15T22:57:55.958962+0000","last_active":"2024-02-15T22:57:55.958914+0000","last_peered":"2024-02-15T22:57:55.958914+0000","last_clean":"2024-02-15T22:57:55.958914+0000","last_became_active":"2024-02-15T22:56:11.724533+0000","last_became_peered":"2024-02-15T22:56:11.724533+0000","last_unstale":"2024-02-15T22:57:55.958914+0000","last_undegraded":"2024-02-15T22:57:55.958914+0000","last_fullsized":"2024-02-15T22:57:55.958914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:55.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:55.958822+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:16:29.483298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.223131+0000","last_change":"2024-02-15T22:56:13.734719+0000","last_active":"2024-02-15T22:56:47.223131+0000","last_peered":"2024-02-15T22:56:47.223131+0000","last_clean":"2024-02-15T22:56:47.223131+0000","last_became_active":"2024-02-15T22:56:13.734428+0000","last_became_peered":"2024-02-15T22:56:13.734428+0000","last_unstale":"2024-02-15T22:56:47.223131+0000","last_undegraded":"2024-02-15T22:56:47.223131+0000","last_fullsized":"2024-02-15T22:56:47.223131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.891735+0000","last_change":"2024-02-15T22:56:05.706212+0000","last_active":"2024-02-15T22:57:29.891735+0000","last_peered":"2024-02-15T22:57:29.891735+0000","last_clean":"2024-02-15T22:57:29.891735+0000","last_became_active":"2024-02-15T22:56:05.705385+0000","last_became_peered":"2024-02-15T22:56:05.705385+0000","last_unstale":"2024-02-15T22:57:29.891735+0000","last_undegraded":"2024-02-15T22:57:29.891735+0000","last_fullsized":"2024-02-15T22:57:29.891735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.928951+0000","last_change":"2024-02-15T22:58:16.928974+0000","last_active":"2024-02-15T22:58:16.928951+0000","last_peered":"2024-02-15T22:58:16.928951+0000","last_clean":"2024-02-15T22:58:16.928951+0000","last_became_active":"2024-02-15T22:56:03.699626+0000","last_became_peered":"2024-02-15T22:56:03.699626+0000","last_unstale":"2024-02-15T22:58:16.928951+0000","last_undegraded":"2024-02-15T22:58:16.928951+0000","last_fullsized":"2024-02-15T22:58:16.928951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:16.928864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:16.928864+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.928864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:26.875704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.924953+0000","last_change":"2024-02-15T22:58:04.924988+0000","last_active":"2024-02-15T22:58:04.924953+0000","last_peered":"2024-02-15T22:58:04.924953+0000","last_clean":"2024-02-15T22:58:04.924953+0000","last_became_active":"2024-02-15T22:56:07.705705+0000","last_became_peered":"2024-02-15T22:56:07.705705+0000","last_unstale":"2024-02-15T22:58:04.924953+0000","last_undegraded":"2024-02-15T22:58:04.924953+0000","last_fullsized":"2024-02-15T22:58:04.924953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:04.924869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:04.924869+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.924869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:40.447542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'41","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.256507+0000","last_change":"2024-02-15T22:58:01.256585+0000","last_active":"2024-02-15T22:58:01.256507+0000","last_peered":"2024-02-15T22:58:01.256507+0000","last_clean":"2024-02-15T22:58:01.256507+0000","last_became_active":"2024-02-15T22:56:09.712337+0000","last_became_peered":"2024-02-15T22:56:09.712337+0000","last_unstale":"2024-02-15T22:58:01.256507+0000","last_undegraded":"2024-02-15T22:58:01.256507+0000","last_fullsized":"2024-02-15T22:58:01.256507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-02-15T22:58:01.256409+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-02-15T22:58:01.256409+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.256409+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:16.356268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.870060+0000","last_change":"2024-02-15T22:57:47.870103+0000","last_active":"2024-02-15T22:57:47.870060+0000","last_peered":"2024-02-15T22:57:47.870060+0000","last_clean":"2024-02-15T22:57:47.870060+0000","last_became_active":"2024-02-15T22:56:11.715697+0000","last_became_peered":"2024-02-15T22:56:11.715697+0000","last_unstale":"2024-02-15T22:57:47.870060+0000","last_undegraded":"2024-02-15T22:57:47.870060+0000","last_fullsized":"2024-02-15T22:57:47.870060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.869954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.869954+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.869954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:54.471463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880226+0000","last_change":"2024-02-15T22:56:13.734867+0000","last_active":"2024-02-15T22:56:45.880226+0000","last_peered":"2024-02-15T22:56:45.880226+0000","last_clean":"2024-02-15T22:56:45.880226+0000","last_became_active":"2024-02-15T22:56:13.734565+0000","last_became_peered":"2024-02-15T22:56:13.734565+0000","last_unstale":"2024-02-15T22:56:45.880226+0000","last_undegraded":"2024-02-15T22:56:45.880226+0000","last_fullsized":"2024-02-15T22:56:45.880226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.177141+0000","last_change":"2024-02-15T22:58:08.177141+0000","last_active":"2024-02-15T22:58:08.177141+0000","last_peered":"2024-02-15T22:58:08.177141+0000","last_clean":"2024-02-15T22:58:08.177141+0000","last_became_active":"2024-02-15T22:56:05.710562+0000","last_became_peered":"2024-02-15T22:56:05.710562+0000","last_unstale":"2024-02-15T22:58:08.177141+0000","last_undegraded":"2024-02-15T22:58:08.177141+0000","last_fullsized":"2024-02-15T22:58:08.177141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:08.177027+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:08.177027+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.177027+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:26.352171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880219+0000","last_change":"2024-02-15T22:56:03.697251+0000","last_active":"2024-02-15T22:56:45.880219+0000","last_peered":"2024-02-15T22:56:45.880219+0000","last_clean":"2024-02-15T22:56:45.880219+0000","last_became_active":"2024-02-15T22:56:03.696590+0000","last_became_peered":"2024-02-15T22:56:03.696590+0000","last_unstale":"2024-02-15T22:56:45.880219+0000","last_undegraded":"2024-02-15T22:56:45.880219+0000","last_fullsized":"2024-02-15T22:56:45.880219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.041195+0000","last_change":"2024-02-15T22:57:56.041220+0000","last_active":"2024-02-15T22:57:56.041195+0000","last_peered":"2024-02-15T22:57:56.041195+0000","last_clean":"2024-02-15T22:57:56.041195+0000","last_became_active":"2024-02-15T22:56:07.705239+0000","last_became_peered":"2024-02-15T22:56:07.705239+0000","last_unstale":"2024-02-15T22:57:56.041195+0000","last_undegraded":"2024-02-15T22:57:56.041195+0000","last_fullsized":"2024-02-15T22:57:56.041195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.041105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.041105+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.041105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:22.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.989258+0000","last_change":"2024-02-15T22:58:00.989290+0000","last_active":"2024-02-15T22:58:00.989258+0000","last_peered":"2024-02-15T22:58:00.989258+0000","last_clean":"2024-02-15T22:58:00.989258+0000","last_became_active":"2024-02-15T22:56:09.710616+0000","last_became_peered":"2024-02-15T22:56:09.710616+0000","last_unstale":"2024-02-15T22:58:00.989258+0000","last_undegraded":"2024-02-15T22:58:00.989258+0000","last_fullsized":"2024-02-15T22:58:00.989258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:58:00.989160+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:58:00.989160+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.989160+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:16.633010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.881742+0000","last_change":"2024-02-15T22:57:48.881779+0000","last_active":"2024-02-15T22:57:48.881742+0000","last_peered":"2024-02-15T22:57:48.881742+0000","last_clean":"2024-02-15T22:57:48.881742+0000","last_became_active":"2024-02-15T22:56:11.718995+0000","last_became_peered":"2024-02-15T22:56:11.718995+0000","last_unstale":"2024-02-15T22:57:48.881742+0000","last_undegraded":"2024-02-15T22:57:48.881742+0000","last_fullsized":"2024-02-15T22:57:48.881742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:48.881655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:48.881655+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.881655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:00:14.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371805+0000","last_change":"2024-02-15T22:56:05.699435+0000","last_active":"2024-02-15T22:57:47.371805+0000","last_peered":"2024-02-15T22:57:47.371805+0000","last_clean":"2024-02-15T22:57:47.371805+0000","last_became_active":"2024-02-15T22:56:05.699196+0000","last_became_peered":"2024-02-15T22:56:05.699196+0000","last_unstale":"2024-02-15T22:57:47.371805+0000","last_undegraded":"2024-02-15T22:57:47.371805+0000","last_fullsized":"2024-02-15T22:57:47.371805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.507535+0000","last_change":"2024-02-15T22:56:03.702280+0000","last_active":"2024-02-15T22:57:29.507535+0000","last_peered":"2024-02-15T22:57:29.507535+0000","last_clean":"2024-02-15T22:57:29.507535+0000","last_became_active":"2024-02-15T22:56:03.702007+0000","last_became_peered":"2024-02-15T22:56:03.702007+0000","last_unstale":"2024-02-15T22:57:29.507535+0000","last_undegraded":"2024-02-15T22:57:29.507535+0000","last_fullsized":"2024-02-15T22:57:29.507535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.277094+0000","last_change":"2024-02-15T22:58:05.277094+0000","last_active":"2024-02-15T22:58:05.277094+0000","last_peered":"2024-02-15T22:58:05.277094+0000","last_clean":"2024-02-15T22:58:05.277094+0000","last_became_active":"2024-02-15T22:56:07.707124+0000","last_became_peered":"2024-02-15T22:56:07.707124+0000","last_unstale":"2024-02-15T22:58:05.277094+0000","last_undegraded":"2024-02-15T22:58:05.277094+0000","last_fullsized":"2024-02-15T22:58:05.277094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:05.276922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:05.276922+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.276922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:55.491543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'59","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.341791+0000","last_change":"2024-02-15T22:57:59.341829+0000","last_active":"2024-02-15T22:57:59.341791+0000","last_peered":"2024-02-15T22:57:59.341791+0000","last_clean":"2024-02-15T22:57:59.341791+0000","last_became_active":"2024-02-15T22:56:09.713076+0000","last_became_peered":"2024-02-15T22:56:09.713076+0000","last_unstale":"2024-02-15T22:57:59.341791+0000","last_undegraded":"2024-02-15T22:57:59.341791+0000","last_fullsized":"2024-02-15T22:57:59.341791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-15T22:57:59.341704+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-15T22:57:59.341704+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.341704+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:30.766347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.956024+0000","last_change":"2024-02-15T22:57:50.956049+0000","last_active":"2024-02-15T22:57:50.956024+0000","last_peered":"2024-02-15T22:57:50.956024+0000","last_clean":"2024-02-15T22:57:50.956024+0000","last_became_active":"2024-02-15T22:56:11.718102+0000","last_became_peered":"2024-02-15T22:56:11.718102+0000","last_unstale":"2024-02-15T22:57:50.956024+0000","last_undegraded":"2024-02-15T22:57:50.956024+0000","last_fullsized":"2024-02-15T22:57:50.956024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.955925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.955925+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.955925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:28.393475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.896944+0000","last_change":"2024-02-15T22:56:13.734724+0000","last_active":"2024-02-15T22:57:29.896944+0000","last_peered":"2024-02-15T22:57:29.896944+0000","last_clean":"2024-02-15T22:57:29.896944+0000","last_became_active":"2024-02-15T22:56:13.734372+0000","last_became_peered":"2024-02-15T22:56:13.734372+0000","last_unstale":"2024-02-15T22:57:29.896944+0000","last_undegraded":"2024-02-15T22:57:29.896944+0000","last_fullsized":"2024-02-15T22:57:29.896944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053605+0000","last_change":"2024-02-15T22:56:05.705862+0000","last_active":"2024-02-15T22:57:46.053605+0000","last_peered":"2024-02-15T22:57:46.053605+0000","last_clean":"2024-02-15T22:57:46.053605+0000","last_became_active":"2024-02-15T22:56:05.705473+0000","last_became_peered":"2024-02-15T22:56:05.705473+0000","last_unstale":"2024-02-15T22:57:46.053605+0000","last_undegraded":"2024-02-15T22:57:46.053605+0000","last_fullsized":"2024-02-15T22:57:46.053605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:47.420402+0000","last_change":"2024-02-15T22:56:03.698010+0000","last_active":"2024-02-15T22:56:47.420402+0000","last_peered":"2024-02-15T22:56:47.420402+0000","last_clean":"2024-02-15T22:56:47.420402+0000","last_became_active":"2024-02-15T22:56:03.697691+0000","last_became_peered":"2024-02-15T22:56:03.697691+0000","last_unstale":"2024-02-15T22:56:47.420402+0000","last_undegraded":"2024-02-15T22:56:47.420402+0000","last_fullsized":"2024-02-15T22:56:47.420402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.898500+0000","last_change":"2024-02-15T22:58:08.898500+0000","last_active":"2024-02-15T22:58:08.898500+0000","last_peered":"2024-02-15T22:58:08.898500+0000","last_clean":"2024-02-15T22:58:08.898500+0000","last_became_active":"2024-02-15T22:56:07.704018+0000","last_became_peered":"2024-02-15T22:56:07.704018+0000","last_unstale":"2024-02-15T22:58:08.898500+0000","last_undegraded":"2024-02-15T22:58:08.898500+0000","last_fullsized":"2024-02-15T22:58:08.898500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:08.898335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:08.898335+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.898335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:35.455319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.180811+0000","last_change":"2024-02-15T22:58:03.180851+0000","last_active":"2024-02-15T22:58:03.180811+0000","last_peered":"2024-02-15T22:58:03.180811+0000","last_clean":"2024-02-15T22:58:03.180811+0000","last_became_active":"2024-02-15T22:56:09.717105+0000","last_became_peered":"2024-02-15T22:56:09.717105+0000","last_unstale":"2024-02-15T22:58:03.180811+0000","last_undegraded":"2024-02-15T22:58:03.180811+0000","last_fullsized":"2024-02-15T22:58:03.180811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-15T22:58:03.180724+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-15T22:58:03.180724+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.180724+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.050134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.879963+0000","last_change":"2024-02-15T22:58:00.880001+0000","last_active":"2024-02-15T22:58:00.879963+0000","last_peered":"2024-02-15T22:58:00.879963+0000","last_clean":"2024-02-15T22:58:00.879963+0000","last_became_active":"2024-02-15T22:56:11.722865+0000","last_became_peered":"2024-02-15T22:56:11.722865+0000","last_unstale":"2024-02-15T22:58:00.879963+0000","last_undegraded":"2024-02-15T22:58:00.879963+0000","last_fullsized":"2024-02-15T22:58:00.879963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:00.879874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:00.879874+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.879874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:59.902356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.880456+0000","last_change":"2024-02-15T22:56:13.727435+0000","last_active":"2024-02-15T22:56:45.880456+0000","last_peered":"2024-02-15T22:56:45.880456+0000","last_clean":"2024-02-15T22:56:45.880456+0000","last_became_active":"2024-02-15T22:56:13.726748+0000","last_became_peered":"2024-02-15T22:56:13.726748+0000","last_unstale":"2024-02-15T22:56:45.880456+0000","last_undegraded":"2024-02-15T22:56:45.880456+0000","last_fullsized":"2024-02-15T22:56:45.880456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.092867+0000","last_change":"2024-02-15T22:58:00.092893+0000","last_active":"2024-02-15T22:58:00.092867+0000","last_peered":"2024-02-15T22:58:00.092867+0000","last_clean":"2024-02-15T22:58:00.092867+0000","last_became_active":"2024-02-15T22:56:05.716677+0000","last_became_peered":"2024-02-15T22:56:05.716677+0000","last_unstale":"2024-02-15T22:58:00.092867+0000","last_undegraded":"2024-02-15T22:58:00.092867+0000","last_fullsized":"2024-02-15T22:58:00.092867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:00.092774+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:00.092774+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.092774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:55:49.382293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.878610+0000","last_change":"2024-02-15T22:56:03.692964+0000","last_active":"2024-02-15T22:56:45.878610+0000","last_peered":"2024-02-15T22:56:45.878610+0000","last_clean":"2024-02-15T22:56:45.878610+0000","last_became_active":"2024-02-15T22:56:03.692632+0000","last_became_peered":"2024-02-15T22:56:03.692632+0000","last_unstale":"2024-02-15T22:56:45.878610+0000","last_undegraded":"2024-02-15T22:56:45.878610+0000","last_fullsized":"2024-02-15T22:56:45.878610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.944058+0000","last_change":"2024-02-15T22:58:06.944080+0000","last_active":"2024-02-15T22:58:06.944058+0000","last_peered":"2024-02-15T22:58:06.944058+0000","last_clean":"2024-02-15T22:58:06.944058+0000","last_became_active":"2024-02-15T22:56:07.704208+0000","last_became_peered":"2024-02-15T22:56:07.704208+0000","last_unstale":"2024-02-15T22:58:06.944058+0000","last_undegraded":"2024-02-15T22:58:06.944058+0000","last_fullsized":"2024-02-15T22:58:06.944058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:06.943951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:06.943951+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.943951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:12.953469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.383705+0000","last_change":"2024-02-15T22:57:58.383705+0000","last_active":"2024-02-15T22:57:58.383705+0000","last_peered":"2024-02-15T22:57:58.383705+0000","last_clean":"2024-02-15T22:57:58.383705+0000","last_became_active":"2024-02-15T22:56:09.716753+0000","last_became_peered":"2024-02-15T22:56:09.716753+0000","last_unstale":"2024-02-15T22:57:58.383705+0000","last_undegraded":"2024-02-15T22:57:58.383705+0000","last_fullsized":"2024-02-15T22:57:58.383705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-15T22:57:58.383553+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-15T22:57:58.383553+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.383553+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:24.940537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.373579+0000","last_change":"2024-02-15T22:57:56.373579+0000","last_active":"2024-02-15T22:57:56.373579+0000","last_peered":"2024-02-15T22:57:56.373579+0000","last_clean":"2024-02-15T22:57:56.373579+0000","last_became_active":"2024-02-15T22:56:11.722738+0000","last_became_peered":"2024-02-15T22:56:11.722738+0000","last_unstale":"2024-02-15T22:57:56.373579+0000","last_undegraded":"2024-02-15T22:57:56.373579+0000","last_fullsized":"2024-02-15T22:57:56.373579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.373469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.373469+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.373469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:02.382987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882740+0000","last_change":"2024-02-15T22:56:13.727522+0000","last_active":"2024-02-15T22:56:45.882740+0000","last_peered":"2024-02-15T22:56:45.882740+0000","last_clean":"2024-02-15T22:56:45.882740+0000","last_became_active":"2024-02-15T22:56:13.727216+0000","last_became_peered":"2024-02-15T22:56:13.727216+0000","last_unstale":"2024-02-15T22:56:45.882740+0000","last_undegraded":"2024-02-15T22:56:45.882740+0000","last_fullsized":"2024-02-15T22:56:45.882740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881261+0000","last_change":"2024-02-15T22:56:05.707488+0000","last_active":"2024-02-15T22:56:45.881261+0000","last_peered":"2024-02-15T22:56:45.881261+0000","last_clean":"2024-02-15T22:56:45.881261+0000","last_became_active":"2024-02-15T22:56:05.707154+0000","last_became_peered":"2024-02-15T22:56:05.707154+0000","last_unstale":"2024-02-15T22:56:45.881261+0000","last_undegraded":"2024-02-15T22:56:45.881261+0000","last_fullsized":"2024-02-15T22:56:45.881261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881290+0000","last_change":"2024-02-15T22:56:03.700157+0000","last_active":"2024-02-15T22:56:45.881290+0000","last_peered":"2024-02-15T22:56:45.881290+0000","last_clean":"2024-02-15T22:56:45.881290+0000","last_became_active":"2024-02-15T22:56:03.699843+0000","last_became_peered":"2024-02-15T22:56:03.699843+0000","last_unstale":"2024-02-15T22:56:45.881290+0000","last_undegraded":"2024-02-15T22:56:45.881290+0000","last_fullsized":"2024-02-15T22:56:45.881290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.845172+0000","last_change":"2024-02-15T22:58:03.845209+0000","last_active":"2024-02-15T22:58:03.845172+0000","last_peered":"2024-02-15T22:58:03.845172+0000","last_clean":"2024-02-15T22:58:03.845172+0000","last_became_active":"2024-02-15T22:56:07.702014+0000","last_became_peered":"2024-02-15T22:56:07.702014+0000","last_unstale":"2024-02-15T22:58:03.845172+0000","last_undegraded":"2024-02-15T22:58:03.845172+0000","last_fullsized":"2024-02-15T22:58:03.845172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:03.845081+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:03.845081+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.845081+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:36.772070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.010523+0000","last_change":"2024-02-15T22:57:55.010523+0000","last_active":"2024-02-15T22:57:55.010523+0000","last_peered":"2024-02-15T22:57:55.010523+0000","last_clean":"2024-02-15T22:57:55.010523+0000","last_became_active":"2024-02-15T22:56:09.715996+0000","last_became_peered":"2024-02-15T22:56:09.715996+0000","last_unstale":"2024-02-15T22:57:55.010523+0000","last_undegraded":"2024-02-15T22:57:55.010523+0000","last_fullsized":"2024-02-15T22:57:55.010523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:57:55.010359+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:57:55.010359+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.010359+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:25.907925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":302,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.998940+0000","last_change":"2024-02-15T22:57:59.998940+0000","last_active":"2024-02-15T22:57:59.998940+0000","last_peered":"2024-02-15T22:57:59.998940+0000","last_clean":"2024-02-15T22:57:59.998940+0000","last_became_active":"2024-02-15T22:56:11.724520+0000","last_became_peered":"2024-02-15T22:56:11.724520+0000","last_unstale":"2024-02-15T22:57:59.998940+0000","last_undegraded":"2024-02-15T22:57:59.998940+0000","last_fullsized":"2024-02-15T22:57:59.998940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:59.998810+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:59.998810+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.998810+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:37.951898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879418+0000","last_change":"2024-02-15T22:56:13.731954+0000","last_active":"2024-02-15T22:56:45.879418+0000","last_peered":"2024-02-15T22:56:45.879418+0000","last_clean":"2024-02-15T22:56:45.879418+0000","last_became_active":"2024-02-15T22:56:13.731683+0000","last_became_peered":"2024-02-15T22:56:13.731683+0000","last_unstale":"2024-02-15T22:56:45.879418+0000","last_undegraded":"2024-02-15T22:56:45.879418+0000","last_fullsized":"2024-02-15T22:56:45.879418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.904691+0000","last_change":"2024-02-15T22:58:11.904716+0000","last_active":"2024-02-15T22:58:11.904691+0000","last_peered":"2024-02-15T22:58:11.904691+0000","last_clean":"2024-02-15T22:58:11.904691+0000","last_became_active":"2024-02-15T22:56:05.700922+0000","last_became_peered":"2024-02-15T22:56:05.700922+0000","last_unstale":"2024-02-15T22:58:11.904691+0000","last_undegraded":"2024-02-15T22:58:11.904691+0000","last_fullsized":"2024-02-15T22:58:11.904691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.904604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.904604+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.904604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:48.029771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883322+0000","last_change":"2024-02-15T22:56:03.697064+0000","last_active":"2024-02-15T22:56:45.883322+0000","last_peered":"2024-02-15T22:56:45.883322+0000","last_clean":"2024-02-15T22:56:45.883322+0000","last_became_active":"2024-02-15T22:56:03.696168+0000","last_became_peered":"2024-02-15T22:56:03.696168+0000","last_unstale":"2024-02-15T22:56:45.883322+0000","last_undegraded":"2024-02-15T22:56:45.883322+0000","last_fullsized":"2024-02-15T22:56:45.883322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.855040+0000","last_change":"2024-02-15T22:58:05.855063+0000","last_active":"2024-02-15T22:58:05.855040+0000","last_peered":"2024-02-15T22:58:05.855040+0000","last_clean":"2024-02-15T22:58:05.855040+0000","last_became_active":"2024-02-15T22:56:07.701777+0000","last_became_peered":"2024-02-15T22:56:07.701777+0000","last_unstale":"2024-02-15T22:58:05.855040+0000","last_undegraded":"2024-02-15T22:58:05.855040+0000","last_fullsized":"2024-02-15T22:58:05.855040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:05.854938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:05.854938+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.854938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:45.103674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'44","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.877626+0000","last_change":"2024-02-15T22:57:54.877670+0000","last_active":"2024-02-15T22:57:54.877626+0000","last_peered":"2024-02-15T22:57:54.877626+0000","last_clean":"2024-02-15T22:57:54.877626+0000","last_became_active":"2024-02-15T22:56:09.713636+0000","last_became_peered":"2024-02-15T22:56:09.713636+0000","last_unstale":"2024-02-15T22:57:54.877626+0000","last_undegraded":"2024-02-15T22:57:54.877626+0000","last_fullsized":"2024-02-15T22:57:54.877626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:57:54.877538+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:57:54.877538+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.877538+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:18.263250+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.331402+0000","last_change":"2024-02-15T22:57:46.331421+0000","last_active":"2024-02-15T22:57:46.331402+0000","last_peered":"2024-02-15T22:57:46.331402+0000","last_clean":"2024-02-15T22:57:46.331402+0000","last_became_active":"2024-02-15T22:56:11.722374+0000","last_became_peered":"2024-02-15T22:56:11.722374+0000","last_unstale":"2024-02-15T22:57:46.331402+0000","last_undegraded":"2024-02-15T22:57:46.331402+0000","last_fullsized":"2024-02-15T22:57:46.331402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:46.331332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:46.331332+0000","last_clean_scrub_stamp":"2024-02-15T22:57:46.331332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:32.555922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.879445+0000","last_change":"2024-02-15T22:56:13.733861+0000","last_active":"2024-02-15T22:56:45.879445+0000","last_peered":"2024-02-15T22:56:45.879445+0000","last_clean":"2024-02-15T22:56:45.879445+0000","last_became_active":"2024-02-15T22:56:13.733576+0000","last_became_peered":"2024-02-15T22:56:13.733576+0000","last_unstale":"2024-02-15T22:56:45.879445+0000","last_undegraded":"2024-02-15T22:56:45.879445+0000","last_fullsized":"2024-02-15T22:56:45.879445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.944035+0000","last_change":"2024-02-15T22:58:09.944063+0000","last_active":"2024-02-15T22:58:09.944035+0000","last_peered":"2024-02-15T22:58:09.944035+0000","last_clean":"2024-02-15T22:58:09.944035+0000","last_became_active":"2024-02-15T22:56:05.701026+0000","last_became_peered":"2024-02-15T22:56:05.701026+0000","last_unstale":"2024-02-15T22:58:09.944035+0000","last_undegraded":"2024-02-15T22:58:09.944035+0000","last_fullsized":"2024-02-15T22:58:09.944035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:09.943931+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:09.943931+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.943931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:46:04.334961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.883620+0000","last_change":"2024-02-15T22:56:03.706706+0000","last_active":"2024-02-15T22:56:45.883620+0000","last_peered":"2024-02-15T22:56:45.883620+0000","last_clean":"2024-02-15T22:56:45.883620+0000","last_became_active":"2024-02-15T22:56:03.706422+0000","last_became_peered":"2024-02-15T22:56:03.706422+0000","last_unstale":"2024-02-15T22:56:45.883620+0000","last_undegraded":"2024-02-15T22:56:45.883620+0000","last_fullsized":"2024-02-15T22:56:45.883620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.004935+0000","last_change":"2024-02-15T22:58:02.004957+0000","last_active":"2024-02-15T22:58:02.004935+0000","last_peered":"2024-02-15T22:58:02.004935+0000","last_clean":"2024-02-15T22:58:02.004935+0000","last_became_active":"2024-02-15T22:56:07.707265+0000","last_became_peered":"2024-02-15T22:56:07.707265+0000","last_unstale":"2024-02-15T22:58:02.004935+0000","last_undegraded":"2024-02-15T22:58:02.004935+0000","last_fullsized":"2024-02-15T22:58:02.004935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:02.004846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:02.004846+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.004846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:25.390557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'35","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.350840+0000","last_change":"2024-02-15T22:57:57.350886+0000","last_active":"2024-02-15T22:57:57.350840+0000","last_peered":"2024-02-15T22:57:57.350840+0000","last_clean":"2024-02-15T22:57:57.350840+0000","last_became_active":"2024-02-15T22:56:09.716749+0000","last_became_peered":"2024-02-15T22:56:09.716749+0000","last_unstale":"2024-02-15T22:57:57.350840+0000","last_undegraded":"2024-02-15T22:57:57.350840+0000","last_fullsized":"2024-02-15T22:57:57.350840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-02-15T22:57:57.350743+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-02-15T22:57:57.350743+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.350743+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:56.373225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.125903+0000","last_change":"2024-02-15T22:58:17.125944+0000","last_active":"2024-02-15T22:58:17.125903+0000","last_peered":"2024-02-15T22:58:17.125903+0000","last_clean":"2024-02-15T22:58:17.125903+0000","last_became_active":"2024-02-15T22:56:11.725667+0000","last_became_peered":"2024-02-15T22:56:11.725667+0000","last_unstale":"2024-02-15T22:58:17.125903+0000","last_undegraded":"2024-02-15T22:58:17.125903+0000","last_fullsized":"2024-02-15T22:58:17.125903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:17.125792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:17.125792+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.125792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:36:22.884918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'8","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:46.880803+0000","last_change":"2024-02-15T22:56:13.729381+0000","last_active":"2024-02-15T22:56:46.880803+0000","last_peered":"2024-02-15T22:56:46.880803+0000","last_clean":"2024-02-15T22:56:46.880803+0000","last_became_active":"2024-02-15T22:56:13.728844+0000","last_became_peered":"2024-02-15T22:56:13.728844+0000","last_unstale":"2024-02-15T22:56:46.880803+0000","last_undegraded":"2024-02-15T22:56:46.880803+0000","last_fullsized":"2024-02-15T22:56:46.880803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'1","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:29.505750+0000","last_change":"2024-02-15T22:56:05.701351+0000","last_active":"2024-02-15T22:57:29.505750+0000","last_peered":"2024-02-15T22:57:29.505750+0000","last_clean":"2024-02-15T22:57:29.505750+0000","last_became_active":"2024-02-15T22:56:05.700908+0000","last_became_peered":"2024-02-15T22:56:05.700908+0000","last_unstale":"2024-02-15T22:57:29.505750+0000","last_undegraded":"2024-02-15T22:57:29.505750+0000","last_fullsized":"2024-02-15T22:57:29.505750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.253825+0000","last_change":"2024-02-15T22:58:21.253850+0000","last_active":"2024-02-15T22:58:21.253825+0000","last_peered":"2024-02-15T22:58:21.253825+0000","last_clean":"2024-02-15T22:58:21.253825+0000","last_became_active":"2024-02-15T22:56:03.704081+0000","last_became_peered":"2024-02-15T22:56:03.704081+0000","last_unstale":"2024-02-15T22:58:21.253825+0000","last_undegraded":"2024-02-15T22:58:21.253825+0000","last_fullsized":"2024-02-15T22:58:21.253825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:21.253735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:21.253735+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.253735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:33.248382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.886331+0000","last_change":"2024-02-15T22:57:58.886355+0000","last_active":"2024-02-15T22:57:58.886331+0000","last_peered":"2024-02-15T22:57:58.886331+0000","last_clean":"2024-02-15T22:57:58.886331+0000","last_became_active":"2024-02-15T22:56:07.708530+0000","last_became_peered":"2024-02-15T22:56:07.708530+0000","last_unstale":"2024-02-15T22:57:58.886331+0000","last_undegraded":"2024-02-15T22:57:58.886331+0000","last_fullsized":"2024-02-15T22:57:58.886331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:58.886242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:58.886242+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.886242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:28.475625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.000846+0000","last_change":"2024-02-15T22:57:57.000899+0000","last_active":"2024-02-15T22:57:57.000846+0000","last_peered":"2024-02-15T22:57:57.000846+0000","last_clean":"2024-02-15T22:57:57.000846+0000","last_became_active":"2024-02-15T22:56:09.716134+0000","last_became_peered":"2024-02-15T22:56:09.716134+0000","last_unstale":"2024-02-15T22:57:57.000846+0000","last_undegraded":"2024-02-15T22:57:57.000846+0000","last_fullsized":"2024-02-15T22:57:57.000846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-02-15T22:57:57.000753+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-02-15T22:57:57.000753+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.000753+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:47.478957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":49,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.185610+0000","last_change":"2024-02-15T22:58:13.185631+0000","last_active":"2024-02-15T22:58:13.185610+0000","last_peered":"2024-02-15T22:58:13.185610+0000","last_clean":"2024-02-15T22:58:13.185610+0000","last_became_active":"2024-02-15T22:56:11.725271+0000","last_became_peered":"2024-02-15T22:56:11.725271+0000","last_unstale":"2024-02-15T22:58:13.185610+0000","last_undegraded":"2024-02-15T22:58:13.185610+0000","last_fullsized":"2024-02-15T22:58:13.185610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:13.185521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:13.185521+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.185521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:35.729575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.881014+0000","last_change":"2024-02-15T22:56:13.735140+0000","last_active":"2024-02-15T22:56:45.881014+0000","last_peered":"2024-02-15T22:56:45.881014+0000","last_clean":"2024-02-15T22:56:45.881014+0000","last_became_active":"2024-02-15T22:56:13.734871+0000","last_became_peered":"2024-02-15T22:56:13.734871+0000","last_unstale":"2024-02-15T22:56:45.881014+0000","last_undegraded":"2024-02-15T22:56:45.881014+0000","last_fullsized":"2024-02-15T22:56:45.881014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'16","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.955267+0000","last_change":"2024-02-15T22:58:10.955321+0000","last_active":"2024-02-15T22:58:10.955267+0000","last_peered":"2024-02-15T22:58:10.955267+0000","last_clean":"2024-02-15T22:58:10.955267+0000","last_became_active":"2024-02-15T22:56:05.700066+0000","last_became_peered":"2024-02-15T22:56:05.700066+0000","last_unstale":"2024-02-15T22:58:10.955267+0000","last_undegraded":"2024-02-15T22:58:10.955267+0000","last_fullsized":"2024-02-15T22:58:10.955267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-15T22:58:10.955167+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-15T22:58:10.955167+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.955167+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:41:48.202367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491401+0000","last_change":"2024-02-15T22:56:03.694391+0000","last_active":"2024-02-15T22:57:46.491401+0000","last_peered":"2024-02-15T22:57:46.491401+0000","last_clean":"2024-02-15T22:57:46.491401+0000","last_became_active":"2024-02-15T22:56:03.693300+0000","last_became_peered":"2024-02-15T22:56:03.693300+0000","last_unstale":"2024-02-15T22:57:46.491401+0000","last_undegraded":"2024-02-15T22:57:46.491401+0000","last_fullsized":"2024-02-15T22:57:46.491401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.879638+0000","last_change":"2024-02-15T22:57:57.879672+0000","last_active":"2024-02-15T22:57:57.879638+0000","last_peered":"2024-02-15T22:57:57.879638+0000","last_clean":"2024-02-15T22:57:57.879638+0000","last_became_active":"2024-02-15T22:56:07.708720+0000","last_became_peered":"2024-02-15T22:56:07.708720+0000","last_unstale":"2024-02-15T22:57:57.879638+0000","last_undegraded":"2024-02-15T22:57:57.879638+0000","last_fullsized":"2024-02-15T22:57:57.879638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:57:57.879545+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:57:57.879545+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.879545+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:33.402218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'37","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.181047+0000","last_change":"2024-02-15T22:58:20.181089+0000","last_active":"2024-02-15T22:58:20.181047+0000","last_peered":"2024-02-15T22:58:20.181047+0000","last_clean":"2024-02-15T22:58:20.181047+0000","last_became_active":"2024-02-15T22:56:09.717846+0000","last_became_peered":"2024-02-15T22:56:09.717846+0000","last_unstale":"2024-02-15T22:58:20.181047+0000","last_undegraded":"2024-02-15T22:58:20.181047+0000","last_fullsized":"2024-02-15T22:58:20.181047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-15T22:58:20.180944+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-15T22:58:20.180944+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.180944+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:11:37.794373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.339561+0000","last_change":"2024-02-15T22:57:48.339582+0000","last_active":"2024-02-15T22:57:48.339561+0000","last_peered":"2024-02-15T22:57:48.339561+0000","last_clean":"2024-02-15T22:57:48.339561+0000","last_became_active":"2024-02-15T22:56:11.722402+0000","last_became_peered":"2024-02-15T22:56:11.722402+0000","last_unstale":"2024-02-15T22:57:48.339561+0000","last_undegraded":"2024-02-15T22:57:48.339561+0000","last_fullsized":"2024-02-15T22:57:48.339561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:48.339482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:48.339482+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.339482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:51.537660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:56:45.882303+0000","last_change":"2024-02-15T22:56:13.733552+0000","last_active":"2024-02-15T22:56:45.882303+0000","last_peered":"2024-02-15T22:56:45.882303+0000","last_clean":"2024-02-15T22:56:45.882303+0000","last_became_active":"2024-02-15T22:56:13.733285+0000","last_became_peered":"2024-02-15T22:56:13.733285+0000","last_unstale":"2024-02-15T22:56:45.882303+0000","last_undegraded":"2024-02-15T22:56:45.882303+0000","last_fullsized":"2024-02-15T22:56:45.882303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.867874+0000","last_change":"2024-02-15T22:58:06.867874+0000","last_active":"2024-02-15T22:58:06.867874+0000","last_peered":"2024-02-15T22:58:06.867874+0000","last_clean":"2024-02-15T22:58:06.867874+0000","last_became_active":"2024-02-15T22:56:05.715609+0000","last_became_peered":"2024-02-15T22:56:05.715609+0000","last_unstale":"2024-02-15T22:58:06.867874+0000","last_undegraded":"2024-02-15T22:58:06.867874+0000","last_fullsized":"2024-02-15T22:58:06.867874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-02-15T22:58:06.867728+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-02-15T22:58:06.867728+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.867728+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:34.691909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.930705+0000","last_change":"2024-02-15T22:56:03.694275+0000","last_active":"2024-02-15T22:57:46.930705+0000","last_peered":"2024-02-15T22:57:46.930705+0000","last_clean":"2024-02-15T22:57:46.930705+0000","last_became_active":"2024-02-15T22:56:03.691266+0000","last_became_peered":"2024-02-15T22:56:03.691266+0000","last_unstale":"2024-02-15T22:57:46.930705+0000","last_undegraded":"2024-02-15T22:57:46.930705+0000","last_fullsized":"2024-02-15T22:57:46.930705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.222659+0000","last_change":"2024-02-15T22:58:17.222659+0000","last_active":"2024-02-15T22:58:17.222659+0000","last_peered":"2024-02-15T22:58:17.222659+0000","last_clean":"2024-02-15T22:58:17.222659+0000","last_became_active":"2024-02-15T22:56:05.707492+0000","last_became_peered":"2024-02-15T22:56:05.707492+0000","last_unstale":"2024-02-15T22:58:17.222659+0000","last_undegraded":"2024-02-15T22:58:17.222659+0000","last_fullsized":"2024-02-15T22:58:17.222659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:17.222540+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:17.222540+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.222540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:43.244450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053392+0000","last_change":"2024-02-15T22:56:03.693256+0000","last_active":"2024-02-15T22:57:46.053392+0000","last_peered":"2024-02-15T22:57:46.053392+0000","last_clean":"2024-02-15T22:57:46.053392+0000","last_became_active":"2024-02-15T22:56:03.692909+0000","last_became_peered":"2024-02-15T22:56:03.692909+0000","last_unstale":"2024-02-15T22:57:46.053392+0000","last_undegraded":"2024-02-15T22:57:46.053392+0000","last_fullsized":"2024-02-15T22:57:46.053392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.142444+0000","last_change":"2024-02-15T22:58:10.142444+0000","last_active":"2024-02-15T22:58:10.142444+0000","last_peered":"2024-02-15T22:58:10.142444+0000","last_clean":"2024-02-15T22:58:10.142444+0000","last_became_active":"2024-02-15T22:56:05.710095+0000","last_became_peered":"2024-02-15T22:56:05.710095+0000","last_unstale":"2024-02-15T22:58:10.142444+0000","last_undegraded":"2024-02-15T22:58:10.142444+0000","last_fullsized":"2024-02-15T22:58:10.142444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:10.142332+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:10.142332+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.142332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:29:45.908209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371453+0000","last_change":"2024-02-15T22:56:03.695701+0000","last_active":"2024-02-15T22:57:47.371453+0000","last_peered":"2024-02-15T22:57:47.371453+0000","last_clean":"2024-02-15T22:57:47.371453+0000","last_became_active":"2024-02-15T22:56:03.695362+0000","last_became_peered":"2024-02-15T22:56:03.695362+0000","last_unstale":"2024-02-15T22:57:47.371453+0000","last_undegraded":"2024-02-15T22:57:47.371453+0000","last_fullsized":"2024-02-15T22:57:47.371453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.211865+0000","last_change":"2024-02-15T22:58:18.211865+0000","last_active":"2024-02-15T22:58:18.211865+0000","last_peered":"2024-02-15T22:58:18.211865+0000","last_clean":"2024-02-15T22:58:18.211865+0000","last_became_active":"2024-02-15T22:56:05.701253+0000","last_became_peered":"2024-02-15T22:56:05.701253+0000","last_unstale":"2024-02-15T22:58:18.211865+0000","last_undegraded":"2024-02-15T22:58:18.211865+0000","last_fullsized":"2024-02-15T22:58:18.211865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:18.211741+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:18.211741+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.211741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:08.689945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053408+0000","last_change":"2024-02-15T22:56:03.700366+0000","last_active":"2024-02-15T22:57:46.053408+0000","last_peered":"2024-02-15T22:57:46.053408+0000","last_clean":"2024-02-15T22:57:46.053408+0000","last_became_active":"2024-02-15T22:56:03.699881+0000","last_became_peered":"2024-02-15T22:56:03.699881+0000","last_unstale":"2024-02-15T22:57:46.053408+0000","last_undegraded":"2024-02-15T22:57:46.053408+0000","last_fullsized":"2024-02-15T22:57:46.053408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053648+0000","last_change":"2024-02-15T22:56:45.887346+0000","last_active":"2024-02-15T22:57:46.053648+0000","last_peered":"2024-02-15T22:57:46.053648+0000","last_clean":"2024-02-15T22:57:46.053648+0000","last_became_active":"2024-02-15T22:56:45.886976+0000","last_became_peered":"2024-02-15T22:56:45.886976+0000","last_unstale":"2024-02-15T22:57:46.053648+0000","last_undegraded":"2024-02-15T22:57:46.053648+0000","last_fullsized":"2024-02-15T22:57:46.053648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053470+0000","last_change":"2024-02-15T22:56:03.693265+0000","last_active":"2024-02-15T22:57:46.053470+0000","last_peered":"2024-02-15T22:57:46.053470+0000","last_clean":"2024-02-15T22:57:46.053470+0000","last_became_active":"2024-02-15T22:56:03.692939+0000","last_became_peered":"2024-02-15T22:56:03.692939+0000","last_unstale":"2024-02-15T22:57:46.053470+0000","last_undegraded":"2024-02-15T22:57:46.053470+0000","last_fullsized":"2024-02-15T22:57:46.053470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.838311+0000","last_change":"2024-02-15T22:58:09.838311+0000","last_active":"2024-02-15T22:58:09.838311+0000","last_peered":"2024-02-15T22:58:09.838311+0000","last_clean":"2024-02-15T22:58:09.838311+0000","last_became_active":"2024-02-15T22:56:05.713670+0000","last_became_peered":"2024-02-15T22:56:05.713670+0000","last_unstale":"2024-02-15T22:58:09.838311+0000","last_undegraded":"2024-02-15T22:58:09.838311+0000","last_fullsized":"2024-02-15T22:58:09.838311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:09.838137+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:09.838137+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.838137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:24:40.314346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491435+0000","last_change":"2024-02-15T22:56:03.697544+0000","last_active":"2024-02-15T22:57:46.491435+0000","last_peered":"2024-02-15T22:57:46.491435+0000","last_clean":"2024-02-15T22:57:46.491435+0000","last_became_active":"2024-02-15T22:56:03.696174+0000","last_became_peered":"2024-02-15T22:56:03.696174+0000","last_unstale":"2024-02-15T22:57:46.491435+0000","last_undegraded":"2024-02-15T22:57:46.491435+0000","last_fullsized":"2024-02-15T22:57:46.491435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.217171+0000","last_change":"2024-02-15T22:58:20.217197+0000","last_active":"2024-02-15T22:58:20.217171+0000","last_peered":"2024-02-15T22:58:20.217171+0000","last_clean":"2024-02-15T22:58:20.217171+0000","last_became_active":"2024-02-15T22:56:05.703183+0000","last_became_peered":"2024-02-15T22:56:05.703183+0000","last_unstale":"2024-02-15T22:58:20.217171+0000","last_undegraded":"2024-02-15T22:58:20.217171+0000","last_fullsized":"2024-02-15T22:58:20.217171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:20.217082+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:20.217082+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.217082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:26.212867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.899622+0000","last_change":"2024-02-15T22:58:18.899658+0000","last_active":"2024-02-15T22:58:18.899622+0000","last_peered":"2024-02-15T22:58:18.899622+0000","last_clean":"2024-02-15T22:58:18.899622+0000","last_became_active":"2024-02-15T22:56:03.699989+0000","last_became_peered":"2024-02-15T22:56:03.699989+0000","last_unstale":"2024-02-15T22:58:18.899622+0000","last_undegraded":"2024-02-15T22:58:18.899622+0000","last_fullsized":"2024-02-15T22:58:18.899622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:18.899525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:18.899525+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.899525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:19.320652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.867837+0000","last_change":"2024-02-15T22:58:14.867862+0000","last_active":"2024-02-15T22:58:14.867837+0000","last_peered":"2024-02-15T22:58:14.867837+0000","last_clean":"2024-02-15T22:58:14.867837+0000","last_became_active":"2024-02-15T22:56:05.701193+0000","last_became_peered":"2024-02-15T22:56:05.701193+0000","last_unstale":"2024-02-15T22:58:14.867837+0000","last_undegraded":"2024-02-15T22:58:14.867837+0000","last_fullsized":"2024-02-15T22:58:14.867837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:14.867745+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:14.867745+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.867745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:45.079186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053358+0000","last_change":"2024-02-15T22:56:03.693252+0000","last_active":"2024-02-15T22:57:46.053358+0000","last_peered":"2024-02-15T22:57:46.053358+0000","last_clean":"2024-02-15T22:57:46.053358+0000","last_became_active":"2024-02-15T22:56:03.692902+0000","last_became_peered":"2024-02-15T22:56:03.692902+0000","last_unstale":"2024-02-15T22:57:46.053358+0000","last_undegraded":"2024-02-15T22:57:46.053358+0000","last_fullsized":"2024-02-15T22:57:46.053358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.832083+0000","last_change":"2024-02-15T22:58:16.832083+0000","last_active":"2024-02-15T22:58:16.832083+0000","last_peered":"2024-02-15T22:58:16.832083+0000","last_clean":"2024-02-15T22:58:16.832083+0000","last_became_active":"2024-02-15T22:56:05.702455+0000","last_became_peered":"2024-02-15T22:56:05.702455+0000","last_unstale":"2024-02-15T22:58:16.832083+0000","last_undegraded":"2024-02-15T22:58:16.832083+0000","last_fullsized":"2024-02-15T22:58:16.832083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:16.831958+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:16.831958+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.831958+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:31.233589+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371427+0000","last_change":"2024-02-15T22:56:03.695480+0000","last_active":"2024-02-15T22:57:47.371427+0000","last_peered":"2024-02-15T22:57:47.371427+0000","last_clean":"2024-02-15T22:57:47.371427+0000","last_became_active":"2024-02-15T22:56:03.695149+0000","last_became_peered":"2024-02-15T22:56:03.695149+0000","last_unstale":"2024-02-15T22:57:47.371427+0000","last_undegraded":"2024-02-15T22:57:47.371427+0000","last_fullsized":"2024-02-15T22:57:47.371427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371897+0000","last_change":"2024-02-15T22:56:05.704460+0000","last_active":"2024-02-15T22:57:47.371897+0000","last_peered":"2024-02-15T22:57:47.371897+0000","last_clean":"2024-02-15T22:57:47.371897+0000","last_became_active":"2024-02-15T22:56:05.704211+0000","last_became_peered":"2024-02-15T22:56:05.704211+0000","last_unstale":"2024-02-15T22:57:47.371897+0000","last_undegraded":"2024-02-15T22:57:47.371897+0000","last_fullsized":"2024-02-15T22:57:47.371897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053412+0000","last_change":"2024-02-15T22:56:03.700242+0000","last_active":"2024-02-15T22:57:46.053412+0000","last_peered":"2024-02-15T22:57:46.053412+0000","last_clean":"2024-02-15T22:57:46.053412+0000","last_became_active":"2024-02-15T22:56:03.699419+0000","last_became_peered":"2024-02-15T22:56:03.699419+0000","last_unstale":"2024-02-15T22:57:46.053412+0000","last_undegraded":"2024-02-15T22:57:46.053412+0000","last_fullsized":"2024-02-15T22:57:46.053412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.239317+0000","last_change":"2024-02-15T22:58:15.239317+0000","last_active":"2024-02-15T22:58:15.239317+0000","last_peered":"2024-02-15T22:58:15.239317+0000","last_clean":"2024-02-15T22:58:15.239317+0000","last_became_active":"2024-02-15T22:56:05.710665+0000","last_became_peered":"2024-02-15T22:56:05.710665+0000","last_unstale":"2024-02-15T22:58:15.239317+0000","last_undegraded":"2024-02-15T22:58:15.239317+0000","last_fullsized":"2024-02-15T22:58:15.239317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:15.239206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:15.239206+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.239206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:58.794458+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.898287+0000","last_change":"2024-02-15T22:58:23.898307+0000","last_active":"2024-02-15T22:58:23.898287+0000","last_peered":"2024-02-15T22:58:23.898287+0000","last_clean":"2024-02-15T22:58:23.898287+0000","last_became_active":"2024-02-15T22:56:03.705871+0000","last_became_peered":"2024-02-15T22:56:03.705871+0000","last_unstale":"2024-02-15T22:58:23.898287+0000","last_undegraded":"2024-02-15T22:58:23.898287+0000","last_fullsized":"2024-02-15T22:58:23.898287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.898186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.898186+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.898186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:29.893971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.881465+0000","last_change":"2024-02-15T22:58:22.881496+0000","last_active":"2024-02-15T22:58:22.881465+0000","last_peered":"2024-02-15T22:58:22.881465+0000","last_clean":"2024-02-15T22:58:22.881465+0000","last_became_active":"2024-02-15T22:56:05.704505+0000","last_became_peered":"2024-02-15T22:56:05.704505+0000","last_unstale":"2024-02-15T22:58:22.881465+0000","last_undegraded":"2024-02-15T22:58:22.881465+0000","last_fullsized":"2024-02-15T22:58:22.881465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:22.881364+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:22.881364+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.881364+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:32:11.297043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.853912+0000","last_change":"2024-02-15T22:58:21.853937+0000","last_active":"2024-02-15T22:58:21.853912+0000","last_peered":"2024-02-15T22:58:21.853912+0000","last_clean":"2024-02-15T22:58:21.853912+0000","last_became_active":"2024-02-15T22:56:03.705904+0000","last_became_peered":"2024-02-15T22:56:03.705904+0000","last_unstale":"2024-02-15T22:58:21.853912+0000","last_undegraded":"2024-02-15T22:58:21.853912+0000","last_fullsized":"2024-02-15T22:58:21.853912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:21.853819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:21.853819+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.853819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:12.332024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.864194+0000","last_change":"2024-02-15T22:58:13.864194+0000","last_active":"2024-02-15T22:58:13.864194+0000","last_peered":"2024-02-15T22:58:13.864194+0000","last_clean":"2024-02-15T22:58:13.864194+0000","last_became_active":"2024-02-15T22:56:05.713035+0000","last_became_peered":"2024-02-15T22:56:05.713035+0000","last_unstale":"2024-02-15T22:58:13.864194+0000","last_undegraded":"2024-02-15T22:58:13.864194+0000","last_fullsized":"2024-02-15T22:58:13.864194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:13.864083+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:13.864083+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.864083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:17.062902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371548+0000","last_change":"2024-02-15T22:56:03.696317+0000","last_active":"2024-02-15T22:57:47.371548+0000","last_peered":"2024-02-15T22:57:47.371548+0000","last_clean":"2024-02-15T22:57:47.371548+0000","last_became_active":"2024-02-15T22:56:03.696045+0000","last_became_peered":"2024-02-15T22:56:03.696045+0000","last_unstale":"2024-02-15T22:57:47.371548+0000","last_undegraded":"2024-02-15T22:57:47.371548+0000","last_fullsized":"2024-02-15T22:57:47.371548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.867031+0000","last_change":"2024-02-15T22:58:20.867085+0000","last_active":"2024-02-15T22:58:20.867031+0000","last_peered":"2024-02-15T22:58:20.867031+0000","last_clean":"2024-02-15T22:58:20.867031+0000","last_became_active":"2024-02-15T22:56:05.704733+0000","last_became_peered":"2024-02-15T22:56:05.704733+0000","last_unstale":"2024-02-15T22:58:20.867031+0000","last_undegraded":"2024-02-15T22:58:20.867031+0000","last_fullsized":"2024-02-15T22:58:20.867031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-02-15T22:58:20.866916+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-02-15T22:58:20.866916+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.866916+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:09:47.979444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371496+0000","last_change":"2024-02-15T22:56:03.695753+0000","last_active":"2024-02-15T22:57:47.371496+0000","last_peered":"2024-02-15T22:57:47.371496+0000","last_clean":"2024-02-15T22:57:47.371496+0000","last_became_active":"2024-02-15T22:56:03.695454+0000","last_became_peered":"2024-02-15T22:56:03.695454+0000","last_unstale":"2024-02-15T22:57:47.371496+0000","last_undegraded":"2024-02-15T22:57:47.371496+0000","last_fullsized":"2024-02-15T22:57:47.371496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371888+0000","last_change":"2024-02-15T22:56:05.707756+0000","last_active":"2024-02-15T22:57:47.371888+0000","last_peered":"2024-02-15T22:57:47.371888+0000","last_clean":"2024-02-15T22:57:47.371888+0000","last_became_active":"2024-02-15T22:56:05.707464+0000","last_became_peered":"2024-02-15T22:56:05.707464+0000","last_unstale":"2024-02-15T22:57:47.371888+0000","last_undegraded":"2024-02-15T22:57:47.371888+0000","last_fullsized":"2024-02-15T22:57:47.371888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.930749+0000","last_change":"2024-02-15T22:56:03.696562+0000","last_active":"2024-02-15T22:57:46.930749+0000","last_peered":"2024-02-15T22:57:46.930749+0000","last_clean":"2024-02-15T22:57:46.930749+0000","last_became_active":"2024-02-15T22:56:03.696267+0000","last_became_peered":"2024-02-15T22:56:03.696267+0000","last_unstale":"2024-02-15T22:57:46.930749+0000","last_undegraded":"2024-02-15T22:57:46.930749+0000","last_fullsized":"2024-02-15T22:57:46.930749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491732+0000","last_change":"2024-02-15T22:56:05.705880+0000","last_active":"2024-02-15T22:57:46.491732+0000","last_peered":"2024-02-15T22:57:46.491732+0000","last_clean":"2024-02-15T22:57:46.491732+0000","last_became_active":"2024-02-15T22:56:05.705496+0000","last_became_peered":"2024-02-15T22:56:05.705496+0000","last_unstale":"2024-02-15T22:57:46.491732+0000","last_undegraded":"2024-02-15T22:57:46.491732+0000","last_fullsized":"2024-02-15T22:57:46.491732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371528+0000","last_change":"2024-02-15T22:56:03.707531+0000","last_active":"2024-02-15T22:57:47.371528+0000","last_peered":"2024-02-15T22:57:47.371528+0000","last_clean":"2024-02-15T22:57:47.371528+0000","last_became_active":"2024-02-15T22:56:03.707033+0000","last_became_peered":"2024-02-15T22:56:03.707033+0000","last_unstale":"2024-02-15T22:57:47.371528+0000","last_undegraded":"2024-02-15T22:57:47.371528+0000","last_fullsized":"2024-02-15T22:57:47.371528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371494+0000","last_change":"2024-02-15T22:56:03.706143+0000","last_active":"2024-02-15T22:57:47.371494+0000","last_peered":"2024-02-15T22:57:47.371494+0000","last_clean":"2024-02-15T22:57:47.371494+0000","last_became_active":"2024-02-15T22:56:03.705853+0000","last_became_peered":"2024-02-15T22:56:03.705853+0000","last_unstale":"2024-02-15T22:57:47.371494+0000","last_undegraded":"2024-02-15T22:57:47.371494+0000","last_fullsized":"2024-02-15T22:57:47.371494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.186846+0000","last_change":"2024-02-15T22:58:19.186899+0000","last_active":"2024-02-15T22:58:19.186846+0000","last_peered":"2024-02-15T22:58:19.186846+0000","last_clean":"2024-02-15T22:58:19.186846+0000","last_became_active":"2024-02-15T22:56:05.699141+0000","last_became_peered":"2024-02-15T22:56:05.699141+0000","last_unstale":"2024-02-15T22:58:19.186846+0000","last_undegraded":"2024-02-15T22:58:19.186846+0000","last_fullsized":"2024-02-15T22:58:19.186846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:19.186738+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:19.186738+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.186738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:54.706314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053453+0000","last_change":"2024-02-15T22:56:03.700573+0000","last_active":"2024-02-15T22:57:46.053453+0000","last_peered":"2024-02-15T22:57:46.053453+0000","last_clean":"2024-02-15T22:57:46.053453+0000","last_became_active":"2024-02-15T22:56:03.700107+0000","last_became_peered":"2024-02-15T22:56:03.700107+0000","last_unstale":"2024-02-15T22:57:46.053453+0000","last_undegraded":"2024-02-15T22:57:46.053453+0000","last_fullsized":"2024-02-15T22:57:46.053453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.897621+0000","last_change":"2024-02-15T22:58:11.897645+0000","last_active":"2024-02-15T22:58:11.897621+0000","last_peered":"2024-02-15T22:58:11.897621+0000","last_clean":"2024-02-15T22:58:11.897621+0000","last_became_active":"2024-02-15T22:56:05.713142+0000","last_became_peered":"2024-02-15T22:56:05.713142+0000","last_unstale":"2024-02-15T22:58:11.897621+0000","last_undegraded":"2024-02-15T22:58:11.897621+0000","last_fullsized":"2024-02-15T22:58:11.897621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:11.897529+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:11.897529+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.897529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:37.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1419,"ondisk_log_size":1419,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":46,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672995,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35764,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336076,"statfs":{"total":96636764160,"available":96600141824,"internally_reserved":0,"allocated":438272,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.41999999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.374},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Feb 15 22:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.316,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.41299999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.24099999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46300000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Feb 15 22:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35199999999999998,"15min":0.35599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.432,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.32400000000000001,"15min":0.32800000000000001},"min":{"1min":0.23699999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.44800000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.28899999999999998}]}]},{"osd":2,"up_from":10,"seq":42949672996,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":978944,"data_stored":722767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.52700000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.54700000000000004,"5min":0.623,"15min":0.623},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Feb 15 22:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30299999999999999,"15min":0.30399999999999999},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41799999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.313,"15min":0.311},"min":{"1min":0.19500000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.48799999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.376}]},{"osd":3,"last update":"Thu Feb 15 22:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.33000000000000002,"15min":0.33200000000000002},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.433,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46300000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.30499999999999999}]}]},{"osd":1,"up_from":10,"seq":42949672995,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.311,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52500000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Feb 15 22:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.192,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.30299999999999999,"15min":0.30199999999999999},"min":{"1min":0.23499999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Feb 15 22:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.311,"15min":0.309},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34799999999999998,"15min":0.34699999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.28199999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:57:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.48899999999999999},"min":{"1min":0.377,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68400000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.499},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.36099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67600000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Feb 15 22:57:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69099999999999995,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.502,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.63100000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Feb 15 22:57:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.33400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.313,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70099999999999996,"5min":0.75,"15min":0.75},"last":0.45500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:58:28.482 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.482 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.482 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.483 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.483 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.483 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.483 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.483 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.483 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.484 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.484 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.484 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.484 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.484 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.485 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.485 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.485 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.485 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.485 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.485 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.486 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.486 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.486 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.486 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.486 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.486 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.487 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.487 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.487 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.487 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.487 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.488 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.488 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.488 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.488 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.488 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.489 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.489 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.489 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.489 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.489 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.489 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-15T22:55:51.648340+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=51, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.490 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.490 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.490 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.490 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.490 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.490 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.490 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.491 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.491 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.491 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.491 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.491 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.491 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.492 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.492 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.492 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.492 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.492 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.492 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.493 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.493 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.493 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.493 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.493 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.493 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.494 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.494 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.494 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.494 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.494 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.494 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.495 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.495 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.495 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.495 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.495 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.495 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.496 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.496 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.496 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.496 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.496 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.496 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.497 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.497 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.497 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.497 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.497 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.497 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.498 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.498 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.498 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.498 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.498 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.498 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.499 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.499 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.499 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.499 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.499 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.499 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.499 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.500 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.500 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.500 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.500 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.500 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.500 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.501 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.501 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.501 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.501 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.501 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:28.501 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-15T22:58:48.503 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T22:58:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.613+0000 7f25e9463640 1 Processor -- start 2024-02-15T22:58:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.613+0000 7f25e9463640 1 -- start start 2024-02-15T22:58:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.613+0000 7f25e9463640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f25e406c020 0x7f25e406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.613+0000 7f25e9463640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e40969f0 con 0x7f25e4071ff0 2024-02-15T22:58:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.613+0000 7f25e9463640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e409d050 con 0x7f25e406c020 2024-02-15T22:58:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.613+0000 7f25e2ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f25e406c020 0x7f25e406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.614+0000 7f25e27fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f25e4071ff0 0x7f25e406c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37778/0 (socket says 172.21.15.52:37778) 2024-02-15T22:58:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.614+0000 7f25e2ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f25e406c020 0x7f25e406c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58724/0 (socket says 172.21.15.52:58724) 2024-02-15T22:58:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.614+0000 7f25e27fc640 1 -- 172.21.15.52:0/1885100787 learned_addr learned my addr 172.21.15.52:0/1885100787 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:58:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.614+0000 7f25e2ffd640 1 -- 172.21.15.52:0/1885100787 >> v1:172.21.15.52:6789/0 conn(0x7f25e4071ff0 legacy=0x7f25e406c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.614+0000 7f25e2ffd640 1 -- 172.21.15.52:0/1885100787 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e4071a00 con 0x7f25e406c020 2024-02-15T22:58:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.614+0000 7f25e2ffd640 1 --2- 172.21.15.52:0/1885100787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e406c020 0x7f25e406c400 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009720 tx=0x7f25dc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48507e0c97c625e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.615+0000 7f25e1ffb640 1 -- 172.21.15.52:0/1885100787 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25dc02e070 con 0x7f25e406c020 2024-02-15T22:58:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.615+0000 7f25e1ffb640 1 -- 172.21.15.52:0/1885100787 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc0316d0 con 0x7f25e406c020 2024-02-15T22:58:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.615+0000 7f25e1ffb640 1 -- 172.21.15.52:0/1885100787 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25dc031990 con 0x7f25e406c020 2024-02-15T22:58:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.615+0000 7f25e9463640 1 -- 172.21.15.52:0/1885100787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e406c020 msgr2=0x7f25e406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.615+0000 7f25e9463640 1 --2- 172.21.15.52:0/1885100787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e406c020 0x7f25e406c400 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009720 tx=0x7f25dc02b840 comp rx=0 tx=0).stop 2024-02-15T22:58:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.615+0000 7f25e9463640 1 -- 172.21.15.52:0/1885100787 shutdown_connections 2024-02-15T22:58:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.615+0000 7f25e9463640 1 --2- 172.21.15.52:0/1885100787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e406c020 0x7f25e406c400 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.615+0000 7f25e9463640 1 -- 172.21.15.52:0/1885100787 >> 172.21.15.52:0/1885100787 conn(0x7f25e409b520 msgr2=0x7f25e409b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.615+0000 7f25e9463640 1 -- 172.21.15.52:0/1885100787 shutdown_connections 2024-02-15T22:58:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.615+0000 7f25e9463640 1 -- 172.21.15.52:0/1885100787 wait complete. 2024-02-15T22:58:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.616+0000 7f25e9463640 1 Processor -- start 2024-02-15T22:58:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.616+0000 7f25e9463640 1 -- start start 2024-02-15T22:58:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25e9463640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e406c020 0x7f25e41222c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25e9463640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4125220 con 0x7f25e406c020 2024-02-15T22:58:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25e2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e406c020 0x7f25e41222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25e2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e406c020 0x7f25e41222c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58726/0 (socket says 172.21.15.52:58726) 2024-02-15T22:58:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25e2ffd640 1 -- 172.21.15.52:0/519709187 learned_addr learned my addr 172.21.15.52:0/519709187 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:58:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25e2ffd640 1 -- 172.21.15.52:0/519709187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc009400 con 0x7f25e406c020 2024-02-15T22:58:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25e2ffd640 1 --2- 172.21.15.52:0/519709187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e406c020 0x7f25e41222c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f25dc02b880 tx=0x7f25dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25db7fe640 1 -- 172.21.15.52:0/519709187 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25dc032830 con 0x7f25e406c020 2024-02-15T22:58:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25db7fe640 1 -- 172.21.15.52:0/519709187 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc032990 con 0x7f25e406c020 2024-02-15T22:58:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25db7fe640 1 -- 172.21.15.52:0/519709187 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25dc032c30 con 0x7f25e406c020 2024-02-15T22:58:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25e9463640 1 -- 172.21.15.52:0/519709187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e4124b50 con 0x7f25e406c020 2024-02-15T22:58:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.617+0000 7f25e9463640 1 -- 172.21.15.52:0/519709187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e4123be0 con 0x7f25e406c020 2024-02-15T22:58:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.618+0000 7f25db7fe640 1 -- 172.21.15.52:0/519709187 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f25dc04d3f0 con 0x7f25e406c020 2024-02-15T22:58:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.618+0000 7f25db7fe640 1 --2- 172.21.15.52:0/519709187 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f25c4037ef0 0x7f25c403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.618+0000 7f25e9463640 1 -- 172.21.15.52:0/519709187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e4124410 con 0x7f25e406c020 2024-02-15T22:58:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.618+0000 7f25db7fe640 1 -- 172.21.15.52:0/519709187 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f25dc06d110 con 0x7f25e406c020 2024-02-15T22:58:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.619+0000 7f25e27fc640 1 --2- 172.21.15.52:0/519709187 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f25c4037ef0 0x7f25c403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.619+0000 7f25e27fc640 1 --2- 172.21.15.52:0/519709187 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f25c4037ef0 0x7f25c403a3b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f25cc007fd0 tx=0x7f25cc007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.623+0000 7f25db7fe640 1 -- 172.21.15.52:0/519709187 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f25dc0306b0 con 0x7f25e406c020 2024-02-15T22:58:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.798+0000 7f25e9463640 1 -- 172.21.15.52:0/519709187 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25e4093090 con 0x7f25c4037ef0 2024-02-15T22:58:48.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.814+0000 7f25db7fe640 1 -- 172.21.15.52:0/519709187 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+672080 (secure 0 0 0) 0x7f25e4093090 con 0x7f25c4037ef0 2024-02-15T22:58:48.826 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:58:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-02-15T22:58:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.818+0000 7f25e9463640 1 -- 172.21.15.52:0/519709187 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f25c4037ef0 msgr2=0x7f25c403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.818+0000 7f25e9463640 1 --2- 172.21.15.52:0/519709187 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f25c4037ef0 0x7f25c403a3b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f25cc007fd0 tx=0x7f25cc007ac0 comp rx=0 tx=0).stop 2024-02-15T22:58:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.818+0000 7f25e9463640 1 -- 172.21.15.52:0/519709187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e406c020 msgr2=0x7f25e41222c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.818+0000 7f25e9463640 1 --2- 172.21.15.52:0/519709187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e406c020 0x7f25e41222c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f25dc02b880 tx=0x7f25dc0046c0 comp rx=0 tx=0).stop 2024-02-15T22:58:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.818+0000 7f25e9463640 1 -- 172.21.15.52:0/519709187 shutdown_connections 2024-02-15T22:58:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.818+0000 7f25e9463640 1 --2- 172.21.15.52:0/519709187 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f25c4037ef0 0x7f25c403a3b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.818+0000 7f25e9463640 1 --2- 172.21.15.52:0/519709187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e406c020 0x7f25e41222c0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.818+0000 7f25e9463640 1 -- 172.21.15.52:0/519709187 >> 172.21.15.52:0/519709187 conn(0x7f25e409b520 msgr2=0x7f25e409c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.818+0000 7f25e9463640 1 -- 172.21.15.52:0/519709187 shutdown_connections 2024-02-15T22:58:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:58:48.818+0000 7f25e9463640 1 -- 172.21.15.52:0/519709187 wait complete. 2024-02-15T22:58:48.836 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2024-02-15T22:58:46.854005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4011,"num_read_kb":3661,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3967,"ondisk_log_size":3967,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135792,"kb_used_data":2768,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351568,"statfs":{"total":386547056640,"available":386408005632,"internally_reserved":0,"allocated":2834432,"data_stored":1715324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003763"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.912061+0000","last_change":"2024-02-15T22:58:20.912083+0000","last_active":"2024-02-15T22:58:20.912061+0000","last_peered":"2024-02-15T22:58:20.912061+0000","last_clean":"2024-02-15T22:58:20.912061+0000","last_became_active":"2024-02-15T22:56:03.699163+0000","last_became_peered":"2024-02-15T22:56:03.699163+0000","last_unstale":"2024-02-15T22:58:20.912061+0000","last_undegraded":"2024-02-15T22:58:20.912061+0000","last_fullsized":"2024-02-15T22:58:20.912061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:20.911968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:20.911968+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.911968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:40.922588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.936654+0000","last_change":"2024-02-15T22:58:28.936654+0000","last_active":"2024-02-15T22:58:28.936654+0000","last_peered":"2024-02-15T22:58:28.936654+0000","last_clean":"2024-02-15T22:58:28.936654+0000","last_became_active":"2024-02-15T22:56:05.708415+0000","last_became_peered":"2024-02-15T22:56:05.708415+0000","last_unstale":"2024-02-15T22:58:28.936654+0000","last_undegraded":"2024-02-15T22:58:28.936654+0000","last_fullsized":"2024-02-15T22:58:28.936654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:28.936526+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:28.936526+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.936526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:34.423952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.335594+0000","last_change":"2024-02-15T22:58:23.335618+0000","last_active":"2024-02-15T22:58:23.335594+0000","last_peered":"2024-02-15T22:58:23.335594+0000","last_clean":"2024-02-15T22:58:23.335594+0000","last_became_active":"2024-02-15T22:56:03.704043+0000","last_became_peered":"2024-02-15T22:56:03.704043+0000","last_unstale":"2024-02-15T22:58:23.335594+0000","last_undegraded":"2024-02-15T22:58:23.335594+0000","last_fullsized":"2024-02-15T22:58:23.335594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.335501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.335501+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.335501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:18.066378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.128742+0000","last_change":"2024-02-15T22:58:30.128742+0000","last_active":"2024-02-15T22:58:30.128742+0000","last_peered":"2024-02-15T22:58:30.128742+0000","last_clean":"2024-02-15T22:58:30.128742+0000","last_became_active":"2024-02-15T22:56:05.703587+0000","last_became_peered":"2024-02-15T22:56:05.703587+0000","last_unstale":"2024-02-15T22:58:30.128742+0000","last_undegraded":"2024-02-15T22:58:30.128742+0000","last_fullsized":"2024-02-15T22:58:30.128742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:30.128618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:30.128618+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.128618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:46.358215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371601+0000","last_change":"2024-02-15T22:56:03.703994+0000","last_active":"2024-02-15T22:57:47.371601+0000","last_peered":"2024-02-15T22:57:47.371601+0000","last_clean":"2024-02-15T22:57:47.371601+0000","last_became_active":"2024-02-15T22:56:03.703702+0000","last_became_peered":"2024-02-15T22:56:03.703702+0000","last_unstale":"2024-02-15T22:57:47.371601+0000","last_undegraded":"2024-02-15T22:57:47.371601+0000","last_fullsized":"2024-02-15T22:57:47.371601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.151651+0000","last_change":"2024-02-15T22:58:24.151651+0000","last_active":"2024-02-15T22:58:24.151651+0000","last_peered":"2024-02-15T22:58:24.151651+0000","last_clean":"2024-02-15T22:58:24.151651+0000","last_became_active":"2024-02-15T22:56:05.709003+0000","last_became_peered":"2024-02-15T22:56:05.709003+0000","last_unstale":"2024-02-15T22:58:24.151651+0000","last_undegraded":"2024-02-15T22:58:24.151651+0000","last_fullsized":"2024-02-15T22:58:24.151651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:24.151517+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:24.151517+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.151517+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:49:20.993618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.972432+0000","last_change":"2024-02-15T22:58:26.972464+0000","last_active":"2024-02-15T22:58:26.972432+0000","last_peered":"2024-02-15T22:58:26.972432+0000","last_clean":"2024-02-15T22:58:26.972432+0000","last_became_active":"2024-02-15T22:56:03.691753+0000","last_became_peered":"2024-02-15T22:56:03.691753+0000","last_unstale":"2024-02-15T22:58:26.972432+0000","last_undegraded":"2024-02-15T22:58:26.972432+0000","last_fullsized":"2024-02-15T22:58:26.972432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:26.972306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:26.972306+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.972306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:17.450511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.106482+0000","last_change":"2024-02-15T22:58:31.106482+0000","last_active":"2024-02-15T22:58:31.106482+0000","last_peered":"2024-02-15T22:58:31.106482+0000","last_clean":"2024-02-15T22:58:31.106482+0000","last_became_active":"2024-02-15T22:56:05.703541+0000","last_became_peered":"2024-02-15T22:56:05.703541+0000","last_unstale":"2024-02-15T22:58:31.106482+0000","last_undegraded":"2024-02-15T22:58:31.106482+0000","last_fullsized":"2024-02-15T22:58:31.106482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:31.106368+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:31.106368+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.106368+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:09:52.155517+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371593+0000","last_change":"2024-02-15T22:56:03.694830+0000","last_active":"2024-02-15T22:57:47.371593+0000","last_peered":"2024-02-15T22:57:47.371593+0000","last_clean":"2024-02-15T22:57:47.371593+0000","last_became_active":"2024-02-15T22:56:03.694522+0000","last_became_peered":"2024-02-15T22:56:03.694522+0000","last_unstale":"2024-02-15T22:57:47.371593+0000","last_undegraded":"2024-02-15T22:57:47.371593+0000","last_fullsized":"2024-02-15T22:57:47.371593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.896989+0000","last_change":"2024-02-15T22:58:24.897030+0000","last_active":"2024-02-15T22:58:24.896989+0000","last_peered":"2024-02-15T22:58:24.896989+0000","last_clean":"2024-02-15T22:58:24.896989+0000","last_became_active":"2024-02-15T22:56:05.704411+0000","last_became_peered":"2024-02-15T22:56:05.704411+0000","last_unstale":"2024-02-15T22:58:24.896989+0000","last_undegraded":"2024-02-15T22:58:24.896989+0000","last_fullsized":"2024-02-15T22:58:24.896989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:24.896851+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:24.896851+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.896851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:14.186370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.993859+0000","last_change":"2024-02-15T22:58:27.993859+0000","last_active":"2024-02-15T22:58:27.993859+0000","last_peered":"2024-02-15T22:58:27.993859+0000","last_clean":"2024-02-15T22:58:27.993859+0000","last_became_active":"2024-02-15T22:56:03.692316+0000","last_became_peered":"2024-02-15T22:56:03.692316+0000","last_unstale":"2024-02-15T22:58:27.993859+0000","last_undegraded":"2024-02-15T22:58:27.993859+0000","last_fullsized":"2024-02-15T22:58:27.993859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.993707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.993707+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.993707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:03.513283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.226214+0000","last_change":"2024-02-15T22:58:04.226214+0000","last_active":"2024-02-15T22:58:04.226214+0000","last_peered":"2024-02-15T22:58:04.226214+0000","last_clean":"2024-02-15T22:58:04.226214+0000","last_became_active":"2024-02-15T22:56:05.715460+0000","last_became_peered":"2024-02-15T22:56:05.715460+0000","last_unstale":"2024-02-15T22:58:04.226214+0000","last_undegraded":"2024-02-15T22:58:04.226214+0000","last_fullsized":"2024-02-15T22:58:04.226214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:04.226104+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:04.226104+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.226104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:09.713529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371569+0000","last_change":"2024-02-15T22:56:03.701184+0000","last_active":"2024-02-15T22:57:47.371569+0000","last_peered":"2024-02-15T22:57:47.371569+0000","last_clean":"2024-02-15T22:57:47.371569+0000","last_became_active":"2024-02-15T22:56:03.700908+0000","last_became_peered":"2024-02-15T22:56:03.700908+0000","last_unstale":"2024-02-15T22:57:47.371569+0000","last_undegraded":"2024-02-15T22:57:47.371569+0000","last_fullsized":"2024-02-15T22:57:47.371569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.814673+0000","last_change":"2024-02-15T22:58:33.814700+0000","last_active":"2024-02-15T22:58:33.814673+0000","last_peered":"2024-02-15T22:58:33.814673+0000","last_clean":"2024-02-15T22:58:33.814673+0000","last_became_active":"2024-02-15T22:56:05.706078+0000","last_became_peered":"2024-02-15T22:56:05.706078+0000","last_unstale":"2024-02-15T22:58:33.814673+0000","last_undegraded":"2024-02-15T22:58:33.814673+0000","last_fullsized":"2024-02-15T22:58:33.814673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:33.814536+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:33.814536+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.814536+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:39.301962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.375633+0000","last_change":"2024-02-15T22:58:39.375658+0000","last_active":"2024-02-15T22:58:39.375633+0000","last_peered":"2024-02-15T22:58:39.375633+0000","last_clean":"2024-02-15T22:58:39.375633+0000","last_became_active":"2024-02-15T22:56:03.697327+0000","last_became_peered":"2024-02-15T22:56:03.697327+0000","last_unstale":"2024-02-15T22:58:39.375633+0000","last_undegraded":"2024-02-15T22:58:39.375633+0000","last_fullsized":"2024-02-15T22:58:39.375633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:39.375530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:39.375530+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.375530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:53:42.378564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.901912+0000","last_change":"2024-02-15T22:58:17.901959+0000","last_active":"2024-02-15T22:58:17.901912+0000","last_peered":"2024-02-15T22:58:17.901912+0000","last_clean":"2024-02-15T22:58:17.901912+0000","last_became_active":"2024-02-15T22:56:05.705173+0000","last_became_peered":"2024-02-15T22:56:05.705173+0000","last_unstale":"2024-02-15T22:58:17.901912+0000","last_undegraded":"2024-02-15T22:58:17.901912+0000","last_fullsized":"2024-02-15T22:58:17.901912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:17.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:17.901806+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:43.081246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.138179+0000","last_change":"2024-02-15T22:58:28.138210+0000","last_active":"2024-02-15T22:58:28.138179+0000","last_peered":"2024-02-15T22:58:28.138179+0000","last_clean":"2024-02-15T22:58:28.138179+0000","last_became_active":"2024-02-15T22:56:05.703708+0000","last_became_peered":"2024-02-15T22:56:05.703708+0000","last_unstale":"2024-02-15T22:58:28.138179+0000","last_undegraded":"2024-02-15T22:58:28.138179+0000","last_fullsized":"2024-02-15T22:58:28.138179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:28.138094+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:28.138094+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.138094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:24.448130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.889280+0000","last_change":"2024-02-15T22:58:36.889321+0000","last_active":"2024-02-15T22:58:36.889280+0000","last_peered":"2024-02-15T22:58:36.889280+0000","last_clean":"2024-02-15T22:58:36.889280+0000","last_became_active":"2024-02-15T22:56:03.696959+0000","last_became_peered":"2024-02-15T22:56:03.696959+0000","last_unstale":"2024-02-15T22:58:36.889280+0000","last_undegraded":"2024-02-15T22:58:36.889280+0000","last_fullsized":"2024-02-15T22:58:36.889280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:36.889188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:36.889188+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.889188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:18:14.962422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.876807+0000","last_change":"2024-02-15T22:58:15.876807+0000","last_active":"2024-02-15T22:58:15.876807+0000","last_peered":"2024-02-15T22:58:15.876807+0000","last_clean":"2024-02-15T22:58:15.876807+0000","last_became_active":"2024-02-15T22:56:05.700071+0000","last_became_peered":"2024-02-15T22:56:05.700071+0000","last_unstale":"2024-02-15T22:58:15.876807+0000","last_undegraded":"2024-02-15T22:58:15.876807+0000","last_fullsized":"2024-02-15T22:58:15.876807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:15.876691+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:15.876691+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.876691+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:07:22.097823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.942805+0000","last_change":"2024-02-15T22:58:22.942805+0000","last_active":"2024-02-15T22:58:22.942805+0000","last_peered":"2024-02-15T22:58:22.942805+0000","last_clean":"2024-02-15T22:58:22.942805+0000","last_became_active":"2024-02-15T22:56:03.699574+0000","last_became_peered":"2024-02-15T22:56:03.699574+0000","last_unstale":"2024-02-15T22:58:22.942805+0000","last_undegraded":"2024-02-15T22:58:22.942805+0000","last_fullsized":"2024-02-15T22:58:22.942805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:22.942683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:22.942683+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.942683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:12:51.398096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.860710+0000","last_change":"2024-02-15T22:58:18.860710+0000","last_active":"2024-02-15T22:58:18.860710+0000","last_peered":"2024-02-15T22:58:18.860710+0000","last_clean":"2024-02-15T22:58:18.860710+0000","last_became_active":"2024-02-15T22:56:05.702488+0000","last_became_peered":"2024-02-15T22:56:05.702488+0000","last_unstale":"2024-02-15T22:58:18.860710+0000","last_undegraded":"2024-02-15T22:58:18.860710+0000","last_fullsized":"2024-02-15T22:58:18.860710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:18.860532+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:18.860532+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.860532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:34:02.415784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:44.833931+0000","last_change":"2024-02-15T22:58:44.833965+0000","last_active":"2024-02-15T22:58:44.833931+0000","last_peered":"2024-02-15T22:58:44.833931+0000","last_clean":"2024-02-15T22:58:44.833931+0000","last_became_active":"2024-02-15T22:56:45.885555+0000","last_became_peered":"2024-02-15T22:56:45.885555+0000","last_unstale":"2024-02-15T22:58:44.833931+0000","last_undegraded":"2024-02-15T22:58:44.833931+0000","last_fullsized":"2024-02-15T22:58:44.833931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:44.833847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:44.833847+0000","last_clean_scrub_stamp":"2024-02-15T22:58:44.833847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:30:21.375226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.370992+0000","last_change":"2024-02-15T22:58:30.370992+0000","last_active":"2024-02-15T22:58:30.370992+0000","last_peered":"2024-02-15T22:58:30.370992+0000","last_clean":"2024-02-15T22:58:30.370992+0000","last_became_active":"2024-02-15T22:56:05.705386+0000","last_became_peered":"2024-02-15T22:56:05.705386+0000","last_unstale":"2024-02-15T22:58:30.370992+0000","last_undegraded":"2024-02-15T22:58:30.370992+0000","last_fullsized":"2024-02-15T22:58:30.370992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:30.370877+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:30.370877+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.370877+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:50.153151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.911133+0000","last_change":"2024-02-15T22:58:32.911159+0000","last_active":"2024-02-15T22:58:32.911133+0000","last_peered":"2024-02-15T22:58:32.911133+0000","last_clean":"2024-02-15T22:58:32.911133+0000","last_became_active":"2024-02-15T22:56:03.693329+0000","last_became_peered":"2024-02-15T22:56:03.693329+0000","last_unstale":"2024-02-15T22:58:32.911133+0000","last_undegraded":"2024-02-15T22:58:32.911133+0000","last_fullsized":"2024-02-15T22:58:32.911133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:32.911045+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:32.911045+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.911045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:51.086189+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.936285+0000","last_change":"2024-02-15T22:58:15.936285+0000","last_active":"2024-02-15T22:58:15.936285+0000","last_peered":"2024-02-15T22:58:15.936285+0000","last_clean":"2024-02-15T22:58:15.936285+0000","last_became_active":"2024-02-15T22:56:05.704729+0000","last_became_peered":"2024-02-15T22:56:05.704729+0000","last_unstale":"2024-02-15T22:58:15.936285+0000","last_undegraded":"2024-02-15T22:58:15.936285+0000","last_fullsized":"2024-02-15T22:58:15.936285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:15.936168+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:15.936168+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.936168+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:39:13.873642+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.327486+0000","last_change":"2024-02-15T22:58:25.327486+0000","last_active":"2024-02-15T22:58:25.327486+0000","last_peered":"2024-02-15T22:58:25.327486+0000","last_clean":"2024-02-15T22:58:25.327486+0000","last_became_active":"2024-02-15T22:56:03.703885+0000","last_became_peered":"2024-02-15T22:56:03.703885+0000","last_unstale":"2024-02-15T22:58:25.327486+0000","last_undegraded":"2024-02-15T22:58:25.327486+0000","last_fullsized":"2024-02-15T22:58:25.327486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.327361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.327361+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.327361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:30.814787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.872443+0000","last_change":"2024-02-15T22:58:17.872443+0000","last_active":"2024-02-15T22:58:17.872443+0000","last_peered":"2024-02-15T22:58:17.872443+0000","last_clean":"2024-02-15T22:58:17.872443+0000","last_became_active":"2024-02-15T22:56:05.698553+0000","last_became_peered":"2024-02-15T22:56:05.698553+0000","last_unstale":"2024-02-15T22:58:17.872443+0000","last_undegraded":"2024-02-15T22:58:17.872443+0000","last_fullsized":"2024-02-15T22:58:17.872443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:17.872326+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:17.872326+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.872326+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:41.035527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:44.252285+0000","last_change":"2024-02-15T22:58:44.252311+0000","last_active":"2024-02-15T22:58:44.252285+0000","last_peered":"2024-02-15T22:58:44.252285+0000","last_clean":"2024-02-15T22:58:44.252285+0000","last_became_active":"2024-02-15T22:56:03.701819+0000","last_became_peered":"2024-02-15T22:56:03.701819+0000","last_unstale":"2024-02-15T22:58:44.252285+0000","last_undegraded":"2024-02-15T22:58:44.252285+0000","last_fullsized":"2024-02-15T22:58:44.252285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:44.252191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:44.252191+0000","last_clean_scrub_stamp":"2024-02-15T22:58:44.252191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:09:18.350889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'18","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.869532+0000","last_change":"2024-02-15T22:58:40.869563+0000","last_active":"2024-02-15T22:58:40.869532+0000","last_peered":"2024-02-15T22:58:40.869532+0000","last_clean":"2024-02-15T22:58:40.869532+0000","last_became_active":"2024-02-15T22:56:13.730499+0000","last_became_peered":"2024-02-15T22:56:13.730499+0000","last_unstale":"2024-02-15T22:58:40.869532+0000","last_undegraded":"2024-02-15T22:58:40.869532+0000","last_fullsized":"2024-02-15T22:58:40.869532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-02-15T22:58:40.869438+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-02-15T22:58:40.869438+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.869438+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:35:38.385067+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.223665+0000","last_change":"2024-02-15T22:58:36.223717+0000","last_active":"2024-02-15T22:58:36.223665+0000","last_peered":"2024-02-15T22:58:36.223665+0000","last_clean":"2024-02-15T22:58:36.223665+0000","last_became_active":"2024-02-15T22:56:05.699821+0000","last_became_peered":"2024-02-15T22:56:05.699821+0000","last_unstale":"2024-02-15T22:58:36.223665+0000","last_undegraded":"2024-02-15T22:58:36.223665+0000","last_fullsized":"2024-02-15T22:58:36.223665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:36.223565+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:36.223565+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.223565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:37:39.745954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371412+0000","last_change":"2024-02-15T22:56:03.706199+0000","last_active":"2024-02-15T22:57:47.371412+0000","last_peered":"2024-02-15T22:57:47.371412+0000","last_clean":"2024-02-15T22:57:47.371412+0000","last_became_active":"2024-02-15T22:56:03.705881+0000","last_became_peered":"2024-02-15T22:56:03.705881+0000","last_unstale":"2024-02-15T22:57:47.371412+0000","last_undegraded":"2024-02-15T22:57:47.371412+0000","last_fullsized":"2024-02-15T22:57:47.371412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372135+0000","last_change":"2024-02-15T22:56:45.893437+0000","last_active":"2024-02-15T22:57:47.372135+0000","last_peered":"2024-02-15T22:57:47.372135+0000","last_clean":"2024-02-15T22:57:47.372135+0000","last_became_active":"2024-02-15T22:56:45.893067+0000","last_became_peered":"2024-02-15T22:56:45.893067+0000","last_unstale":"2024-02-15T22:57:47.372135+0000","last_undegraded":"2024-02-15T22:57:47.372135+0000","last_fullsized":"2024-02-15T22:57:47.372135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.887564+0000","last_change":"2024-02-15T22:57:48.887564+0000","last_active":"2024-02-15T22:57:48.887564+0000","last_peered":"2024-02-15T22:57:48.887564+0000","last_clean":"2024-02-15T22:57:48.887564+0000","last_became_active":"2024-02-15T22:56:09.714201+0000","last_became_peered":"2024-02-15T22:56:09.714201+0000","last_unstale":"2024-02-15T22:57:48.887564+0000","last_undegraded":"2024-02-15T22:57:48.887564+0000","last_fullsized":"2024-02-15T22:57:48.887564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:48.887402+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:48.887402+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.887402+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:20.076360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.920914+0000","last_change":"2024-02-15T22:57:56.920914+0000","last_active":"2024-02-15T22:57:56.920914+0000","last_peered":"2024-02-15T22:57:56.920914+0000","last_clean":"2024-02-15T22:57:56.920914+0000","last_became_active":"2024-02-15T22:56:11.722257+0000","last_became_peered":"2024-02-15T22:56:11.722257+0000","last_unstale":"2024-02-15T22:57:56.920914+0000","last_undegraded":"2024-02-15T22:57:56.920914+0000","last_fullsized":"2024-02-15T22:57:56.920914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.920756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.920756+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.920756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:24:37.182344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.844517+0000","last_change":"2024-02-15T22:58:08.844517+0000","last_active":"2024-02-15T22:58:08.844517+0000","last_peered":"2024-02-15T22:58:08.844517+0000","last_clean":"2024-02-15T22:58:08.844517+0000","last_became_active":"2024-02-15T22:56:13.729067+0000","last_became_peered":"2024-02-15T22:56:13.729067+0000","last_unstale":"2024-02-15T22:58:08.844517+0000","last_undegraded":"2024-02-15T22:58:08.844517+0000","last_fullsized":"2024-02-15T22:58:08.844517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-02-15T22:58:08.844397+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-02-15T22:58:08.844397+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.844397+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:59.059018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.151094+0000","last_change":"2024-02-15T22:58:23.151094+0000","last_active":"2024-02-15T22:58:23.151094+0000","last_peered":"2024-02-15T22:58:23.151094+0000","last_clean":"2024-02-15T22:58:23.151094+0000","last_became_active":"2024-02-15T22:56:05.709632+0000","last_became_peered":"2024-02-15T22:56:05.709632+0000","last_unstale":"2024-02-15T22:58:23.151094+0000","last_undegraded":"2024-02-15T22:58:23.151094+0000","last_fullsized":"2024-02-15T22:58:23.151094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:23.150930+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:23.150930+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.150930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:00:49.803296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.934779+0000","last_change":"2024-02-15T22:58:24.934798+0000","last_active":"2024-02-15T22:58:24.934779+0000","last_peered":"2024-02-15T22:58:24.934779+0000","last_clean":"2024-02-15T22:58:24.934779+0000","last_became_active":"2024-02-15T22:56:03.699250+0000","last_became_peered":"2024-02-15T22:56:03.699250+0000","last_unstale":"2024-02-15T22:58:24.934779+0000","last_undegraded":"2024-02-15T22:58:24.934779+0000","last_fullsized":"2024-02-15T22:58:24.934779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:24.934666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:24.934666+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.934666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:55.832233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.213704+0000","last_change":"2024-02-15T22:58:09.213704+0000","last_active":"2024-02-15T22:58:09.213704+0000","last_peered":"2024-02-15T22:58:09.213704+0000","last_clean":"2024-02-15T22:58:09.213704+0000","last_became_active":"2024-02-15T22:56:07.705828+0000","last_became_peered":"2024-02-15T22:56:07.705828+0000","last_unstale":"2024-02-15T22:58:09.213704+0000","last_undegraded":"2024-02-15T22:58:09.213704+0000","last_fullsized":"2024-02-15T22:58:09.213704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:09.213585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:09.213585+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.213585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:09.634712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.924930+0000","last_change":"2024-02-15T22:57:55.924930+0000","last_active":"2024-02-15T22:57:55.924930+0000","last_peered":"2024-02-15T22:57:55.924930+0000","last_clean":"2024-02-15T22:57:55.924930+0000","last_became_active":"2024-02-15T22:56:09.712812+0000","last_became_peered":"2024-02-15T22:56:09.712812+0000","last_unstale":"2024-02-15T22:57:55.924930+0000","last_undegraded":"2024-02-15T22:57:55.924930+0000","last_fullsized":"2024-02-15T22:57:55.924930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-15T22:57:55.924760+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-15T22:57:55.924760+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.924760+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:30.496577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.900635+0000","last_change":"2024-02-15T22:57:52.900635+0000","last_active":"2024-02-15T22:57:52.900635+0000","last_peered":"2024-02-15T22:57:52.900635+0000","last_clean":"2024-02-15T22:57:52.900635+0000","last_became_active":"2024-02-15T22:56:11.721486+0000","last_became_peered":"2024-02-15T22:56:11.721486+0000","last_unstale":"2024-02-15T22:57:52.900635+0000","last_undegraded":"2024-02-15T22:57:52.900635+0000","last_fullsized":"2024-02-15T22:57:52.900635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.900511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.900511+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.900511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:44.599545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.054342+0000","last_change":"2024-02-15T22:56:13.734756+0000","last_active":"2024-02-15T22:57:46.054342+0000","last_peered":"2024-02-15T22:57:46.054342+0000","last_clean":"2024-02-15T22:57:46.054342+0000","last_became_active":"2024-02-15T22:56:13.734418+0000","last_became_peered":"2024-02-15T22:56:13.734418+0000","last_unstale":"2024-02-15T22:57:46.054342+0000","last_undegraded":"2024-02-15T22:57:46.054342+0000","last_fullsized":"2024-02-15T22:57:46.054342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.225352+0000","last_change":"2024-02-15T22:58:35.225417+0000","last_active":"2024-02-15T22:58:35.225352+0000","last_peered":"2024-02-15T22:58:35.225352+0000","last_clean":"2024-02-15T22:58:35.225352+0000","last_became_active":"2024-02-15T22:56:05.699398+0000","last_became_peered":"2024-02-15T22:56:05.699398+0000","last_unstale":"2024-02-15T22:58:35.225352+0000","last_undegraded":"2024-02-15T22:58:35.225352+0000","last_fullsized":"2024-02-15T22:58:35.225352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:35.225215+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:35.225215+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.225215+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:11:04.131887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:42.187864+0000","last_change":"2024-02-15T22:58:42.187887+0000","last_active":"2024-02-15T22:58:42.187864+0000","last_peered":"2024-02-15T22:58:42.187864+0000","last_clean":"2024-02-15T22:58:42.187864+0000","last_became_active":"2024-02-15T22:56:03.706818+0000","last_became_peered":"2024-02-15T22:56:03.706818+0000","last_unstale":"2024-02-15T22:58:42.187864+0000","last_undegraded":"2024-02-15T22:58:42.187864+0000","last_fullsized":"2024-02-15T22:58:42.187864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:42.187772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:42.187772+0000","last_clean_scrub_stamp":"2024-02-15T22:58:42.187772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:18:04.461318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.225506+0000","last_change":"2024-02-15T22:58:14.225506+0000","last_active":"2024-02-15T22:58:14.225506+0000","last_peered":"2024-02-15T22:58:14.225506+0000","last_clean":"2024-02-15T22:58:14.225506+0000","last_became_active":"2024-02-15T22:56:07.704168+0000","last_became_peered":"2024-02-15T22:56:07.704168+0000","last_unstale":"2024-02-15T22:58:14.225506+0000","last_undegraded":"2024-02-15T22:58:14.225506+0000","last_fullsized":"2024-02-15T22:58:14.225506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:14.225364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:14.225364+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.225364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:37.388564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.998999+0000","last_change":"2024-02-15T22:57:54.998999+0000","last_active":"2024-02-15T22:57:54.998999+0000","last_peered":"2024-02-15T22:57:54.998999+0000","last_clean":"2024-02-15T22:57:54.998999+0000","last_became_active":"2024-02-15T22:56:09.718326+0000","last_became_peered":"2024-02-15T22:56:09.718326+0000","last_unstale":"2024-02-15T22:57:54.998999+0000","last_undegraded":"2024-02-15T22:57:54.998999+0000","last_fullsized":"2024-02-15T22:57:54.998999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:57:54.998836+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:57:54.998836+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.998836+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:33:48.011800+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":315,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.156370+0000","last_change":"2024-02-15T22:58:21.156370+0000","last_active":"2024-02-15T22:58:21.156370+0000","last_peered":"2024-02-15T22:58:21.156370+0000","last_clean":"2024-02-15T22:58:21.156370+0000","last_became_active":"2024-02-15T22:56:11.724138+0000","last_became_peered":"2024-02-15T22:56:11.724138+0000","last_unstale":"2024-02-15T22:58:21.156370+0000","last_undegraded":"2024-02-15T22:58:21.156370+0000","last_fullsized":"2024-02-15T22:58:21.156370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-02-15T22:58:21.156191+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-02-15T22:58:21.156191+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.156191+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:39:40.871645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.775334+0000","last_change":"2024-02-15T22:58:37.775334+0000","last_active":"2024-02-15T22:58:37.775334+0000","last_peered":"2024-02-15T22:58:37.775334+0000","last_clean":"2024-02-15T22:58:37.775334+0000","last_became_active":"2024-02-15T22:56:13.732762+0000","last_became_peered":"2024-02-15T22:56:13.732762+0000","last_unstale":"2024-02-15T22:58:37.775334+0000","last_undegraded":"2024-02-15T22:58:37.775334+0000","last_fullsized":"2024-02-15T22:58:37.775334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:37.775222+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:37.775222+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.775222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:55.950367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.295013+0000","last_change":"2024-02-15T22:58:22.295013+0000","last_active":"2024-02-15T22:58:22.295013+0000","last_peered":"2024-02-15T22:58:22.295013+0000","last_clean":"2024-02-15T22:58:22.295013+0000","last_became_active":"2024-02-15T22:56:05.705360+0000","last_became_peered":"2024-02-15T22:56:05.705360+0000","last_unstale":"2024-02-15T22:58:22.295013+0000","last_undegraded":"2024-02-15T22:58:22.295013+0000","last_fullsized":"2024-02-15T22:58:22.295013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:22.294850+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:22.294850+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.294850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:21:05.771908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.956494+0000","last_change":"2024-02-15T22:58:27.956522+0000","last_active":"2024-02-15T22:58:27.956494+0000","last_peered":"2024-02-15T22:58:27.956494+0000","last_clean":"2024-02-15T22:58:27.956494+0000","last_became_active":"2024-02-15T22:56:03.698225+0000","last_became_peered":"2024-02-15T22:56:03.698225+0000","last_unstale":"2024-02-15T22:58:27.956494+0000","last_undegraded":"2024-02-15T22:58:27.956494+0000","last_fullsized":"2024-02-15T22:58:27.956494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.956385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.956385+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.956385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:33.825795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.851925+0000","last_change":"2024-02-15T22:57:47.851925+0000","last_active":"2024-02-15T22:57:47.851925+0000","last_peered":"2024-02-15T22:57:47.851925+0000","last_clean":"2024-02-15T22:57:47.851925+0000","last_became_active":"2024-02-15T22:56:07.709236+0000","last_became_peered":"2024-02-15T22:56:07.709236+0000","last_unstale":"2024-02-15T22:57:47.851925+0000","last_undegraded":"2024-02-15T22:57:47.851925+0000","last_fullsized":"2024-02-15T22:57:47.851925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.851815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.851815+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.851815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:42.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.003016+0000","last_change":"2024-02-15T22:57:53.003016+0000","last_active":"2024-02-15T22:57:53.003016+0000","last_peered":"2024-02-15T22:57:53.003016+0000","last_clean":"2024-02-15T22:57:53.003016+0000","last_became_active":"2024-02-15T22:56:09.729556+0000","last_became_peered":"2024-02-15T22:56:09.729556+0000","last_unstale":"2024-02-15T22:57:53.003016+0000","last_undegraded":"2024-02-15T22:57:53.003016+0000","last_fullsized":"2024-02-15T22:57:53.003016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:53.002893+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:53.002893+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.002893+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:27:11.902505+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":342,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.310138+0000","last_change":"2024-02-15T22:57:53.310138+0000","last_active":"2024-02-15T22:57:53.310138+0000","last_peered":"2024-02-15T22:57:53.310138+0000","last_clean":"2024-02-15T22:57:53.310138+0000","last_became_active":"2024-02-15T22:56:11.719588+0000","last_became_peered":"2024-02-15T22:56:11.719588+0000","last_unstale":"2024-02-15T22:57:53.310138+0000","last_undegraded":"2024-02-15T22:57:53.310138+0000","last_fullsized":"2024-02-15T22:57:53.310138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:53.309962+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:53.309962+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.309962+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:05.319309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.137427+0000","last_change":"2024-02-15T22:58:07.137427+0000","last_active":"2024-02-15T22:58:07.137427+0000","last_peered":"2024-02-15T22:58:07.137427+0000","last_clean":"2024-02-15T22:58:07.137427+0000","last_became_active":"2024-02-15T22:56:05.710578+0000","last_became_peered":"2024-02-15T22:56:05.710578+0000","last_unstale":"2024-02-15T22:58:07.137427+0000","last_undegraded":"2024-02-15T22:58:07.137427+0000","last_fullsized":"2024-02-15T22:58:07.137427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.137300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.137300+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.137300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:02:26.024097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.890089+0000","last_change":"2024-02-15T22:58:14.890089+0000","last_active":"2024-02-15T22:58:14.890089+0000","last_peered":"2024-02-15T22:58:14.890089+0000","last_clean":"2024-02-15T22:58:14.890089+0000","last_became_active":"2024-02-15T22:56:03.702187+0000","last_became_peered":"2024-02-15T22:56:03.702187+0000","last_unstale":"2024-02-15T22:58:14.890089+0000","last_undegraded":"2024-02-15T22:58:14.890089+0000","last_fullsized":"2024-02-15T22:58:14.890089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:14.889959+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:14.889959+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.889959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:33.400014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.884933+0000","last_change":"2024-02-15T22:57:59.884933+0000","last_active":"2024-02-15T22:57:59.884933+0000","last_peered":"2024-02-15T22:57:59.884933+0000","last_clean":"2024-02-15T22:57:59.884933+0000","last_became_active":"2024-02-15T22:56:07.707328+0000","last_became_peered":"2024-02-15T22:56:07.707328+0000","last_unstale":"2024-02-15T22:57:59.884933+0000","last_undegraded":"2024-02-15T22:57:59.884933+0000","last_fullsized":"2024-02-15T22:57:59.884933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:59.884790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:59.884790+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.884790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:05.894308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.000916+0000","last_change":"2024-02-15T22:57:57.000916+0000","last_active":"2024-02-15T22:57:57.000916+0000","last_peered":"2024-02-15T22:57:57.000916+0000","last_clean":"2024-02-15T22:57:57.000916+0000","last_became_active":"2024-02-15T22:56:09.715019+0000","last_became_peered":"2024-02-15T22:56:09.715019+0000","last_unstale":"2024-02-15T22:57:57.000916+0000","last_undegraded":"2024-02-15T22:57:57.000916+0000","last_fullsized":"2024-02-15T22:57:57.000916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-15T22:57:57.000759+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-15T22:57:57.000759+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.000759+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:45:12.812634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.357140+0000","last_change":"2024-02-15T22:57:50.357140+0000","last_active":"2024-02-15T22:57:50.357140+0000","last_peered":"2024-02-15T22:57:50.357140+0000","last_clean":"2024-02-15T22:57:50.357140+0000","last_became_active":"2024-02-15T22:56:11.719845+0000","last_became_peered":"2024-02-15T22:56:11.719845+0000","last_unstale":"2024-02-15T22:57:50.357140+0000","last_undegraded":"2024-02-15T22:57:50.357140+0000","last_fullsized":"2024-02-15T22:57:50.357140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.357021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.357021+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.357021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:06.000871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.823633+0000","last_change":"2024-02-15T22:58:34.823667+0000","last_active":"2024-02-15T22:58:34.823633+0000","last_peered":"2024-02-15T22:58:34.823633+0000","last_clean":"2024-02-15T22:58:34.823633+0000","last_became_active":"2024-02-15T22:56:13.732321+0000","last_became_peered":"2024-02-15T22:56:13.732321+0000","last_unstale":"2024-02-15T22:58:34.823633+0000","last_undegraded":"2024-02-15T22:58:34.823633+0000","last_fullsized":"2024-02-15T22:58:34.823633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:58:34.823529+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:58:34.823529+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.823529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:12:30.547146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.868943+0000","last_change":"2024-02-15T22:58:19.869033+0000","last_active":"2024-02-15T22:58:19.868943+0000","last_peered":"2024-02-15T22:58:19.868943+0000","last_clean":"2024-02-15T22:58:19.868943+0000","last_became_active":"2024-02-15T22:56:05.697834+0000","last_became_peered":"2024-02-15T22:56:05.697834+0000","last_unstale":"2024-02-15T22:58:19.868943+0000","last_undegraded":"2024-02-15T22:58:19.868943+0000","last_fullsized":"2024-02-15T22:58:19.868943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:19.868817+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:19.868817+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.868817+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:50.766383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.855300+0000","last_change":"2024-02-15T22:58:12.855300+0000","last_active":"2024-02-15T22:58:12.855300+0000","last_peered":"2024-02-15T22:58:12.855300+0000","last_clean":"2024-02-15T22:58:12.855300+0000","last_became_active":"2024-02-15T22:56:03.702353+0000","last_became_peered":"2024-02-15T22:56:03.702353+0000","last_unstale":"2024-02-15T22:58:12.855300+0000","last_undegraded":"2024-02-15T22:58:12.855300+0000","last_fullsized":"2024-02-15T22:58:12.855300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.855162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.855162+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.855162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:40.679343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.208925+0000","last_change":"2024-02-15T22:58:07.208925+0000","last_active":"2024-02-15T22:58:07.208925+0000","last_peered":"2024-02-15T22:58:07.208925+0000","last_clean":"2024-02-15T22:58:07.208925+0000","last_became_active":"2024-02-15T22:56:07.706656+0000","last_became_peered":"2024-02-15T22:56:07.706656+0000","last_unstale":"2024-02-15T22:58:07.208925+0000","last_undegraded":"2024-02-15T22:58:07.208925+0000","last_fullsized":"2024-02-15T22:58:07.208925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.208777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.208777+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.208777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:31.806933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.993269+0000","last_change":"2024-02-15T22:57:52.993269+0000","last_active":"2024-02-15T22:57:52.993269+0000","last_peered":"2024-02-15T22:57:52.993269+0000","last_clean":"2024-02-15T22:57:52.993269+0000","last_became_active":"2024-02-15T22:56:09.716138+0000","last_became_peered":"2024-02-15T22:56:09.716138+0000","last_unstale":"2024-02-15T22:57:52.993269+0000","last_undegraded":"2024-02-15T22:57:52.993269+0000","last_fullsized":"2024-02-15T22:57:52.993269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:52.993117+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:52.993117+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.993117+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:16.156318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.238737+0000","last_change":"2024-02-15T22:58:04.238737+0000","last_active":"2024-02-15T22:58:04.238737+0000","last_peered":"2024-02-15T22:58:04.238737+0000","last_clean":"2024-02-15T22:58:04.238737+0000","last_became_active":"2024-02-15T22:56:11.724317+0000","last_became_peered":"2024-02-15T22:56:11.724317+0000","last_unstale":"2024-02-15T22:58:04.238737+0000","last_undegraded":"2024-02-15T22:58:04.238737+0000","last_fullsized":"2024-02-15T22:58:04.238737+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:04.238614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:04.238614+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.238614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:27.604291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:41.860482+0000","last_change":"2024-02-15T22:58:41.860509+0000","last_active":"2024-02-15T22:58:41.860482+0000","last_peered":"2024-02-15T22:58:41.860482+0000","last_clean":"2024-02-15T22:58:41.860482+0000","last_became_active":"2024-02-15T22:56:13.733118+0000","last_became_peered":"2024-02-15T22:56:13.733118+0000","last_unstale":"2024-02-15T22:58:41.860482+0000","last_undegraded":"2024-02-15T22:58:41.860482+0000","last_fullsized":"2024-02-15T22:58:41.860482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:41.860400+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:41.860400+0000","last_clean_scrub_stamp":"2024-02-15T22:58:41.860400+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:36:47.619526+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'20","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.823539+0000","last_change":"2024-02-15T22:58:38.823565+0000","last_active":"2024-02-15T22:58:38.823539+0000","last_peered":"2024-02-15T22:58:38.823539+0000","last_clean":"2024-02-15T22:58:38.823539+0000","last_became_active":"2024-02-15T22:56:45.886248+0000","last_became_peered":"2024-02-15T22:56:45.886248+0000","last_unstale":"2024-02-15T22:58:38.823539+0000","last_undegraded":"2024-02-15T22:58:38.823539+0000","last_fullsized":"2024-02-15T22:58:38.823539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-02-15T22:58:38.823451+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-02-15T22:58:38.823451+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.823451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:58.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371408+0000","last_change":"2024-02-15T22:56:03.700436+0000","last_active":"2024-02-15T22:57:47.371408+0000","last_peered":"2024-02-15T22:57:47.371408+0000","last_clean":"2024-02-15T22:57:47.371408+0000","last_became_active":"2024-02-15T22:56:03.700087+0000","last_became_peered":"2024-02-15T22:56:03.700087+0000","last_unstale":"2024-02-15T22:57:47.371408+0000","last_undegraded":"2024-02-15T22:57:47.371408+0000","last_fullsized":"2024-02-15T22:57:47.371408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.176919+0000","last_change":"2024-02-15T22:58:10.176919+0000","last_active":"2024-02-15T22:58:10.176919+0000","last_peered":"2024-02-15T22:58:10.176919+0000","last_clean":"2024-02-15T22:58:10.176919+0000","last_became_active":"2024-02-15T22:56:07.704502+0000","last_became_peered":"2024-02-15T22:56:07.704502+0000","last_unstale":"2024-02-15T22:58:10.176919+0000","last_undegraded":"2024-02-15T22:58:10.176919+0000","last_fullsized":"2024-02-15T22:58:10.176919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:10.176806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:10.176806+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.176806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:13.375626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'44","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.182521+0000","last_change":"2024-02-15T22:58:22.182562+0000","last_active":"2024-02-15T22:58:22.182521+0000","last_peered":"2024-02-15T22:58:22.182521+0000","last_clean":"2024-02-15T22:58:22.182521+0000","last_became_active":"2024-02-15T22:56:09.717174+0000","last_became_peered":"2024-02-15T22:56:09.717174+0000","last_unstale":"2024-02-15T22:58:22.182521+0000","last_undegraded":"2024-02-15T22:58:22.182521+0000","last_fullsized":"2024-02-15T22:58:22.182521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:58:22.182437+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:58:22.182437+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.182437+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:01.680145+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":313,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.299547+0000","last_change":"2024-02-15T22:58:00.299547+0000","last_active":"2024-02-15T22:58:00.299547+0000","last_peered":"2024-02-15T22:58:00.299547+0000","last_clean":"2024-02-15T22:58:00.299547+0000","last_became_active":"2024-02-15T22:56:11.724273+0000","last_became_peered":"2024-02-15T22:56:11.724273+0000","last_unstale":"2024-02-15T22:58:00.299547+0000","last_undegraded":"2024-02-15T22:58:00.299547+0000","last_fullsized":"2024-02-15T22:58:00.299547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:58:00.299415+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:58:00.299415+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.299415+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:33.226403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.241434+0000","last_change":"2024-02-15T22:58:12.241434+0000","last_active":"2024-02-15T22:58:12.241434+0000","last_peered":"2024-02-15T22:58:12.241434+0000","last_clean":"2024-02-15T22:58:12.241434+0000","last_became_active":"2024-02-15T22:56:13.726858+0000","last_became_peered":"2024-02-15T22:56:13.726858+0000","last_unstale":"2024-02-15T22:58:12.241434+0000","last_undegraded":"2024-02-15T22:58:12.241434+0000","last_fullsized":"2024-02-15T22:58:12.241434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.241315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.241315+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.241315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:07:18.462448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.889358+0000","last_change":"2024-02-15T22:58:13.889358+0000","last_active":"2024-02-15T22:58:13.889358+0000","last_peered":"2024-02-15T22:58:13.889358+0000","last_clean":"2024-02-15T22:58:13.889358+0000","last_became_active":"2024-02-15T22:56:05.701568+0000","last_became_peered":"2024-02-15T22:56:05.701568+0000","last_unstale":"2024-02-15T22:58:13.889358+0000","last_undegraded":"2024-02-15T22:58:13.889358+0000","last_fullsized":"2024-02-15T22:58:13.889358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:13.889250+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:13.889250+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.889250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:22.586047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371304+0000","last_change":"2024-02-15T22:56:03.695726+0000","last_active":"2024-02-15T22:57:47.371304+0000","last_peered":"2024-02-15T22:57:47.371304+0000","last_clean":"2024-02-15T22:57:47.371304+0000","last_became_active":"2024-02-15T22:56:03.694668+0000","last_became_peered":"2024-02-15T22:56:03.694668+0000","last_unstale":"2024-02-15T22:57:47.371304+0000","last_undegraded":"2024-02-15T22:57:47.371304+0000","last_fullsized":"2024-02-15T22:57:47.371304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.212958+0000","last_change":"2024-02-15T22:58:13.212958+0000","last_active":"2024-02-15T22:58:13.212958+0000","last_peered":"2024-02-15T22:58:13.212958+0000","last_clean":"2024-02-15T22:58:13.212958+0000","last_became_active":"2024-02-15T22:56:07.704054+0000","last_became_peered":"2024-02-15T22:56:07.704054+0000","last_unstale":"2024-02-15T22:58:13.212958+0000","last_undegraded":"2024-02-15T22:58:13.212958+0000","last_fullsized":"2024-02-15T22:58:13.212958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:13.212847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:13.212847+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.212847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:27.614478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.173318+0000","last_change":"2024-02-15T22:58:09.173318+0000","last_active":"2024-02-15T22:58:09.173318+0000","last_peered":"2024-02-15T22:58:09.173318+0000","last_clean":"2024-02-15T22:58:09.173318+0000","last_became_active":"2024-02-15T22:56:09.717264+0000","last_became_peered":"2024-02-15T22:56:09.717264+0000","last_unstale":"2024-02-15T22:58:09.173318+0000","last_undegraded":"2024-02-15T22:58:09.173318+0000","last_fullsized":"2024-02-15T22:58:09.173318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-15T22:58:09.173193+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-15T22:58:09.173193+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.173193+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:35:38.023140+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.388857+0000","last_change":"2024-02-15T22:57:49.388857+0000","last_active":"2024-02-15T22:57:49.388857+0000","last_peered":"2024-02-15T22:57:49.388857+0000","last_clean":"2024-02-15T22:57:49.388857+0000","last_became_active":"2024-02-15T22:56:11.720616+0000","last_became_peered":"2024-02-15T22:56:11.720616+0000","last_unstale":"2024-02-15T22:57:49.388857+0000","last_undegraded":"2024-02-15T22:57:49.388857+0000","last_fullsized":"2024-02-15T22:57:49.388857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.388740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.388740+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.388740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:41.087774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.231314+0000","last_change":"2024-02-15T22:58:16.231314+0000","last_active":"2024-02-15T22:58:16.231314+0000","last_peered":"2024-02-15T22:58:16.231314+0000","last_clean":"2024-02-15T22:58:16.231314+0000","last_became_active":"2024-02-15T22:56:13.729015+0000","last_became_peered":"2024-02-15T22:56:13.729015+0000","last_unstale":"2024-02-15T22:58:16.231314+0000","last_undegraded":"2024-02-15T22:58:16.231314+0000","last_fullsized":"2024-02-15T22:58:16.231314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:16.231166+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:16.231166+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.231166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:47.128732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.838345+0000","last_change":"2024-02-15T22:58:39.838371+0000","last_active":"2024-02-15T22:58:39.838345+0000","last_peered":"2024-02-15T22:58:39.838345+0000","last_clean":"2024-02-15T22:58:39.838345+0000","last_became_active":"2024-02-15T22:56:45.893017+0000","last_became_peered":"2024-02-15T22:56:45.893017+0000","last_unstale":"2024-02-15T22:58:39.838345+0000","last_undegraded":"2024-02-15T22:58:39.838345+0000","last_fullsized":"2024-02-15T22:58:39.838345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:39.838252+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:39.838252+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.838252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:36:08.688199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053369+0000","last_change":"2024-02-15T22:56:45.886880+0000","last_active":"2024-02-15T22:57:46.053369+0000","last_peered":"2024-02-15T22:57:46.053369+0000","last_clean":"2024-02-15T22:57:46.053369+0000","last_became_active":"2024-02-15T22:56:45.886530+0000","last_became_peered":"2024-02-15T22:56:45.886530+0000","last_unstale":"2024-02-15T22:57:46.053369+0000","last_undegraded":"2024-02-15T22:57:46.053369+0000","last_fullsized":"2024-02-15T22:57:46.053369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.012863+0000","last_change":"2024-02-15T22:58:03.012863+0000","last_active":"2024-02-15T22:58:03.012863+0000","last_peered":"2024-02-15T22:58:03.012863+0000","last_clean":"2024-02-15T22:58:03.012863+0000","last_became_active":"2024-02-15T22:56:07.707207+0000","last_became_peered":"2024-02-15T22:56:07.707207+0000","last_unstale":"2024-02-15T22:58:03.012863+0000","last_undegraded":"2024-02-15T22:58:03.012863+0000","last_fullsized":"2024-02-15T22:58:03.012863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:03.012756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:03.012756+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.012756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:24.662100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.911848+0000","last_change":"2024-02-15T22:57:51.911848+0000","last_active":"2024-02-15T22:57:51.911848+0000","last_peered":"2024-02-15T22:57:51.911848+0000","last_clean":"2024-02-15T22:57:51.911848+0000","last_became_active":"2024-02-15T22:56:09.714592+0000","last_became_peered":"2024-02-15T22:56:09.714592+0000","last_unstale":"2024-02-15T22:57:51.911848+0000","last_undegraded":"2024-02-15T22:57:51.911848+0000","last_fullsized":"2024-02-15T22:57:51.911848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-15T22:57:51.911723+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-15T22:57:51.911723+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.911723+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:55.109902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.119618+0000","last_change":"2024-02-15T22:58:15.119618+0000","last_active":"2024-02-15T22:58:15.119618+0000","last_peered":"2024-02-15T22:58:15.119618+0000","last_clean":"2024-02-15T22:58:15.119618+0000","last_became_active":"2024-02-15T22:56:11.723557+0000","last_became_peered":"2024-02-15T22:56:11.723557+0000","last_unstale":"2024-02-15T22:58:15.119618+0000","last_undegraded":"2024-02-15T22:58:15.119618+0000","last_fullsized":"2024-02-15T22:58:15.119618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:15.119498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:15.119498+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.119498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:26.132469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.172807+0000","last_change":"2024-02-15T22:58:29.172829+0000","last_active":"2024-02-15T22:58:29.172807+0000","last_peered":"2024-02-15T22:58:29.172807+0000","last_clean":"2024-02-15T22:58:29.172807+0000","last_became_active":"2024-02-15T22:56:13.726586+0000","last_became_peered":"2024-02-15T22:56:13.726586+0000","last_unstale":"2024-02-15T22:58:29.172807+0000","last_undegraded":"2024-02-15T22:58:29.172807+0000","last_fullsized":"2024-02-15T22:58:29.172807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:29.172716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:29.172716+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.172716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:48:22.998360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.049602+0000","last_change":"2024-02-15T22:57:59.049602+0000","last_active":"2024-02-15T22:57:59.049602+0000","last_peered":"2024-02-15T22:57:59.049602+0000","last_clean":"2024-02-15T22:57:59.049602+0000","last_became_active":"2024-02-15T22:56:05.716590+0000","last_became_peered":"2024-02-15T22:56:05.716590+0000","last_unstale":"2024-02-15T22:57:59.049602+0000","last_undegraded":"2024-02-15T22:57:59.049602+0000","last_fullsized":"2024-02-15T22:57:59.049602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-15T22:57:59.049477+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-15T22:57:59.049477+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.049477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:05.045262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371318+0000","last_change":"2024-02-15T22:56:03.703244+0000","last_active":"2024-02-15T22:57:47.371318+0000","last_peered":"2024-02-15T22:57:47.371318+0000","last_clean":"2024-02-15T22:57:47.371318+0000","last_became_active":"2024-02-15T22:56:03.702875+0000","last_became_peered":"2024-02-15T22:56:03.702875+0000","last_unstale":"2024-02-15T22:57:47.371318+0000","last_undegraded":"2024-02-15T22:57:47.371318+0000","last_fullsized":"2024-02-15T22:57:47.371318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.194271+0000","last_change":"2024-02-15T22:58:11.194271+0000","last_active":"2024-02-15T22:58:11.194271+0000","last_peered":"2024-02-15T22:58:11.194271+0000","last_clean":"2024-02-15T22:58:11.194271+0000","last_became_active":"2024-02-15T22:56:07.704058+0000","last_became_peered":"2024-02-15T22:56:07.704058+0000","last_unstale":"2024-02-15T22:58:11.194271+0000","last_undegraded":"2024-02-15T22:58:11.194271+0000","last_fullsized":"2024-02-15T22:58:11.194271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.194159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.194159+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.194159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:19:30.005727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'44","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.970287+0000","last_change":"2024-02-15T22:57:57.970287+0000","last_active":"2024-02-15T22:57:57.970287+0000","last_peered":"2024-02-15T22:57:57.970287+0000","last_clean":"2024-02-15T22:57:57.970287+0000","last_became_active":"2024-02-15T22:56:09.712113+0000","last_became_peered":"2024-02-15T22:56:09.712113+0000","last_unstale":"2024-02-15T22:57:57.970287+0000","last_undegraded":"2024-02-15T22:57:57.970287+0000","last_fullsized":"2024-02-15T22:57:57.970287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:57:57.970127+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:57:57.970127+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.970127+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:59.472492+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":344,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.871443+0000","last_change":"2024-02-15T22:57:47.871443+0000","last_active":"2024-02-15T22:57:47.871443+0000","last_peered":"2024-02-15T22:57:47.871443+0000","last_clean":"2024-02-15T22:57:47.871443+0000","last_became_active":"2024-02-15T22:56:11.720390+0000","last_became_peered":"2024-02-15T22:56:11.720390+0000","last_unstale":"2024-02-15T22:57:47.871443+0000","last_undegraded":"2024-02-15T22:57:47.871443+0000","last_fullsized":"2024-02-15T22:57:47.871443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:47.871285+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:47.871285+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.871285+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:51.713747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.054234+0000","last_change":"2024-02-15T22:56:13.734537+0000","last_active":"2024-02-15T22:57:46.054234+0000","last_peered":"2024-02-15T22:57:46.054234+0000","last_clean":"2024-02-15T22:57:46.054234+0000","last_became_active":"2024-02-15T22:56:13.734227+0000","last_became_peered":"2024-02-15T22:56:13.734227+0000","last_unstale":"2024-02-15T22:57:46.054234+0000","last_undegraded":"2024-02-15T22:57:46.054234+0000","last_fullsized":"2024-02-15T22:57:46.054234+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.945487+0000","last_change":"2024-02-15T22:58:23.945528+0000","last_active":"2024-02-15T22:58:23.945487+0000","last_peered":"2024-02-15T22:58:23.945487+0000","last_clean":"2024-02-15T22:58:23.945487+0000","last_became_active":"2024-02-15T22:56:05.705551+0000","last_became_peered":"2024-02-15T22:56:05.705551+0000","last_unstale":"2024-02-15T22:58:23.945487+0000","last_undegraded":"2024-02-15T22:58:23.945487+0000","last_fullsized":"2024-02-15T22:58:23.945487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.945394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.945394+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.945394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:34:07.500646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371332+0000","last_change":"2024-02-15T22:56:03.704800+0000","last_active":"2024-02-15T22:57:47.371332+0000","last_peered":"2024-02-15T22:57:47.371332+0000","last_clean":"2024-02-15T22:57:47.371332+0000","last_became_active":"2024-02-15T22:56:03.704526+0000","last_became_peered":"2024-02-15T22:56:03.704526+0000","last_unstale":"2024-02-15T22:57:47.371332+0000","last_undegraded":"2024-02-15T22:57:47.371332+0000","last_fullsized":"2024-02-15T22:57:47.371332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'9","reported_seq":547,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.866099+0000","last_change":"2024-02-15T22:58:01.866099+0000","last_active":"2024-02-15T22:58:01.866099+0000","last_peered":"2024-02-15T22:58:01.866099+0000","last_clean":"2024-02-15T22:58:01.866099+0000","last_became_active":"2024-02-15T22:56:07.704281+0000","last_became_peered":"2024-02-15T22:56:07.704281+0000","last_unstale":"2024-02-15T22:58:01.866099+0000","last_undegraded":"2024-02-15T22:58:01.866099+0000","last_fullsized":"2024-02-15T22:58:01.866099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-15T22:58:01.865973+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-15T22:58:01.865973+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.865973+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:28.422958+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":595,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.204666+0000","last_change":"2024-02-15T22:58:05.204666+0000","last_active":"2024-02-15T22:58:05.204666+0000","last_peered":"2024-02-15T22:58:05.204666+0000","last_clean":"2024-02-15T22:58:05.204666+0000","last_became_active":"2024-02-15T22:56:09.717735+0000","last_became_peered":"2024-02-15T22:56:09.717735+0000","last_unstale":"2024-02-15T22:58:05.204666+0000","last_undegraded":"2024-02-15T22:58:05.204666+0000","last_fullsized":"2024-02-15T22:58:05.204666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:58:05.204500+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:58:05.204500+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.204500+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:17:36.367930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":387,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.877265+0000","last_change":"2024-02-15T22:57:46.877265+0000","last_active":"2024-02-15T22:57:46.877265+0000","last_peered":"2024-02-15T22:57:46.877265+0000","last_clean":"2024-02-15T22:57:46.877265+0000","last_became_active":"2024-02-15T22:56:11.717380+0000","last_became_peered":"2024-02-15T22:56:11.717380+0000","last_unstale":"2024-02-15T22:57:46.877265+0000","last_undegraded":"2024-02-15T22:57:46.877265+0000","last_fullsized":"2024-02-15T22:57:46.877265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:46.877108+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:46.877108+0000","last_clean_scrub_stamp":"2024-02-15T22:57:46.877108+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:13:26.299004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.974720+0000","last_change":"2024-02-15T22:58:03.974720+0000","last_active":"2024-02-15T22:58:03.974720+0000","last_peered":"2024-02-15T22:58:03.974720+0000","last_clean":"2024-02-15T22:58:03.974720+0000","last_became_active":"2024-02-15T22:56:13.729467+0000","last_became_peered":"2024-02-15T22:56:13.729467+0000","last_unstale":"2024-02-15T22:58:03.974720+0000","last_undegraded":"2024-02-15T22:58:03.974720+0000","last_fullsized":"2024-02-15T22:58:03.974720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:03.974606+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:03.974606+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.974606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:15.983952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"30'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.800281+0000","last_change":"2024-02-15T22:58:40.800305+0000","last_active":"2024-02-15T22:58:40.800281+0000","last_peered":"2024-02-15T22:58:40.800281+0000","last_clean":"2024-02-15T22:58:40.800281+0000","last_became_active":"2024-02-15T22:56:45.892949+0000","last_became_peered":"2024-02-15T22:56:45.892949+0000","last_unstale":"2024-02-15T22:58:40.800281+0000","last_undegraded":"2024-02-15T22:58:40.800281+0000","last_fullsized":"2024-02-15T22:58:40.800281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:40.800199+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:40.800199+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:54.182110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:43.210282+0000","last_change":"2024-02-15T22:58:43.210317+0000","last_active":"2024-02-15T22:58:43.210282+0000","last_peered":"2024-02-15T22:58:43.210282+0000","last_clean":"2024-02-15T22:58:43.210282+0000","last_became_active":"2024-02-15T22:56:03.702035+0000","last_became_peered":"2024-02-15T22:56:03.702035+0000","last_unstale":"2024-02-15T22:58:43.210282+0000","last_undegraded":"2024-02-15T22:58:43.210282+0000","last_fullsized":"2024-02-15T22:58:43.210282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:43.210199+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:43.210199+0000","last_clean_scrub_stamp":"2024-02-15T22:58:43.210199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:24:20.480239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.003934+0000","last_change":"2024-02-15T22:57:52.003934+0000","last_active":"2024-02-15T22:57:52.003934+0000","last_peered":"2024-02-15T22:57:52.003934+0000","last_clean":"2024-02-15T22:57:52.003934+0000","last_became_active":"2024-02-15T22:56:07.706615+0000","last_became_peered":"2024-02-15T22:56:07.706615+0000","last_unstale":"2024-02-15T22:57:52.003934+0000","last_undegraded":"2024-02-15T22:57:52.003934+0000","last_fullsized":"2024-02-15T22:57:52.003934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.003831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.003831+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.003831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:06.405461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.860641+0000","last_change":"2024-02-15T22:57:53.860641+0000","last_active":"2024-02-15T22:57:53.860641+0000","last_peered":"2024-02-15T22:57:53.860641+0000","last_clean":"2024-02-15T22:57:53.860641+0000","last_became_active":"2024-02-15T22:56:09.713660+0000","last_became_peered":"2024-02-15T22:56:09.713660+0000","last_unstale":"2024-02-15T22:57:53.860641+0000","last_undegraded":"2024-02-15T22:57:53.860641+0000","last_fullsized":"2024-02-15T22:57:53.860641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-02-15T22:57:53.860514+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-02-15T22:57:53.860514+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.860514+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:09.504364+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.953591+0000","last_change":"2024-02-15T22:57:51.953591+0000","last_active":"2024-02-15T22:57:51.953591+0000","last_peered":"2024-02-15T22:57:51.953591+0000","last_clean":"2024-02-15T22:57:51.953591+0000","last_became_active":"2024-02-15T22:56:11.724575+0000","last_became_peered":"2024-02-15T22:56:11.724575+0000","last_unstale":"2024-02-15T22:57:51.953591+0000","last_undegraded":"2024-02-15T22:57:51.953591+0000","last_fullsized":"2024-02-15T22:57:51.953591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:51.953487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:51.953487+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.953487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:47.214571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.822668+0000","last_change":"2024-02-15T22:58:04.822668+0000","last_active":"2024-02-15T22:58:04.822668+0000","last_peered":"2024-02-15T22:58:04.822668+0000","last_clean":"2024-02-15T22:58:04.822668+0000","last_became_active":"2024-02-15T22:56:13.722550+0000","last_became_peered":"2024-02-15T22:56:13.722550+0000","last_unstale":"2024-02-15T22:58:04.822668+0000","last_undegraded":"2024-02-15T22:58:04.822668+0000","last_fullsized":"2024-02-15T22:58:04.822668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:04.822525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:04.822525+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.822525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:19.922383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.150482+0000","last_change":"2024-02-15T22:58:02.150482+0000","last_active":"2024-02-15T22:58:02.150482+0000","last_peered":"2024-02-15T22:58:02.150482+0000","last_clean":"2024-02-15T22:58:02.150482+0000","last_became_active":"2024-02-15T22:56:05.715513+0000","last_became_peered":"2024-02-15T22:56:05.715513+0000","last_unstale":"2024-02-15T22:58:02.150482+0000","last_undegraded":"2024-02-15T22:58:02.150482+0000","last_fullsized":"2024-02-15T22:58:02.150482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-15T22:58:02.150334+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-15T22:58:02.150334+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.150334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:52:56.881211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":210,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.912168+0000","last_change":"2024-02-15T22:58:30.912209+0000","last_active":"2024-02-15T22:58:30.912168+0000","last_peered":"2024-02-15T22:58:30.912168+0000","last_clean":"2024-02-15T22:58:30.912168+0000","last_became_active":"2024-02-15T22:55:52.657750+0000","last_became_peered":"2024-02-15T22:55:52.657750+0000","last_unstale":"2024-02-15T22:58:30.912168+0000","last_undegraded":"2024-02-15T22:58:30.912168+0000","last_fullsized":"2024-02-15T22:58:30.912168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-02-15T22:58:30.912082+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-02-15T22:58:30.912082+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.912082+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:11.193723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371230+0000","last_change":"2024-02-15T22:55:57.672733+0000","last_active":"2024-02-15T22:57:47.371230+0000","last_peered":"2024-02-15T22:57:47.371230+0000","last_clean":"2024-02-15T22:57:47.371230+0000","last_became_active":"2024-02-15T22:55:57.672281+0000","last_became_peered":"2024-02-15T22:55:57.672281+0000","last_unstale":"2024-02-15T22:57:47.371230+0000","last_undegraded":"2024-02-15T22:57:47.371230+0000","last_fullsized":"2024-02-15T22:57:47.371230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.159145+0000","last_change":"2024-02-15T22:58:40.159166+0000","last_active":"2024-02-15T22:58:40.159145+0000","last_peered":"2024-02-15T22:58:40.159145+0000","last_clean":"2024-02-15T22:58:40.159145+0000","last_became_active":"2024-02-15T22:56:03.706721+0000","last_became_peered":"2024-02-15T22:56:03.706721+0000","last_unstale":"2024-02-15T22:58:40.159145+0000","last_undegraded":"2024-02-15T22:58:40.159145+0000","last_fullsized":"2024-02-15T22:58:40.159145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:40.159068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:40.159068+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.159068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:21:27.293449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.491985+0000","last_change":"2024-02-15T22:56:45.887614+0000","last_active":"2024-02-15T22:57:46.491985+0000","last_peered":"2024-02-15T22:57:46.491985+0000","last_clean":"2024-02-15T22:57:46.491985+0000","last_became_active":"2024-02-15T22:56:45.887260+0000","last_became_peered":"2024-02-15T22:56:45.887260+0000","last_unstale":"2024-02-15T22:57:46.491985+0000","last_undegraded":"2024-02-15T22:57:46.491985+0000","last_fullsized":"2024-02-15T22:57:46.491985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'81","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.126986+0000","last_change":"2024-02-15T22:58:01.126986+0000","last_active":"2024-02-15T22:58:01.126986+0000","last_peered":"2024-02-15T22:58:01.126986+0000","last_clean":"2024-02-15T22:58:01.126986+0000","last_became_active":"2024-02-15T22:56:09.716109+0000","last_became_peered":"2024-02-15T22:56:09.716109+0000","last_unstale":"2024-02-15T22:58:01.126986+0000","last_undegraded":"2024-02-15T22:58:01.126986+0000","last_fullsized":"2024-02-15T22:58:01.126986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-02-15T22:58:01.126822+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-02-15T22:58:01.126822+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.126822+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:24.668741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.351175+0000","last_change":"2024-02-15T22:57:52.351175+0000","last_active":"2024-02-15T22:57:52.351175+0000","last_peered":"2024-02-15T22:57:52.351175+0000","last_clean":"2024-02-15T22:57:52.351175+0000","last_became_active":"2024-02-15T22:56:11.722390+0000","last_became_peered":"2024-02-15T22:56:11.722390+0000","last_unstale":"2024-02-15T22:57:52.351175+0000","last_undegraded":"2024-02-15T22:57:52.351175+0000","last_fullsized":"2024-02-15T22:57:52.351175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.351041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.351041+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.351041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:26.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.817643+0000","last_change":"2024-02-15T22:58:36.817669+0000","last_active":"2024-02-15T22:58:36.817643+0000","last_peered":"2024-02-15T22:58:36.817643+0000","last_clean":"2024-02-15T22:58:36.817643+0000","last_became_active":"2024-02-15T22:56:13.732437+0000","last_became_peered":"2024-02-15T22:56:13.732437+0000","last_unstale":"2024-02-15T22:58:36.817643+0000","last_undegraded":"2024-02-15T22:58:36.817643+0000","last_fullsized":"2024-02-15T22:58:36.817643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-15T22:58:36.817537+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-15T22:58:36.817537+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.817537+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:42:08.747988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.192867+0000","last_change":"2024-02-15T22:58:34.192905+0000","last_active":"2024-02-15T22:58:34.192867+0000","last_peered":"2024-02-15T22:58:34.192867+0000","last_clean":"2024-02-15T22:58:34.192867+0000","last_became_active":"2024-02-15T22:56:05.699679+0000","last_became_peered":"2024-02-15T22:56:05.699679+0000","last_unstale":"2024-02-15T22:58:34.192867+0000","last_undegraded":"2024-02-15T22:58:34.192867+0000","last_fullsized":"2024-02-15T22:58:34.192867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:34.192733+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:34.192733+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.192733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:23.150003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371221+0000","last_change":"2024-02-15T22:55:57.673021+0000","last_active":"2024-02-15T22:57:47.371221+0000","last_peered":"2024-02-15T22:57:47.371221+0000","last_clean":"2024-02-15T22:57:47.371221+0000","last_became_active":"2024-02-15T22:55:57.672705+0000","last_became_peered":"2024-02-15T22:55:57.672705+0000","last_unstale":"2024-02-15T22:57:47.371221+0000","last_undegraded":"2024-02-15T22:57:47.371221+0000","last_fullsized":"2024-02-15T22:57:47.371221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.330569+0000","last_change":"2024-02-15T22:58:29.330612+0000","last_active":"2024-02-15T22:58:29.330569+0000","last_peered":"2024-02-15T22:58:29.330569+0000","last_clean":"2024-02-15T22:58:29.330569+0000","last_became_active":"2024-02-15T22:56:03.699864+0000","last_became_peered":"2024-02-15T22:56:03.699864+0000","last_unstale":"2024-02-15T22:58:29.330569+0000","last_undegraded":"2024-02-15T22:58:29.330569+0000","last_fullsized":"2024-02-15T22:58:29.330569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:29.330452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:29.330452+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.330452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:47.505596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.977656+0000","last_change":"2024-02-15T22:57:50.977656+0000","last_active":"2024-02-15T22:57:50.977656+0000","last_peered":"2024-02-15T22:57:50.977656+0000","last_clean":"2024-02-15T22:57:50.977656+0000","last_became_active":"2024-02-15T22:56:07.707620+0000","last_became_peered":"2024-02-15T22:56:07.707620+0000","last_unstale":"2024-02-15T22:57:50.977656+0000","last_undegraded":"2024-02-15T22:57:50.977656+0000","last_fullsized":"2024-02-15T22:57:50.977656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.977533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.977533+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.977533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:06:57.198666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":447,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.870292+0000","last_change":"2024-02-15T22:57:50.870292+0000","last_active":"2024-02-15T22:57:50.870292+0000","last_peered":"2024-02-15T22:57:50.870292+0000","last_clean":"2024-02-15T22:57:50.870292+0000","last_became_active":"2024-02-15T22:56:09.718396+0000","last_became_peered":"2024-02-15T22:56:09.718396+0000","last_unstale":"2024-02-15T22:57:50.870292+0000","last_undegraded":"2024-02-15T22:57:50.870292+0000","last_fullsized":"2024-02-15T22:57:50.870292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-02-15T22:57:50.870120+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-02-15T22:57:50.870120+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.870120+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:52.372485+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.133283+0000","last_change":"2024-02-15T22:58:11.133283+0000","last_active":"2024-02-15T22:58:11.133283+0000","last_peered":"2024-02-15T22:58:11.133283+0000","last_clean":"2024-02-15T22:58:11.133283+0000","last_became_active":"2024-02-15T22:56:11.725005+0000","last_became_peered":"2024-02-15T22:56:11.725005+0000","last_unstale":"2024-02-15T22:58:11.133283+0000","last_undegraded":"2024-02-15T22:58:11.133283+0000","last_fullsized":"2024-02-15T22:58:11.133283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.133157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.133157+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.133157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:19:51.739962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:43.851177+0000","last_change":"2024-02-15T22:58:43.851204+0000","last_active":"2024-02-15T22:58:43.851177+0000","last_peered":"2024-02-15T22:58:43.851177+0000","last_clean":"2024-02-15T22:58:43.851177+0000","last_became_active":"2024-02-15T22:56:13.733760+0000","last_became_peered":"2024-02-15T22:56:13.733760+0000","last_unstale":"2024-02-15T22:58:43.851177+0000","last_undegraded":"2024-02-15T22:58:43.851177+0000","last_fullsized":"2024-02-15T22:58:43.851177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:58:43.851088+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:58:43.851088+0000","last_clean_scrub_stamp":"2024-02-15T22:58:43.851088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:42.577719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.342257+0000","last_change":"2024-02-15T22:58:28.342294+0000","last_active":"2024-02-15T22:58:28.342257+0000","last_peered":"2024-02-15T22:58:28.342257+0000","last_clean":"2024-02-15T22:58:28.342257+0000","last_became_active":"2024-02-15T22:56:05.704953+0000","last_became_peered":"2024-02-15T22:56:05.704953+0000","last_unstale":"2024-02-15T22:58:28.342257+0000","last_undegraded":"2024-02-15T22:58:28.342257+0000","last_fullsized":"2024-02-15T22:58:28.342257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:28.342172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:28.342172+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.342172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:42:00.272623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.926087+0000","last_change":"2024-02-15T22:58:25.926114+0000","last_active":"2024-02-15T22:58:25.926087+0000","last_peered":"2024-02-15T22:58:25.926087+0000","last_clean":"2024-02-15T22:58:25.926087+0000","last_became_active":"2024-02-15T22:55:57.671130+0000","last_became_peered":"2024-02-15T22:55:57.671130+0000","last_unstale":"2024-02-15T22:58:25.926087+0000","last_undegraded":"2024-02-15T22:58:25.926087+0000","last_fullsized":"2024-02-15T22:58:25.926087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.925997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.925997+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.925997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:51.947906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.386100+0000","last_change":"2024-02-15T22:58:33.386127+0000","last_active":"2024-02-15T22:58:33.386100+0000","last_peered":"2024-02-15T22:58:33.386100+0000","last_clean":"2024-02-15T22:58:33.386100+0000","last_became_active":"2024-02-15T22:56:03.699598+0000","last_became_peered":"2024-02-15T22:56:03.699598+0000","last_unstale":"2024-02-15T22:58:33.386100+0000","last_undegraded":"2024-02-15T22:58:33.386100+0000","last_fullsized":"2024-02-15T22:58:33.386100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:33.385993+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:33.385993+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.385993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:03:57.567548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.962853+0000","last_change":"2024-02-15T22:58:05.962853+0000","last_active":"2024-02-15T22:58:05.962853+0000","last_peered":"2024-02-15T22:58:05.962853+0000","last_clean":"2024-02-15T22:58:05.962853+0000","last_became_active":"2024-02-15T22:56:07.704107+0000","last_became_peered":"2024-02-15T22:56:07.704107+0000","last_unstale":"2024-02-15T22:58:05.962853+0000","last_undegraded":"2024-02-15T22:58:05.962853+0000","last_fullsized":"2024-02-15T22:58:05.962853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:05.962670+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:05.962670+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.962670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:35.552053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.972000+0000","last_change":"2024-02-15T22:57:58.972000+0000","last_active":"2024-02-15T22:57:58.972000+0000","last_peered":"2024-02-15T22:57:58.972000+0000","last_clean":"2024-02-15T22:57:58.972000+0000","last_became_active":"2024-02-15T22:56:09.711494+0000","last_became_peered":"2024-02-15T22:56:09.711494+0000","last_unstale":"2024-02-15T22:57:58.972000+0000","last_undegraded":"2024-02-15T22:57:58.972000+0000","last_fullsized":"2024-02-15T22:57:58.972000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-02-15T22:57:58.971860+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-02-15T22:57:58.971860+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.971860+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:36:02.170038+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.345803+0000","last_change":"2024-02-15T22:57:47.345803+0000","last_active":"2024-02-15T22:57:47.345803+0000","last_peered":"2024-02-15T22:57:47.345803+0000","last_clean":"2024-02-15T22:57:47.345803+0000","last_became_active":"2024-02-15T22:56:11.722277+0000","last_became_peered":"2024-02-15T22:56:11.722277+0000","last_unstale":"2024-02-15T22:57:47.345803+0000","last_undegraded":"2024-02-15T22:57:47.345803+0000","last_fullsized":"2024-02-15T22:57:47.345803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.345669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.345669+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.345669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:53:30.201838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.154491+0000","last_change":"2024-02-15T22:58:25.154491+0000","last_active":"2024-02-15T22:58:25.154491+0000","last_peered":"2024-02-15T22:58:25.154491+0000","last_clean":"2024-02-15T22:58:25.154491+0000","last_became_active":"2024-02-15T22:56:13.726165+0000","last_became_peered":"2024-02-15T22:56:13.726165+0000","last_unstale":"2024-02-15T22:58:25.154491+0000","last_undegraded":"2024-02-15T22:58:25.154491+0000","last_fullsized":"2024-02-15T22:58:25.154491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.154393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.154393+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.154393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:00:50.346134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.355105+0000","last_change":"2024-02-15T22:58:32.355136+0000","last_active":"2024-02-15T22:58:32.355105+0000","last_peered":"2024-02-15T22:58:32.355105+0000","last_clean":"2024-02-15T22:58:32.355105+0000","last_became_active":"2024-02-15T22:56:05.707171+0000","last_became_peered":"2024-02-15T22:56:05.707171+0000","last_unstale":"2024-02-15T22:58:32.355105+0000","last_undegraded":"2024-02-15T22:58:32.355105+0000","last_fullsized":"2024-02-15T22:58:32.355105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:32.355014+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:32.355014+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.355014+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:45.736925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371190+0000","last_change":"2024-02-15T22:55:57.672717+0000","last_active":"2024-02-15T22:57:47.371190+0000","last_peered":"2024-02-15T22:57:47.371190+0000","last_clean":"2024-02-15T22:57:47.371190+0000","last_became_active":"2024-02-15T22:55:57.672268+0000","last_became_peered":"2024-02-15T22:55:57.672268+0000","last_unstale":"2024-02-15T22:57:47.371190+0000","last_undegraded":"2024-02-15T22:57:47.371190+0000","last_fullsized":"2024-02-15T22:57:47.371190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.861421+0000","last_change":"2024-02-15T22:58:31.861445+0000","last_active":"2024-02-15T22:58:31.861421+0000","last_peered":"2024-02-15T22:58:31.861421+0000","last_clean":"2024-02-15T22:58:31.861421+0000","last_became_active":"2024-02-15T22:56:03.693487+0000","last_became_peered":"2024-02-15T22:56:03.693487+0000","last_unstale":"2024-02-15T22:58:31.861421+0000","last_undegraded":"2024-02-15T22:58:31.861421+0000","last_fullsized":"2024-02-15T22:58:31.861421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:31.861328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:31.861328+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.861328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:26.592205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.228589+0000","last_change":"2024-02-15T22:58:06.228589+0000","last_active":"2024-02-15T22:58:06.228589+0000","last_peered":"2024-02-15T22:58:06.228589+0000","last_clean":"2024-02-15T22:58:06.228589+0000","last_became_active":"2024-02-15T22:56:07.707227+0000","last_became_peered":"2024-02-15T22:56:07.707227+0000","last_unstale":"2024-02-15T22:58:06.228589+0000","last_undegraded":"2024-02-15T22:58:06.228589+0000","last_fullsized":"2024-02-15T22:58:06.228589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:06.228482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:06.228482+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.228482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:24:36.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.146475+0000","last_change":"2024-02-15T22:58:18.146475+0000","last_active":"2024-02-15T22:58:18.146475+0000","last_peered":"2024-02-15T22:58:18.146475+0000","last_clean":"2024-02-15T22:58:18.146475+0000","last_became_active":"2024-02-15T22:56:09.719999+0000","last_became_peered":"2024-02-15T22:56:09.719999+0000","last_unstale":"2024-02-15T22:58:18.146475+0000","last_undegraded":"2024-02-15T22:58:18.146475+0000","last_fullsized":"2024-02-15T22:58:18.146475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-02-15T22:58:18.146343+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-02-15T22:58:18.146343+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.146343+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:46:00.908693+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.141146+0000","last_change":"2024-02-15T22:58:14.141146+0000","last_active":"2024-02-15T22:58:14.141146+0000","last_peered":"2024-02-15T22:58:14.141146+0000","last_clean":"2024-02-15T22:58:14.141146+0000","last_became_active":"2024-02-15T22:56:11.723718+0000","last_became_peered":"2024-02-15T22:56:11.723718+0000","last_unstale":"2024-02-15T22:58:14.141146+0000","last_undegraded":"2024-02-15T22:58:14.141146+0000","last_fullsized":"2024-02-15T22:58:14.141146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:14.141029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:14.141029+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.141029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:54:12.738246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.889819+0000","last_change":"2024-02-15T22:58:39.889864+0000","last_active":"2024-02-15T22:58:39.889819+0000","last_peered":"2024-02-15T22:58:39.889819+0000","last_clean":"2024-02-15T22:58:39.889819+0000","last_became_active":"2024-02-15T22:56:13.730551+0000","last_became_peered":"2024-02-15T22:56:13.730551+0000","last_unstale":"2024-02-15T22:58:39.889819+0000","last_undegraded":"2024-02-15T22:58:39.889819+0000","last_fullsized":"2024-02-15T22:58:39.889819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:39.889725+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:39.889725+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.889725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:50.902696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.886211+0000","last_change":"2024-02-15T22:58:07.886211+0000","last_active":"2024-02-15T22:58:07.886211+0000","last_peered":"2024-02-15T22:58:07.886211+0000","last_clean":"2024-02-15T22:58:07.886211+0000","last_became_active":"2024-02-15T22:56:05.714389+0000","last_became_peered":"2024-02-15T22:56:05.714389+0000","last_unstale":"2024-02-15T22:58:07.886211+0000","last_undegraded":"2024-02-15T22:58:07.886211+0000","last_fullsized":"2024-02-15T22:58:07.886211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:07.886088+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:07.886088+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.886088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:31.251765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.952076+0000","last_change":"2024-02-15T22:58:28.952099+0000","last_active":"2024-02-15T22:58:28.952076+0000","last_peered":"2024-02-15T22:58:28.952076+0000","last_clean":"2024-02-15T22:58:28.952076+0000","last_became_active":"2024-02-15T22:56:03.693005+0000","last_became_peered":"2024-02-15T22:56:03.693005+0000","last_unstale":"2024-02-15T22:58:28.952076+0000","last_undegraded":"2024-02-15T22:58:28.952076+0000","last_fullsized":"2024-02-15T22:58:28.952076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:28.951988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:28.951988+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.951988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:34.947773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.360612+0000","last_change":"2024-02-15T22:58:35.360642+0000","last_active":"2024-02-15T22:58:35.360612+0000","last_peered":"2024-02-15T22:58:35.360612+0000","last_clean":"2024-02-15T22:58:35.360612+0000","last_became_active":"2024-02-15T22:55:57.671524+0000","last_became_peered":"2024-02-15T22:55:57.671524+0000","last_unstale":"2024-02-15T22:58:35.360612+0000","last_undegraded":"2024-02-15T22:58:35.360612+0000","last_fullsized":"2024-02-15T22:58:35.360612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:35.360528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:35.360528+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.360528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:16:02.723261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.254714+0000","last_change":"2024-02-15T22:58:03.254714+0000","last_active":"2024-02-15T22:58:03.254714+0000","last_peered":"2024-02-15T22:58:03.254714+0000","last_clean":"2024-02-15T22:58:03.254714+0000","last_became_active":"2024-02-15T22:56:07.707281+0000","last_became_peered":"2024-02-15T22:56:07.707281+0000","last_unstale":"2024-02-15T22:58:03.254714+0000","last_undegraded":"2024-02-15T22:58:03.254714+0000","last_fullsized":"2024-02-15T22:58:03.254714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:03.254575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:03.254575+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.254575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:31.078756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.385601+0000","last_change":"2024-02-15T22:57:55.385601+0000","last_active":"2024-02-15T22:57:55.385601+0000","last_peered":"2024-02-15T22:57:55.385601+0000","last_clean":"2024-02-15T22:57:55.385601+0000","last_became_active":"2024-02-15T22:56:09.717692+0000","last_became_peered":"2024-02-15T22:56:09.717692+0000","last_unstale":"2024-02-15T22:57:55.385601+0000","last_undegraded":"2024-02-15T22:57:55.385601+0000","last_fullsized":"2024-02-15T22:57:55.385601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-02-15T22:57:55.385469+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-02-15T22:57:55.385469+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.385469+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:24.974853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.917439+0000","last_change":"2024-02-15T22:57:49.917439+0000","last_active":"2024-02-15T22:57:49.917439+0000","last_peered":"2024-02-15T22:57:49.917439+0000","last_clean":"2024-02-15T22:57:49.917439+0000","last_became_active":"2024-02-15T22:56:11.718332+0000","last_became_peered":"2024-02-15T22:56:11.718332+0000","last_unstale":"2024-02-15T22:57:49.917439+0000","last_undegraded":"2024-02-15T22:57:49.917439+0000","last_fullsized":"2024-02-15T22:57:49.917439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.917248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.917248+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.917248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:48.180880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.184633+0000","last_change":"2024-02-15T22:58:08.184633+0000","last_active":"2024-02-15T22:58:08.184633+0000","last_peered":"2024-02-15T22:58:08.184633+0000","last_clean":"2024-02-15T22:58:08.184633+0000","last_became_active":"2024-02-15T22:56:13.723512+0000","last_became_peered":"2024-02-15T22:56:13.723512+0000","last_unstale":"2024-02-15T22:58:08.184633+0000","last_undegraded":"2024-02-15T22:58:08.184633+0000","last_fullsized":"2024-02-15T22:58:08.184633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-02-15T22:58:08.184528+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-02-15T22:58:08.184528+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.184528+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:33.363968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.905431+0000","last_change":"2024-02-15T22:58:38.905461+0000","last_active":"2024-02-15T22:58:38.905431+0000","last_peered":"2024-02-15T22:58:38.905431+0000","last_clean":"2024-02-15T22:58:38.905431+0000","last_became_active":"2024-02-15T22:56:05.713036+0000","last_became_peered":"2024-02-15T22:56:05.713036+0000","last_unstale":"2024-02-15T22:58:38.905431+0000","last_undegraded":"2024-02-15T22:58:38.905431+0000","last_fullsized":"2024-02-15T22:58:38.905431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:38.905348+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:38.905348+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.905348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:54:37.502566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.358592+0000","last_change":"2024-02-15T22:58:40.358643+0000","last_active":"2024-02-15T22:58:40.358592+0000","last_peered":"2024-02-15T22:58:40.358592+0000","last_clean":"2024-02-15T22:58:40.358592+0000","last_became_active":"2024-02-15T22:56:03.699564+0000","last_became_peered":"2024-02-15T22:56:03.699564+0000","last_unstale":"2024-02-15T22:58:40.358592+0000","last_undegraded":"2024-02-15T22:58:40.358592+0000","last_fullsized":"2024-02-15T22:58:40.358592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:40.358505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:40.358505+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.358505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:56:17.281060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371220+0000","last_change":"2024-02-15T22:55:57.672438+0000","last_active":"2024-02-15T22:57:47.371220+0000","last_peered":"2024-02-15T22:57:47.371220+0000","last_clean":"2024-02-15T22:57:47.371220+0000","last_became_active":"2024-02-15T22:55:57.672053+0000","last_became_peered":"2024-02-15T22:55:57.672053+0000","last_unstale":"2024-02-15T22:57:47.371220+0000","last_undegraded":"2024-02-15T22:57:47.371220+0000","last_fullsized":"2024-02-15T22:57:47.371220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372046+0000","last_change":"2024-02-15T22:56:45.893645+0000","last_active":"2024-02-15T22:57:47.372046+0000","last_peered":"2024-02-15T22:57:47.372046+0000","last_clean":"2024-02-15T22:57:47.372046+0000","last_became_active":"2024-02-15T22:56:45.893109+0000","last_became_peered":"2024-02-15T22:56:45.893109+0000","last_unstale":"2024-02-15T22:57:47.372046+0000","last_undegraded":"2024-02-15T22:57:47.372046+0000","last_fullsized":"2024-02-15T22:57:47.372046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.859195+0000","last_change":"2024-02-15T22:57:49.859195+0000","last_active":"2024-02-15T22:57:49.859195+0000","last_peered":"2024-02-15T22:57:49.859195+0000","last_clean":"2024-02-15T22:57:49.859195+0000","last_became_active":"2024-02-15T22:56:09.721140+0000","last_became_peered":"2024-02-15T22:56:09.721140+0000","last_unstale":"2024-02-15T22:57:49.859195+0000","last_undegraded":"2024-02-15T22:57:49.859195+0000","last_fullsized":"2024-02-15T22:57:49.859195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-02-15T22:57:49.859068+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-02-15T22:57:49.859068+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.859068+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:24:17.693114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":290,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.831746+0000","last_change":"2024-02-15T22:57:48.831746+0000","last_active":"2024-02-15T22:57:48.831746+0000","last_peered":"2024-02-15T22:57:48.831746+0000","last_clean":"2024-02-15T22:57:48.831746+0000","last_became_active":"2024-02-15T22:56:11.717544+0000","last_became_peered":"2024-02-15T22:56:11.717544+0000","last_unstale":"2024-02-15T22:57:48.831746+0000","last_undegraded":"2024-02-15T22:57:48.831746+0000","last_fullsized":"2024-02-15T22:57:48.831746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:48.831614+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:48.831614+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.831614+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:25.818844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:41.175420+0000","last_change":"2024-02-15T22:58:41.175444+0000","last_active":"2024-02-15T22:58:41.175420+0000","last_peered":"2024-02-15T22:58:41.175420+0000","last_clean":"2024-02-15T22:58:41.175420+0000","last_became_active":"2024-02-15T22:56:13.728228+0000","last_became_peered":"2024-02-15T22:56:13.728228+0000","last_unstale":"2024-02-15T22:58:41.175420+0000","last_undegraded":"2024-02-15T22:58:41.175420+0000","last_fullsized":"2024-02-15T22:58:41.175420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:41.175331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:41.175331+0000","last_clean_scrub_stamp":"2024-02-15T22:58:41.175331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:05:22.295896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.164396+0000","last_change":"2024-02-15T22:58:06.164425+0000","last_active":"2024-02-15T22:58:06.164396+0000","last_peered":"2024-02-15T22:58:06.164396+0000","last_clean":"2024-02-15T22:58:06.164396+0000","last_became_active":"2024-02-15T22:56:05.710924+0000","last_became_peered":"2024-02-15T22:56:05.710924+0000","last_unstale":"2024-02-15T22:58:06.164396+0000","last_undegraded":"2024-02-15T22:58:06.164396+0000","last_fullsized":"2024-02-15T22:58:06.164396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:06.164305+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:06.164305+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.164305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:46.445946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371250+0000","last_change":"2024-02-15T22:56:03.696202+0000","last_active":"2024-02-15T22:57:47.371250+0000","last_peered":"2024-02-15T22:57:47.371250+0000","last_clean":"2024-02-15T22:57:47.371250+0000","last_became_active":"2024-02-15T22:56:03.695921+0000","last_became_peered":"2024-02-15T22:56:03.695921+0000","last_unstale":"2024-02-15T22:57:47.371250+0000","last_undegraded":"2024-02-15T22:57:47.371250+0000","last_fullsized":"2024-02-15T22:57:47.371250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.343375+0000","last_change":"2024-02-15T22:58:34.343403+0000","last_active":"2024-02-15T22:58:34.343375+0000","last_peered":"2024-02-15T22:58:34.343375+0000","last_clean":"2024-02-15T22:58:34.343375+0000","last_became_active":"2024-02-15T22:55:57.671257+0000","last_became_peered":"2024-02-15T22:55:57.671257+0000","last_unstale":"2024-02-15T22:58:34.343375+0000","last_undegraded":"2024-02-15T22:58:34.343375+0000","last_fullsized":"2024-02-15T22:58:34.343375+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:34.343288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:34.343288+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.343288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:20.945858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.993271+0000","last_change":"2024-02-15T22:57:53.993271+0000","last_active":"2024-02-15T22:57:53.993271+0000","last_peered":"2024-02-15T22:57:53.993271+0000","last_clean":"2024-02-15T22:57:53.993271+0000","last_became_active":"2024-02-15T22:56:07.705323+0000","last_became_peered":"2024-02-15T22:56:07.705323+0000","last_unstale":"2024-02-15T22:57:53.993271+0000","last_undegraded":"2024-02-15T22:57:53.993271+0000","last_fullsized":"2024-02-15T22:57:53.993271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:53.993161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:53.993161+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.993161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:37.548413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.097818+0000","last_change":"2024-02-15T22:58:16.097856+0000","last_active":"2024-02-15T22:58:16.097818+0000","last_peered":"2024-02-15T22:58:16.097818+0000","last_clean":"2024-02-15T22:58:16.097818+0000","last_became_active":"2024-02-15T22:56:09.729131+0000","last_became_peered":"2024-02-15T22:56:09.729131+0000","last_unstale":"2024-02-15T22:58:16.097818+0000","last_undegraded":"2024-02-15T22:58:16.097818+0000","last_fullsized":"2024-02-15T22:58:16.097818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-15T22:58:16.097737+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-15T22:58:16.097737+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.097737+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:35:13.613365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":323,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.400056+0000","last_change":"2024-02-15T22:57:51.400056+0000","last_active":"2024-02-15T22:57:51.400056+0000","last_peered":"2024-02-15T22:57:51.400056+0000","last_clean":"2024-02-15T22:57:51.400056+0000","last_became_active":"2024-02-15T22:56:11.719685+0000","last_became_peered":"2024-02-15T22:56:11.719685+0000","last_unstale":"2024-02-15T22:57:51.400056+0000","last_undegraded":"2024-02-15T22:57:51.400056+0000","last_fullsized":"2024-02-15T22:57:51.400056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:51.399947+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:51.399947+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.399947+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:14.785659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.892686+0000","last_change":"2024-02-15T22:58:12.892686+0000","last_active":"2024-02-15T22:58:12.892686+0000","last_peered":"2024-02-15T22:58:12.892686+0000","last_clean":"2024-02-15T22:58:12.892686+0000","last_became_active":"2024-02-15T22:56:13.730494+0000","last_became_peered":"2024-02-15T22:56:13.730494+0000","last_unstale":"2024-02-15T22:58:12.892686+0000","last_undegraded":"2024-02-15T22:58:12.892686+0000","last_fullsized":"2024-02-15T22:58:12.892686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-15T22:58:12.892569+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-15T22:58:12.892569+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.892569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:13.313696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.895931+0000","last_change":"2024-02-15T22:58:21.895961+0000","last_active":"2024-02-15T22:58:21.895931+0000","last_peered":"2024-02-15T22:58:21.895931+0000","last_clean":"2024-02-15T22:58:21.895931+0000","last_became_active":"2024-02-15T22:56:05.705764+0000","last_became_peered":"2024-02-15T22:56:05.705764+0000","last_unstale":"2024-02-15T22:58:21.895931+0000","last_undegraded":"2024-02-15T22:58:21.895931+0000","last_fullsized":"2024-02-15T22:58:21.895931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:21.895840+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:21.895840+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.895840+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:12.132052+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.912018+0000","last_change":"2024-02-15T22:58:25.912041+0000","last_active":"2024-02-15T22:58:25.912018+0000","last_peered":"2024-02-15T22:58:25.912018+0000","last_clean":"2024-02-15T22:58:25.912018+0000","last_became_active":"2024-02-15T22:56:03.705783+0000","last_became_peered":"2024-02-15T22:56:03.705783+0000","last_unstale":"2024-02-15T22:58:25.912018+0000","last_undegraded":"2024-02-15T22:58:25.912018+0000","last_fullsized":"2024-02-15T22:58:25.912018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.911921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.911921+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.911921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:49.453839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371211+0000","last_change":"2024-02-15T22:55:57.854108+0000","last_active":"2024-02-15T22:57:47.371211+0000","last_peered":"2024-02-15T22:57:47.371211+0000","last_clean":"2024-02-15T22:57:47.371211+0000","last_became_active":"2024-02-15T22:55:57.853714+0000","last_became_peered":"2024-02-15T22:55:57.853714+0000","last_unstale":"2024-02-15T22:57:47.371211+0000","last_undegraded":"2024-02-15T22:57:47.371211+0000","last_fullsized":"2024-02-15T22:57:47.371211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:55:56.659827+0000","last_clean_scrub_stamp":"2024-02-15T22:55:56.659827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.020401+0000","last_change":"2024-02-15T22:57:58.020401+0000","last_active":"2024-02-15T22:57:58.020401+0000","last_peered":"2024-02-15T22:57:58.020401+0000","last_clean":"2024-02-15T22:57:58.020401+0000","last_became_active":"2024-02-15T22:56:07.705013+0000","last_became_peered":"2024-02-15T22:56:07.705013+0000","last_unstale":"2024-02-15T22:57:58.020401+0000","last_undegraded":"2024-02-15T22:57:58.020401+0000","last_fullsized":"2024-02-15T22:57:58.020401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:58.020263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:58.020263+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.020263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:46.435941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.962295+0000","last_change":"2024-02-15T22:57:53.962295+0000","last_active":"2024-02-15T22:57:53.962295+0000","last_peered":"2024-02-15T22:57:53.962295+0000","last_clean":"2024-02-15T22:57:53.962295+0000","last_became_active":"2024-02-15T22:56:09.719916+0000","last_became_peered":"2024-02-15T22:56:09.719916+0000","last_unstale":"2024-02-15T22:57:53.962295+0000","last_undegraded":"2024-02-15T22:57:53.962295+0000","last_fullsized":"2024-02-15T22:57:53.962295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-02-15T22:57:53.962112+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-02-15T22:57:53.962112+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.962112+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:13:33.384008+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.358256+0000","last_change":"2024-02-15T22:57:54.358256+0000","last_active":"2024-02-15T22:57:54.358256+0000","last_peered":"2024-02-15T22:57:54.358256+0000","last_clean":"2024-02-15T22:57:54.358256+0000","last_became_active":"2024-02-15T22:56:11.717758+0000","last_became_peered":"2024-02-15T22:56:11.717758+0000","last_unstale":"2024-02-15T22:57:54.358256+0000","last_undegraded":"2024-02-15T22:57:54.358256+0000","last_fullsized":"2024-02-15T22:57:54.358256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:54.358148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:54.358148+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.358148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:29.880821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.851752+0000","last_change":"2024-02-15T22:58:35.851776+0000","last_active":"2024-02-15T22:58:35.851752+0000","last_peered":"2024-02-15T22:58:35.851752+0000","last_clean":"2024-02-15T22:58:35.851752+0000","last_became_active":"2024-02-15T22:56:13.732325+0000","last_became_peered":"2024-02-15T22:56:13.732325+0000","last_unstale":"2024-02-15T22:58:35.851752+0000","last_undegraded":"2024-02-15T22:58:35.851752+0000","last_fullsized":"2024-02-15T22:58:35.851752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:35.851664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:35.851664+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.851664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:32:35.470507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.926533+0000","last_change":"2024-02-15T22:58:07.926533+0000","last_active":"2024-02-15T22:58:07.926533+0000","last_peered":"2024-02-15T22:58:07.926533+0000","last_clean":"2024-02-15T22:58:07.926533+0000","last_became_active":"2024-02-15T22:56:13.732216+0000","last_became_peered":"2024-02-15T22:56:13.732216+0000","last_unstale":"2024-02-15T22:58:07.926533+0000","last_undegraded":"2024-02-15T22:58:07.926533+0000","last_fullsized":"2024-02-15T22:58:07.926533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.926378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.926378+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.926378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:00.958886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.897351+0000","last_change":"2024-02-15T22:58:19.897351+0000","last_active":"2024-02-15T22:58:19.897351+0000","last_peered":"2024-02-15T22:58:19.897351+0000","last_clean":"2024-02-15T22:58:19.897351+0000","last_became_active":"2024-02-15T22:56:05.704959+0000","last_became_peered":"2024-02-15T22:56:05.704959+0000","last_unstale":"2024-02-15T22:58:19.897351+0000","last_undegraded":"2024-02-15T22:58:19.897351+0000","last_fullsized":"2024-02-15T22:58:19.897351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:19.897173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:19.897173+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.897173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:28:13.350809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371392+0000","last_change":"2024-02-15T22:56:03.705460+0000","last_active":"2024-02-15T22:57:47.371392+0000","last_peered":"2024-02-15T22:57:47.371392+0000","last_clean":"2024-02-15T22:57:47.371392+0000","last_became_active":"2024-02-15T22:56:03.705176+0000","last_became_peered":"2024-02-15T22:56:03.705176+0000","last_unstale":"2024-02-15T22:57:47.371392+0000","last_undegraded":"2024-02-15T22:57:47.371392+0000","last_fullsized":"2024-02-15T22:57:47.371392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.818396+0000","last_change":"2024-02-15T22:58:02.818396+0000","last_active":"2024-02-15T22:58:02.818396+0000","last_peered":"2024-02-15T22:58:02.818396+0000","last_clean":"2024-02-15T22:58:02.818396+0000","last_became_active":"2024-02-15T22:56:07.703060+0000","last_became_peered":"2024-02-15T22:56:07.703060+0000","last_unstale":"2024-02-15T22:58:02.818396+0000","last_undegraded":"2024-02-15T22:58:02.818396+0000","last_fullsized":"2024-02-15T22:58:02.818396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:02.818259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:02.818259+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.818259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:34.242902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.172307+0000","last_change":"2024-02-15T22:58:19.172307+0000","last_active":"2024-02-15T22:58:19.172307+0000","last_peered":"2024-02-15T22:58:19.172307+0000","last_clean":"2024-02-15T22:58:19.172307+0000","last_became_active":"2024-02-15T22:56:09.720627+0000","last_became_peered":"2024-02-15T22:56:09.720627+0000","last_unstale":"2024-02-15T22:58:19.172307+0000","last_undegraded":"2024-02-15T22:58:19.172307+0000","last_fullsized":"2024-02-15T22:58:19.172307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-15T22:58:19.172190+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-15T22:58:19.172190+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.172190+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:17.898821+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.182843+0000","last_change":"2024-02-15T22:58:12.182843+0000","last_active":"2024-02-15T22:58:12.182843+0000","last_peered":"2024-02-15T22:58:12.182843+0000","last_clean":"2024-02-15T22:58:12.182843+0000","last_became_active":"2024-02-15T22:56:11.724592+0000","last_became_peered":"2024-02-15T22:56:11.724592+0000","last_unstale":"2024-02-15T22:58:12.182843+0000","last_undegraded":"2024-02-15T22:58:12.182843+0000","last_fullsized":"2024-02-15T22:58:12.182843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.182689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.182689+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.182689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:17:50.255923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:43.398046+0000","last_change":"2024-02-15T22:58:43.398078+0000","last_active":"2024-02-15T22:58:43.398046+0000","last_peered":"2024-02-15T22:58:43.398046+0000","last_clean":"2024-02-15T22:58:43.398046+0000","last_became_active":"2024-02-15T22:56:13.729931+0000","last_became_peered":"2024-02-15T22:56:13.729931+0000","last_unstale":"2024-02-15T22:58:43.398046+0000","last_undegraded":"2024-02-15T22:58:43.398046+0000","last_fullsized":"2024-02-15T22:58:43.398046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:43.397960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:43.397960+0000","last_clean_scrub_stamp":"2024-02-15T22:58:43.397960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:19.186513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.873645+0000","last_change":"2024-02-15T22:58:10.873645+0000","last_active":"2024-02-15T22:58:10.873645+0000","last_peered":"2024-02-15T22:58:10.873645+0000","last_clean":"2024-02-15T22:58:10.873645+0000","last_became_active":"2024-02-15T22:56:05.714024+0000","last_became_peered":"2024-02-15T22:56:05.714024+0000","last_unstale":"2024-02-15T22:58:10.873645+0000","last_undegraded":"2024-02-15T22:58:10.873645+0000","last_fullsized":"2024-02-15T22:58:10.873645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:10.873523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:10.873523+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.873523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:35.471679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.861301+0000","last_change":"2024-02-15T22:58:32.861325+0000","last_active":"2024-02-15T22:58:32.861301+0000","last_peered":"2024-02-15T22:58:32.861301+0000","last_clean":"2024-02-15T22:58:32.861301+0000","last_became_active":"2024-02-15T22:56:03.695339+0000","last_became_peered":"2024-02-15T22:56:03.695339+0000","last_unstale":"2024-02-15T22:58:32.861301+0000","last_undegraded":"2024-02-15T22:58:32.861301+0000","last_fullsized":"2024-02-15T22:58:32.861301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:32.861212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:32.861212+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.861212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:38.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.932729+0000","last_change":"2024-02-15T22:57:49.932729+0000","last_active":"2024-02-15T22:57:49.932729+0000","last_peered":"2024-02-15T22:57:49.932729+0000","last_clean":"2024-02-15T22:57:49.932729+0000","last_became_active":"2024-02-15T22:56:07.708692+0000","last_became_peered":"2024-02-15T22:56:07.708692+0000","last_unstale":"2024-02-15T22:57:49.932729+0000","last_undegraded":"2024-02-15T22:57:49.932729+0000","last_fullsized":"2024-02-15T22:57:49.932729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.932578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.932578+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.932578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:19:08.744146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.213042+0000","last_change":"2024-02-15T22:58:02.213042+0000","last_active":"2024-02-15T22:58:02.213042+0000","last_peered":"2024-02-15T22:58:02.213042+0000","last_clean":"2024-02-15T22:58:02.213042+0000","last_became_active":"2024-02-15T22:56:09.710942+0000","last_became_peered":"2024-02-15T22:56:09.710942+0000","last_unstale":"2024-02-15T22:58:02.213042+0000","last_undegraded":"2024-02-15T22:58:02.213042+0000","last_fullsized":"2024-02-15T22:58:02.213042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:02.212917+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:02.212917+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.212917+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:41.461653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.958962+0000","last_change":"2024-02-15T22:57:55.958962+0000","last_active":"2024-02-15T22:57:55.958962+0000","last_peered":"2024-02-15T22:57:55.958962+0000","last_clean":"2024-02-15T22:57:55.958962+0000","last_became_active":"2024-02-15T22:56:11.724533+0000","last_became_peered":"2024-02-15T22:56:11.724533+0000","last_unstale":"2024-02-15T22:57:55.958962+0000","last_undegraded":"2024-02-15T22:57:55.958962+0000","last_fullsized":"2024-02-15T22:57:55.958962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:55.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:55.958822+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:16:29.483298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.054392+0000","last_change":"2024-02-15T22:56:13.734719+0000","last_active":"2024-02-15T22:57:46.054392+0000","last_peered":"2024-02-15T22:57:46.054392+0000","last_clean":"2024-02-15T22:57:46.054392+0000","last_became_active":"2024-02-15T22:56:13.734428+0000","last_became_peered":"2024-02-15T22:56:13.734428+0000","last_unstale":"2024-02-15T22:57:46.054392+0000","last_undegraded":"2024-02-15T22:57:46.054392+0000","last_fullsized":"2024-02-15T22:57:46.054392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.301512+0000","last_change":"2024-02-15T22:58:26.301512+0000","last_active":"2024-02-15T22:58:26.301512+0000","last_peered":"2024-02-15T22:58:26.301512+0000","last_clean":"2024-02-15T22:58:26.301512+0000","last_became_active":"2024-02-15T22:56:05.705385+0000","last_became_peered":"2024-02-15T22:56:05.705385+0000","last_unstale":"2024-02-15T22:58:26.301512+0000","last_undegraded":"2024-02-15T22:58:26.301512+0000","last_fullsized":"2024-02-15T22:58:26.301512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:26.301369+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:26.301369+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.301369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:12:22.024986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.928974+0000","last_change":"2024-02-15T22:58:16.928974+0000","last_active":"2024-02-15T22:58:16.928974+0000","last_peered":"2024-02-15T22:58:16.928974+0000","last_clean":"2024-02-15T22:58:16.928974+0000","last_became_active":"2024-02-15T22:56:03.699626+0000","last_became_peered":"2024-02-15T22:56:03.699626+0000","last_unstale":"2024-02-15T22:58:16.928974+0000","last_undegraded":"2024-02-15T22:58:16.928974+0000","last_fullsized":"2024-02-15T22:58:16.928974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:16.928864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:16.928864+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.928864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:26.875704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.924988+0000","last_change":"2024-02-15T22:58:04.924988+0000","last_active":"2024-02-15T22:58:04.924988+0000","last_peered":"2024-02-15T22:58:04.924988+0000","last_clean":"2024-02-15T22:58:04.924988+0000","last_became_active":"2024-02-15T22:56:07.705705+0000","last_became_peered":"2024-02-15T22:56:07.705705+0000","last_unstale":"2024-02-15T22:58:04.924988+0000","last_undegraded":"2024-02-15T22:58:04.924988+0000","last_fullsized":"2024-02-15T22:58:04.924988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:04.924869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:04.924869+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.924869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:40.447542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'41","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.256585+0000","last_change":"2024-02-15T22:58:01.256585+0000","last_active":"2024-02-15T22:58:01.256585+0000","last_peered":"2024-02-15T22:58:01.256585+0000","last_clean":"2024-02-15T22:58:01.256585+0000","last_became_active":"2024-02-15T22:56:09.712337+0000","last_became_peered":"2024-02-15T22:56:09.712337+0000","last_unstale":"2024-02-15T22:58:01.256585+0000","last_undegraded":"2024-02-15T22:58:01.256585+0000","last_fullsized":"2024-02-15T22:58:01.256585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-02-15T22:58:01.256409+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-02-15T22:58:01.256409+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.256409+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:16.356268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.870103+0000","last_change":"2024-02-15T22:57:47.870103+0000","last_active":"2024-02-15T22:57:47.870103+0000","last_peered":"2024-02-15T22:57:47.870103+0000","last_clean":"2024-02-15T22:57:47.870103+0000","last_became_active":"2024-02-15T22:56:11.715697+0000","last_became_peered":"2024-02-15T22:56:11.715697+0000","last_unstale":"2024-02-15T22:57:47.870103+0000","last_undegraded":"2024-02-15T22:57:47.870103+0000","last_fullsized":"2024-02-15T22:57:47.870103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.869954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.869954+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.869954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:54.471463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372691+0000","last_change":"2024-02-15T22:56:13.734867+0000","last_active":"2024-02-15T22:57:47.372691+0000","last_peered":"2024-02-15T22:57:47.372691+0000","last_clean":"2024-02-15T22:57:47.372691+0000","last_became_active":"2024-02-15T22:56:13.734565+0000","last_became_peered":"2024-02-15T22:56:13.734565+0000","last_unstale":"2024-02-15T22:57:47.372691+0000","last_undegraded":"2024-02-15T22:57:47.372691+0000","last_fullsized":"2024-02-15T22:57:47.372691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.177141+0000","last_change":"2024-02-15T22:58:08.177141+0000","last_active":"2024-02-15T22:58:08.177141+0000","last_peered":"2024-02-15T22:58:08.177141+0000","last_clean":"2024-02-15T22:58:08.177141+0000","last_became_active":"2024-02-15T22:56:05.710562+0000","last_became_peered":"2024-02-15T22:56:05.710562+0000","last_unstale":"2024-02-15T22:58:08.177141+0000","last_undegraded":"2024-02-15T22:58:08.177141+0000","last_fullsized":"2024-02-15T22:58:08.177141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:08.177027+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:08.177027+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.177027+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:26.352171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.843667+0000","last_change":"2024-02-15T22:58:35.843691+0000","last_active":"2024-02-15T22:58:35.843667+0000","last_peered":"2024-02-15T22:58:35.843667+0000","last_clean":"2024-02-15T22:58:35.843667+0000","last_became_active":"2024-02-15T22:56:03.696590+0000","last_became_peered":"2024-02-15T22:56:03.696590+0000","last_unstale":"2024-02-15T22:58:35.843667+0000","last_undegraded":"2024-02-15T22:58:35.843667+0000","last_fullsized":"2024-02-15T22:58:35.843667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:35.843557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:35.843557+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.843557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:20:16.450362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.041220+0000","last_change":"2024-02-15T22:57:56.041220+0000","last_active":"2024-02-15T22:57:56.041220+0000","last_peered":"2024-02-15T22:57:56.041220+0000","last_clean":"2024-02-15T22:57:56.041220+0000","last_became_active":"2024-02-15T22:56:07.705239+0000","last_became_peered":"2024-02-15T22:56:07.705239+0000","last_unstale":"2024-02-15T22:57:56.041220+0000","last_undegraded":"2024-02-15T22:57:56.041220+0000","last_fullsized":"2024-02-15T22:57:56.041220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.041105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.041105+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.041105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:22.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.989290+0000","last_change":"2024-02-15T22:58:00.989290+0000","last_active":"2024-02-15T22:58:00.989290+0000","last_peered":"2024-02-15T22:58:00.989290+0000","last_clean":"2024-02-15T22:58:00.989290+0000","last_became_active":"2024-02-15T22:56:09.710616+0000","last_became_peered":"2024-02-15T22:56:09.710616+0000","last_unstale":"2024-02-15T22:58:00.989290+0000","last_undegraded":"2024-02-15T22:58:00.989290+0000","last_fullsized":"2024-02-15T22:58:00.989290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:58:00.989160+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:58:00.989160+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.989160+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:16.633010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.881779+0000","last_change":"2024-02-15T22:57:48.881779+0000","last_active":"2024-02-15T22:57:48.881779+0000","last_peered":"2024-02-15T22:57:48.881779+0000","last_clean":"2024-02-15T22:57:48.881779+0000","last_became_active":"2024-02-15T22:56:11.718995+0000","last_became_peered":"2024-02-15T22:56:11.718995+0000","last_unstale":"2024-02-15T22:57:48.881779+0000","last_undegraded":"2024-02-15T22:57:48.881779+0000","last_fullsized":"2024-02-15T22:57:48.881779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:48.881655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:48.881655+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.881655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:00:14.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.179900+0000","last_change":"2024-02-15T22:58:38.179928+0000","last_active":"2024-02-15T22:58:38.179900+0000","last_peered":"2024-02-15T22:58:38.179900+0000","last_clean":"2024-02-15T22:58:38.179900+0000","last_became_active":"2024-02-15T22:56:05.699196+0000","last_became_peered":"2024-02-15T22:56:05.699196+0000","last_unstale":"2024-02-15T22:58:38.179900+0000","last_undegraded":"2024-02-15T22:58:38.179900+0000","last_fullsized":"2024-02-15T22:58:38.179900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:38.179767+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:38.179767+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.179767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:54:16.863075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371498+0000","last_change":"2024-02-15T22:56:03.702280+0000","last_active":"2024-02-15T22:57:47.371498+0000","last_peered":"2024-02-15T22:57:47.371498+0000","last_clean":"2024-02-15T22:57:47.371498+0000","last_became_active":"2024-02-15T22:56:03.702007+0000","last_became_peered":"2024-02-15T22:56:03.702007+0000","last_unstale":"2024-02-15T22:57:47.371498+0000","last_undegraded":"2024-02-15T22:57:47.371498+0000","last_fullsized":"2024-02-15T22:57:47.371498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.277094+0000","last_change":"2024-02-15T22:58:05.277094+0000","last_active":"2024-02-15T22:58:05.277094+0000","last_peered":"2024-02-15T22:58:05.277094+0000","last_clean":"2024-02-15T22:58:05.277094+0000","last_became_active":"2024-02-15T22:56:07.707124+0000","last_became_peered":"2024-02-15T22:56:07.707124+0000","last_unstale":"2024-02-15T22:58:05.277094+0000","last_undegraded":"2024-02-15T22:58:05.277094+0000","last_fullsized":"2024-02-15T22:58:05.277094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:05.276922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:05.276922+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.276922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:55.491543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.341829+0000","last_change":"2024-02-15T22:57:59.341829+0000","last_active":"2024-02-15T22:57:59.341829+0000","last_peered":"2024-02-15T22:57:59.341829+0000","last_clean":"2024-02-15T22:57:59.341829+0000","last_became_active":"2024-02-15T22:56:09.713076+0000","last_became_peered":"2024-02-15T22:56:09.713076+0000","last_unstale":"2024-02-15T22:57:59.341829+0000","last_undegraded":"2024-02-15T22:57:59.341829+0000","last_fullsized":"2024-02-15T22:57:59.341829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-15T22:57:59.341704+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-15T22:57:59.341704+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.341704+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:30.766347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.956049+0000","last_change":"2024-02-15T22:57:50.956049+0000","last_active":"2024-02-15T22:57:50.956049+0000","last_peered":"2024-02-15T22:57:50.956049+0000","last_clean":"2024-02-15T22:57:50.956049+0000","last_became_active":"2024-02-15T22:56:11.718102+0000","last_became_peered":"2024-02-15T22:56:11.718102+0000","last_unstale":"2024-02-15T22:57:50.956049+0000","last_undegraded":"2024-02-15T22:57:50.956049+0000","last_fullsized":"2024-02-15T22:57:50.956049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.955925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.955925+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.955925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:28.393475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.054334+0000","last_change":"2024-02-15T22:56:13.734724+0000","last_active":"2024-02-15T22:57:46.054334+0000","last_peered":"2024-02-15T22:57:46.054334+0000","last_clean":"2024-02-15T22:57:46.054334+0000","last_became_active":"2024-02-15T22:56:13.734372+0000","last_became_peered":"2024-02-15T22:56:13.734372+0000","last_unstale":"2024-02-15T22:57:46.054334+0000","last_undegraded":"2024-02-15T22:57:46.054334+0000","last_fullsized":"2024-02-15T22:57:46.054334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.298195+0000","last_change":"2024-02-15T22:58:24.298221+0000","last_active":"2024-02-15T22:58:24.298195+0000","last_peered":"2024-02-15T22:58:24.298195+0000","last_clean":"2024-02-15T22:58:24.298195+0000","last_became_active":"2024-02-15T22:56:05.705473+0000","last_became_peered":"2024-02-15T22:56:05.705473+0000","last_unstale":"2024-02-15T22:58:24.298195+0000","last_undegraded":"2024-02-15T22:58:24.298195+0000","last_fullsized":"2024-02-15T22:58:24.298195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:24.298093+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:24.298093+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.298093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:30.167502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.894042+0000","last_change":"2024-02-15T22:58:29.894066+0000","last_active":"2024-02-15T22:58:29.894042+0000","last_peered":"2024-02-15T22:58:29.894042+0000","last_clean":"2024-02-15T22:58:29.894042+0000","last_became_active":"2024-02-15T22:56:03.697691+0000","last_became_peered":"2024-02-15T22:56:03.697691+0000","last_unstale":"2024-02-15T22:58:29.894042+0000","last_undegraded":"2024-02-15T22:58:29.894042+0000","last_fullsized":"2024-02-15T22:58:29.894042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:29.893936+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:29.893936+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.893936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:01.057365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.898500+0000","last_change":"2024-02-15T22:58:08.898500+0000","last_active":"2024-02-15T22:58:08.898500+0000","last_peered":"2024-02-15T22:58:08.898500+0000","last_clean":"2024-02-15T22:58:08.898500+0000","last_became_active":"2024-02-15T22:56:07.704018+0000","last_became_peered":"2024-02-15T22:56:07.704018+0000","last_unstale":"2024-02-15T22:58:08.898500+0000","last_undegraded":"2024-02-15T22:58:08.898500+0000","last_fullsized":"2024-02-15T22:58:08.898500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:08.898335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:08.898335+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.898335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:35.455319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.180851+0000","last_change":"2024-02-15T22:58:03.180851+0000","last_active":"2024-02-15T22:58:03.180851+0000","last_peered":"2024-02-15T22:58:03.180851+0000","last_clean":"2024-02-15T22:58:03.180851+0000","last_became_active":"2024-02-15T22:56:09.717105+0000","last_became_peered":"2024-02-15T22:56:09.717105+0000","last_unstale":"2024-02-15T22:58:03.180851+0000","last_undegraded":"2024-02-15T22:58:03.180851+0000","last_fullsized":"2024-02-15T22:58:03.180851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-15T22:58:03.180724+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-15T22:58:03.180724+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.180724+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.050134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.880001+0000","last_change":"2024-02-15T22:58:00.880001+0000","last_active":"2024-02-15T22:58:00.880001+0000","last_peered":"2024-02-15T22:58:00.880001+0000","last_clean":"2024-02-15T22:58:00.880001+0000","last_became_active":"2024-02-15T22:56:11.722865+0000","last_became_peered":"2024-02-15T22:56:11.722865+0000","last_unstale":"2024-02-15T22:58:00.880001+0000","last_undegraded":"2024-02-15T22:58:00.880001+0000","last_fullsized":"2024-02-15T22:58:00.880001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:00.879874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:00.879874+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.879874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:59.902356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.151443+0000","last_change":"2024-02-15T22:58:33.151443+0000","last_active":"2024-02-15T22:58:33.151443+0000","last_peered":"2024-02-15T22:58:33.151443+0000","last_clean":"2024-02-15T22:58:33.151443+0000","last_became_active":"2024-02-15T22:56:13.726748+0000","last_became_peered":"2024-02-15T22:56:13.726748+0000","last_unstale":"2024-02-15T22:58:33.151443+0000","last_undegraded":"2024-02-15T22:58:33.151443+0000","last_fullsized":"2024-02-15T22:58:33.151443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:33.151251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:33.151251+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.151251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:05:46.319989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.092893+0000","last_change":"2024-02-15T22:58:00.092893+0000","last_active":"2024-02-15T22:58:00.092893+0000","last_peered":"2024-02-15T22:58:00.092893+0000","last_clean":"2024-02-15T22:58:00.092893+0000","last_became_active":"2024-02-15T22:56:05.716677+0000","last_became_peered":"2024-02-15T22:56:05.716677+0000","last_unstale":"2024-02-15T22:58:00.092893+0000","last_undegraded":"2024-02-15T22:58:00.092893+0000","last_fullsized":"2024-02-15T22:58:00.092893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:00.092774+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:00.092774+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.092774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:55:49.382293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.946666+0000","last_change":"2024-02-15T22:58:31.946666+0000","last_active":"2024-02-15T22:58:31.946666+0000","last_peered":"2024-02-15T22:58:31.946666+0000","last_clean":"2024-02-15T22:58:31.946666+0000","last_became_active":"2024-02-15T22:56:03.692632+0000","last_became_peered":"2024-02-15T22:56:03.692632+0000","last_unstale":"2024-02-15T22:58:31.946666+0000","last_undegraded":"2024-02-15T22:58:31.946666+0000","last_fullsized":"2024-02-15T22:58:31.946666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:31.946551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:31.946551+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.946551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:02:50.833349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.944080+0000","last_change":"2024-02-15T22:58:06.944080+0000","last_active":"2024-02-15T22:58:06.944080+0000","last_peered":"2024-02-15T22:58:06.944080+0000","last_clean":"2024-02-15T22:58:06.944080+0000","last_became_active":"2024-02-15T22:56:07.704208+0000","last_became_peered":"2024-02-15T22:56:07.704208+0000","last_unstale":"2024-02-15T22:58:06.944080+0000","last_undegraded":"2024-02-15T22:58:06.944080+0000","last_fullsized":"2024-02-15T22:58:06.944080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:06.943951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:06.943951+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.943951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:12.953469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.383705+0000","last_change":"2024-02-15T22:57:58.383705+0000","last_active":"2024-02-15T22:57:58.383705+0000","last_peered":"2024-02-15T22:57:58.383705+0000","last_clean":"2024-02-15T22:57:58.383705+0000","last_became_active":"2024-02-15T22:56:09.716753+0000","last_became_peered":"2024-02-15T22:56:09.716753+0000","last_unstale":"2024-02-15T22:57:58.383705+0000","last_undegraded":"2024-02-15T22:57:58.383705+0000","last_fullsized":"2024-02-15T22:57:58.383705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-15T22:57:58.383553+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-15T22:57:58.383553+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.383553+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:24.940537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.373579+0000","last_change":"2024-02-15T22:57:56.373579+0000","last_active":"2024-02-15T22:57:56.373579+0000","last_peered":"2024-02-15T22:57:56.373579+0000","last_clean":"2024-02-15T22:57:56.373579+0000","last_became_active":"2024-02-15T22:56:11.722738+0000","last_became_peered":"2024-02-15T22:56:11.722738+0000","last_unstale":"2024-02-15T22:57:56.373579+0000","last_undegraded":"2024-02-15T22:57:56.373579+0000","last_fullsized":"2024-02-15T22:57:56.373579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.373469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.373469+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.373469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:02.382987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.215685+0000","last_change":"2024-02-15T22:58:37.215724+0000","last_active":"2024-02-15T22:58:37.215685+0000","last_peered":"2024-02-15T22:58:37.215685+0000","last_clean":"2024-02-15T22:58:37.215685+0000","last_became_active":"2024-02-15T22:56:13.727216+0000","last_became_peered":"2024-02-15T22:56:13.727216+0000","last_unstale":"2024-02-15T22:58:37.215685+0000","last_undegraded":"2024-02-15T22:58:37.215685+0000","last_fullsized":"2024-02-15T22:58:37.215685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:37.215594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:37.215594+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.215594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:56:44.091191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:42.355635+0000","last_change":"2024-02-15T22:58:42.355660+0000","last_active":"2024-02-15T22:58:42.355635+0000","last_peered":"2024-02-15T22:58:42.355635+0000","last_clean":"2024-02-15T22:58:42.355635+0000","last_became_active":"2024-02-15T22:56:05.707154+0000","last_became_peered":"2024-02-15T22:56:05.707154+0000","last_unstale":"2024-02-15T22:58:42.355635+0000","last_undegraded":"2024-02-15T22:58:42.355635+0000","last_fullsized":"2024-02-15T22:58:42.355635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:42.355546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:42.355546+0000","last_clean_scrub_stamp":"2024-02-15T22:58:42.355546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:37.329988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371567+0000","last_change":"2024-02-15T22:56:03.700157+0000","last_active":"2024-02-15T22:57:47.371567+0000","last_peered":"2024-02-15T22:57:47.371567+0000","last_clean":"2024-02-15T22:57:47.371567+0000","last_became_active":"2024-02-15T22:56:03.699843+0000","last_became_peered":"2024-02-15T22:56:03.699843+0000","last_unstale":"2024-02-15T22:57:47.371567+0000","last_undegraded":"2024-02-15T22:57:47.371567+0000","last_fullsized":"2024-02-15T22:57:47.371567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.845209+0000","last_change":"2024-02-15T22:58:03.845209+0000","last_active":"2024-02-15T22:58:03.845209+0000","last_peered":"2024-02-15T22:58:03.845209+0000","last_clean":"2024-02-15T22:58:03.845209+0000","last_became_active":"2024-02-15T22:56:07.702014+0000","last_became_peered":"2024-02-15T22:56:07.702014+0000","last_unstale":"2024-02-15T22:58:03.845209+0000","last_undegraded":"2024-02-15T22:58:03.845209+0000","last_fullsized":"2024-02-15T22:58:03.845209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:03.845081+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:03.845081+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.845081+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:36.772070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.010523+0000","last_change":"2024-02-15T22:57:55.010523+0000","last_active":"2024-02-15T22:57:55.010523+0000","last_peered":"2024-02-15T22:57:55.010523+0000","last_clean":"2024-02-15T22:57:55.010523+0000","last_became_active":"2024-02-15T22:56:09.715996+0000","last_became_peered":"2024-02-15T22:56:09.715996+0000","last_unstale":"2024-02-15T22:57:55.010523+0000","last_undegraded":"2024-02-15T22:57:55.010523+0000","last_fullsized":"2024-02-15T22:57:55.010523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:57:55.010359+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:57:55.010359+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.010359+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:25.907925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":302,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.998940+0000","last_change":"2024-02-15T22:57:59.998940+0000","last_active":"2024-02-15T22:57:59.998940+0000","last_peered":"2024-02-15T22:57:59.998940+0000","last_clean":"2024-02-15T22:57:59.998940+0000","last_became_active":"2024-02-15T22:56:11.724520+0000","last_became_peered":"2024-02-15T22:56:11.724520+0000","last_unstale":"2024-02-15T22:57:59.998940+0000","last_undegraded":"2024-02-15T22:57:59.998940+0000","last_fullsized":"2024-02-15T22:57:59.998940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:59.998810+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:59.998810+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.998810+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:37.951898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372616+0000","last_change":"2024-02-15T22:56:13.731954+0000","last_active":"2024-02-15T22:57:47.372616+0000","last_peered":"2024-02-15T22:57:47.372616+0000","last_clean":"2024-02-15T22:57:47.372616+0000","last_became_active":"2024-02-15T22:56:13.731683+0000","last_became_peered":"2024-02-15T22:56:13.731683+0000","last_unstale":"2024-02-15T22:57:47.372616+0000","last_undegraded":"2024-02-15T22:57:47.372616+0000","last_fullsized":"2024-02-15T22:57:47.372616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.904716+0000","last_change":"2024-02-15T22:58:11.904716+0000","last_active":"2024-02-15T22:58:11.904716+0000","last_peered":"2024-02-15T22:58:11.904716+0000","last_clean":"2024-02-15T22:58:11.904716+0000","last_became_active":"2024-02-15T22:56:05.700922+0000","last_became_peered":"2024-02-15T22:56:05.700922+0000","last_unstale":"2024-02-15T22:58:11.904716+0000","last_undegraded":"2024-02-15T22:58:11.904716+0000","last_fullsized":"2024-02-15T22:58:11.904716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.904604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.904604+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.904604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:48.029771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.842958+0000","last_change":"2024-02-15T22:58:34.842958+0000","last_active":"2024-02-15T22:58:34.842958+0000","last_peered":"2024-02-15T22:58:34.842958+0000","last_clean":"2024-02-15T22:58:34.842958+0000","last_became_active":"2024-02-15T22:56:03.696168+0000","last_became_peered":"2024-02-15T22:56:03.696168+0000","last_unstale":"2024-02-15T22:58:34.842958+0000","last_undegraded":"2024-02-15T22:58:34.842958+0000","last_fullsized":"2024-02-15T22:58:34.842958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:34.842794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:34.842794+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.842794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:10.608670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.855063+0000","last_change":"2024-02-15T22:58:05.855063+0000","last_active":"2024-02-15T22:58:05.855063+0000","last_peered":"2024-02-15T22:58:05.855063+0000","last_clean":"2024-02-15T22:58:05.855063+0000","last_became_active":"2024-02-15T22:56:07.701777+0000","last_became_peered":"2024-02-15T22:56:07.701777+0000","last_unstale":"2024-02-15T22:58:05.855063+0000","last_undegraded":"2024-02-15T22:58:05.855063+0000","last_fullsized":"2024-02-15T22:58:05.855063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:05.854938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:05.854938+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.854938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:45.103674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'44","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.877670+0000","last_change":"2024-02-15T22:57:54.877670+0000","last_active":"2024-02-15T22:57:54.877670+0000","last_peered":"2024-02-15T22:57:54.877670+0000","last_clean":"2024-02-15T22:57:54.877670+0000","last_became_active":"2024-02-15T22:56:09.713636+0000","last_became_peered":"2024-02-15T22:56:09.713636+0000","last_unstale":"2024-02-15T22:57:54.877670+0000","last_undegraded":"2024-02-15T22:57:54.877670+0000","last_fullsized":"2024-02-15T22:57:54.877670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:57:54.877538+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:57:54.877538+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.877538+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:18.263250+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.331421+0000","last_change":"2024-02-15T22:57:46.331421+0000","last_active":"2024-02-15T22:57:46.331421+0000","last_peered":"2024-02-15T22:57:46.331421+0000","last_clean":"2024-02-15T22:57:46.331421+0000","last_became_active":"2024-02-15T22:56:11.722374+0000","last_became_peered":"2024-02-15T22:56:11.722374+0000","last_unstale":"2024-02-15T22:57:46.331421+0000","last_undegraded":"2024-02-15T22:57:46.331421+0000","last_fullsized":"2024-02-15T22:57:46.331421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:46.331332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:46.331332+0000","last_clean_scrub_stamp":"2024-02-15T22:57:46.331332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:32.555922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:42.836090+0000","last_change":"2024-02-15T22:58:42.836114+0000","last_active":"2024-02-15T22:58:42.836090+0000","last_peered":"2024-02-15T22:58:42.836090+0000","last_clean":"2024-02-15T22:58:42.836090+0000","last_became_active":"2024-02-15T22:56:13.733576+0000","last_became_peered":"2024-02-15T22:56:13.733576+0000","last_unstale":"2024-02-15T22:58:42.836090+0000","last_undegraded":"2024-02-15T22:58:42.836090+0000","last_fullsized":"2024-02-15T22:58:42.836090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:42.836000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:42.836000+0000","last_clean_scrub_stamp":"2024-02-15T22:58:42.836000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:46:25.598350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.944063+0000","last_change":"2024-02-15T22:58:09.944063+0000","last_active":"2024-02-15T22:58:09.944063+0000","last_peered":"2024-02-15T22:58:09.944063+0000","last_clean":"2024-02-15T22:58:09.944063+0000","last_became_active":"2024-02-15T22:56:05.701026+0000","last_became_peered":"2024-02-15T22:56:05.701026+0000","last_unstale":"2024-02-15T22:58:09.944063+0000","last_undegraded":"2024-02-15T22:58:09.944063+0000","last_fullsized":"2024-02-15T22:58:09.944063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:09.943931+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:09.943931+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.943931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:46:04.334961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371443+0000","last_change":"2024-02-15T22:56:03.706706+0000","last_active":"2024-02-15T22:57:47.371443+0000","last_peered":"2024-02-15T22:57:47.371443+0000","last_clean":"2024-02-15T22:57:47.371443+0000","last_became_active":"2024-02-15T22:56:03.706422+0000","last_became_peered":"2024-02-15T22:56:03.706422+0000","last_unstale":"2024-02-15T22:57:47.371443+0000","last_undegraded":"2024-02-15T22:57:47.371443+0000","last_fullsized":"2024-02-15T22:57:47.371443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.004957+0000","last_change":"2024-02-15T22:58:02.004957+0000","last_active":"2024-02-15T22:58:02.004957+0000","last_peered":"2024-02-15T22:58:02.004957+0000","last_clean":"2024-02-15T22:58:02.004957+0000","last_became_active":"2024-02-15T22:56:07.707265+0000","last_became_peered":"2024-02-15T22:56:07.707265+0000","last_unstale":"2024-02-15T22:58:02.004957+0000","last_undegraded":"2024-02-15T22:58:02.004957+0000","last_fullsized":"2024-02-15T22:58:02.004957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:02.004846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:02.004846+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.004846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:25.390557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.350886+0000","last_change":"2024-02-15T22:57:57.350886+0000","last_active":"2024-02-15T22:57:57.350886+0000","last_peered":"2024-02-15T22:57:57.350886+0000","last_clean":"2024-02-15T22:57:57.350886+0000","last_became_active":"2024-02-15T22:56:09.716749+0000","last_became_peered":"2024-02-15T22:56:09.716749+0000","last_unstale":"2024-02-15T22:57:57.350886+0000","last_undegraded":"2024-02-15T22:57:57.350886+0000","last_fullsized":"2024-02-15T22:57:57.350886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-02-15T22:57:57.350743+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-02-15T22:57:57.350743+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.350743+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:56.373225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.125944+0000","last_change":"2024-02-15T22:58:17.125944+0000","last_active":"2024-02-15T22:58:17.125944+0000","last_peered":"2024-02-15T22:58:17.125944+0000","last_clean":"2024-02-15T22:58:17.125944+0000","last_became_active":"2024-02-15T22:56:11.725667+0000","last_became_peered":"2024-02-15T22:56:11.725667+0000","last_unstale":"2024-02-15T22:58:17.125944+0000","last_undegraded":"2024-02-15T22:58:17.125944+0000","last_fullsized":"2024-02-15T22:58:17.125944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:17.125792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:17.125792+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.125792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:36:22.884918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'8","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372674+0000","last_change":"2024-02-15T22:56:13.729381+0000","last_active":"2024-02-15T22:57:47.372674+0000","last_peered":"2024-02-15T22:57:47.372674+0000","last_clean":"2024-02-15T22:57:47.372674+0000","last_became_active":"2024-02-15T22:56:13.728844+0000","last_became_peered":"2024-02-15T22:56:13.728844+0000","last_unstale":"2024-02-15T22:57:47.372674+0000","last_undegraded":"2024-02-15T22:57:47.372674+0000","last_fullsized":"2024-02-15T22:57:47.372674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.115835+0000","last_change":"2024-02-15T22:58:32.115868+0000","last_active":"2024-02-15T22:58:32.115835+0000","last_peered":"2024-02-15T22:58:32.115835+0000","last_clean":"2024-02-15T22:58:32.115835+0000","last_became_active":"2024-02-15T22:56:05.700908+0000","last_became_peered":"2024-02-15T22:56:05.700908+0000","last_unstale":"2024-02-15T22:58:32.115835+0000","last_undegraded":"2024-02-15T22:58:32.115835+0000","last_fullsized":"2024-02-15T22:58:32.115835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:32.115751+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:32.115751+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.115751+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:52:27.671060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.253825+0000","last_change":"2024-02-15T22:58:21.253850+0000","last_active":"2024-02-15T22:58:21.253825+0000","last_peered":"2024-02-15T22:58:21.253825+0000","last_clean":"2024-02-15T22:58:21.253825+0000","last_became_active":"2024-02-15T22:56:03.704081+0000","last_became_peered":"2024-02-15T22:56:03.704081+0000","last_unstale":"2024-02-15T22:58:21.253825+0000","last_undegraded":"2024-02-15T22:58:21.253825+0000","last_fullsized":"2024-02-15T22:58:21.253825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:21.253735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:21.253735+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.253735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:33.248382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.886355+0000","last_change":"2024-02-15T22:57:58.886355+0000","last_active":"2024-02-15T22:57:58.886355+0000","last_peered":"2024-02-15T22:57:58.886355+0000","last_clean":"2024-02-15T22:57:58.886355+0000","last_became_active":"2024-02-15T22:56:07.708530+0000","last_became_peered":"2024-02-15T22:56:07.708530+0000","last_unstale":"2024-02-15T22:57:58.886355+0000","last_undegraded":"2024-02-15T22:57:58.886355+0000","last_fullsized":"2024-02-15T22:57:58.886355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:58.886242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:58.886242+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.886242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:28.475625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.000899+0000","last_change":"2024-02-15T22:57:57.000899+0000","last_active":"2024-02-15T22:57:57.000899+0000","last_peered":"2024-02-15T22:57:57.000899+0000","last_clean":"2024-02-15T22:57:57.000899+0000","last_became_active":"2024-02-15T22:56:09.716134+0000","last_became_peered":"2024-02-15T22:56:09.716134+0000","last_unstale":"2024-02-15T22:57:57.000899+0000","last_undegraded":"2024-02-15T22:57:57.000899+0000","last_fullsized":"2024-02-15T22:57:57.000899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-02-15T22:57:57.000753+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-02-15T22:57:57.000753+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.000753+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:47.478957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":49,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.185631+0000","last_change":"2024-02-15T22:58:13.185631+0000","last_active":"2024-02-15T22:58:13.185631+0000","last_peered":"2024-02-15T22:58:13.185631+0000","last_clean":"2024-02-15T22:58:13.185631+0000","last_became_active":"2024-02-15T22:56:11.725271+0000","last_became_peered":"2024-02-15T22:56:11.725271+0000","last_unstale":"2024-02-15T22:58:13.185631+0000","last_undegraded":"2024-02-15T22:58:13.185631+0000","last_fullsized":"2024-02-15T22:58:13.185631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:13.185521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:13.185521+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.185521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:35.729575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372705+0000","last_change":"2024-02-15T22:56:13.735140+0000","last_active":"2024-02-15T22:57:47.372705+0000","last_peered":"2024-02-15T22:57:47.372705+0000","last_clean":"2024-02-15T22:57:47.372705+0000","last_became_active":"2024-02-15T22:56:13.734871+0000","last_became_peered":"2024-02-15T22:56:13.734871+0000","last_unstale":"2024-02-15T22:57:47.372705+0000","last_undegraded":"2024-02-15T22:57:47.372705+0000","last_fullsized":"2024-02-15T22:57:47.372705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'16","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.955321+0000","last_change":"2024-02-15T22:58:10.955321+0000","last_active":"2024-02-15T22:58:10.955321+0000","last_peered":"2024-02-15T22:58:10.955321+0000","last_clean":"2024-02-15T22:58:10.955321+0000","last_became_active":"2024-02-15T22:56:05.700066+0000","last_became_peered":"2024-02-15T22:56:05.700066+0000","last_unstale":"2024-02-15T22:58:10.955321+0000","last_undegraded":"2024-02-15T22:58:10.955321+0000","last_fullsized":"2024-02-15T22:58:10.955321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-15T22:58:10.955167+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-15T22:58:10.955167+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.955167+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:41:48.202367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.878922+0000","last_change":"2024-02-15T22:58:33.878985+0000","last_active":"2024-02-15T22:58:33.878922+0000","last_peered":"2024-02-15T22:58:33.878922+0000","last_clean":"2024-02-15T22:58:33.878922+0000","last_became_active":"2024-02-15T22:56:03.693300+0000","last_became_peered":"2024-02-15T22:56:03.693300+0000","last_unstale":"2024-02-15T22:58:33.878922+0000","last_undegraded":"2024-02-15T22:58:33.878922+0000","last_fullsized":"2024-02-15T22:58:33.878922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:33.878818+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:33.878818+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.878818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:36:02.728765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.879672+0000","last_change":"2024-02-15T22:57:57.879672+0000","last_active":"2024-02-15T22:57:57.879672+0000","last_peered":"2024-02-15T22:57:57.879672+0000","last_clean":"2024-02-15T22:57:57.879672+0000","last_became_active":"2024-02-15T22:56:07.708720+0000","last_became_peered":"2024-02-15T22:56:07.708720+0000","last_unstale":"2024-02-15T22:57:57.879672+0000","last_undegraded":"2024-02-15T22:57:57.879672+0000","last_fullsized":"2024-02-15T22:57:57.879672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:57:57.879545+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:57:57.879545+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.879545+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:33.402218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.181089+0000","last_change":"2024-02-15T22:58:20.181089+0000","last_active":"2024-02-15T22:58:20.181089+0000","last_peered":"2024-02-15T22:58:20.181089+0000","last_clean":"2024-02-15T22:58:20.181089+0000","last_became_active":"2024-02-15T22:56:09.717846+0000","last_became_peered":"2024-02-15T22:56:09.717846+0000","last_unstale":"2024-02-15T22:58:20.181089+0000","last_undegraded":"2024-02-15T22:58:20.181089+0000","last_fullsized":"2024-02-15T22:58:20.181089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-15T22:58:20.180944+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-15T22:58:20.180944+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.180944+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:11:37.794373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.339582+0000","last_change":"2024-02-15T22:57:48.339582+0000","last_active":"2024-02-15T22:57:48.339582+0000","last_peered":"2024-02-15T22:57:48.339582+0000","last_clean":"2024-02-15T22:57:48.339582+0000","last_became_active":"2024-02-15T22:56:11.722402+0000","last_became_peered":"2024-02-15T22:56:11.722402+0000","last_unstale":"2024-02-15T22:57:48.339582+0000","last_undegraded":"2024-02-15T22:57:48.339582+0000","last_fullsized":"2024-02-15T22:57:48.339582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:48.339482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:48.339482+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.339482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:51.537660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372635+0000","last_change":"2024-02-15T22:56:13.733552+0000","last_active":"2024-02-15T22:57:47.372635+0000","last_peered":"2024-02-15T22:57:47.372635+0000","last_clean":"2024-02-15T22:57:47.372635+0000","last_became_active":"2024-02-15T22:56:13.733285+0000","last_became_peered":"2024-02-15T22:56:13.733285+0000","last_unstale":"2024-02-15T22:57:47.372635+0000","last_undegraded":"2024-02-15T22:57:47.372635+0000","last_fullsized":"2024-02-15T22:57:47.372635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.867874+0000","last_change":"2024-02-15T22:58:06.867874+0000","last_active":"2024-02-15T22:58:06.867874+0000","last_peered":"2024-02-15T22:58:06.867874+0000","last_clean":"2024-02-15T22:58:06.867874+0000","last_became_active":"2024-02-15T22:56:05.715609+0000","last_became_peered":"2024-02-15T22:56:05.715609+0000","last_unstale":"2024-02-15T22:58:06.867874+0000","last_undegraded":"2024-02-15T22:58:06.867874+0000","last_fullsized":"2024-02-15T22:58:06.867874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-02-15T22:58:06.867728+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-02-15T22:58:06.867728+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.867728+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:34.691909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.939014+0000","last_change":"2024-02-15T22:58:29.939039+0000","last_active":"2024-02-15T22:58:29.939014+0000","last_peered":"2024-02-15T22:58:29.939014+0000","last_clean":"2024-02-15T22:58:29.939014+0000","last_became_active":"2024-02-15T22:56:03.691266+0000","last_became_peered":"2024-02-15T22:56:03.691266+0000","last_unstale":"2024-02-15T22:58:29.939014+0000","last_undegraded":"2024-02-15T22:58:29.939014+0000","last_fullsized":"2024-02-15T22:58:29.939014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:29.938899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:29.938899+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.938899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:41.933547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.222659+0000","last_change":"2024-02-15T22:58:17.222659+0000","last_active":"2024-02-15T22:58:17.222659+0000","last_peered":"2024-02-15T22:58:17.222659+0000","last_clean":"2024-02-15T22:58:17.222659+0000","last_became_active":"2024-02-15T22:56:05.707492+0000","last_became_peered":"2024-02-15T22:56:05.707492+0000","last_unstale":"2024-02-15T22:58:17.222659+0000","last_undegraded":"2024-02-15T22:58:17.222659+0000","last_fullsized":"2024-02-15T22:58:17.222659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:17.222540+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:17.222540+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.222540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:43.244450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.338054+0000","last_change":"2024-02-15T22:58:38.338096+0000","last_active":"2024-02-15T22:58:38.338054+0000","last_peered":"2024-02-15T22:58:38.338054+0000","last_clean":"2024-02-15T22:58:38.338054+0000","last_became_active":"2024-02-15T22:56:03.692909+0000","last_became_peered":"2024-02-15T22:56:03.692909+0000","last_unstale":"2024-02-15T22:58:38.338054+0000","last_undegraded":"2024-02-15T22:58:38.338054+0000","last_fullsized":"2024-02-15T22:58:38.338054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:38.337963+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:38.337963+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.337963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:04:55.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.142444+0000","last_change":"2024-02-15T22:58:10.142444+0000","last_active":"2024-02-15T22:58:10.142444+0000","last_peered":"2024-02-15T22:58:10.142444+0000","last_clean":"2024-02-15T22:58:10.142444+0000","last_became_active":"2024-02-15T22:56:05.710095+0000","last_became_peered":"2024-02-15T22:56:05.710095+0000","last_unstale":"2024-02-15T22:58:10.142444+0000","last_undegraded":"2024-02-15T22:58:10.142444+0000","last_fullsized":"2024-02-15T22:58:10.142444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:10.142332+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:10.142332+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.142332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:29:45.908209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371453+0000","last_change":"2024-02-15T22:56:03.695701+0000","last_active":"2024-02-15T22:57:47.371453+0000","last_peered":"2024-02-15T22:57:47.371453+0000","last_clean":"2024-02-15T22:57:47.371453+0000","last_became_active":"2024-02-15T22:56:03.695362+0000","last_became_peered":"2024-02-15T22:56:03.695362+0000","last_unstale":"2024-02-15T22:57:47.371453+0000","last_undegraded":"2024-02-15T22:57:47.371453+0000","last_fullsized":"2024-02-15T22:57:47.371453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.211865+0000","last_change":"2024-02-15T22:58:18.211865+0000","last_active":"2024-02-15T22:58:18.211865+0000","last_peered":"2024-02-15T22:58:18.211865+0000","last_clean":"2024-02-15T22:58:18.211865+0000","last_became_active":"2024-02-15T22:56:05.701253+0000","last_became_peered":"2024-02-15T22:56:05.701253+0000","last_unstale":"2024-02-15T22:58:18.211865+0000","last_undegraded":"2024-02-15T22:58:18.211865+0000","last_fullsized":"2024-02-15T22:58:18.211865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:18.211741+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:18.211741+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.211741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:08.689945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.354906+0000","last_change":"2024-02-15T22:58:31.354934+0000","last_active":"2024-02-15T22:58:31.354906+0000","last_peered":"2024-02-15T22:58:31.354906+0000","last_clean":"2024-02-15T22:58:31.354906+0000","last_became_active":"2024-02-15T22:56:03.699881+0000","last_became_peered":"2024-02-15T22:56:03.699881+0000","last_unstale":"2024-02-15T22:58:31.354906+0000","last_undegraded":"2024-02-15T22:58:31.354906+0000","last_fullsized":"2024-02-15T22:58:31.354906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:31.354815+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:31.354815+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.354815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:36:00.204762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.053648+0000","last_change":"2024-02-15T22:56:45.887346+0000","last_active":"2024-02-15T22:57:46.053648+0000","last_peered":"2024-02-15T22:57:46.053648+0000","last_clean":"2024-02-15T22:57:46.053648+0000","last_became_active":"2024-02-15T22:56:45.886976+0000","last_became_peered":"2024-02-15T22:56:45.886976+0000","last_unstale":"2024-02-15T22:57:46.053648+0000","last_undegraded":"2024-02-15T22:57:46.053648+0000","last_fullsized":"2024-02-15T22:57:46.053648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:04.680299+0000","last_clean_scrub_stamp":"2024-02-15T22:56:04.680299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.317868+0000","last_change":"2024-02-15T22:58:37.317895+0000","last_active":"2024-02-15T22:58:37.317868+0000","last_peered":"2024-02-15T22:58:37.317868+0000","last_clean":"2024-02-15T22:58:37.317868+0000","last_became_active":"2024-02-15T22:56:03.692939+0000","last_became_peered":"2024-02-15T22:56:03.692939+0000","last_unstale":"2024-02-15T22:58:37.317868+0000","last_undegraded":"2024-02-15T22:58:37.317868+0000","last_fullsized":"2024-02-15T22:58:37.317868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:37.317783+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:37.317783+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.317783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:26:18.134612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.838311+0000","last_change":"2024-02-15T22:58:09.838311+0000","last_active":"2024-02-15T22:58:09.838311+0000","last_peered":"2024-02-15T22:58:09.838311+0000","last_clean":"2024-02-15T22:58:09.838311+0000","last_became_active":"2024-02-15T22:56:05.713670+0000","last_became_peered":"2024-02-15T22:56:05.713670+0000","last_unstale":"2024-02-15T22:58:09.838311+0000","last_undegraded":"2024-02-15T22:58:09.838311+0000","last_fullsized":"2024-02-15T22:58:09.838311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:09.838137+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:09.838137+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.838137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:24:40.314346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.899329+0000","last_change":"2024-02-15T22:58:37.899378+0000","last_active":"2024-02-15T22:58:37.899329+0000","last_peered":"2024-02-15T22:58:37.899329+0000","last_clean":"2024-02-15T22:58:37.899329+0000","last_became_active":"2024-02-15T22:56:03.696174+0000","last_became_peered":"2024-02-15T22:56:03.696174+0000","last_unstale":"2024-02-15T22:58:37.899329+0000","last_undegraded":"2024-02-15T22:58:37.899329+0000","last_fullsized":"2024-02-15T22:58:37.899329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:37.899233+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:37.899233+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.899233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:52:00.443287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.217171+0000","last_change":"2024-02-15T22:58:20.217197+0000","last_active":"2024-02-15T22:58:20.217171+0000","last_peered":"2024-02-15T22:58:20.217171+0000","last_clean":"2024-02-15T22:58:20.217171+0000","last_became_active":"2024-02-15T22:56:05.703183+0000","last_became_peered":"2024-02-15T22:56:05.703183+0000","last_unstale":"2024-02-15T22:58:20.217171+0000","last_undegraded":"2024-02-15T22:58:20.217171+0000","last_fullsized":"2024-02-15T22:58:20.217171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:20.217082+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:20.217082+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.217082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:26.212867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.899622+0000","last_change":"2024-02-15T22:58:18.899658+0000","last_active":"2024-02-15T22:58:18.899622+0000","last_peered":"2024-02-15T22:58:18.899622+0000","last_clean":"2024-02-15T22:58:18.899622+0000","last_became_active":"2024-02-15T22:56:03.699989+0000","last_became_peered":"2024-02-15T22:56:03.699989+0000","last_unstale":"2024-02-15T22:58:18.899622+0000","last_undegraded":"2024-02-15T22:58:18.899622+0000","last_fullsized":"2024-02-15T22:58:18.899622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:18.899525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:18.899525+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.899525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:19.320652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.867837+0000","last_change":"2024-02-15T22:58:14.867862+0000","last_active":"2024-02-15T22:58:14.867837+0000","last_peered":"2024-02-15T22:58:14.867837+0000","last_clean":"2024-02-15T22:58:14.867837+0000","last_became_active":"2024-02-15T22:56:05.701193+0000","last_became_peered":"2024-02-15T22:56:05.701193+0000","last_unstale":"2024-02-15T22:58:14.867837+0000","last_undegraded":"2024-02-15T22:58:14.867837+0000","last_fullsized":"2024-02-15T22:58:14.867837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:14.867745+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:14.867745+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.867745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:45.079186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.339449+0000","last_change":"2024-02-15T22:58:36.339475+0000","last_active":"2024-02-15T22:58:36.339449+0000","last_peered":"2024-02-15T22:58:36.339449+0000","last_clean":"2024-02-15T22:58:36.339449+0000","last_became_active":"2024-02-15T22:56:03.692902+0000","last_became_peered":"2024-02-15T22:56:03.692902+0000","last_unstale":"2024-02-15T22:58:36.339449+0000","last_undegraded":"2024-02-15T22:58:36.339449+0000","last_fullsized":"2024-02-15T22:58:36.339449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:36.339345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:36.339345+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.339345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:47.179116+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.832083+0000","last_change":"2024-02-15T22:58:16.832083+0000","last_active":"2024-02-15T22:58:16.832083+0000","last_peered":"2024-02-15T22:58:16.832083+0000","last_clean":"2024-02-15T22:58:16.832083+0000","last_became_active":"2024-02-15T22:56:05.702455+0000","last_became_peered":"2024-02-15T22:56:05.702455+0000","last_unstale":"2024-02-15T22:58:16.832083+0000","last_undegraded":"2024-02-15T22:58:16.832083+0000","last_fullsized":"2024-02-15T22:58:16.832083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:16.831958+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:16.831958+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.831958+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:31.233589+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371427+0000","last_change":"2024-02-15T22:56:03.695480+0000","last_active":"2024-02-15T22:57:47.371427+0000","last_peered":"2024-02-15T22:57:47.371427+0000","last_clean":"2024-02-15T22:57:47.371427+0000","last_became_active":"2024-02-15T22:56:03.695149+0000","last_became_peered":"2024-02-15T22:56:03.695149+0000","last_unstale":"2024-02-15T22:57:47.371427+0000","last_undegraded":"2024-02-15T22:57:47.371427+0000","last_fullsized":"2024-02-15T22:57:47.371427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.160635+0000","last_change":"2024-02-15T22:58:27.160657+0000","last_active":"2024-02-15T22:58:27.160635+0000","last_peered":"2024-02-15T22:58:27.160635+0000","last_clean":"2024-02-15T22:58:27.160635+0000","last_became_active":"2024-02-15T22:56:05.704211+0000","last_became_peered":"2024-02-15T22:56:05.704211+0000","last_unstale":"2024-02-15T22:58:27.160635+0000","last_undegraded":"2024-02-15T22:58:27.160635+0000","last_fullsized":"2024-02-15T22:58:27.160635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.160532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.160532+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.160532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:12.630776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:41.376176+0000","last_change":"2024-02-15T22:58:41.376207+0000","last_active":"2024-02-15T22:58:41.376176+0000","last_peered":"2024-02-15T22:58:41.376176+0000","last_clean":"2024-02-15T22:58:41.376176+0000","last_became_active":"2024-02-15T22:56:03.699419+0000","last_became_peered":"2024-02-15T22:56:03.699419+0000","last_unstale":"2024-02-15T22:58:41.376176+0000","last_undegraded":"2024-02-15T22:58:41.376176+0000","last_fullsized":"2024-02-15T22:58:41.376176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:41.376083+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:41.376083+0000","last_clean_scrub_stamp":"2024-02-15T22:58:41.376083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:07:04.420054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.239317+0000","last_change":"2024-02-15T22:58:15.239317+0000","last_active":"2024-02-15T22:58:15.239317+0000","last_peered":"2024-02-15T22:58:15.239317+0000","last_clean":"2024-02-15T22:58:15.239317+0000","last_became_active":"2024-02-15T22:56:05.710665+0000","last_became_peered":"2024-02-15T22:56:05.710665+0000","last_unstale":"2024-02-15T22:58:15.239317+0000","last_undegraded":"2024-02-15T22:58:15.239317+0000","last_fullsized":"2024-02-15T22:58:15.239317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:15.239206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:15.239206+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.239206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:58.794458+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.898287+0000","last_change":"2024-02-15T22:58:23.898307+0000","last_active":"2024-02-15T22:58:23.898287+0000","last_peered":"2024-02-15T22:58:23.898287+0000","last_clean":"2024-02-15T22:58:23.898287+0000","last_became_active":"2024-02-15T22:56:03.705871+0000","last_became_peered":"2024-02-15T22:56:03.705871+0000","last_unstale":"2024-02-15T22:58:23.898287+0000","last_undegraded":"2024-02-15T22:58:23.898287+0000","last_fullsized":"2024-02-15T22:58:23.898287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.898186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.898186+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.898186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:29.893971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.881465+0000","last_change":"2024-02-15T22:58:22.881496+0000","last_active":"2024-02-15T22:58:22.881465+0000","last_peered":"2024-02-15T22:58:22.881465+0000","last_clean":"2024-02-15T22:58:22.881465+0000","last_became_active":"2024-02-15T22:56:05.704505+0000","last_became_peered":"2024-02-15T22:56:05.704505+0000","last_unstale":"2024-02-15T22:58:22.881465+0000","last_undegraded":"2024-02-15T22:58:22.881465+0000","last_fullsized":"2024-02-15T22:58:22.881465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:22.881364+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:22.881364+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.881364+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:32:11.297043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.853912+0000","last_change":"2024-02-15T22:58:21.853937+0000","last_active":"2024-02-15T22:58:21.853912+0000","last_peered":"2024-02-15T22:58:21.853912+0000","last_clean":"2024-02-15T22:58:21.853912+0000","last_became_active":"2024-02-15T22:56:03.705904+0000","last_became_peered":"2024-02-15T22:56:03.705904+0000","last_unstale":"2024-02-15T22:58:21.853912+0000","last_undegraded":"2024-02-15T22:58:21.853912+0000","last_fullsized":"2024-02-15T22:58:21.853912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:21.853819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:21.853819+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.853819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:12.332024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.864194+0000","last_change":"2024-02-15T22:58:13.864194+0000","last_active":"2024-02-15T22:58:13.864194+0000","last_peered":"2024-02-15T22:58:13.864194+0000","last_clean":"2024-02-15T22:58:13.864194+0000","last_became_active":"2024-02-15T22:56:05.713035+0000","last_became_peered":"2024-02-15T22:56:05.713035+0000","last_unstale":"2024-02-15T22:58:13.864194+0000","last_undegraded":"2024-02-15T22:58:13.864194+0000","last_fullsized":"2024-02-15T22:58:13.864194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:13.864083+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:13.864083+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.864083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:17.062902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371548+0000","last_change":"2024-02-15T22:56:03.696317+0000","last_active":"2024-02-15T22:57:47.371548+0000","last_peered":"2024-02-15T22:57:47.371548+0000","last_clean":"2024-02-15T22:57:47.371548+0000","last_became_active":"2024-02-15T22:56:03.696045+0000","last_became_peered":"2024-02-15T22:56:03.696045+0000","last_unstale":"2024-02-15T22:57:47.371548+0000","last_undegraded":"2024-02-15T22:57:47.371548+0000","last_fullsized":"2024-02-15T22:57:47.371548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.867031+0000","last_change":"2024-02-15T22:58:20.867085+0000","last_active":"2024-02-15T22:58:20.867031+0000","last_peered":"2024-02-15T22:58:20.867031+0000","last_clean":"2024-02-15T22:58:20.867031+0000","last_became_active":"2024-02-15T22:56:05.704733+0000","last_became_peered":"2024-02-15T22:56:05.704733+0000","last_unstale":"2024-02-15T22:58:20.867031+0000","last_undegraded":"2024-02-15T22:58:20.867031+0000","last_fullsized":"2024-02-15T22:58:20.867031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-02-15T22:58:20.866916+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-02-15T22:58:20.866916+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.866916+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:09:47.979444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371496+0000","last_change":"2024-02-15T22:56:03.695753+0000","last_active":"2024-02-15T22:57:47.371496+0000","last_peered":"2024-02-15T22:57:47.371496+0000","last_clean":"2024-02-15T22:57:47.371496+0000","last_became_active":"2024-02-15T22:56:03.695454+0000","last_became_peered":"2024-02-15T22:56:03.695454+0000","last_unstale":"2024-02-15T22:57:47.371496+0000","last_undegraded":"2024-02-15T22:57:47.371496+0000","last_fullsized":"2024-02-15T22:57:47.371496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.191943+0000","last_change":"2024-02-15T22:58:26.191993+0000","last_active":"2024-02-15T22:58:26.191943+0000","last_peered":"2024-02-15T22:58:26.191943+0000","last_clean":"2024-02-15T22:58:26.191943+0000","last_became_active":"2024-02-15T22:56:05.707464+0000","last_became_peered":"2024-02-15T22:56:05.707464+0000","last_unstale":"2024-02-15T22:58:26.191943+0000","last_undegraded":"2024-02-15T22:58:26.191943+0000","last_fullsized":"2024-02-15T22:58:26.191943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:26.191834+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:26.191834+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.191834+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:13:44.299345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.893079+0000","last_change":"2024-02-15T22:58:30.893122+0000","last_active":"2024-02-15T22:58:30.893079+0000","last_peered":"2024-02-15T22:58:30.893079+0000","last_clean":"2024-02-15T22:58:30.893079+0000","last_became_active":"2024-02-15T22:56:03.696267+0000","last_became_peered":"2024-02-15T22:56:03.696267+0000","last_unstale":"2024-02-15T22:58:30.893079+0000","last_undegraded":"2024-02-15T22:58:30.893079+0000","last_fullsized":"2024-02-15T22:58:30.893079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:30.892968+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:30.892968+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.892968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:21:14.370027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.933019+0000","last_change":"2024-02-15T22:58:26.933047+0000","last_active":"2024-02-15T22:58:26.933019+0000","last_peered":"2024-02-15T22:58:26.933019+0000","last_clean":"2024-02-15T22:58:26.933019+0000","last_became_active":"2024-02-15T22:56:05.705496+0000","last_became_peered":"2024-02-15T22:56:05.705496+0000","last_unstale":"2024-02-15T22:58:26.933019+0000","last_undegraded":"2024-02-15T22:58:26.933019+0000","last_fullsized":"2024-02-15T22:58:26.933019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:26.932917+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:26.932917+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.932917+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:21.663794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.155914+0000","last_change":"2024-02-15T22:58:39.155989+0000","last_active":"2024-02-15T22:58:39.155914+0000","last_peered":"2024-02-15T22:58:39.155914+0000","last_clean":"2024-02-15T22:58:39.155914+0000","last_became_active":"2024-02-15T22:56:03.707033+0000","last_became_peered":"2024-02-15T22:56:03.707033+0000","last_unstale":"2024-02-15T22:58:39.155914+0000","last_undegraded":"2024-02-15T22:58:39.155914+0000","last_fullsized":"2024-02-15T22:58:39.155914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:39.155824+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:39.155824+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.155824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:29.633424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371494+0000","last_change":"2024-02-15T22:56:03.706143+0000","last_active":"2024-02-15T22:57:47.371494+0000","last_peered":"2024-02-15T22:57:47.371494+0000","last_clean":"2024-02-15T22:57:47.371494+0000","last_became_active":"2024-02-15T22:56:03.705853+0000","last_became_peered":"2024-02-15T22:56:03.705853+0000","last_unstale":"2024-02-15T22:57:47.371494+0000","last_undegraded":"2024-02-15T22:57:47.371494+0000","last_fullsized":"2024-02-15T22:57:47.371494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.186899+0000","last_change":"2024-02-15T22:58:19.186899+0000","last_active":"2024-02-15T22:58:19.186899+0000","last_peered":"2024-02-15T22:58:19.186899+0000","last_clean":"2024-02-15T22:58:19.186899+0000","last_became_active":"2024-02-15T22:56:05.699141+0000","last_became_peered":"2024-02-15T22:56:05.699141+0000","last_unstale":"2024-02-15T22:58:19.186899+0000","last_undegraded":"2024-02-15T22:58:19.186899+0000","last_fullsized":"2024-02-15T22:58:19.186899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:19.186738+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:19.186738+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.186738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:54.706314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.303775+0000","last_change":"2024-02-15T22:58:27.303798+0000","last_active":"2024-02-15T22:58:27.303775+0000","last_peered":"2024-02-15T22:58:27.303775+0000","last_clean":"2024-02-15T22:58:27.303775+0000","last_became_active":"2024-02-15T22:56:03.700107+0000","last_became_peered":"2024-02-15T22:56:03.700107+0000","last_unstale":"2024-02-15T22:58:27.303775+0000","last_undegraded":"2024-02-15T22:58:27.303775+0000","last_fullsized":"2024-02-15T22:58:27.303775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.303690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.303690+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.303690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:32:26.922533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.897645+0000","last_change":"2024-02-15T22:58:11.897645+0000","last_active":"2024-02-15T22:58:11.897645+0000","last_peered":"2024-02-15T22:58:11.897645+0000","last_clean":"2024-02-15T22:58:11.897645+0000","last_became_active":"2024-02-15T22:56:05.713142+0000","last_became_peered":"2024-02-15T22:56:05.713142+0000","last_unstale":"2024-02-15T22:58:11.897645+0000","last_undegraded":"2024-02-15T22:58:11.897645+0000","last_fullsized":"2024-02-15T22:58:11.897645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:11.897529+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:11.897529+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.897529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:37.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1419,"ondisk_log_size":1419,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":46,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672999,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35764,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336076,"statfs":{"total":96636764160,"available":96600141824,"internally_reserved":0,"allocated":438272,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.41999999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Feb 15 22:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.316,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.41299999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.24099999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46300000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Feb 15 22:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35199999999999998,"15min":0.35599999999999998},"min":{"1min":0.23699999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.432,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.32400000000000001,"15min":0.32800000000000001},"min":{"1min":0.23699999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.44800000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.376}]}]},{"osd":2,"up_from":10,"seq":42949673000,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":978944,"data_stored":722767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.52700000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.54700000000000004,"5min":0.623,"15min":0.623},"last":0.44}]},{"osd":1,"last update":"Thu Feb 15 22:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30299999999999999,"15min":0.30399999999999999},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41799999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.313,"15min":0.311},"min":{"1min":0.19500000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.48799999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.25600000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.33000000000000002,"15min":0.33200000000000002},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.433,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46300000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.32100000000000001}]}]},{"osd":1,"up_from":10,"seq":42949672999,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.311,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52500000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.433}]},{"osd":2,"last update":"Thu Feb 15 22:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.192,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.30299999999999999,"15min":0.30199999999999999},"min":{"1min":0.23499999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Feb 15 22:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.311,"15min":0.309},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34799999999999998,"15min":0.34699999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.32000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:57:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.48899999999999999},"min":{"1min":0.377,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68400000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.36099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67600000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Feb 15 22:57:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69099999999999995,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.502,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.63100000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Feb 15 22:57:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.33400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.313,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70099999999999996,"5min":0.75,"15min":0.75},"last":0.72599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:58:48.846 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.846 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.847 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.847 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.847 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.847 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.848 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.848 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.848 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.849 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.849 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.849 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.849 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.850 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.850 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.850 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.850 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.851 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.851 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.851 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-15T22:55:56.659827+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=55, tm_sec=56, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.851 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.852 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.852 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.852 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.853 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.853 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.853 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.854 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.854 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.854 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.854 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.854 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.855 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-15T22:56:04.680299+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=4, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.855 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.855 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.855 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.856 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:58:48.856 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-15T22:59:08.857 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T22:59:08.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.967+0000 7f20dc93b640 1 Processor -- start 2024-02-15T22:59:08.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.967+0000 7f20dc93b640 1 -- start start 2024-02-15T22:59:08.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.968+0000 7f20dc93b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20d812edb0 0x7f20d81311a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:08.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.968+0000 7f20dc93b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d8095e00 con 0x7f20d8128810 2024-02-15T22:59:08.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.968+0000 7f20dc93b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d8094d30 con 0x7f20d812edb0 2024-02-15T22:59:08.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.968+0000 7f20d659c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f20d8128810 0x7f20d8128bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47370/0 (socket says 172.21.15.52:47370) 2024-02-15T22:59:08.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.968+0000 7f20d659c640 1 -- 172.21.15.52:0/2633067037 learned_addr learned my addr 172.21.15.52:0/2633067037 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:59:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.968+0000 7f20d5d9b640 1 --2- 172.21.15.52:0/2633067037 >> v2:172.21.15.52:3300/0 conn(0x7f20d812edb0 0x7f20d81311a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.968+0000 7f20d559a640 1 -- 172.21.15.52:0/2633067037 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582493516 0 0) 0x7f20d8095e00 con 0x7f20d8128810 2024-02-15T22:59:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.968+0000 7f20d559a640 1 -- 172.21.15.52:0/2633067037 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c0003520 con 0x7f20d8128810 2024-02-15T22:59:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.969+0000 7f20d5d9b640 1 -- 172.21.15.52:0/2633067037 >> v1:172.21.15.52:6789/0 conn(0x7f20d8128810 legacy=0x7f20d8128bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.969+0000 7f20d5d9b640 1 -- 172.21.15.52:0/2633067037 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8096180 con 0x7f20d812edb0 2024-02-15T22:59:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.969+0000 7f20d5d9b640 1 --2- 172.21.15.52:0/2633067037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d812edb0 0x7f20d81311a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009720 tx=0x7f20cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83db994d7d1ae3f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.969+0000 7f20d559a640 1 -- 172.21.15.52:0/2633067037 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20cc02e070 con 0x7f20d812edb0 2024-02-15T22:59:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.969+0000 7f20d559a640 1 -- 172.21.15.52:0/2633067037 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc0316d0 con 0x7f20d812edb0 2024-02-15T22:59:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.969+0000 7f20d559a640 1 -- 172.21.15.52:0/2633067037 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20cc031990 con 0x7f20d812edb0 2024-02-15T22:59:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.970+0000 7f20dc93b640 1 -- 172.21.15.52:0/2633067037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d812edb0 msgr2=0x7f20d81311a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.970+0000 7f20dc93b640 1 --2- 172.21.15.52:0/2633067037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d812edb0 0x7f20d81311a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009720 tx=0x7f20cc02b840 comp rx=0 tx=0).stop 2024-02-15T22:59:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.970+0000 7f20dc93b640 1 -- 172.21.15.52:0/2633067037 shutdown_connections 2024-02-15T22:59:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.970+0000 7f20dc93b640 1 --2- 172.21.15.52:0/2633067037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d812edb0 0x7f20d81311a0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.970+0000 7f20dc93b640 1 -- 172.21.15.52:0/2633067037 >> 172.21.15.52:0/2633067037 conn(0x7f20d809a300 msgr2=0x7f20d809a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.970+0000 7f20dc93b640 1 -- 172.21.15.52:0/2633067037 shutdown_connections 2024-02-15T22:59:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.970+0000 7f20dc93b640 1 -- 172.21.15.52:0/2633067037 wait complete. 2024-02-15T22:59:08.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.971+0000 7f20dc93b640 1 Processor -- start 2024-02-15T22:59:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.971+0000 7f20dc93b640 1 -- start start 2024-02-15T22:59:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20dc93b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d8128810 0x7f20d8124470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20dc93b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8122c00 con 0x7f20d8128810 2024-02-15T22:59:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20d659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d8128810 0x7f20d8124470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20d659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d8128810 0x7f20d8124470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59270/0 (socket says 172.21.15.52:59270) 2024-02-15T22:59:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20d659c640 1 -- 172.21.15.52:0/498275053 learned_addr learned my addr 172.21.15.52:0/498275053 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:59:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20d659c640 1 -- 172.21.15.52:0/498275053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc009400 con 0x7f20d8128810 2024-02-15T22:59:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20d659c640 1 --2- 172.21.15.52:0/498275053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d8128810 0x7f20d8124470 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f20d000c480 tx=0x7f20d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:08.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20c6ffd640 1 -- 172.21.15.52:0/498275053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20d0005c10 con 0x7f20d8128810 2024-02-15T22:59:08.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20c6ffd640 1 -- 172.21.15.52:0/498275053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d0005d70 con 0x7f20d8128810 2024-02-15T22:59:08.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20dc93b640 1 -- 172.21.15.52:0/498275053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d8095070 con 0x7f20d8128810 2024-02-15T22:59:08.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20c6ffd640 1 -- 172.21.15.52:0/498275053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20d00071e0 con 0x7f20d8128810 2024-02-15T22:59:08.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.972+0000 7f20dc93b640 1 -- 172.21.15.52:0/498275053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d808f7c0 con 0x7f20d8128810 2024-02-15T22:59:08.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.973+0000 7f20c6ffd640 1 -- 172.21.15.52:0/498275053 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f20d0007340 con 0x7f20d8128810 2024-02-15T22:59:08.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.973+0000 7f20c6ffd640 1 --2- 172.21.15.52:0/498275053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b8037f40 0x7f20b803a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:08.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.973+0000 7f20c6ffd640 1 -- 172.21.15.52:0/498275053 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f20d004a8a0 con 0x7f20d8128810 2024-02-15T22:59:08.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.973+0000 7f20dc93b640 1 -- 172.21.15.52:0/498275053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d80627b0 con 0x7f20d8128810 2024-02-15T22:59:08.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.974+0000 7f20d5d9b640 1 --2- 172.21.15.52:0/498275053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b8037f40 0x7f20b803a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:08.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.974+0000 7f20d5d9b640 1 --2- 172.21.15.52:0/498275053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b8037f40 0x7f20b803a400 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f20cc036000 tx=0x7f20cc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:08.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:08.978+0000 7f20c6ffd640 1 -- 172.21.15.52:0/498275053 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20d0019dc0 con 0x7f20d8128810 2024-02-15T22:59:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.155+0000 7f20dc93b640 1 -- 172.21.15.52:0/498275053 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20d8094ef0 con 0x7f20b8037f40 2024-02-15T22:59:09.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.171+0000 7f20c6ffd640 1 -- 172.21.15.52:0/498275053 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673122 (secure 0 0 0) 0x7f20cc031b40 con 0x7f20b8037f40 2024-02-15T22:59:09.182 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:59:09.187 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-02-15T22:59:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.175+0000 7f20dc93b640 1 -- 172.21.15.52:0/498275053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b8037f40 msgr2=0x7f20b803a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.175+0000 7f20dc93b640 1 --2- 172.21.15.52:0/498275053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b8037f40 0x7f20b803a400 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f20cc036000 tx=0x7f20cc008030 comp rx=0 tx=0).stop 2024-02-15T22:59:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.175+0000 7f20dc93b640 1 -- 172.21.15.52:0/498275053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d8128810 msgr2=0x7f20d8124470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.175+0000 7f20dc93b640 1 --2- 172.21.15.52:0/498275053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d8128810 0x7f20d8124470 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f20d000c480 tx=0x7f20d000c940 comp rx=0 tx=0).stop 2024-02-15T22:59:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.175+0000 7f20dc93b640 1 -- 172.21.15.52:0/498275053 shutdown_connections 2024-02-15T22:59:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.175+0000 7f20dc93b640 1 --2- 172.21.15.52:0/498275053 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f20b8037f40 0x7f20b803a400 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.175+0000 7f20dc93b640 1 --2- 172.21.15.52:0/498275053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d8128810 0x7f20d8124470 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:09.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.175+0000 7f20dc93b640 1 -- 172.21.15.52:0/498275053 >> 172.21.15.52:0/498275053 conn(0x7f20d809a300 msgr2=0x7f20d81270e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:09.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.175+0000 7f20dc93b640 1 -- 172.21.15.52:0/498275053 shutdown_connections 2024-02-15T22:59:09.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:09.175+0000 7f20dc93b640 1 -- 172.21.15.52:0/498275053 wait complete. 2024-02-15T22:59:09.191 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-02-15T22:59:08.861788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4011,"num_read_kb":3661,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3968,"ondisk_log_size":3968,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135792,"kb_used_data":2768,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351568,"statfs":{"total":386547056640,"available":386408005632,"internally_reserved":0,"allocated":2834432,"data_stored":1715324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004436"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.912061+0000","last_change":"2024-02-15T22:58:20.912083+0000","last_active":"2024-02-15T22:58:20.912061+0000","last_peered":"2024-02-15T22:58:20.912061+0000","last_clean":"2024-02-15T22:58:20.912061+0000","last_became_active":"2024-02-15T22:56:03.699163+0000","last_became_peered":"2024-02-15T22:56:03.699163+0000","last_unstale":"2024-02-15T22:58:20.912061+0000","last_undegraded":"2024-02-15T22:58:20.912061+0000","last_fullsized":"2024-02-15T22:58:20.912061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:20.911968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:20.911968+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.911968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:40.922588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.936654+0000","last_change":"2024-02-15T22:58:28.936654+0000","last_active":"2024-02-15T22:58:28.936654+0000","last_peered":"2024-02-15T22:58:28.936654+0000","last_clean":"2024-02-15T22:58:28.936654+0000","last_became_active":"2024-02-15T22:56:05.708415+0000","last_became_peered":"2024-02-15T22:56:05.708415+0000","last_unstale":"2024-02-15T22:58:28.936654+0000","last_undegraded":"2024-02-15T22:58:28.936654+0000","last_fullsized":"2024-02-15T22:58:28.936654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:28.936526+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:28.936526+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.936526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:34.423952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.335594+0000","last_change":"2024-02-15T22:58:23.335618+0000","last_active":"2024-02-15T22:58:23.335594+0000","last_peered":"2024-02-15T22:58:23.335594+0000","last_clean":"2024-02-15T22:58:23.335594+0000","last_became_active":"2024-02-15T22:56:03.704043+0000","last_became_peered":"2024-02-15T22:56:03.704043+0000","last_unstale":"2024-02-15T22:58:23.335594+0000","last_undegraded":"2024-02-15T22:58:23.335594+0000","last_fullsized":"2024-02-15T22:58:23.335594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.335501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.335501+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.335501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:18.066378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.128742+0000","last_change":"2024-02-15T22:58:30.128742+0000","last_active":"2024-02-15T22:58:30.128742+0000","last_peered":"2024-02-15T22:58:30.128742+0000","last_clean":"2024-02-15T22:58:30.128742+0000","last_became_active":"2024-02-15T22:56:05.703587+0000","last_became_peered":"2024-02-15T22:56:05.703587+0000","last_unstale":"2024-02-15T22:58:30.128742+0000","last_undegraded":"2024-02-15T22:58:30.128742+0000","last_fullsized":"2024-02-15T22:58:30.128742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:30.128618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:30.128618+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.128618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:46.358215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:49.129929+0000","last_change":"2024-02-15T22:58:49.129953+0000","last_active":"2024-02-15T22:58:49.129929+0000","last_peered":"2024-02-15T22:58:49.129929+0000","last_clean":"2024-02-15T22:58:49.129929+0000","last_became_active":"2024-02-15T22:56:03.703702+0000","last_became_peered":"2024-02-15T22:56:03.703702+0000","last_unstale":"2024-02-15T22:58:49.129929+0000","last_undegraded":"2024-02-15T22:58:49.129929+0000","last_fullsized":"2024-02-15T22:58:49.129929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:49.129836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:49.129836+0000","last_clean_scrub_stamp":"2024-02-15T22:58:49.129836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:05:30.943348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.151651+0000","last_change":"2024-02-15T22:58:24.151651+0000","last_active":"2024-02-15T22:58:24.151651+0000","last_peered":"2024-02-15T22:58:24.151651+0000","last_clean":"2024-02-15T22:58:24.151651+0000","last_became_active":"2024-02-15T22:56:05.709003+0000","last_became_peered":"2024-02-15T22:56:05.709003+0000","last_unstale":"2024-02-15T22:58:24.151651+0000","last_undegraded":"2024-02-15T22:58:24.151651+0000","last_fullsized":"2024-02-15T22:58:24.151651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:24.151517+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:24.151517+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.151517+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:49:20.993618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.972432+0000","last_change":"2024-02-15T22:58:26.972464+0000","last_active":"2024-02-15T22:58:26.972432+0000","last_peered":"2024-02-15T22:58:26.972432+0000","last_clean":"2024-02-15T22:58:26.972432+0000","last_became_active":"2024-02-15T22:56:03.691753+0000","last_became_peered":"2024-02-15T22:56:03.691753+0000","last_unstale":"2024-02-15T22:58:26.972432+0000","last_undegraded":"2024-02-15T22:58:26.972432+0000","last_fullsized":"2024-02-15T22:58:26.972432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:26.972306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:26.972306+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.972306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:17.450511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.106482+0000","last_change":"2024-02-15T22:58:31.106482+0000","last_active":"2024-02-15T22:58:31.106482+0000","last_peered":"2024-02-15T22:58:31.106482+0000","last_clean":"2024-02-15T22:58:31.106482+0000","last_became_active":"2024-02-15T22:56:05.703541+0000","last_became_peered":"2024-02-15T22:56:05.703541+0000","last_unstale":"2024-02-15T22:58:31.106482+0000","last_undegraded":"2024-02-15T22:58:31.106482+0000","last_fullsized":"2024-02-15T22:58:31.106482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:31.106368+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:31.106368+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.106368+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:09:52.155517+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:04.232655+0000","last_change":"2024-02-15T22:59:04.232691+0000","last_active":"2024-02-15T22:59:04.232655+0000","last_peered":"2024-02-15T22:59:04.232655+0000","last_clean":"2024-02-15T22:59:04.232655+0000","last_became_active":"2024-02-15T22:56:03.694522+0000","last_became_peered":"2024-02-15T22:56:03.694522+0000","last_unstale":"2024-02-15T22:59:04.232655+0000","last_undegraded":"2024-02-15T22:59:04.232655+0000","last_fullsized":"2024-02-15T22:59:04.232655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:04.232567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:04.232567+0000","last_clean_scrub_stamp":"2024-02-15T22:59:04.232567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:07:11.322782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.896989+0000","last_change":"2024-02-15T22:58:24.897030+0000","last_active":"2024-02-15T22:58:24.896989+0000","last_peered":"2024-02-15T22:58:24.896989+0000","last_clean":"2024-02-15T22:58:24.896989+0000","last_became_active":"2024-02-15T22:56:05.704411+0000","last_became_peered":"2024-02-15T22:56:05.704411+0000","last_unstale":"2024-02-15T22:58:24.896989+0000","last_undegraded":"2024-02-15T22:58:24.896989+0000","last_fullsized":"2024-02-15T22:58:24.896989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:24.896851+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:24.896851+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.896851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:14.186370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.993859+0000","last_change":"2024-02-15T22:58:27.993859+0000","last_active":"2024-02-15T22:58:27.993859+0000","last_peered":"2024-02-15T22:58:27.993859+0000","last_clean":"2024-02-15T22:58:27.993859+0000","last_became_active":"2024-02-15T22:56:03.692316+0000","last_became_peered":"2024-02-15T22:56:03.692316+0000","last_unstale":"2024-02-15T22:58:27.993859+0000","last_undegraded":"2024-02-15T22:58:27.993859+0000","last_fullsized":"2024-02-15T22:58:27.993859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.993707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.993707+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.993707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:03.513283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.226214+0000","last_change":"2024-02-15T22:58:04.226214+0000","last_active":"2024-02-15T22:58:04.226214+0000","last_peered":"2024-02-15T22:58:04.226214+0000","last_clean":"2024-02-15T22:58:04.226214+0000","last_became_active":"2024-02-15T22:56:05.715460+0000","last_became_peered":"2024-02-15T22:56:05.715460+0000","last_unstale":"2024-02-15T22:58:04.226214+0000","last_undegraded":"2024-02-15T22:58:04.226214+0000","last_fullsized":"2024-02-15T22:58:04.226214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:04.226104+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:04.226104+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.226104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:09.713529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:46.217162+0000","last_change":"2024-02-15T22:58:46.217199+0000","last_active":"2024-02-15T22:58:46.217162+0000","last_peered":"2024-02-15T22:58:46.217162+0000","last_clean":"2024-02-15T22:58:46.217162+0000","last_became_active":"2024-02-15T22:56:03.700908+0000","last_became_peered":"2024-02-15T22:56:03.700908+0000","last_unstale":"2024-02-15T22:58:46.217162+0000","last_undegraded":"2024-02-15T22:58:46.217162+0000","last_fullsized":"2024-02-15T22:58:46.217162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:46.217073+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:46.217073+0000","last_clean_scrub_stamp":"2024-02-15T22:58:46.217073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:16.883350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.814673+0000","last_change":"2024-02-15T22:58:33.814700+0000","last_active":"2024-02-15T22:58:33.814673+0000","last_peered":"2024-02-15T22:58:33.814673+0000","last_clean":"2024-02-15T22:58:33.814673+0000","last_became_active":"2024-02-15T22:56:05.706078+0000","last_became_peered":"2024-02-15T22:56:05.706078+0000","last_unstale":"2024-02-15T22:58:33.814673+0000","last_undegraded":"2024-02-15T22:58:33.814673+0000","last_fullsized":"2024-02-15T22:58:33.814673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:33.814536+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:33.814536+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.814536+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:39.301962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.375633+0000","last_change":"2024-02-15T22:58:39.375658+0000","last_active":"2024-02-15T22:58:39.375633+0000","last_peered":"2024-02-15T22:58:39.375633+0000","last_clean":"2024-02-15T22:58:39.375633+0000","last_became_active":"2024-02-15T22:56:03.697327+0000","last_became_peered":"2024-02-15T22:56:03.697327+0000","last_unstale":"2024-02-15T22:58:39.375633+0000","last_undegraded":"2024-02-15T22:58:39.375633+0000","last_fullsized":"2024-02-15T22:58:39.375633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:39.375530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:39.375530+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.375530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:53:42.378564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.901912+0000","last_change":"2024-02-15T22:58:17.901959+0000","last_active":"2024-02-15T22:58:17.901912+0000","last_peered":"2024-02-15T22:58:17.901912+0000","last_clean":"2024-02-15T22:58:17.901912+0000","last_became_active":"2024-02-15T22:56:05.705173+0000","last_became_peered":"2024-02-15T22:56:05.705173+0000","last_unstale":"2024-02-15T22:58:17.901912+0000","last_undegraded":"2024-02-15T22:58:17.901912+0000","last_fullsized":"2024-02-15T22:58:17.901912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:17.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:17.901806+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:43.081246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.138179+0000","last_change":"2024-02-15T22:58:28.138210+0000","last_active":"2024-02-15T22:58:28.138179+0000","last_peered":"2024-02-15T22:58:28.138179+0000","last_clean":"2024-02-15T22:58:28.138179+0000","last_became_active":"2024-02-15T22:56:05.703708+0000","last_became_peered":"2024-02-15T22:56:05.703708+0000","last_unstale":"2024-02-15T22:58:28.138179+0000","last_undegraded":"2024-02-15T22:58:28.138179+0000","last_fullsized":"2024-02-15T22:58:28.138179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:28.138094+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:28.138094+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.138094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:24.448130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.889280+0000","last_change":"2024-02-15T22:58:36.889321+0000","last_active":"2024-02-15T22:58:36.889280+0000","last_peered":"2024-02-15T22:58:36.889280+0000","last_clean":"2024-02-15T22:58:36.889280+0000","last_became_active":"2024-02-15T22:56:03.696959+0000","last_became_peered":"2024-02-15T22:56:03.696959+0000","last_unstale":"2024-02-15T22:58:36.889280+0000","last_undegraded":"2024-02-15T22:58:36.889280+0000","last_fullsized":"2024-02-15T22:58:36.889280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:36.889188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:36.889188+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.889188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:18:14.962422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.876807+0000","last_change":"2024-02-15T22:58:15.876807+0000","last_active":"2024-02-15T22:58:15.876807+0000","last_peered":"2024-02-15T22:58:15.876807+0000","last_clean":"2024-02-15T22:58:15.876807+0000","last_became_active":"2024-02-15T22:56:05.700071+0000","last_became_peered":"2024-02-15T22:56:05.700071+0000","last_unstale":"2024-02-15T22:58:15.876807+0000","last_undegraded":"2024-02-15T22:58:15.876807+0000","last_fullsized":"2024-02-15T22:58:15.876807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:15.876691+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:15.876691+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.876691+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:07:22.097823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.942805+0000","last_change":"2024-02-15T22:58:22.942805+0000","last_active":"2024-02-15T22:58:22.942805+0000","last_peered":"2024-02-15T22:58:22.942805+0000","last_clean":"2024-02-15T22:58:22.942805+0000","last_became_active":"2024-02-15T22:56:03.699574+0000","last_became_peered":"2024-02-15T22:56:03.699574+0000","last_unstale":"2024-02-15T22:58:22.942805+0000","last_undegraded":"2024-02-15T22:58:22.942805+0000","last_fullsized":"2024-02-15T22:58:22.942805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:22.942683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:22.942683+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.942683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:12:51.398096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.860710+0000","last_change":"2024-02-15T22:58:18.860710+0000","last_active":"2024-02-15T22:58:18.860710+0000","last_peered":"2024-02-15T22:58:18.860710+0000","last_clean":"2024-02-15T22:58:18.860710+0000","last_became_active":"2024-02-15T22:56:05.702488+0000","last_became_peered":"2024-02-15T22:56:05.702488+0000","last_unstale":"2024-02-15T22:58:18.860710+0000","last_undegraded":"2024-02-15T22:58:18.860710+0000","last_fullsized":"2024-02-15T22:58:18.860710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:18.860532+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:18.860532+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.860532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:34:02.415784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:44.833931+0000","last_change":"2024-02-15T22:58:44.833965+0000","last_active":"2024-02-15T22:58:44.833931+0000","last_peered":"2024-02-15T22:58:44.833931+0000","last_clean":"2024-02-15T22:58:44.833931+0000","last_became_active":"2024-02-15T22:56:45.885555+0000","last_became_peered":"2024-02-15T22:56:45.885555+0000","last_unstale":"2024-02-15T22:58:44.833931+0000","last_undegraded":"2024-02-15T22:58:44.833931+0000","last_fullsized":"2024-02-15T22:58:44.833931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:44.833847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:44.833847+0000","last_clean_scrub_stamp":"2024-02-15T22:58:44.833847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:30:21.375226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.370992+0000","last_change":"2024-02-15T22:58:30.370992+0000","last_active":"2024-02-15T22:58:30.370992+0000","last_peered":"2024-02-15T22:58:30.370992+0000","last_clean":"2024-02-15T22:58:30.370992+0000","last_became_active":"2024-02-15T22:56:05.705386+0000","last_became_peered":"2024-02-15T22:56:05.705386+0000","last_unstale":"2024-02-15T22:58:30.370992+0000","last_undegraded":"2024-02-15T22:58:30.370992+0000","last_fullsized":"2024-02-15T22:58:30.370992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:30.370877+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:30.370877+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.370877+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:50.153151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.911133+0000","last_change":"2024-02-15T22:58:32.911159+0000","last_active":"2024-02-15T22:58:32.911133+0000","last_peered":"2024-02-15T22:58:32.911133+0000","last_clean":"2024-02-15T22:58:32.911133+0000","last_became_active":"2024-02-15T22:56:03.693329+0000","last_became_peered":"2024-02-15T22:56:03.693329+0000","last_unstale":"2024-02-15T22:58:32.911133+0000","last_undegraded":"2024-02-15T22:58:32.911133+0000","last_fullsized":"2024-02-15T22:58:32.911133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:32.911045+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:32.911045+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.911045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:51.086189+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.936285+0000","last_change":"2024-02-15T22:58:15.936285+0000","last_active":"2024-02-15T22:58:15.936285+0000","last_peered":"2024-02-15T22:58:15.936285+0000","last_clean":"2024-02-15T22:58:15.936285+0000","last_became_active":"2024-02-15T22:56:05.704729+0000","last_became_peered":"2024-02-15T22:56:05.704729+0000","last_unstale":"2024-02-15T22:58:15.936285+0000","last_undegraded":"2024-02-15T22:58:15.936285+0000","last_fullsized":"2024-02-15T22:58:15.936285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:15.936168+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:15.936168+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.936168+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:39:13.873642+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.327486+0000","last_change":"2024-02-15T22:58:25.327486+0000","last_active":"2024-02-15T22:58:25.327486+0000","last_peered":"2024-02-15T22:58:25.327486+0000","last_clean":"2024-02-15T22:58:25.327486+0000","last_became_active":"2024-02-15T22:56:03.703885+0000","last_became_peered":"2024-02-15T22:56:03.703885+0000","last_unstale":"2024-02-15T22:58:25.327486+0000","last_undegraded":"2024-02-15T22:58:25.327486+0000","last_fullsized":"2024-02-15T22:58:25.327486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.327361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.327361+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.327361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:30.814787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.872443+0000","last_change":"2024-02-15T22:58:17.872443+0000","last_active":"2024-02-15T22:58:17.872443+0000","last_peered":"2024-02-15T22:58:17.872443+0000","last_clean":"2024-02-15T22:58:17.872443+0000","last_became_active":"2024-02-15T22:56:05.698553+0000","last_became_peered":"2024-02-15T22:56:05.698553+0000","last_unstale":"2024-02-15T22:58:17.872443+0000","last_undegraded":"2024-02-15T22:58:17.872443+0000","last_fullsized":"2024-02-15T22:58:17.872443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:17.872326+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:17.872326+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.872326+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:41.035527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:44.252285+0000","last_change":"2024-02-15T22:58:44.252311+0000","last_active":"2024-02-15T22:58:44.252285+0000","last_peered":"2024-02-15T22:58:44.252285+0000","last_clean":"2024-02-15T22:58:44.252285+0000","last_became_active":"2024-02-15T22:56:03.701819+0000","last_became_peered":"2024-02-15T22:56:03.701819+0000","last_unstale":"2024-02-15T22:58:44.252285+0000","last_undegraded":"2024-02-15T22:58:44.252285+0000","last_fullsized":"2024-02-15T22:58:44.252285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:44.252191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:44.252191+0000","last_clean_scrub_stamp":"2024-02-15T22:58:44.252191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:09:18.350889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'18","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.869532+0000","last_change":"2024-02-15T22:58:40.869563+0000","last_active":"2024-02-15T22:58:40.869532+0000","last_peered":"2024-02-15T22:58:40.869532+0000","last_clean":"2024-02-15T22:58:40.869532+0000","last_became_active":"2024-02-15T22:56:13.730499+0000","last_became_peered":"2024-02-15T22:56:13.730499+0000","last_unstale":"2024-02-15T22:58:40.869532+0000","last_undegraded":"2024-02-15T22:58:40.869532+0000","last_fullsized":"2024-02-15T22:58:40.869532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-02-15T22:58:40.869438+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-02-15T22:58:40.869438+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.869438+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:35:38.385067+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.223665+0000","last_change":"2024-02-15T22:58:36.223717+0000","last_active":"2024-02-15T22:58:36.223665+0000","last_peered":"2024-02-15T22:58:36.223665+0000","last_clean":"2024-02-15T22:58:36.223665+0000","last_became_active":"2024-02-15T22:56:05.699821+0000","last_became_peered":"2024-02-15T22:56:05.699821+0000","last_unstale":"2024-02-15T22:58:36.223665+0000","last_undegraded":"2024-02-15T22:58:36.223665+0000","last_fullsized":"2024-02-15T22:58:36.223665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:36.223565+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:36.223565+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.223565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:37:39.745954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:57.197755+0000","last_change":"2024-02-15T22:58:57.197786+0000","last_active":"2024-02-15T22:58:57.197755+0000","last_peered":"2024-02-15T22:58:57.197755+0000","last_clean":"2024-02-15T22:58:57.197755+0000","last_became_active":"2024-02-15T22:56:03.705881+0000","last_became_peered":"2024-02-15T22:56:03.705881+0000","last_unstale":"2024-02-15T22:58:57.197755+0000","last_undegraded":"2024-02-15T22:58:57.197755+0000","last_fullsized":"2024-02-15T22:58:57.197755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:57.197651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:57.197651+0000","last_clean_scrub_stamp":"2024-02-15T22:58:57.197651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:39:49.528497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372135+0000","last_change":"2024-02-15T22:56:45.893437+0000","last_active":"2024-02-15T22:57:47.372135+0000","last_peered":"2024-02-15T22:57:47.372135+0000","last_clean":"2024-02-15T22:57:47.372135+0000","last_became_active":"2024-02-15T22:56:45.893067+0000","last_became_peered":"2024-02-15T22:56:45.893067+0000","last_unstale":"2024-02-15T22:57:47.372135+0000","last_undegraded":"2024-02-15T22:57:47.372135+0000","last_fullsized":"2024-02-15T22:57:47.372135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.887564+0000","last_change":"2024-02-15T22:57:48.887564+0000","last_active":"2024-02-15T22:57:48.887564+0000","last_peered":"2024-02-15T22:57:48.887564+0000","last_clean":"2024-02-15T22:57:48.887564+0000","last_became_active":"2024-02-15T22:56:09.714201+0000","last_became_peered":"2024-02-15T22:56:09.714201+0000","last_unstale":"2024-02-15T22:57:48.887564+0000","last_undegraded":"2024-02-15T22:57:48.887564+0000","last_fullsized":"2024-02-15T22:57:48.887564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:48.887402+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:48.887402+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.887402+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:20.076360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.920914+0000","last_change":"2024-02-15T22:57:56.920914+0000","last_active":"2024-02-15T22:57:56.920914+0000","last_peered":"2024-02-15T22:57:56.920914+0000","last_clean":"2024-02-15T22:57:56.920914+0000","last_became_active":"2024-02-15T22:56:11.722257+0000","last_became_peered":"2024-02-15T22:56:11.722257+0000","last_unstale":"2024-02-15T22:57:56.920914+0000","last_undegraded":"2024-02-15T22:57:56.920914+0000","last_fullsized":"2024-02-15T22:57:56.920914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.920756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.920756+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.920756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:24:37.182344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.844517+0000","last_change":"2024-02-15T22:58:08.844517+0000","last_active":"2024-02-15T22:58:08.844517+0000","last_peered":"2024-02-15T22:58:08.844517+0000","last_clean":"2024-02-15T22:58:08.844517+0000","last_became_active":"2024-02-15T22:56:13.729067+0000","last_became_peered":"2024-02-15T22:56:13.729067+0000","last_unstale":"2024-02-15T22:58:08.844517+0000","last_undegraded":"2024-02-15T22:58:08.844517+0000","last_fullsized":"2024-02-15T22:58:08.844517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-02-15T22:58:08.844397+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-02-15T22:58:08.844397+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.844397+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:59.059018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.151094+0000","last_change":"2024-02-15T22:58:23.151094+0000","last_active":"2024-02-15T22:58:23.151094+0000","last_peered":"2024-02-15T22:58:23.151094+0000","last_clean":"2024-02-15T22:58:23.151094+0000","last_became_active":"2024-02-15T22:56:05.709632+0000","last_became_peered":"2024-02-15T22:56:05.709632+0000","last_unstale":"2024-02-15T22:58:23.151094+0000","last_undegraded":"2024-02-15T22:58:23.151094+0000","last_fullsized":"2024-02-15T22:58:23.151094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:23.150930+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:23.150930+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.150930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:00:49.803296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.934779+0000","last_change":"2024-02-15T22:58:24.934798+0000","last_active":"2024-02-15T22:58:24.934779+0000","last_peered":"2024-02-15T22:58:24.934779+0000","last_clean":"2024-02-15T22:58:24.934779+0000","last_became_active":"2024-02-15T22:56:03.699250+0000","last_became_peered":"2024-02-15T22:56:03.699250+0000","last_unstale":"2024-02-15T22:58:24.934779+0000","last_undegraded":"2024-02-15T22:58:24.934779+0000","last_fullsized":"2024-02-15T22:58:24.934779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:24.934666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:24.934666+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.934666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:55.832233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.213704+0000","last_change":"2024-02-15T22:58:09.213704+0000","last_active":"2024-02-15T22:58:09.213704+0000","last_peered":"2024-02-15T22:58:09.213704+0000","last_clean":"2024-02-15T22:58:09.213704+0000","last_became_active":"2024-02-15T22:56:07.705828+0000","last_became_peered":"2024-02-15T22:56:07.705828+0000","last_unstale":"2024-02-15T22:58:09.213704+0000","last_undegraded":"2024-02-15T22:58:09.213704+0000","last_fullsized":"2024-02-15T22:58:09.213704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:09.213585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:09.213585+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.213585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:09.634712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.924930+0000","last_change":"2024-02-15T22:57:55.924930+0000","last_active":"2024-02-15T22:57:55.924930+0000","last_peered":"2024-02-15T22:57:55.924930+0000","last_clean":"2024-02-15T22:57:55.924930+0000","last_became_active":"2024-02-15T22:56:09.712812+0000","last_became_peered":"2024-02-15T22:56:09.712812+0000","last_unstale":"2024-02-15T22:57:55.924930+0000","last_undegraded":"2024-02-15T22:57:55.924930+0000","last_fullsized":"2024-02-15T22:57:55.924930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-15T22:57:55.924760+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-15T22:57:55.924760+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.924760+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:30.496577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.900635+0000","last_change":"2024-02-15T22:57:52.900635+0000","last_active":"2024-02-15T22:57:52.900635+0000","last_peered":"2024-02-15T22:57:52.900635+0000","last_clean":"2024-02-15T22:57:52.900635+0000","last_became_active":"2024-02-15T22:56:11.721486+0000","last_became_peered":"2024-02-15T22:56:11.721486+0000","last_unstale":"2024-02-15T22:57:52.900635+0000","last_undegraded":"2024-02-15T22:57:52.900635+0000","last_fullsized":"2024-02-15T22:57:52.900635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.900511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.900511+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.900511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:44.599545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:47.364401+0000","last_change":"2024-02-15T22:58:47.364428+0000","last_active":"2024-02-15T22:58:47.364401+0000","last_peered":"2024-02-15T22:58:47.364401+0000","last_clean":"2024-02-15T22:58:47.364401+0000","last_became_active":"2024-02-15T22:56:13.734418+0000","last_became_peered":"2024-02-15T22:56:13.734418+0000","last_unstale":"2024-02-15T22:58:47.364401+0000","last_undegraded":"2024-02-15T22:58:47.364401+0000","last_fullsized":"2024-02-15T22:58:47.364401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:47.364309+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:47.364309+0000","last_clean_scrub_stamp":"2024-02-15T22:58:47.364309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:55:08.387965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.225352+0000","last_change":"2024-02-15T22:58:35.225417+0000","last_active":"2024-02-15T22:58:35.225352+0000","last_peered":"2024-02-15T22:58:35.225352+0000","last_clean":"2024-02-15T22:58:35.225352+0000","last_became_active":"2024-02-15T22:56:05.699398+0000","last_became_peered":"2024-02-15T22:56:05.699398+0000","last_unstale":"2024-02-15T22:58:35.225352+0000","last_undegraded":"2024-02-15T22:58:35.225352+0000","last_fullsized":"2024-02-15T22:58:35.225352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:35.225215+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:35.225215+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.225215+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:11:04.131887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:42.187864+0000","last_change":"2024-02-15T22:58:42.187887+0000","last_active":"2024-02-15T22:58:42.187864+0000","last_peered":"2024-02-15T22:58:42.187864+0000","last_clean":"2024-02-15T22:58:42.187864+0000","last_became_active":"2024-02-15T22:56:03.706818+0000","last_became_peered":"2024-02-15T22:56:03.706818+0000","last_unstale":"2024-02-15T22:58:42.187864+0000","last_undegraded":"2024-02-15T22:58:42.187864+0000","last_fullsized":"2024-02-15T22:58:42.187864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:42.187772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:42.187772+0000","last_clean_scrub_stamp":"2024-02-15T22:58:42.187772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:18:04.461318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.225506+0000","last_change":"2024-02-15T22:58:14.225506+0000","last_active":"2024-02-15T22:58:14.225506+0000","last_peered":"2024-02-15T22:58:14.225506+0000","last_clean":"2024-02-15T22:58:14.225506+0000","last_became_active":"2024-02-15T22:56:07.704168+0000","last_became_peered":"2024-02-15T22:56:07.704168+0000","last_unstale":"2024-02-15T22:58:14.225506+0000","last_undegraded":"2024-02-15T22:58:14.225506+0000","last_fullsized":"2024-02-15T22:58:14.225506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:14.225364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:14.225364+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.225364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:37.388564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.998999+0000","last_change":"2024-02-15T22:57:54.998999+0000","last_active":"2024-02-15T22:57:54.998999+0000","last_peered":"2024-02-15T22:57:54.998999+0000","last_clean":"2024-02-15T22:57:54.998999+0000","last_became_active":"2024-02-15T22:56:09.718326+0000","last_became_peered":"2024-02-15T22:56:09.718326+0000","last_unstale":"2024-02-15T22:57:54.998999+0000","last_undegraded":"2024-02-15T22:57:54.998999+0000","last_fullsized":"2024-02-15T22:57:54.998999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:57:54.998836+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:57:54.998836+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.998836+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:33:48.011800+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":315,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.156370+0000","last_change":"2024-02-15T22:58:21.156370+0000","last_active":"2024-02-15T22:58:21.156370+0000","last_peered":"2024-02-15T22:58:21.156370+0000","last_clean":"2024-02-15T22:58:21.156370+0000","last_became_active":"2024-02-15T22:56:11.724138+0000","last_became_peered":"2024-02-15T22:56:11.724138+0000","last_unstale":"2024-02-15T22:58:21.156370+0000","last_undegraded":"2024-02-15T22:58:21.156370+0000","last_fullsized":"2024-02-15T22:58:21.156370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-02-15T22:58:21.156191+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-02-15T22:58:21.156191+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.156191+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:39:40.871645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.775334+0000","last_change":"2024-02-15T22:58:37.775334+0000","last_active":"2024-02-15T22:58:37.775334+0000","last_peered":"2024-02-15T22:58:37.775334+0000","last_clean":"2024-02-15T22:58:37.775334+0000","last_became_active":"2024-02-15T22:56:13.732762+0000","last_became_peered":"2024-02-15T22:56:13.732762+0000","last_unstale":"2024-02-15T22:58:37.775334+0000","last_undegraded":"2024-02-15T22:58:37.775334+0000","last_fullsized":"2024-02-15T22:58:37.775334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:37.775222+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:37.775222+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.775222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:55.950367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.295013+0000","last_change":"2024-02-15T22:58:22.295013+0000","last_active":"2024-02-15T22:58:22.295013+0000","last_peered":"2024-02-15T22:58:22.295013+0000","last_clean":"2024-02-15T22:58:22.295013+0000","last_became_active":"2024-02-15T22:56:05.705360+0000","last_became_peered":"2024-02-15T22:56:05.705360+0000","last_unstale":"2024-02-15T22:58:22.295013+0000","last_undegraded":"2024-02-15T22:58:22.295013+0000","last_fullsized":"2024-02-15T22:58:22.295013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:22.294850+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:22.294850+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.294850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:21:05.771908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.956494+0000","last_change":"2024-02-15T22:58:27.956522+0000","last_active":"2024-02-15T22:58:27.956494+0000","last_peered":"2024-02-15T22:58:27.956494+0000","last_clean":"2024-02-15T22:58:27.956494+0000","last_became_active":"2024-02-15T22:56:03.698225+0000","last_became_peered":"2024-02-15T22:56:03.698225+0000","last_unstale":"2024-02-15T22:58:27.956494+0000","last_undegraded":"2024-02-15T22:58:27.956494+0000","last_fullsized":"2024-02-15T22:58:27.956494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.956385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.956385+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.956385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:33.825795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.851925+0000","last_change":"2024-02-15T22:57:47.851925+0000","last_active":"2024-02-15T22:57:47.851925+0000","last_peered":"2024-02-15T22:57:47.851925+0000","last_clean":"2024-02-15T22:57:47.851925+0000","last_became_active":"2024-02-15T22:56:07.709236+0000","last_became_peered":"2024-02-15T22:56:07.709236+0000","last_unstale":"2024-02-15T22:57:47.851925+0000","last_undegraded":"2024-02-15T22:57:47.851925+0000","last_fullsized":"2024-02-15T22:57:47.851925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.851815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.851815+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.851815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:42.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.003016+0000","last_change":"2024-02-15T22:57:53.003016+0000","last_active":"2024-02-15T22:57:53.003016+0000","last_peered":"2024-02-15T22:57:53.003016+0000","last_clean":"2024-02-15T22:57:53.003016+0000","last_became_active":"2024-02-15T22:56:09.729556+0000","last_became_peered":"2024-02-15T22:56:09.729556+0000","last_unstale":"2024-02-15T22:57:53.003016+0000","last_undegraded":"2024-02-15T22:57:53.003016+0000","last_fullsized":"2024-02-15T22:57:53.003016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:53.002893+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:53.002893+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.002893+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:27:11.902505+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":342,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.310138+0000","last_change":"2024-02-15T22:57:53.310138+0000","last_active":"2024-02-15T22:57:53.310138+0000","last_peered":"2024-02-15T22:57:53.310138+0000","last_clean":"2024-02-15T22:57:53.310138+0000","last_became_active":"2024-02-15T22:56:11.719588+0000","last_became_peered":"2024-02-15T22:56:11.719588+0000","last_unstale":"2024-02-15T22:57:53.310138+0000","last_undegraded":"2024-02-15T22:57:53.310138+0000","last_fullsized":"2024-02-15T22:57:53.310138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:53.309962+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:53.309962+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.309962+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:05.319309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.137427+0000","last_change":"2024-02-15T22:58:07.137427+0000","last_active":"2024-02-15T22:58:07.137427+0000","last_peered":"2024-02-15T22:58:07.137427+0000","last_clean":"2024-02-15T22:58:07.137427+0000","last_became_active":"2024-02-15T22:56:05.710578+0000","last_became_peered":"2024-02-15T22:56:05.710578+0000","last_unstale":"2024-02-15T22:58:07.137427+0000","last_undegraded":"2024-02-15T22:58:07.137427+0000","last_fullsized":"2024-02-15T22:58:07.137427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.137300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.137300+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.137300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:02:26.024097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.890089+0000","last_change":"2024-02-15T22:58:14.890089+0000","last_active":"2024-02-15T22:58:14.890089+0000","last_peered":"2024-02-15T22:58:14.890089+0000","last_clean":"2024-02-15T22:58:14.890089+0000","last_became_active":"2024-02-15T22:56:03.702187+0000","last_became_peered":"2024-02-15T22:56:03.702187+0000","last_unstale":"2024-02-15T22:58:14.890089+0000","last_undegraded":"2024-02-15T22:58:14.890089+0000","last_fullsized":"2024-02-15T22:58:14.890089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:14.889959+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:14.889959+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.889959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:33.400014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.884933+0000","last_change":"2024-02-15T22:57:59.884933+0000","last_active":"2024-02-15T22:57:59.884933+0000","last_peered":"2024-02-15T22:57:59.884933+0000","last_clean":"2024-02-15T22:57:59.884933+0000","last_became_active":"2024-02-15T22:56:07.707328+0000","last_became_peered":"2024-02-15T22:56:07.707328+0000","last_unstale":"2024-02-15T22:57:59.884933+0000","last_undegraded":"2024-02-15T22:57:59.884933+0000","last_fullsized":"2024-02-15T22:57:59.884933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:59.884790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:59.884790+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.884790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:05.894308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.000916+0000","last_change":"2024-02-15T22:57:57.000916+0000","last_active":"2024-02-15T22:57:57.000916+0000","last_peered":"2024-02-15T22:57:57.000916+0000","last_clean":"2024-02-15T22:57:57.000916+0000","last_became_active":"2024-02-15T22:56:09.715019+0000","last_became_peered":"2024-02-15T22:56:09.715019+0000","last_unstale":"2024-02-15T22:57:57.000916+0000","last_undegraded":"2024-02-15T22:57:57.000916+0000","last_fullsized":"2024-02-15T22:57:57.000916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-15T22:57:57.000759+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-15T22:57:57.000759+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.000759+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:45:12.812634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.357140+0000","last_change":"2024-02-15T22:57:50.357140+0000","last_active":"2024-02-15T22:57:50.357140+0000","last_peered":"2024-02-15T22:57:50.357140+0000","last_clean":"2024-02-15T22:57:50.357140+0000","last_became_active":"2024-02-15T22:56:11.719845+0000","last_became_peered":"2024-02-15T22:56:11.719845+0000","last_unstale":"2024-02-15T22:57:50.357140+0000","last_undegraded":"2024-02-15T22:57:50.357140+0000","last_fullsized":"2024-02-15T22:57:50.357140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.357021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.357021+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.357021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:06.000871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.823633+0000","last_change":"2024-02-15T22:58:34.823667+0000","last_active":"2024-02-15T22:58:34.823633+0000","last_peered":"2024-02-15T22:58:34.823633+0000","last_clean":"2024-02-15T22:58:34.823633+0000","last_became_active":"2024-02-15T22:56:13.732321+0000","last_became_peered":"2024-02-15T22:56:13.732321+0000","last_unstale":"2024-02-15T22:58:34.823633+0000","last_undegraded":"2024-02-15T22:58:34.823633+0000","last_fullsized":"2024-02-15T22:58:34.823633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:58:34.823529+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:58:34.823529+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.823529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:12:30.547146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.868943+0000","last_change":"2024-02-15T22:58:19.869033+0000","last_active":"2024-02-15T22:58:19.868943+0000","last_peered":"2024-02-15T22:58:19.868943+0000","last_clean":"2024-02-15T22:58:19.868943+0000","last_became_active":"2024-02-15T22:56:05.697834+0000","last_became_peered":"2024-02-15T22:56:05.697834+0000","last_unstale":"2024-02-15T22:58:19.868943+0000","last_undegraded":"2024-02-15T22:58:19.868943+0000","last_fullsized":"2024-02-15T22:58:19.868943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:19.868817+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:19.868817+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.868817+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:50.766383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.855300+0000","last_change":"2024-02-15T22:58:12.855300+0000","last_active":"2024-02-15T22:58:12.855300+0000","last_peered":"2024-02-15T22:58:12.855300+0000","last_clean":"2024-02-15T22:58:12.855300+0000","last_became_active":"2024-02-15T22:56:03.702353+0000","last_became_peered":"2024-02-15T22:56:03.702353+0000","last_unstale":"2024-02-15T22:58:12.855300+0000","last_undegraded":"2024-02-15T22:58:12.855300+0000","last_fullsized":"2024-02-15T22:58:12.855300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.855162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.855162+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.855162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:40.679343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.208925+0000","last_change":"2024-02-15T22:58:07.208925+0000","last_active":"2024-02-15T22:58:07.208925+0000","last_peered":"2024-02-15T22:58:07.208925+0000","last_clean":"2024-02-15T22:58:07.208925+0000","last_became_active":"2024-02-15T22:56:07.706656+0000","last_became_peered":"2024-02-15T22:56:07.706656+0000","last_unstale":"2024-02-15T22:58:07.208925+0000","last_undegraded":"2024-02-15T22:58:07.208925+0000","last_fullsized":"2024-02-15T22:58:07.208925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.208777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.208777+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.208777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:31.806933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.993269+0000","last_change":"2024-02-15T22:57:52.993269+0000","last_active":"2024-02-15T22:57:52.993269+0000","last_peered":"2024-02-15T22:57:52.993269+0000","last_clean":"2024-02-15T22:57:52.993269+0000","last_became_active":"2024-02-15T22:56:09.716138+0000","last_became_peered":"2024-02-15T22:56:09.716138+0000","last_unstale":"2024-02-15T22:57:52.993269+0000","last_undegraded":"2024-02-15T22:57:52.993269+0000","last_fullsized":"2024-02-15T22:57:52.993269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:52.993117+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:52.993117+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.993117+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:16.156318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.238737+0000","last_change":"2024-02-15T22:58:04.238737+0000","last_active":"2024-02-15T22:58:04.238737+0000","last_peered":"2024-02-15T22:58:04.238737+0000","last_clean":"2024-02-15T22:58:04.238737+0000","last_became_active":"2024-02-15T22:56:11.724317+0000","last_became_peered":"2024-02-15T22:56:11.724317+0000","last_unstale":"2024-02-15T22:58:04.238737+0000","last_undegraded":"2024-02-15T22:58:04.238737+0000","last_fullsized":"2024-02-15T22:58:04.238737+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:04.238614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:04.238614+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.238614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:27.604291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:41.860482+0000","last_change":"2024-02-15T22:58:41.860509+0000","last_active":"2024-02-15T22:58:41.860482+0000","last_peered":"2024-02-15T22:58:41.860482+0000","last_clean":"2024-02-15T22:58:41.860482+0000","last_became_active":"2024-02-15T22:56:13.733118+0000","last_became_peered":"2024-02-15T22:56:13.733118+0000","last_unstale":"2024-02-15T22:58:41.860482+0000","last_undegraded":"2024-02-15T22:58:41.860482+0000","last_fullsized":"2024-02-15T22:58:41.860482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:41.860400+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:41.860400+0000","last_clean_scrub_stamp":"2024-02-15T22:58:41.860400+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:36:47.619526+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'20","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.823539+0000","last_change":"2024-02-15T22:58:38.823565+0000","last_active":"2024-02-15T22:58:38.823539+0000","last_peered":"2024-02-15T22:58:38.823539+0000","last_clean":"2024-02-15T22:58:38.823539+0000","last_became_active":"2024-02-15T22:56:45.886248+0000","last_became_peered":"2024-02-15T22:56:45.886248+0000","last_unstale":"2024-02-15T22:58:38.823539+0000","last_undegraded":"2024-02-15T22:58:38.823539+0000","last_fullsized":"2024-02-15T22:58:38.823539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-02-15T22:58:38.823451+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-02-15T22:58:38.823451+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.823451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:58.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:48.175496+0000","last_change":"2024-02-15T22:58:48.175523+0000","last_active":"2024-02-15T22:58:48.175496+0000","last_peered":"2024-02-15T22:58:48.175496+0000","last_clean":"2024-02-15T22:58:48.175496+0000","last_became_active":"2024-02-15T22:56:03.700087+0000","last_became_peered":"2024-02-15T22:56:03.700087+0000","last_unstale":"2024-02-15T22:58:48.175496+0000","last_undegraded":"2024-02-15T22:58:48.175496+0000","last_fullsized":"2024-02-15T22:58:48.175496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:48.175395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:48.175395+0000","last_clean_scrub_stamp":"2024-02-15T22:58:48.175395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:19.955411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.176919+0000","last_change":"2024-02-15T22:58:10.176919+0000","last_active":"2024-02-15T22:58:10.176919+0000","last_peered":"2024-02-15T22:58:10.176919+0000","last_clean":"2024-02-15T22:58:10.176919+0000","last_became_active":"2024-02-15T22:56:07.704502+0000","last_became_peered":"2024-02-15T22:56:07.704502+0000","last_unstale":"2024-02-15T22:58:10.176919+0000","last_undegraded":"2024-02-15T22:58:10.176919+0000","last_fullsized":"2024-02-15T22:58:10.176919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:10.176806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:10.176806+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.176806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:13.375626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'44","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.182521+0000","last_change":"2024-02-15T22:58:22.182562+0000","last_active":"2024-02-15T22:58:22.182521+0000","last_peered":"2024-02-15T22:58:22.182521+0000","last_clean":"2024-02-15T22:58:22.182521+0000","last_became_active":"2024-02-15T22:56:09.717174+0000","last_became_peered":"2024-02-15T22:56:09.717174+0000","last_unstale":"2024-02-15T22:58:22.182521+0000","last_undegraded":"2024-02-15T22:58:22.182521+0000","last_fullsized":"2024-02-15T22:58:22.182521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:58:22.182437+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:58:22.182437+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.182437+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:01.680145+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":313,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.299547+0000","last_change":"2024-02-15T22:58:00.299547+0000","last_active":"2024-02-15T22:58:00.299547+0000","last_peered":"2024-02-15T22:58:00.299547+0000","last_clean":"2024-02-15T22:58:00.299547+0000","last_became_active":"2024-02-15T22:56:11.724273+0000","last_became_peered":"2024-02-15T22:56:11.724273+0000","last_unstale":"2024-02-15T22:58:00.299547+0000","last_undegraded":"2024-02-15T22:58:00.299547+0000","last_fullsized":"2024-02-15T22:58:00.299547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:58:00.299415+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:58:00.299415+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.299415+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:33.226403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.241434+0000","last_change":"2024-02-15T22:58:12.241434+0000","last_active":"2024-02-15T22:58:12.241434+0000","last_peered":"2024-02-15T22:58:12.241434+0000","last_clean":"2024-02-15T22:58:12.241434+0000","last_became_active":"2024-02-15T22:56:13.726858+0000","last_became_peered":"2024-02-15T22:56:13.726858+0000","last_unstale":"2024-02-15T22:58:12.241434+0000","last_undegraded":"2024-02-15T22:58:12.241434+0000","last_fullsized":"2024-02-15T22:58:12.241434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.241315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.241315+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.241315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:07:18.462448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.889358+0000","last_change":"2024-02-15T22:58:13.889358+0000","last_active":"2024-02-15T22:58:13.889358+0000","last_peered":"2024-02-15T22:58:13.889358+0000","last_clean":"2024-02-15T22:58:13.889358+0000","last_became_active":"2024-02-15T22:56:05.701568+0000","last_became_peered":"2024-02-15T22:56:05.701568+0000","last_unstale":"2024-02-15T22:58:13.889358+0000","last_undegraded":"2024-02-15T22:58:13.889358+0000","last_fullsized":"2024-02-15T22:58:13.889358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:13.889250+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:13.889250+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.889250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:22.586047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:58.179744+0000","last_change":"2024-02-15T22:58:58.179768+0000","last_active":"2024-02-15T22:58:58.179744+0000","last_peered":"2024-02-15T22:58:58.179744+0000","last_clean":"2024-02-15T22:58:58.179744+0000","last_became_active":"2024-02-15T22:56:03.694668+0000","last_became_peered":"2024-02-15T22:56:03.694668+0000","last_unstale":"2024-02-15T22:58:58.179744+0000","last_undegraded":"2024-02-15T22:58:58.179744+0000","last_fullsized":"2024-02-15T22:58:58.179744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:58.179652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:58.179652+0000","last_clean_scrub_stamp":"2024-02-15T22:58:58.179652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:02:07.739954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.212958+0000","last_change":"2024-02-15T22:58:13.212958+0000","last_active":"2024-02-15T22:58:13.212958+0000","last_peered":"2024-02-15T22:58:13.212958+0000","last_clean":"2024-02-15T22:58:13.212958+0000","last_became_active":"2024-02-15T22:56:07.704054+0000","last_became_peered":"2024-02-15T22:56:07.704054+0000","last_unstale":"2024-02-15T22:58:13.212958+0000","last_undegraded":"2024-02-15T22:58:13.212958+0000","last_fullsized":"2024-02-15T22:58:13.212958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:13.212847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:13.212847+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.212847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:27.614478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.173318+0000","last_change":"2024-02-15T22:58:09.173318+0000","last_active":"2024-02-15T22:58:09.173318+0000","last_peered":"2024-02-15T22:58:09.173318+0000","last_clean":"2024-02-15T22:58:09.173318+0000","last_became_active":"2024-02-15T22:56:09.717264+0000","last_became_peered":"2024-02-15T22:56:09.717264+0000","last_unstale":"2024-02-15T22:58:09.173318+0000","last_undegraded":"2024-02-15T22:58:09.173318+0000","last_fullsized":"2024-02-15T22:58:09.173318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-15T22:58:09.173193+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-15T22:58:09.173193+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.173193+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:35:38.023140+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.388857+0000","last_change":"2024-02-15T22:57:49.388857+0000","last_active":"2024-02-15T22:57:49.388857+0000","last_peered":"2024-02-15T22:57:49.388857+0000","last_clean":"2024-02-15T22:57:49.388857+0000","last_became_active":"2024-02-15T22:56:11.720616+0000","last_became_peered":"2024-02-15T22:56:11.720616+0000","last_unstale":"2024-02-15T22:57:49.388857+0000","last_undegraded":"2024-02-15T22:57:49.388857+0000","last_fullsized":"2024-02-15T22:57:49.388857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.388740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.388740+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.388740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:41.087774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.231314+0000","last_change":"2024-02-15T22:58:16.231314+0000","last_active":"2024-02-15T22:58:16.231314+0000","last_peered":"2024-02-15T22:58:16.231314+0000","last_clean":"2024-02-15T22:58:16.231314+0000","last_became_active":"2024-02-15T22:56:13.729015+0000","last_became_peered":"2024-02-15T22:56:13.729015+0000","last_unstale":"2024-02-15T22:58:16.231314+0000","last_undegraded":"2024-02-15T22:58:16.231314+0000","last_fullsized":"2024-02-15T22:58:16.231314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:16.231166+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:16.231166+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.231166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:47.128732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.838371+0000","last_change":"2024-02-15T22:58:39.838371+0000","last_active":"2024-02-15T22:58:39.838371+0000","last_peered":"2024-02-15T22:58:39.838371+0000","last_clean":"2024-02-15T22:58:39.838371+0000","last_became_active":"2024-02-15T22:56:45.893017+0000","last_became_peered":"2024-02-15T22:56:45.893017+0000","last_unstale":"2024-02-15T22:58:39.838371+0000","last_undegraded":"2024-02-15T22:58:39.838371+0000","last_fullsized":"2024-02-15T22:58:39.838371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:39.838252+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:39.838252+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.838252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:36:08.688199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:48.361917+0000","last_change":"2024-02-15T22:58:48.361940+0000","last_active":"2024-02-15T22:58:48.361917+0000","last_peered":"2024-02-15T22:58:48.361917+0000","last_clean":"2024-02-15T22:58:48.361917+0000","last_became_active":"2024-02-15T22:56:45.886530+0000","last_became_peered":"2024-02-15T22:56:45.886530+0000","last_unstale":"2024-02-15T22:58:48.361917+0000","last_undegraded":"2024-02-15T22:58:48.361917+0000","last_fullsized":"2024-02-15T22:58:48.361917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:48.361832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:48.361832+0000","last_clean_scrub_stamp":"2024-02-15T22:58:48.361832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:04:00.156122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.012863+0000","last_change":"2024-02-15T22:58:03.012863+0000","last_active":"2024-02-15T22:58:03.012863+0000","last_peered":"2024-02-15T22:58:03.012863+0000","last_clean":"2024-02-15T22:58:03.012863+0000","last_became_active":"2024-02-15T22:56:07.707207+0000","last_became_peered":"2024-02-15T22:56:07.707207+0000","last_unstale":"2024-02-15T22:58:03.012863+0000","last_undegraded":"2024-02-15T22:58:03.012863+0000","last_fullsized":"2024-02-15T22:58:03.012863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:03.012756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:03.012756+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.012756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:24.662100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.911848+0000","last_change":"2024-02-15T22:57:51.911848+0000","last_active":"2024-02-15T22:57:51.911848+0000","last_peered":"2024-02-15T22:57:51.911848+0000","last_clean":"2024-02-15T22:57:51.911848+0000","last_became_active":"2024-02-15T22:56:09.714592+0000","last_became_peered":"2024-02-15T22:56:09.714592+0000","last_unstale":"2024-02-15T22:57:51.911848+0000","last_undegraded":"2024-02-15T22:57:51.911848+0000","last_fullsized":"2024-02-15T22:57:51.911848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-15T22:57:51.911723+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-15T22:57:51.911723+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.911723+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:55.109902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.119618+0000","last_change":"2024-02-15T22:58:15.119618+0000","last_active":"2024-02-15T22:58:15.119618+0000","last_peered":"2024-02-15T22:58:15.119618+0000","last_clean":"2024-02-15T22:58:15.119618+0000","last_became_active":"2024-02-15T22:56:11.723557+0000","last_became_peered":"2024-02-15T22:56:11.723557+0000","last_unstale":"2024-02-15T22:58:15.119618+0000","last_undegraded":"2024-02-15T22:58:15.119618+0000","last_fullsized":"2024-02-15T22:58:15.119618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:15.119498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:15.119498+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.119498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:26.132469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.172807+0000","last_change":"2024-02-15T22:58:29.172829+0000","last_active":"2024-02-15T22:58:29.172807+0000","last_peered":"2024-02-15T22:58:29.172807+0000","last_clean":"2024-02-15T22:58:29.172807+0000","last_became_active":"2024-02-15T22:56:13.726586+0000","last_became_peered":"2024-02-15T22:56:13.726586+0000","last_unstale":"2024-02-15T22:58:29.172807+0000","last_undegraded":"2024-02-15T22:58:29.172807+0000","last_fullsized":"2024-02-15T22:58:29.172807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:29.172716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:29.172716+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.172716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:48:22.998360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.049602+0000","last_change":"2024-02-15T22:57:59.049602+0000","last_active":"2024-02-15T22:57:59.049602+0000","last_peered":"2024-02-15T22:57:59.049602+0000","last_clean":"2024-02-15T22:57:59.049602+0000","last_became_active":"2024-02-15T22:56:05.716590+0000","last_became_peered":"2024-02-15T22:56:05.716590+0000","last_unstale":"2024-02-15T22:57:59.049602+0000","last_undegraded":"2024-02-15T22:57:59.049602+0000","last_fullsized":"2024-02-15T22:57:59.049602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-15T22:57:59.049477+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-15T22:57:59.049477+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.049477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:05.045262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:47.194380+0000","last_change":"2024-02-15T22:58:47.194421+0000","last_active":"2024-02-15T22:58:47.194380+0000","last_peered":"2024-02-15T22:58:47.194380+0000","last_clean":"2024-02-15T22:58:47.194380+0000","last_became_active":"2024-02-15T22:56:03.702875+0000","last_became_peered":"2024-02-15T22:56:03.702875+0000","last_unstale":"2024-02-15T22:58:47.194380+0000","last_undegraded":"2024-02-15T22:58:47.194380+0000","last_fullsized":"2024-02-15T22:58:47.194380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:47.194284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:47.194284+0000","last_clean_scrub_stamp":"2024-02-15T22:58:47.194284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:24:31.964461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.194271+0000","last_change":"2024-02-15T22:58:11.194271+0000","last_active":"2024-02-15T22:58:11.194271+0000","last_peered":"2024-02-15T22:58:11.194271+0000","last_clean":"2024-02-15T22:58:11.194271+0000","last_became_active":"2024-02-15T22:56:07.704058+0000","last_became_peered":"2024-02-15T22:56:07.704058+0000","last_unstale":"2024-02-15T22:58:11.194271+0000","last_undegraded":"2024-02-15T22:58:11.194271+0000","last_fullsized":"2024-02-15T22:58:11.194271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.194159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.194159+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.194159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:19:30.005727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'44","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.970287+0000","last_change":"2024-02-15T22:57:57.970287+0000","last_active":"2024-02-15T22:57:57.970287+0000","last_peered":"2024-02-15T22:57:57.970287+0000","last_clean":"2024-02-15T22:57:57.970287+0000","last_became_active":"2024-02-15T22:56:09.712113+0000","last_became_peered":"2024-02-15T22:56:09.712113+0000","last_unstale":"2024-02-15T22:57:57.970287+0000","last_undegraded":"2024-02-15T22:57:57.970287+0000","last_fullsized":"2024-02-15T22:57:57.970287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:57:57.970127+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:57:57.970127+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.970127+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:59.472492+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":344,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.871443+0000","last_change":"2024-02-15T22:57:47.871443+0000","last_active":"2024-02-15T22:57:47.871443+0000","last_peered":"2024-02-15T22:57:47.871443+0000","last_clean":"2024-02-15T22:57:47.871443+0000","last_became_active":"2024-02-15T22:56:11.720390+0000","last_became_peered":"2024-02-15T22:56:11.720390+0000","last_unstale":"2024-02-15T22:57:47.871443+0000","last_undegraded":"2024-02-15T22:57:47.871443+0000","last_fullsized":"2024-02-15T22:57:47.871443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:47.871285+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:47.871285+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.871285+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:51.713747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:44.376467+0000","last_change":"2024-02-15T22:58:44.376496+0000","last_active":"2024-02-15T22:58:44.376467+0000","last_peered":"2024-02-15T22:58:44.376467+0000","last_clean":"2024-02-15T22:58:44.376467+0000","last_became_active":"2024-02-15T22:56:13.734227+0000","last_became_peered":"2024-02-15T22:56:13.734227+0000","last_unstale":"2024-02-15T22:58:44.376467+0000","last_undegraded":"2024-02-15T22:58:44.376467+0000","last_fullsized":"2024-02-15T22:58:44.376467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:44.376377+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:44.376377+0000","last_clean_scrub_stamp":"2024-02-15T22:58:44.376377+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:23.874085+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.945487+0000","last_change":"2024-02-15T22:58:23.945528+0000","last_active":"2024-02-15T22:58:23.945487+0000","last_peered":"2024-02-15T22:58:23.945487+0000","last_clean":"2024-02-15T22:58:23.945487+0000","last_became_active":"2024-02-15T22:56:05.705551+0000","last_became_peered":"2024-02-15T22:56:05.705551+0000","last_unstale":"2024-02-15T22:58:23.945487+0000","last_undegraded":"2024-02-15T22:58:23.945487+0000","last_fullsized":"2024-02-15T22:58:23.945487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.945394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.945394+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.945394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:34:07.500646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:51.174836+0000","last_change":"2024-02-15T22:58:51.174864+0000","last_active":"2024-02-15T22:58:51.174836+0000","last_peered":"2024-02-15T22:58:51.174836+0000","last_clean":"2024-02-15T22:58:51.174836+0000","last_became_active":"2024-02-15T22:56:03.704526+0000","last_became_peered":"2024-02-15T22:56:03.704526+0000","last_unstale":"2024-02-15T22:58:51.174836+0000","last_undegraded":"2024-02-15T22:58:51.174836+0000","last_fullsized":"2024-02-15T22:58:51.174836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:51.174743+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:51.174743+0000","last_clean_scrub_stamp":"2024-02-15T22:58:51.174743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:14:59.893936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'9","reported_seq":547,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.866099+0000","last_change":"2024-02-15T22:58:01.866099+0000","last_active":"2024-02-15T22:58:01.866099+0000","last_peered":"2024-02-15T22:58:01.866099+0000","last_clean":"2024-02-15T22:58:01.866099+0000","last_became_active":"2024-02-15T22:56:07.704281+0000","last_became_peered":"2024-02-15T22:56:07.704281+0000","last_unstale":"2024-02-15T22:58:01.866099+0000","last_undegraded":"2024-02-15T22:58:01.866099+0000","last_fullsized":"2024-02-15T22:58:01.866099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-15T22:58:01.865973+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-15T22:58:01.865973+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.865973+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:28.422958+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":595,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.204666+0000","last_change":"2024-02-15T22:58:05.204666+0000","last_active":"2024-02-15T22:58:05.204666+0000","last_peered":"2024-02-15T22:58:05.204666+0000","last_clean":"2024-02-15T22:58:05.204666+0000","last_became_active":"2024-02-15T22:56:09.717735+0000","last_became_peered":"2024-02-15T22:56:09.717735+0000","last_unstale":"2024-02-15T22:58:05.204666+0000","last_undegraded":"2024-02-15T22:58:05.204666+0000","last_fullsized":"2024-02-15T22:58:05.204666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:58:05.204500+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:58:05.204500+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.204500+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:17:36.367930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":387,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.877265+0000","last_change":"2024-02-15T22:57:46.877265+0000","last_active":"2024-02-15T22:57:46.877265+0000","last_peered":"2024-02-15T22:57:46.877265+0000","last_clean":"2024-02-15T22:57:46.877265+0000","last_became_active":"2024-02-15T22:56:11.717380+0000","last_became_peered":"2024-02-15T22:56:11.717380+0000","last_unstale":"2024-02-15T22:57:46.877265+0000","last_undegraded":"2024-02-15T22:57:46.877265+0000","last_fullsized":"2024-02-15T22:57:46.877265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:46.877108+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:46.877108+0000","last_clean_scrub_stamp":"2024-02-15T22:57:46.877108+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:13:26.299004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.974720+0000","last_change":"2024-02-15T22:58:03.974720+0000","last_active":"2024-02-15T22:58:03.974720+0000","last_peered":"2024-02-15T22:58:03.974720+0000","last_clean":"2024-02-15T22:58:03.974720+0000","last_became_active":"2024-02-15T22:56:13.729467+0000","last_became_peered":"2024-02-15T22:56:13.729467+0000","last_unstale":"2024-02-15T22:58:03.974720+0000","last_undegraded":"2024-02-15T22:58:03.974720+0000","last_fullsized":"2024-02-15T22:58:03.974720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:03.974606+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:03.974606+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.974606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:15.983952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"30'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.800305+0000","last_change":"2024-02-15T22:58:40.800305+0000","last_active":"2024-02-15T22:58:40.800305+0000","last_peered":"2024-02-15T22:58:40.800305+0000","last_clean":"2024-02-15T22:58:40.800305+0000","last_became_active":"2024-02-15T22:56:45.892949+0000","last_became_peered":"2024-02-15T22:56:45.892949+0000","last_unstale":"2024-02-15T22:58:40.800305+0000","last_undegraded":"2024-02-15T22:58:40.800305+0000","last_fullsized":"2024-02-15T22:58:40.800305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:40.800199+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:40.800199+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:54.182110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:43.210282+0000","last_change":"2024-02-15T22:58:43.210317+0000","last_active":"2024-02-15T22:58:43.210282+0000","last_peered":"2024-02-15T22:58:43.210282+0000","last_clean":"2024-02-15T22:58:43.210282+0000","last_became_active":"2024-02-15T22:56:03.702035+0000","last_became_peered":"2024-02-15T22:56:03.702035+0000","last_unstale":"2024-02-15T22:58:43.210282+0000","last_undegraded":"2024-02-15T22:58:43.210282+0000","last_fullsized":"2024-02-15T22:58:43.210282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:43.210199+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:43.210199+0000","last_clean_scrub_stamp":"2024-02-15T22:58:43.210199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:24:20.480239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.003934+0000","last_change":"2024-02-15T22:57:52.003934+0000","last_active":"2024-02-15T22:57:52.003934+0000","last_peered":"2024-02-15T22:57:52.003934+0000","last_clean":"2024-02-15T22:57:52.003934+0000","last_became_active":"2024-02-15T22:56:07.706615+0000","last_became_peered":"2024-02-15T22:56:07.706615+0000","last_unstale":"2024-02-15T22:57:52.003934+0000","last_undegraded":"2024-02-15T22:57:52.003934+0000","last_fullsized":"2024-02-15T22:57:52.003934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.003831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.003831+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.003831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:06.405461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.860641+0000","last_change":"2024-02-15T22:57:53.860641+0000","last_active":"2024-02-15T22:57:53.860641+0000","last_peered":"2024-02-15T22:57:53.860641+0000","last_clean":"2024-02-15T22:57:53.860641+0000","last_became_active":"2024-02-15T22:56:09.713660+0000","last_became_peered":"2024-02-15T22:56:09.713660+0000","last_unstale":"2024-02-15T22:57:53.860641+0000","last_undegraded":"2024-02-15T22:57:53.860641+0000","last_fullsized":"2024-02-15T22:57:53.860641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-02-15T22:57:53.860514+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-02-15T22:57:53.860514+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.860514+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:09.504364+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.953591+0000","last_change":"2024-02-15T22:57:51.953591+0000","last_active":"2024-02-15T22:57:51.953591+0000","last_peered":"2024-02-15T22:57:51.953591+0000","last_clean":"2024-02-15T22:57:51.953591+0000","last_became_active":"2024-02-15T22:56:11.724575+0000","last_became_peered":"2024-02-15T22:56:11.724575+0000","last_unstale":"2024-02-15T22:57:51.953591+0000","last_undegraded":"2024-02-15T22:57:51.953591+0000","last_fullsized":"2024-02-15T22:57:51.953591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:51.953487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:51.953487+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.953487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:47.214571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.822668+0000","last_change":"2024-02-15T22:58:04.822668+0000","last_active":"2024-02-15T22:58:04.822668+0000","last_peered":"2024-02-15T22:58:04.822668+0000","last_clean":"2024-02-15T22:58:04.822668+0000","last_became_active":"2024-02-15T22:56:13.722550+0000","last_became_peered":"2024-02-15T22:56:13.722550+0000","last_unstale":"2024-02-15T22:58:04.822668+0000","last_undegraded":"2024-02-15T22:58:04.822668+0000","last_fullsized":"2024-02-15T22:58:04.822668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:04.822525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:04.822525+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.822525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:19.922383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.150482+0000","last_change":"2024-02-15T22:58:02.150482+0000","last_active":"2024-02-15T22:58:02.150482+0000","last_peered":"2024-02-15T22:58:02.150482+0000","last_clean":"2024-02-15T22:58:02.150482+0000","last_became_active":"2024-02-15T22:56:05.715513+0000","last_became_peered":"2024-02-15T22:56:05.715513+0000","last_unstale":"2024-02-15T22:58:02.150482+0000","last_undegraded":"2024-02-15T22:58:02.150482+0000","last_fullsized":"2024-02-15T22:58:02.150482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-15T22:58:02.150334+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-15T22:58:02.150334+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.150334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:52:56.881211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":210,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.912168+0000","last_change":"2024-02-15T22:58:30.912209+0000","last_active":"2024-02-15T22:58:30.912168+0000","last_peered":"2024-02-15T22:58:30.912168+0000","last_clean":"2024-02-15T22:58:30.912168+0000","last_became_active":"2024-02-15T22:55:52.657750+0000","last_became_peered":"2024-02-15T22:55:52.657750+0000","last_unstale":"2024-02-15T22:58:30.912168+0000","last_undegraded":"2024-02-15T22:58:30.912168+0000","last_fullsized":"2024-02-15T22:58:30.912168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-02-15T22:58:30.912082+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-02-15T22:58:30.912082+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.912082+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:11.193723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:01.177631+0000","last_change":"2024-02-15T22:59:01.177658+0000","last_active":"2024-02-15T22:59:01.177631+0000","last_peered":"2024-02-15T22:59:01.177631+0000","last_clean":"2024-02-15T22:59:01.177631+0000","last_became_active":"2024-02-15T22:55:57.672281+0000","last_became_peered":"2024-02-15T22:55:57.672281+0000","last_unstale":"2024-02-15T22:59:01.177631+0000","last_undegraded":"2024-02-15T22:59:01.177631+0000","last_fullsized":"2024-02-15T22:59:01.177631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:01.177537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:01.177537+0000","last_clean_scrub_stamp":"2024-02-15T22:59:01.177537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:01.479337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.159145+0000","last_change":"2024-02-15T22:58:40.159166+0000","last_active":"2024-02-15T22:58:40.159145+0000","last_peered":"2024-02-15T22:58:40.159145+0000","last_clean":"2024-02-15T22:58:40.159145+0000","last_became_active":"2024-02-15T22:56:03.706721+0000","last_became_peered":"2024-02-15T22:56:03.706721+0000","last_unstale":"2024-02-15T22:58:40.159145+0000","last_undegraded":"2024-02-15T22:58:40.159145+0000","last_fullsized":"2024-02-15T22:58:40.159145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:40.159068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:40.159068+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.159068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:21:27.293449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:45.829169+0000","last_change":"2024-02-15T22:58:45.829191+0000","last_active":"2024-02-15T22:58:45.829169+0000","last_peered":"2024-02-15T22:58:45.829169+0000","last_clean":"2024-02-15T22:58:45.829169+0000","last_became_active":"2024-02-15T22:56:45.887260+0000","last_became_peered":"2024-02-15T22:56:45.887260+0000","last_unstale":"2024-02-15T22:58:45.829169+0000","last_undegraded":"2024-02-15T22:58:45.829169+0000","last_fullsized":"2024-02-15T22:58:45.829169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:45.829085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:45.829085+0000","last_clean_scrub_stamp":"2024-02-15T22:58:45.829085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:40:05.544538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'81","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.126986+0000","last_change":"2024-02-15T22:58:01.126986+0000","last_active":"2024-02-15T22:58:01.126986+0000","last_peered":"2024-02-15T22:58:01.126986+0000","last_clean":"2024-02-15T22:58:01.126986+0000","last_became_active":"2024-02-15T22:56:09.716109+0000","last_became_peered":"2024-02-15T22:56:09.716109+0000","last_unstale":"2024-02-15T22:58:01.126986+0000","last_undegraded":"2024-02-15T22:58:01.126986+0000","last_fullsized":"2024-02-15T22:58:01.126986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-02-15T22:58:01.126822+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-02-15T22:58:01.126822+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.126822+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:24.668741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.351175+0000","last_change":"2024-02-15T22:57:52.351175+0000","last_active":"2024-02-15T22:57:52.351175+0000","last_peered":"2024-02-15T22:57:52.351175+0000","last_clean":"2024-02-15T22:57:52.351175+0000","last_became_active":"2024-02-15T22:56:11.722390+0000","last_became_peered":"2024-02-15T22:56:11.722390+0000","last_unstale":"2024-02-15T22:57:52.351175+0000","last_undegraded":"2024-02-15T22:57:52.351175+0000","last_fullsized":"2024-02-15T22:57:52.351175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.351041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.351041+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.351041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:26.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.817643+0000","last_change":"2024-02-15T22:58:36.817669+0000","last_active":"2024-02-15T22:58:36.817643+0000","last_peered":"2024-02-15T22:58:36.817643+0000","last_clean":"2024-02-15T22:58:36.817643+0000","last_became_active":"2024-02-15T22:56:13.732437+0000","last_became_peered":"2024-02-15T22:56:13.732437+0000","last_unstale":"2024-02-15T22:58:36.817643+0000","last_undegraded":"2024-02-15T22:58:36.817643+0000","last_fullsized":"2024-02-15T22:58:36.817643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-15T22:58:36.817537+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-15T22:58:36.817537+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.817537+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:42:08.747988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.192867+0000","last_change":"2024-02-15T22:58:34.192905+0000","last_active":"2024-02-15T22:58:34.192867+0000","last_peered":"2024-02-15T22:58:34.192867+0000","last_clean":"2024-02-15T22:58:34.192867+0000","last_became_active":"2024-02-15T22:56:05.699679+0000","last_became_peered":"2024-02-15T22:56:05.699679+0000","last_unstale":"2024-02-15T22:58:34.192867+0000","last_undegraded":"2024-02-15T22:58:34.192867+0000","last_fullsized":"2024-02-15T22:58:34.192867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:34.192733+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:34.192733+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.192733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:23.150003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:02.218879+0000","last_change":"2024-02-15T22:59:02.218908+0000","last_active":"2024-02-15T22:59:02.218879+0000","last_peered":"2024-02-15T22:59:02.218879+0000","last_clean":"2024-02-15T22:59:02.218879+0000","last_became_active":"2024-02-15T22:55:57.672705+0000","last_became_peered":"2024-02-15T22:55:57.672705+0000","last_unstale":"2024-02-15T22:59:02.218879+0000","last_undegraded":"2024-02-15T22:59:02.218879+0000","last_fullsized":"2024-02-15T22:59:02.218879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:02.218745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:02.218745+0000","last_clean_scrub_stamp":"2024-02-15T22:59:02.218745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:51.502439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.330569+0000","last_change":"2024-02-15T22:58:29.330612+0000","last_active":"2024-02-15T22:58:29.330569+0000","last_peered":"2024-02-15T22:58:29.330569+0000","last_clean":"2024-02-15T22:58:29.330569+0000","last_became_active":"2024-02-15T22:56:03.699864+0000","last_became_peered":"2024-02-15T22:56:03.699864+0000","last_unstale":"2024-02-15T22:58:29.330569+0000","last_undegraded":"2024-02-15T22:58:29.330569+0000","last_fullsized":"2024-02-15T22:58:29.330569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:29.330452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:29.330452+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.330452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:47.505596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.977656+0000","last_change":"2024-02-15T22:57:50.977656+0000","last_active":"2024-02-15T22:57:50.977656+0000","last_peered":"2024-02-15T22:57:50.977656+0000","last_clean":"2024-02-15T22:57:50.977656+0000","last_became_active":"2024-02-15T22:56:07.707620+0000","last_became_peered":"2024-02-15T22:56:07.707620+0000","last_unstale":"2024-02-15T22:57:50.977656+0000","last_undegraded":"2024-02-15T22:57:50.977656+0000","last_fullsized":"2024-02-15T22:57:50.977656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.977533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.977533+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.977533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:06:57.198666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":447,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.870292+0000","last_change":"2024-02-15T22:57:50.870292+0000","last_active":"2024-02-15T22:57:50.870292+0000","last_peered":"2024-02-15T22:57:50.870292+0000","last_clean":"2024-02-15T22:57:50.870292+0000","last_became_active":"2024-02-15T22:56:09.718396+0000","last_became_peered":"2024-02-15T22:56:09.718396+0000","last_unstale":"2024-02-15T22:57:50.870292+0000","last_undegraded":"2024-02-15T22:57:50.870292+0000","last_fullsized":"2024-02-15T22:57:50.870292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-02-15T22:57:50.870120+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-02-15T22:57:50.870120+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.870120+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:52.372485+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.133283+0000","last_change":"2024-02-15T22:58:11.133283+0000","last_active":"2024-02-15T22:58:11.133283+0000","last_peered":"2024-02-15T22:58:11.133283+0000","last_clean":"2024-02-15T22:58:11.133283+0000","last_became_active":"2024-02-15T22:56:11.725005+0000","last_became_peered":"2024-02-15T22:56:11.725005+0000","last_unstale":"2024-02-15T22:58:11.133283+0000","last_undegraded":"2024-02-15T22:58:11.133283+0000","last_fullsized":"2024-02-15T22:58:11.133283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.133157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.133157+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.133157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:19:51.739962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:43.851177+0000","last_change":"2024-02-15T22:58:43.851204+0000","last_active":"2024-02-15T22:58:43.851177+0000","last_peered":"2024-02-15T22:58:43.851177+0000","last_clean":"2024-02-15T22:58:43.851177+0000","last_became_active":"2024-02-15T22:56:13.733760+0000","last_became_peered":"2024-02-15T22:56:13.733760+0000","last_unstale":"2024-02-15T22:58:43.851177+0000","last_undegraded":"2024-02-15T22:58:43.851177+0000","last_fullsized":"2024-02-15T22:58:43.851177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:58:43.851088+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:58:43.851088+0000","last_clean_scrub_stamp":"2024-02-15T22:58:43.851088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:42.577719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.342257+0000","last_change":"2024-02-15T22:58:28.342294+0000","last_active":"2024-02-15T22:58:28.342257+0000","last_peered":"2024-02-15T22:58:28.342257+0000","last_clean":"2024-02-15T22:58:28.342257+0000","last_became_active":"2024-02-15T22:56:05.704953+0000","last_became_peered":"2024-02-15T22:56:05.704953+0000","last_unstale":"2024-02-15T22:58:28.342257+0000","last_undegraded":"2024-02-15T22:58:28.342257+0000","last_fullsized":"2024-02-15T22:58:28.342257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:28.342172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:28.342172+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.342172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:42:00.272623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.926087+0000","last_change":"2024-02-15T22:58:25.926114+0000","last_active":"2024-02-15T22:58:25.926087+0000","last_peered":"2024-02-15T22:58:25.926087+0000","last_clean":"2024-02-15T22:58:25.926087+0000","last_became_active":"2024-02-15T22:55:57.671130+0000","last_became_peered":"2024-02-15T22:55:57.671130+0000","last_unstale":"2024-02-15T22:58:25.926087+0000","last_undegraded":"2024-02-15T22:58:25.926087+0000","last_fullsized":"2024-02-15T22:58:25.926087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.925997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.925997+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.925997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:51.947906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.386100+0000","last_change":"2024-02-15T22:58:33.386127+0000","last_active":"2024-02-15T22:58:33.386100+0000","last_peered":"2024-02-15T22:58:33.386100+0000","last_clean":"2024-02-15T22:58:33.386100+0000","last_became_active":"2024-02-15T22:56:03.699598+0000","last_became_peered":"2024-02-15T22:56:03.699598+0000","last_unstale":"2024-02-15T22:58:33.386100+0000","last_undegraded":"2024-02-15T22:58:33.386100+0000","last_fullsized":"2024-02-15T22:58:33.386100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:33.385993+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:33.385993+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.385993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:03:57.567548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.962853+0000","last_change":"2024-02-15T22:58:05.962853+0000","last_active":"2024-02-15T22:58:05.962853+0000","last_peered":"2024-02-15T22:58:05.962853+0000","last_clean":"2024-02-15T22:58:05.962853+0000","last_became_active":"2024-02-15T22:56:07.704107+0000","last_became_peered":"2024-02-15T22:56:07.704107+0000","last_unstale":"2024-02-15T22:58:05.962853+0000","last_undegraded":"2024-02-15T22:58:05.962853+0000","last_fullsized":"2024-02-15T22:58:05.962853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:05.962670+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:05.962670+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.962670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:35.552053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.972000+0000","last_change":"2024-02-15T22:57:58.972000+0000","last_active":"2024-02-15T22:57:58.972000+0000","last_peered":"2024-02-15T22:57:58.972000+0000","last_clean":"2024-02-15T22:57:58.972000+0000","last_became_active":"2024-02-15T22:56:09.711494+0000","last_became_peered":"2024-02-15T22:56:09.711494+0000","last_unstale":"2024-02-15T22:57:58.972000+0000","last_undegraded":"2024-02-15T22:57:58.972000+0000","last_fullsized":"2024-02-15T22:57:58.972000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-02-15T22:57:58.971860+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-02-15T22:57:58.971860+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.971860+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:36:02.170038+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.345803+0000","last_change":"2024-02-15T22:57:47.345803+0000","last_active":"2024-02-15T22:57:47.345803+0000","last_peered":"2024-02-15T22:57:47.345803+0000","last_clean":"2024-02-15T22:57:47.345803+0000","last_became_active":"2024-02-15T22:56:11.722277+0000","last_became_peered":"2024-02-15T22:56:11.722277+0000","last_unstale":"2024-02-15T22:57:47.345803+0000","last_undegraded":"2024-02-15T22:57:47.345803+0000","last_fullsized":"2024-02-15T22:57:47.345803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.345669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.345669+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.345669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:53:30.201838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.154491+0000","last_change":"2024-02-15T22:58:25.154491+0000","last_active":"2024-02-15T22:58:25.154491+0000","last_peered":"2024-02-15T22:58:25.154491+0000","last_clean":"2024-02-15T22:58:25.154491+0000","last_became_active":"2024-02-15T22:56:13.726165+0000","last_became_peered":"2024-02-15T22:56:13.726165+0000","last_unstale":"2024-02-15T22:58:25.154491+0000","last_undegraded":"2024-02-15T22:58:25.154491+0000","last_fullsized":"2024-02-15T22:58:25.154491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.154393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.154393+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.154393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:00:50.346134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.355105+0000","last_change":"2024-02-15T22:58:32.355136+0000","last_active":"2024-02-15T22:58:32.355105+0000","last_peered":"2024-02-15T22:58:32.355105+0000","last_clean":"2024-02-15T22:58:32.355105+0000","last_became_active":"2024-02-15T22:56:05.707171+0000","last_became_peered":"2024-02-15T22:56:05.707171+0000","last_unstale":"2024-02-15T22:58:32.355105+0000","last_undegraded":"2024-02-15T22:58:32.355105+0000","last_fullsized":"2024-02-15T22:58:32.355105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:32.355014+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:32.355014+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.355014+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:45.736925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:00.222031+0000","last_change":"2024-02-15T22:59:00.222060+0000","last_active":"2024-02-15T22:59:00.222031+0000","last_peered":"2024-02-15T22:59:00.222031+0000","last_clean":"2024-02-15T22:59:00.222031+0000","last_became_active":"2024-02-15T22:55:57.672268+0000","last_became_peered":"2024-02-15T22:55:57.672268+0000","last_unstale":"2024-02-15T22:59:00.222031+0000","last_undegraded":"2024-02-15T22:59:00.222031+0000","last_fullsized":"2024-02-15T22:59:00.222031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:00.221899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:00.221899+0000","last_clean_scrub_stamp":"2024-02-15T22:59:00.221899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:56:05.029478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.861421+0000","last_change":"2024-02-15T22:58:31.861445+0000","last_active":"2024-02-15T22:58:31.861421+0000","last_peered":"2024-02-15T22:58:31.861421+0000","last_clean":"2024-02-15T22:58:31.861421+0000","last_became_active":"2024-02-15T22:56:03.693487+0000","last_became_peered":"2024-02-15T22:56:03.693487+0000","last_unstale":"2024-02-15T22:58:31.861421+0000","last_undegraded":"2024-02-15T22:58:31.861421+0000","last_fullsized":"2024-02-15T22:58:31.861421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:31.861328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:31.861328+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.861328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:26.592205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.228589+0000","last_change":"2024-02-15T22:58:06.228589+0000","last_active":"2024-02-15T22:58:06.228589+0000","last_peered":"2024-02-15T22:58:06.228589+0000","last_clean":"2024-02-15T22:58:06.228589+0000","last_became_active":"2024-02-15T22:56:07.707227+0000","last_became_peered":"2024-02-15T22:56:07.707227+0000","last_unstale":"2024-02-15T22:58:06.228589+0000","last_undegraded":"2024-02-15T22:58:06.228589+0000","last_fullsized":"2024-02-15T22:58:06.228589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:06.228482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:06.228482+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.228482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:24:36.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.146475+0000","last_change":"2024-02-15T22:58:18.146475+0000","last_active":"2024-02-15T22:58:18.146475+0000","last_peered":"2024-02-15T22:58:18.146475+0000","last_clean":"2024-02-15T22:58:18.146475+0000","last_became_active":"2024-02-15T22:56:09.719999+0000","last_became_peered":"2024-02-15T22:56:09.719999+0000","last_unstale":"2024-02-15T22:58:18.146475+0000","last_undegraded":"2024-02-15T22:58:18.146475+0000","last_fullsized":"2024-02-15T22:58:18.146475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-02-15T22:58:18.146343+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-02-15T22:58:18.146343+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.146343+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:46:00.908693+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.141146+0000","last_change":"2024-02-15T22:58:14.141146+0000","last_active":"2024-02-15T22:58:14.141146+0000","last_peered":"2024-02-15T22:58:14.141146+0000","last_clean":"2024-02-15T22:58:14.141146+0000","last_became_active":"2024-02-15T22:56:11.723718+0000","last_became_peered":"2024-02-15T22:56:11.723718+0000","last_unstale":"2024-02-15T22:58:14.141146+0000","last_undegraded":"2024-02-15T22:58:14.141146+0000","last_fullsized":"2024-02-15T22:58:14.141146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:14.141029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:14.141029+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.141029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:54:12.738246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.889819+0000","last_change":"2024-02-15T22:58:39.889864+0000","last_active":"2024-02-15T22:58:39.889819+0000","last_peered":"2024-02-15T22:58:39.889819+0000","last_clean":"2024-02-15T22:58:39.889819+0000","last_became_active":"2024-02-15T22:56:13.730551+0000","last_became_peered":"2024-02-15T22:56:13.730551+0000","last_unstale":"2024-02-15T22:58:39.889819+0000","last_undegraded":"2024-02-15T22:58:39.889819+0000","last_fullsized":"2024-02-15T22:58:39.889819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:39.889725+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:39.889725+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.889725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:50.902696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.886211+0000","last_change":"2024-02-15T22:58:07.886211+0000","last_active":"2024-02-15T22:58:07.886211+0000","last_peered":"2024-02-15T22:58:07.886211+0000","last_clean":"2024-02-15T22:58:07.886211+0000","last_became_active":"2024-02-15T22:56:05.714389+0000","last_became_peered":"2024-02-15T22:56:05.714389+0000","last_unstale":"2024-02-15T22:58:07.886211+0000","last_undegraded":"2024-02-15T22:58:07.886211+0000","last_fullsized":"2024-02-15T22:58:07.886211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:07.886088+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:07.886088+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.886088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:31.251765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.952076+0000","last_change":"2024-02-15T22:58:28.952099+0000","last_active":"2024-02-15T22:58:28.952076+0000","last_peered":"2024-02-15T22:58:28.952076+0000","last_clean":"2024-02-15T22:58:28.952076+0000","last_became_active":"2024-02-15T22:56:03.693005+0000","last_became_peered":"2024-02-15T22:56:03.693005+0000","last_unstale":"2024-02-15T22:58:28.952076+0000","last_undegraded":"2024-02-15T22:58:28.952076+0000","last_fullsized":"2024-02-15T22:58:28.952076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:28.951988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:28.951988+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.951988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:34.947773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.360612+0000","last_change":"2024-02-15T22:58:35.360642+0000","last_active":"2024-02-15T22:58:35.360612+0000","last_peered":"2024-02-15T22:58:35.360612+0000","last_clean":"2024-02-15T22:58:35.360612+0000","last_became_active":"2024-02-15T22:55:57.671524+0000","last_became_peered":"2024-02-15T22:55:57.671524+0000","last_unstale":"2024-02-15T22:58:35.360612+0000","last_undegraded":"2024-02-15T22:58:35.360612+0000","last_fullsized":"2024-02-15T22:58:35.360612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:35.360528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:35.360528+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.360528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:16:02.723261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.254714+0000","last_change":"2024-02-15T22:58:03.254714+0000","last_active":"2024-02-15T22:58:03.254714+0000","last_peered":"2024-02-15T22:58:03.254714+0000","last_clean":"2024-02-15T22:58:03.254714+0000","last_became_active":"2024-02-15T22:56:07.707281+0000","last_became_peered":"2024-02-15T22:56:07.707281+0000","last_unstale":"2024-02-15T22:58:03.254714+0000","last_undegraded":"2024-02-15T22:58:03.254714+0000","last_fullsized":"2024-02-15T22:58:03.254714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:03.254575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:03.254575+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.254575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:31.078756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.385601+0000","last_change":"2024-02-15T22:57:55.385601+0000","last_active":"2024-02-15T22:57:55.385601+0000","last_peered":"2024-02-15T22:57:55.385601+0000","last_clean":"2024-02-15T22:57:55.385601+0000","last_became_active":"2024-02-15T22:56:09.717692+0000","last_became_peered":"2024-02-15T22:56:09.717692+0000","last_unstale":"2024-02-15T22:57:55.385601+0000","last_undegraded":"2024-02-15T22:57:55.385601+0000","last_fullsized":"2024-02-15T22:57:55.385601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-02-15T22:57:55.385469+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-02-15T22:57:55.385469+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.385469+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:24.974853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.917439+0000","last_change":"2024-02-15T22:57:49.917439+0000","last_active":"2024-02-15T22:57:49.917439+0000","last_peered":"2024-02-15T22:57:49.917439+0000","last_clean":"2024-02-15T22:57:49.917439+0000","last_became_active":"2024-02-15T22:56:11.718332+0000","last_became_peered":"2024-02-15T22:56:11.718332+0000","last_unstale":"2024-02-15T22:57:49.917439+0000","last_undegraded":"2024-02-15T22:57:49.917439+0000","last_fullsized":"2024-02-15T22:57:49.917439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.917248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.917248+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.917248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:48.180880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.184633+0000","last_change":"2024-02-15T22:58:08.184633+0000","last_active":"2024-02-15T22:58:08.184633+0000","last_peered":"2024-02-15T22:58:08.184633+0000","last_clean":"2024-02-15T22:58:08.184633+0000","last_became_active":"2024-02-15T22:56:13.723512+0000","last_became_peered":"2024-02-15T22:56:13.723512+0000","last_unstale":"2024-02-15T22:58:08.184633+0000","last_undegraded":"2024-02-15T22:58:08.184633+0000","last_fullsized":"2024-02-15T22:58:08.184633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-02-15T22:58:08.184528+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-02-15T22:58:08.184528+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.184528+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:33.363968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.905431+0000","last_change":"2024-02-15T22:58:38.905461+0000","last_active":"2024-02-15T22:58:38.905431+0000","last_peered":"2024-02-15T22:58:38.905431+0000","last_clean":"2024-02-15T22:58:38.905431+0000","last_became_active":"2024-02-15T22:56:05.713036+0000","last_became_peered":"2024-02-15T22:56:05.713036+0000","last_unstale":"2024-02-15T22:58:38.905431+0000","last_undegraded":"2024-02-15T22:58:38.905431+0000","last_fullsized":"2024-02-15T22:58:38.905431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:38.905348+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:38.905348+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.905348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:54:37.502566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.358592+0000","last_change":"2024-02-15T22:58:40.358643+0000","last_active":"2024-02-15T22:58:40.358592+0000","last_peered":"2024-02-15T22:58:40.358592+0000","last_clean":"2024-02-15T22:58:40.358592+0000","last_became_active":"2024-02-15T22:56:03.699564+0000","last_became_peered":"2024-02-15T22:56:03.699564+0000","last_unstale":"2024-02-15T22:58:40.358592+0000","last_undegraded":"2024-02-15T22:58:40.358592+0000","last_fullsized":"2024-02-15T22:58:40.358592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:40.358505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:40.358505+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.358505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:56:17.281060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:59.196819+0000","last_change":"2024-02-15T22:58:59.196870+0000","last_active":"2024-02-15T22:58:59.196819+0000","last_peered":"2024-02-15T22:58:59.196819+0000","last_clean":"2024-02-15T22:58:59.196819+0000","last_became_active":"2024-02-15T22:55:57.672053+0000","last_became_peered":"2024-02-15T22:55:57.672053+0000","last_unstale":"2024-02-15T22:58:59.196819+0000","last_undegraded":"2024-02-15T22:58:59.196819+0000","last_fullsized":"2024-02-15T22:58:59.196819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:59.196699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:59.196699+0000","last_clean_scrub_stamp":"2024-02-15T22:58:59.196699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:41:21.846177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372046+0000","last_change":"2024-02-15T22:56:45.893645+0000","last_active":"2024-02-15T22:57:47.372046+0000","last_peered":"2024-02-15T22:57:47.372046+0000","last_clean":"2024-02-15T22:57:47.372046+0000","last_became_active":"2024-02-15T22:56:45.893109+0000","last_became_peered":"2024-02-15T22:56:45.893109+0000","last_unstale":"2024-02-15T22:57:47.372046+0000","last_undegraded":"2024-02-15T22:57:47.372046+0000","last_fullsized":"2024-02-15T22:57:47.372046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:06.687025+0000","last_clean_scrub_stamp":"2024-02-15T22:56:06.687025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.859195+0000","last_change":"2024-02-15T22:57:49.859195+0000","last_active":"2024-02-15T22:57:49.859195+0000","last_peered":"2024-02-15T22:57:49.859195+0000","last_clean":"2024-02-15T22:57:49.859195+0000","last_became_active":"2024-02-15T22:56:09.721140+0000","last_became_peered":"2024-02-15T22:56:09.721140+0000","last_unstale":"2024-02-15T22:57:49.859195+0000","last_undegraded":"2024-02-15T22:57:49.859195+0000","last_fullsized":"2024-02-15T22:57:49.859195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-02-15T22:57:49.859068+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-02-15T22:57:49.859068+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.859068+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:24:17.693114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":290,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.831746+0000","last_change":"2024-02-15T22:57:48.831746+0000","last_active":"2024-02-15T22:57:48.831746+0000","last_peered":"2024-02-15T22:57:48.831746+0000","last_clean":"2024-02-15T22:57:48.831746+0000","last_became_active":"2024-02-15T22:56:11.717544+0000","last_became_peered":"2024-02-15T22:56:11.717544+0000","last_unstale":"2024-02-15T22:57:48.831746+0000","last_undegraded":"2024-02-15T22:57:48.831746+0000","last_fullsized":"2024-02-15T22:57:48.831746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:48.831614+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:48.831614+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.831614+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:25.818844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:41.175420+0000","last_change":"2024-02-15T22:58:41.175444+0000","last_active":"2024-02-15T22:58:41.175420+0000","last_peered":"2024-02-15T22:58:41.175420+0000","last_clean":"2024-02-15T22:58:41.175420+0000","last_became_active":"2024-02-15T22:56:13.728228+0000","last_became_peered":"2024-02-15T22:56:13.728228+0000","last_unstale":"2024-02-15T22:58:41.175420+0000","last_undegraded":"2024-02-15T22:58:41.175420+0000","last_fullsized":"2024-02-15T22:58:41.175420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:41.175331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:41.175331+0000","last_clean_scrub_stamp":"2024-02-15T22:58:41.175331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:05:22.295896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.164396+0000","last_change":"2024-02-15T22:58:06.164425+0000","last_active":"2024-02-15T22:58:06.164396+0000","last_peered":"2024-02-15T22:58:06.164396+0000","last_clean":"2024-02-15T22:58:06.164396+0000","last_became_active":"2024-02-15T22:56:05.710924+0000","last_became_peered":"2024-02-15T22:56:05.710924+0000","last_unstale":"2024-02-15T22:58:06.164396+0000","last_undegraded":"2024-02-15T22:58:06.164396+0000","last_fullsized":"2024-02-15T22:58:06.164396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:06.164305+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:06.164305+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.164305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:46.445946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:54.159559+0000","last_change":"2024-02-15T22:58:54.159619+0000","last_active":"2024-02-15T22:58:54.159559+0000","last_peered":"2024-02-15T22:58:54.159559+0000","last_clean":"2024-02-15T22:58:54.159559+0000","last_became_active":"2024-02-15T22:56:03.695921+0000","last_became_peered":"2024-02-15T22:56:03.695921+0000","last_unstale":"2024-02-15T22:58:54.159559+0000","last_undegraded":"2024-02-15T22:58:54.159559+0000","last_fullsized":"2024-02-15T22:58:54.159559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:54.159435+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:54.159435+0000","last_clean_scrub_stamp":"2024-02-15T22:58:54.159435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:30:26.662932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.343375+0000","last_change":"2024-02-15T22:58:34.343403+0000","last_active":"2024-02-15T22:58:34.343375+0000","last_peered":"2024-02-15T22:58:34.343375+0000","last_clean":"2024-02-15T22:58:34.343375+0000","last_became_active":"2024-02-15T22:55:57.671257+0000","last_became_peered":"2024-02-15T22:55:57.671257+0000","last_unstale":"2024-02-15T22:58:34.343375+0000","last_undegraded":"2024-02-15T22:58:34.343375+0000","last_fullsized":"2024-02-15T22:58:34.343375+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:34.343288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:34.343288+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.343288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:20.945858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.993271+0000","last_change":"2024-02-15T22:57:53.993271+0000","last_active":"2024-02-15T22:57:53.993271+0000","last_peered":"2024-02-15T22:57:53.993271+0000","last_clean":"2024-02-15T22:57:53.993271+0000","last_became_active":"2024-02-15T22:56:07.705323+0000","last_became_peered":"2024-02-15T22:56:07.705323+0000","last_unstale":"2024-02-15T22:57:53.993271+0000","last_undegraded":"2024-02-15T22:57:53.993271+0000","last_fullsized":"2024-02-15T22:57:53.993271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:53.993161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:53.993161+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.993161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:37.548413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.097818+0000","last_change":"2024-02-15T22:58:16.097856+0000","last_active":"2024-02-15T22:58:16.097818+0000","last_peered":"2024-02-15T22:58:16.097818+0000","last_clean":"2024-02-15T22:58:16.097818+0000","last_became_active":"2024-02-15T22:56:09.729131+0000","last_became_peered":"2024-02-15T22:56:09.729131+0000","last_unstale":"2024-02-15T22:58:16.097818+0000","last_undegraded":"2024-02-15T22:58:16.097818+0000","last_fullsized":"2024-02-15T22:58:16.097818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-15T22:58:16.097737+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-15T22:58:16.097737+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.097737+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:35:13.613365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":323,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.400056+0000","last_change":"2024-02-15T22:57:51.400056+0000","last_active":"2024-02-15T22:57:51.400056+0000","last_peered":"2024-02-15T22:57:51.400056+0000","last_clean":"2024-02-15T22:57:51.400056+0000","last_became_active":"2024-02-15T22:56:11.719685+0000","last_became_peered":"2024-02-15T22:56:11.719685+0000","last_unstale":"2024-02-15T22:57:51.400056+0000","last_undegraded":"2024-02-15T22:57:51.400056+0000","last_fullsized":"2024-02-15T22:57:51.400056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:51.399947+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:51.399947+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.399947+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:14.785659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.892686+0000","last_change":"2024-02-15T22:58:12.892686+0000","last_active":"2024-02-15T22:58:12.892686+0000","last_peered":"2024-02-15T22:58:12.892686+0000","last_clean":"2024-02-15T22:58:12.892686+0000","last_became_active":"2024-02-15T22:56:13.730494+0000","last_became_peered":"2024-02-15T22:56:13.730494+0000","last_unstale":"2024-02-15T22:58:12.892686+0000","last_undegraded":"2024-02-15T22:58:12.892686+0000","last_fullsized":"2024-02-15T22:58:12.892686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-15T22:58:12.892569+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-15T22:58:12.892569+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.892569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:13.313696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.895931+0000","last_change":"2024-02-15T22:58:21.895961+0000","last_active":"2024-02-15T22:58:21.895931+0000","last_peered":"2024-02-15T22:58:21.895931+0000","last_clean":"2024-02-15T22:58:21.895931+0000","last_became_active":"2024-02-15T22:56:05.705764+0000","last_became_peered":"2024-02-15T22:56:05.705764+0000","last_unstale":"2024-02-15T22:58:21.895931+0000","last_undegraded":"2024-02-15T22:58:21.895931+0000","last_fullsized":"2024-02-15T22:58:21.895931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:21.895840+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:21.895840+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.895840+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:12.132052+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.912018+0000","last_change":"2024-02-15T22:58:25.912041+0000","last_active":"2024-02-15T22:58:25.912018+0000","last_peered":"2024-02-15T22:58:25.912018+0000","last_clean":"2024-02-15T22:58:25.912018+0000","last_became_active":"2024-02-15T22:56:03.705783+0000","last_became_peered":"2024-02-15T22:56:03.705783+0000","last_unstale":"2024-02-15T22:58:25.912018+0000","last_undegraded":"2024-02-15T22:58:25.912018+0000","last_fullsized":"2024-02-15T22:58:25.912018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.911921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.911921+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.911921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:49.453839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:03.192710+0000","last_change":"2024-02-15T22:59:03.192735+0000","last_active":"2024-02-15T22:59:03.192710+0000","last_peered":"2024-02-15T22:59:03.192710+0000","last_clean":"2024-02-15T22:59:03.192710+0000","last_became_active":"2024-02-15T22:55:57.853714+0000","last_became_peered":"2024-02-15T22:55:57.853714+0000","last_unstale":"2024-02-15T22:59:03.192710+0000","last_undegraded":"2024-02-15T22:59:03.192710+0000","last_fullsized":"2024-02-15T22:59:03.192710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:03.192622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:03.192622+0000","last_clean_scrub_stamp":"2024-02-15T22:59:03.192622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:50:57.415025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.020401+0000","last_change":"2024-02-15T22:57:58.020401+0000","last_active":"2024-02-15T22:57:58.020401+0000","last_peered":"2024-02-15T22:57:58.020401+0000","last_clean":"2024-02-15T22:57:58.020401+0000","last_became_active":"2024-02-15T22:56:07.705013+0000","last_became_peered":"2024-02-15T22:56:07.705013+0000","last_unstale":"2024-02-15T22:57:58.020401+0000","last_undegraded":"2024-02-15T22:57:58.020401+0000","last_fullsized":"2024-02-15T22:57:58.020401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:58.020263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:58.020263+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.020263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:46.435941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.962295+0000","last_change":"2024-02-15T22:57:53.962295+0000","last_active":"2024-02-15T22:57:53.962295+0000","last_peered":"2024-02-15T22:57:53.962295+0000","last_clean":"2024-02-15T22:57:53.962295+0000","last_became_active":"2024-02-15T22:56:09.719916+0000","last_became_peered":"2024-02-15T22:56:09.719916+0000","last_unstale":"2024-02-15T22:57:53.962295+0000","last_undegraded":"2024-02-15T22:57:53.962295+0000","last_fullsized":"2024-02-15T22:57:53.962295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-02-15T22:57:53.962112+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-02-15T22:57:53.962112+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.962112+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:13:33.384008+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.358256+0000","last_change":"2024-02-15T22:57:54.358256+0000","last_active":"2024-02-15T22:57:54.358256+0000","last_peered":"2024-02-15T22:57:54.358256+0000","last_clean":"2024-02-15T22:57:54.358256+0000","last_became_active":"2024-02-15T22:56:11.717758+0000","last_became_peered":"2024-02-15T22:56:11.717758+0000","last_unstale":"2024-02-15T22:57:54.358256+0000","last_undegraded":"2024-02-15T22:57:54.358256+0000","last_fullsized":"2024-02-15T22:57:54.358256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:54.358148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:54.358148+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.358148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:29.880821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.851752+0000","last_change":"2024-02-15T22:58:35.851776+0000","last_active":"2024-02-15T22:58:35.851752+0000","last_peered":"2024-02-15T22:58:35.851752+0000","last_clean":"2024-02-15T22:58:35.851752+0000","last_became_active":"2024-02-15T22:56:13.732325+0000","last_became_peered":"2024-02-15T22:56:13.732325+0000","last_unstale":"2024-02-15T22:58:35.851752+0000","last_undegraded":"2024-02-15T22:58:35.851752+0000","last_fullsized":"2024-02-15T22:58:35.851752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:35.851664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:35.851664+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.851664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:32:35.470507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.926533+0000","last_change":"2024-02-15T22:58:07.926533+0000","last_active":"2024-02-15T22:58:07.926533+0000","last_peered":"2024-02-15T22:58:07.926533+0000","last_clean":"2024-02-15T22:58:07.926533+0000","last_became_active":"2024-02-15T22:56:13.732216+0000","last_became_peered":"2024-02-15T22:56:13.732216+0000","last_unstale":"2024-02-15T22:58:07.926533+0000","last_undegraded":"2024-02-15T22:58:07.926533+0000","last_fullsized":"2024-02-15T22:58:07.926533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.926378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.926378+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.926378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:00.958886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.897351+0000","last_change":"2024-02-15T22:58:19.897351+0000","last_active":"2024-02-15T22:58:19.897351+0000","last_peered":"2024-02-15T22:58:19.897351+0000","last_clean":"2024-02-15T22:58:19.897351+0000","last_became_active":"2024-02-15T22:56:05.704959+0000","last_became_peered":"2024-02-15T22:56:05.704959+0000","last_unstale":"2024-02-15T22:58:19.897351+0000","last_undegraded":"2024-02-15T22:58:19.897351+0000","last_fullsized":"2024-02-15T22:58:19.897351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:19.897173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:19.897173+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.897173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:28:13.350809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:53.190108+0000","last_change":"2024-02-15T22:58:53.190133+0000","last_active":"2024-02-15T22:58:53.190108+0000","last_peered":"2024-02-15T22:58:53.190108+0000","last_clean":"2024-02-15T22:58:53.190108+0000","last_became_active":"2024-02-15T22:56:03.705176+0000","last_became_peered":"2024-02-15T22:56:03.705176+0000","last_unstale":"2024-02-15T22:58:53.190108+0000","last_undegraded":"2024-02-15T22:58:53.190108+0000","last_fullsized":"2024-02-15T22:58:53.190108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:53.190019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:53.190019+0000","last_clean_scrub_stamp":"2024-02-15T22:58:53.190019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:42:21.245324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.818396+0000","last_change":"2024-02-15T22:58:02.818396+0000","last_active":"2024-02-15T22:58:02.818396+0000","last_peered":"2024-02-15T22:58:02.818396+0000","last_clean":"2024-02-15T22:58:02.818396+0000","last_became_active":"2024-02-15T22:56:07.703060+0000","last_became_peered":"2024-02-15T22:56:07.703060+0000","last_unstale":"2024-02-15T22:58:02.818396+0000","last_undegraded":"2024-02-15T22:58:02.818396+0000","last_fullsized":"2024-02-15T22:58:02.818396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:02.818259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:02.818259+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.818259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:34.242902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.172307+0000","last_change":"2024-02-15T22:58:19.172307+0000","last_active":"2024-02-15T22:58:19.172307+0000","last_peered":"2024-02-15T22:58:19.172307+0000","last_clean":"2024-02-15T22:58:19.172307+0000","last_became_active":"2024-02-15T22:56:09.720627+0000","last_became_peered":"2024-02-15T22:56:09.720627+0000","last_unstale":"2024-02-15T22:58:19.172307+0000","last_undegraded":"2024-02-15T22:58:19.172307+0000","last_fullsized":"2024-02-15T22:58:19.172307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-15T22:58:19.172190+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-15T22:58:19.172190+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.172190+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:17.898821+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.182843+0000","last_change":"2024-02-15T22:58:12.182843+0000","last_active":"2024-02-15T22:58:12.182843+0000","last_peered":"2024-02-15T22:58:12.182843+0000","last_clean":"2024-02-15T22:58:12.182843+0000","last_became_active":"2024-02-15T22:56:11.724592+0000","last_became_peered":"2024-02-15T22:56:11.724592+0000","last_unstale":"2024-02-15T22:58:12.182843+0000","last_undegraded":"2024-02-15T22:58:12.182843+0000","last_fullsized":"2024-02-15T22:58:12.182843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.182689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.182689+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.182689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:17:50.255923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:43.398046+0000","last_change":"2024-02-15T22:58:43.398078+0000","last_active":"2024-02-15T22:58:43.398046+0000","last_peered":"2024-02-15T22:58:43.398046+0000","last_clean":"2024-02-15T22:58:43.398046+0000","last_became_active":"2024-02-15T22:56:13.729931+0000","last_became_peered":"2024-02-15T22:56:13.729931+0000","last_unstale":"2024-02-15T22:58:43.398046+0000","last_undegraded":"2024-02-15T22:58:43.398046+0000","last_fullsized":"2024-02-15T22:58:43.398046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:43.397960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:43.397960+0000","last_clean_scrub_stamp":"2024-02-15T22:58:43.397960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:19.186513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.873645+0000","last_change":"2024-02-15T22:58:10.873645+0000","last_active":"2024-02-15T22:58:10.873645+0000","last_peered":"2024-02-15T22:58:10.873645+0000","last_clean":"2024-02-15T22:58:10.873645+0000","last_became_active":"2024-02-15T22:56:05.714024+0000","last_became_peered":"2024-02-15T22:56:05.714024+0000","last_unstale":"2024-02-15T22:58:10.873645+0000","last_undegraded":"2024-02-15T22:58:10.873645+0000","last_fullsized":"2024-02-15T22:58:10.873645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:10.873523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:10.873523+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.873523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:35.471679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.861301+0000","last_change":"2024-02-15T22:58:32.861325+0000","last_active":"2024-02-15T22:58:32.861301+0000","last_peered":"2024-02-15T22:58:32.861301+0000","last_clean":"2024-02-15T22:58:32.861301+0000","last_became_active":"2024-02-15T22:56:03.695339+0000","last_became_peered":"2024-02-15T22:56:03.695339+0000","last_unstale":"2024-02-15T22:58:32.861301+0000","last_undegraded":"2024-02-15T22:58:32.861301+0000","last_fullsized":"2024-02-15T22:58:32.861301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:32.861212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:32.861212+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.861212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:38.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.932729+0000","last_change":"2024-02-15T22:57:49.932729+0000","last_active":"2024-02-15T22:57:49.932729+0000","last_peered":"2024-02-15T22:57:49.932729+0000","last_clean":"2024-02-15T22:57:49.932729+0000","last_became_active":"2024-02-15T22:56:07.708692+0000","last_became_peered":"2024-02-15T22:56:07.708692+0000","last_unstale":"2024-02-15T22:57:49.932729+0000","last_undegraded":"2024-02-15T22:57:49.932729+0000","last_fullsized":"2024-02-15T22:57:49.932729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.932578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.932578+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.932578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:19:08.744146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.213042+0000","last_change":"2024-02-15T22:58:02.213042+0000","last_active":"2024-02-15T22:58:02.213042+0000","last_peered":"2024-02-15T22:58:02.213042+0000","last_clean":"2024-02-15T22:58:02.213042+0000","last_became_active":"2024-02-15T22:56:09.710942+0000","last_became_peered":"2024-02-15T22:56:09.710942+0000","last_unstale":"2024-02-15T22:58:02.213042+0000","last_undegraded":"2024-02-15T22:58:02.213042+0000","last_fullsized":"2024-02-15T22:58:02.213042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:02.212917+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:02.212917+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.212917+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:41.461653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.958962+0000","last_change":"2024-02-15T22:57:55.958962+0000","last_active":"2024-02-15T22:57:55.958962+0000","last_peered":"2024-02-15T22:57:55.958962+0000","last_clean":"2024-02-15T22:57:55.958962+0000","last_became_active":"2024-02-15T22:56:11.724533+0000","last_became_peered":"2024-02-15T22:56:11.724533+0000","last_unstale":"2024-02-15T22:57:55.958962+0000","last_undegraded":"2024-02-15T22:57:55.958962+0000","last_fullsized":"2024-02-15T22:57:55.958962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:55.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:55.958822+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:16:29.483298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:45.343807+0000","last_change":"2024-02-15T22:58:45.343831+0000","last_active":"2024-02-15T22:58:45.343807+0000","last_peered":"2024-02-15T22:58:45.343807+0000","last_clean":"2024-02-15T22:58:45.343807+0000","last_became_active":"2024-02-15T22:56:13.734428+0000","last_became_peered":"2024-02-15T22:56:13.734428+0000","last_unstale":"2024-02-15T22:58:45.343807+0000","last_undegraded":"2024-02-15T22:58:45.343807+0000","last_fullsized":"2024-02-15T22:58:45.343807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:45.343720+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:45.343720+0000","last_clean_scrub_stamp":"2024-02-15T22:58:45.343720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:29.928656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.301512+0000","last_change":"2024-02-15T22:58:26.301512+0000","last_active":"2024-02-15T22:58:26.301512+0000","last_peered":"2024-02-15T22:58:26.301512+0000","last_clean":"2024-02-15T22:58:26.301512+0000","last_became_active":"2024-02-15T22:56:05.705385+0000","last_became_peered":"2024-02-15T22:56:05.705385+0000","last_unstale":"2024-02-15T22:58:26.301512+0000","last_undegraded":"2024-02-15T22:58:26.301512+0000","last_fullsized":"2024-02-15T22:58:26.301512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:26.301369+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:26.301369+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.301369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:12:22.024986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.928974+0000","last_change":"2024-02-15T22:58:16.928974+0000","last_active":"2024-02-15T22:58:16.928974+0000","last_peered":"2024-02-15T22:58:16.928974+0000","last_clean":"2024-02-15T22:58:16.928974+0000","last_became_active":"2024-02-15T22:56:03.699626+0000","last_became_peered":"2024-02-15T22:56:03.699626+0000","last_unstale":"2024-02-15T22:58:16.928974+0000","last_undegraded":"2024-02-15T22:58:16.928974+0000","last_fullsized":"2024-02-15T22:58:16.928974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:16.928864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:16.928864+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.928864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:26.875704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.924988+0000","last_change":"2024-02-15T22:58:04.924988+0000","last_active":"2024-02-15T22:58:04.924988+0000","last_peered":"2024-02-15T22:58:04.924988+0000","last_clean":"2024-02-15T22:58:04.924988+0000","last_became_active":"2024-02-15T22:56:07.705705+0000","last_became_peered":"2024-02-15T22:56:07.705705+0000","last_unstale":"2024-02-15T22:58:04.924988+0000","last_undegraded":"2024-02-15T22:58:04.924988+0000","last_fullsized":"2024-02-15T22:58:04.924988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:04.924869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:04.924869+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.924869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:40.447542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'41","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.256585+0000","last_change":"2024-02-15T22:58:01.256585+0000","last_active":"2024-02-15T22:58:01.256585+0000","last_peered":"2024-02-15T22:58:01.256585+0000","last_clean":"2024-02-15T22:58:01.256585+0000","last_became_active":"2024-02-15T22:56:09.712337+0000","last_became_peered":"2024-02-15T22:56:09.712337+0000","last_unstale":"2024-02-15T22:58:01.256585+0000","last_undegraded":"2024-02-15T22:58:01.256585+0000","last_fullsized":"2024-02-15T22:58:01.256585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-02-15T22:58:01.256409+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-02-15T22:58:01.256409+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.256409+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:16.356268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.870103+0000","last_change":"2024-02-15T22:57:47.870103+0000","last_active":"2024-02-15T22:57:47.870103+0000","last_peered":"2024-02-15T22:57:47.870103+0000","last_clean":"2024-02-15T22:57:47.870103+0000","last_became_active":"2024-02-15T22:56:11.715697+0000","last_became_peered":"2024-02-15T22:56:11.715697+0000","last_unstale":"2024-02-15T22:57:47.870103+0000","last_undegraded":"2024-02-15T22:57:47.870103+0000","last_fullsized":"2024-02-15T22:57:47.870103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.869954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.869954+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.869954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:54.471463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372691+0000","last_change":"2024-02-15T22:56:13.734867+0000","last_active":"2024-02-15T22:57:47.372691+0000","last_peered":"2024-02-15T22:57:47.372691+0000","last_clean":"2024-02-15T22:57:47.372691+0000","last_became_active":"2024-02-15T22:56:13.734565+0000","last_became_peered":"2024-02-15T22:56:13.734565+0000","last_unstale":"2024-02-15T22:57:47.372691+0000","last_undegraded":"2024-02-15T22:57:47.372691+0000","last_fullsized":"2024-02-15T22:57:47.372691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.177141+0000","last_change":"2024-02-15T22:58:08.177141+0000","last_active":"2024-02-15T22:58:08.177141+0000","last_peered":"2024-02-15T22:58:08.177141+0000","last_clean":"2024-02-15T22:58:08.177141+0000","last_became_active":"2024-02-15T22:56:05.710562+0000","last_became_peered":"2024-02-15T22:56:05.710562+0000","last_unstale":"2024-02-15T22:58:08.177141+0000","last_undegraded":"2024-02-15T22:58:08.177141+0000","last_fullsized":"2024-02-15T22:58:08.177141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:08.177027+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:08.177027+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.177027+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:26.352171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.843667+0000","last_change":"2024-02-15T22:58:35.843691+0000","last_active":"2024-02-15T22:58:35.843667+0000","last_peered":"2024-02-15T22:58:35.843667+0000","last_clean":"2024-02-15T22:58:35.843667+0000","last_became_active":"2024-02-15T22:56:03.696590+0000","last_became_peered":"2024-02-15T22:56:03.696590+0000","last_unstale":"2024-02-15T22:58:35.843667+0000","last_undegraded":"2024-02-15T22:58:35.843667+0000","last_fullsized":"2024-02-15T22:58:35.843667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:35.843557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:35.843557+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.843557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:20:16.450362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.041220+0000","last_change":"2024-02-15T22:57:56.041220+0000","last_active":"2024-02-15T22:57:56.041220+0000","last_peered":"2024-02-15T22:57:56.041220+0000","last_clean":"2024-02-15T22:57:56.041220+0000","last_became_active":"2024-02-15T22:56:07.705239+0000","last_became_peered":"2024-02-15T22:56:07.705239+0000","last_unstale":"2024-02-15T22:57:56.041220+0000","last_undegraded":"2024-02-15T22:57:56.041220+0000","last_fullsized":"2024-02-15T22:57:56.041220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.041105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.041105+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.041105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:22.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.989290+0000","last_change":"2024-02-15T22:58:00.989290+0000","last_active":"2024-02-15T22:58:00.989290+0000","last_peered":"2024-02-15T22:58:00.989290+0000","last_clean":"2024-02-15T22:58:00.989290+0000","last_became_active":"2024-02-15T22:56:09.710616+0000","last_became_peered":"2024-02-15T22:56:09.710616+0000","last_unstale":"2024-02-15T22:58:00.989290+0000","last_undegraded":"2024-02-15T22:58:00.989290+0000","last_fullsized":"2024-02-15T22:58:00.989290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:58:00.989160+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:58:00.989160+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.989160+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:16.633010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.881779+0000","last_change":"2024-02-15T22:57:48.881779+0000","last_active":"2024-02-15T22:57:48.881779+0000","last_peered":"2024-02-15T22:57:48.881779+0000","last_clean":"2024-02-15T22:57:48.881779+0000","last_became_active":"2024-02-15T22:56:11.718995+0000","last_became_peered":"2024-02-15T22:56:11.718995+0000","last_unstale":"2024-02-15T22:57:48.881779+0000","last_undegraded":"2024-02-15T22:57:48.881779+0000","last_fullsized":"2024-02-15T22:57:48.881779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:48.881655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:48.881655+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.881655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:00:14.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.179900+0000","last_change":"2024-02-15T22:58:38.179928+0000","last_active":"2024-02-15T22:58:38.179900+0000","last_peered":"2024-02-15T22:58:38.179900+0000","last_clean":"2024-02-15T22:58:38.179900+0000","last_became_active":"2024-02-15T22:56:05.699196+0000","last_became_peered":"2024-02-15T22:56:05.699196+0000","last_unstale":"2024-02-15T22:58:38.179900+0000","last_undegraded":"2024-02-15T22:58:38.179900+0000","last_fullsized":"2024-02-15T22:58:38.179900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:38.179767+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:38.179767+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.179767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:54:16.863075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'3","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:45.264206+0000","last_change":"2024-02-15T22:58:45.264248+0000","last_active":"2024-02-15T22:58:45.264206+0000","last_peered":"2024-02-15T22:58:45.264206+0000","last_clean":"2024-02-15T22:58:45.264206+0000","last_became_active":"2024-02-15T22:56:03.702007+0000","last_became_peered":"2024-02-15T22:56:03.702007+0000","last_unstale":"2024-02-15T22:58:45.264206+0000","last_undegraded":"2024-02-15T22:58:45.264206+0000","last_fullsized":"2024-02-15T22:58:45.264206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:58:45.264113+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:58:45.264113+0000","last_clean_scrub_stamp":"2024-02-15T22:58:45.264113+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:46.236878+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.277094+0000","last_change":"2024-02-15T22:58:05.277094+0000","last_active":"2024-02-15T22:58:05.277094+0000","last_peered":"2024-02-15T22:58:05.277094+0000","last_clean":"2024-02-15T22:58:05.277094+0000","last_became_active":"2024-02-15T22:56:07.707124+0000","last_became_peered":"2024-02-15T22:56:07.707124+0000","last_unstale":"2024-02-15T22:58:05.277094+0000","last_undegraded":"2024-02-15T22:58:05.277094+0000","last_fullsized":"2024-02-15T22:58:05.277094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:05.276922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:05.276922+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.276922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:55.491543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.341829+0000","last_change":"2024-02-15T22:57:59.341829+0000","last_active":"2024-02-15T22:57:59.341829+0000","last_peered":"2024-02-15T22:57:59.341829+0000","last_clean":"2024-02-15T22:57:59.341829+0000","last_became_active":"2024-02-15T22:56:09.713076+0000","last_became_peered":"2024-02-15T22:56:09.713076+0000","last_unstale":"2024-02-15T22:57:59.341829+0000","last_undegraded":"2024-02-15T22:57:59.341829+0000","last_fullsized":"2024-02-15T22:57:59.341829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-15T22:57:59.341704+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-15T22:57:59.341704+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.341704+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:30.766347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.956049+0000","last_change":"2024-02-15T22:57:50.956049+0000","last_active":"2024-02-15T22:57:50.956049+0000","last_peered":"2024-02-15T22:57:50.956049+0000","last_clean":"2024-02-15T22:57:50.956049+0000","last_became_active":"2024-02-15T22:56:11.718102+0000","last_became_peered":"2024-02-15T22:56:11.718102+0000","last_unstale":"2024-02-15T22:57:50.956049+0000","last_undegraded":"2024-02-15T22:57:50.956049+0000","last_fullsized":"2024-02-15T22:57:50.956049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.955925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.955925+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.955925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:28.393475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:46.316594+0000","last_change":"2024-02-15T22:58:46.316619+0000","last_active":"2024-02-15T22:58:46.316594+0000","last_peered":"2024-02-15T22:58:46.316594+0000","last_clean":"2024-02-15T22:58:46.316594+0000","last_became_active":"2024-02-15T22:56:13.734372+0000","last_became_peered":"2024-02-15T22:56:13.734372+0000","last_unstale":"2024-02-15T22:58:46.316594+0000","last_undegraded":"2024-02-15T22:58:46.316594+0000","last_fullsized":"2024-02-15T22:58:46.316594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:46.316508+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:46.316508+0000","last_clean_scrub_stamp":"2024-02-15T22:58:46.316508+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:54:26.350765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.298195+0000","last_change":"2024-02-15T22:58:24.298221+0000","last_active":"2024-02-15T22:58:24.298195+0000","last_peered":"2024-02-15T22:58:24.298195+0000","last_clean":"2024-02-15T22:58:24.298195+0000","last_became_active":"2024-02-15T22:56:05.705473+0000","last_became_peered":"2024-02-15T22:56:05.705473+0000","last_unstale":"2024-02-15T22:58:24.298195+0000","last_undegraded":"2024-02-15T22:58:24.298195+0000","last_fullsized":"2024-02-15T22:58:24.298195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:24.298093+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:24.298093+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.298093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:30.167502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.894042+0000","last_change":"2024-02-15T22:58:29.894066+0000","last_active":"2024-02-15T22:58:29.894042+0000","last_peered":"2024-02-15T22:58:29.894042+0000","last_clean":"2024-02-15T22:58:29.894042+0000","last_became_active":"2024-02-15T22:56:03.697691+0000","last_became_peered":"2024-02-15T22:56:03.697691+0000","last_unstale":"2024-02-15T22:58:29.894042+0000","last_undegraded":"2024-02-15T22:58:29.894042+0000","last_fullsized":"2024-02-15T22:58:29.894042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:29.893936+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:29.893936+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.893936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:01.057365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.898500+0000","last_change":"2024-02-15T22:58:08.898500+0000","last_active":"2024-02-15T22:58:08.898500+0000","last_peered":"2024-02-15T22:58:08.898500+0000","last_clean":"2024-02-15T22:58:08.898500+0000","last_became_active":"2024-02-15T22:56:07.704018+0000","last_became_peered":"2024-02-15T22:56:07.704018+0000","last_unstale":"2024-02-15T22:58:08.898500+0000","last_undegraded":"2024-02-15T22:58:08.898500+0000","last_fullsized":"2024-02-15T22:58:08.898500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:08.898335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:08.898335+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.898335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:35.455319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.180851+0000","last_change":"2024-02-15T22:58:03.180851+0000","last_active":"2024-02-15T22:58:03.180851+0000","last_peered":"2024-02-15T22:58:03.180851+0000","last_clean":"2024-02-15T22:58:03.180851+0000","last_became_active":"2024-02-15T22:56:09.717105+0000","last_became_peered":"2024-02-15T22:56:09.717105+0000","last_unstale":"2024-02-15T22:58:03.180851+0000","last_undegraded":"2024-02-15T22:58:03.180851+0000","last_fullsized":"2024-02-15T22:58:03.180851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-15T22:58:03.180724+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-15T22:58:03.180724+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.180724+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.050134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.880001+0000","last_change":"2024-02-15T22:58:00.880001+0000","last_active":"2024-02-15T22:58:00.880001+0000","last_peered":"2024-02-15T22:58:00.880001+0000","last_clean":"2024-02-15T22:58:00.880001+0000","last_became_active":"2024-02-15T22:56:11.722865+0000","last_became_peered":"2024-02-15T22:56:11.722865+0000","last_unstale":"2024-02-15T22:58:00.880001+0000","last_undegraded":"2024-02-15T22:58:00.880001+0000","last_fullsized":"2024-02-15T22:58:00.880001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:00.879874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:00.879874+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.879874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:59.902356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.151443+0000","last_change":"2024-02-15T22:58:33.151443+0000","last_active":"2024-02-15T22:58:33.151443+0000","last_peered":"2024-02-15T22:58:33.151443+0000","last_clean":"2024-02-15T22:58:33.151443+0000","last_became_active":"2024-02-15T22:56:13.726748+0000","last_became_peered":"2024-02-15T22:56:13.726748+0000","last_unstale":"2024-02-15T22:58:33.151443+0000","last_undegraded":"2024-02-15T22:58:33.151443+0000","last_fullsized":"2024-02-15T22:58:33.151443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:33.151251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:33.151251+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.151251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:05:46.319989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.092893+0000","last_change":"2024-02-15T22:58:00.092893+0000","last_active":"2024-02-15T22:58:00.092893+0000","last_peered":"2024-02-15T22:58:00.092893+0000","last_clean":"2024-02-15T22:58:00.092893+0000","last_became_active":"2024-02-15T22:56:05.716677+0000","last_became_peered":"2024-02-15T22:56:05.716677+0000","last_unstale":"2024-02-15T22:58:00.092893+0000","last_undegraded":"2024-02-15T22:58:00.092893+0000","last_fullsized":"2024-02-15T22:58:00.092893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:00.092774+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:00.092774+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.092774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:55:49.382293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.946666+0000","last_change":"2024-02-15T22:58:31.946666+0000","last_active":"2024-02-15T22:58:31.946666+0000","last_peered":"2024-02-15T22:58:31.946666+0000","last_clean":"2024-02-15T22:58:31.946666+0000","last_became_active":"2024-02-15T22:56:03.692632+0000","last_became_peered":"2024-02-15T22:56:03.692632+0000","last_unstale":"2024-02-15T22:58:31.946666+0000","last_undegraded":"2024-02-15T22:58:31.946666+0000","last_fullsized":"2024-02-15T22:58:31.946666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:31.946551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:31.946551+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.946551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:02:50.833349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.944080+0000","last_change":"2024-02-15T22:58:06.944080+0000","last_active":"2024-02-15T22:58:06.944080+0000","last_peered":"2024-02-15T22:58:06.944080+0000","last_clean":"2024-02-15T22:58:06.944080+0000","last_became_active":"2024-02-15T22:56:07.704208+0000","last_became_peered":"2024-02-15T22:56:07.704208+0000","last_unstale":"2024-02-15T22:58:06.944080+0000","last_undegraded":"2024-02-15T22:58:06.944080+0000","last_fullsized":"2024-02-15T22:58:06.944080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:06.943951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:06.943951+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.943951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:12.953469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.383705+0000","last_change":"2024-02-15T22:57:58.383705+0000","last_active":"2024-02-15T22:57:58.383705+0000","last_peered":"2024-02-15T22:57:58.383705+0000","last_clean":"2024-02-15T22:57:58.383705+0000","last_became_active":"2024-02-15T22:56:09.716753+0000","last_became_peered":"2024-02-15T22:56:09.716753+0000","last_unstale":"2024-02-15T22:57:58.383705+0000","last_undegraded":"2024-02-15T22:57:58.383705+0000","last_fullsized":"2024-02-15T22:57:58.383705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-15T22:57:58.383553+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-15T22:57:58.383553+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.383553+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:24.940537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.373579+0000","last_change":"2024-02-15T22:57:56.373579+0000","last_active":"2024-02-15T22:57:56.373579+0000","last_peered":"2024-02-15T22:57:56.373579+0000","last_clean":"2024-02-15T22:57:56.373579+0000","last_became_active":"2024-02-15T22:56:11.722738+0000","last_became_peered":"2024-02-15T22:56:11.722738+0000","last_unstale":"2024-02-15T22:57:56.373579+0000","last_undegraded":"2024-02-15T22:57:56.373579+0000","last_fullsized":"2024-02-15T22:57:56.373579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.373469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.373469+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.373469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:02.382987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.215685+0000","last_change":"2024-02-15T22:58:37.215724+0000","last_active":"2024-02-15T22:58:37.215685+0000","last_peered":"2024-02-15T22:58:37.215685+0000","last_clean":"2024-02-15T22:58:37.215685+0000","last_became_active":"2024-02-15T22:56:13.727216+0000","last_became_peered":"2024-02-15T22:56:13.727216+0000","last_unstale":"2024-02-15T22:58:37.215685+0000","last_undegraded":"2024-02-15T22:58:37.215685+0000","last_fullsized":"2024-02-15T22:58:37.215685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:37.215594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:37.215594+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.215594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:56:44.091191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:42.355635+0000","last_change":"2024-02-15T22:58:42.355660+0000","last_active":"2024-02-15T22:58:42.355635+0000","last_peered":"2024-02-15T22:58:42.355635+0000","last_clean":"2024-02-15T22:58:42.355635+0000","last_became_active":"2024-02-15T22:56:05.707154+0000","last_became_peered":"2024-02-15T22:56:05.707154+0000","last_unstale":"2024-02-15T22:58:42.355635+0000","last_undegraded":"2024-02-15T22:58:42.355635+0000","last_fullsized":"2024-02-15T22:58:42.355635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:42.355546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:42.355546+0000","last_clean_scrub_stamp":"2024-02-15T22:58:42.355546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:37.329988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:50.165885+0000","last_change":"2024-02-15T22:58:50.165910+0000","last_active":"2024-02-15T22:58:50.165885+0000","last_peered":"2024-02-15T22:58:50.165885+0000","last_clean":"2024-02-15T22:58:50.165885+0000","last_became_active":"2024-02-15T22:56:03.699843+0000","last_became_peered":"2024-02-15T22:56:03.699843+0000","last_unstale":"2024-02-15T22:58:50.165885+0000","last_undegraded":"2024-02-15T22:58:50.165885+0000","last_fullsized":"2024-02-15T22:58:50.165885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:50.165791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:50.165791+0000","last_clean_scrub_stamp":"2024-02-15T22:58:50.165791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:52.639273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.845209+0000","last_change":"2024-02-15T22:58:03.845209+0000","last_active":"2024-02-15T22:58:03.845209+0000","last_peered":"2024-02-15T22:58:03.845209+0000","last_clean":"2024-02-15T22:58:03.845209+0000","last_became_active":"2024-02-15T22:56:07.702014+0000","last_became_peered":"2024-02-15T22:56:07.702014+0000","last_unstale":"2024-02-15T22:58:03.845209+0000","last_undegraded":"2024-02-15T22:58:03.845209+0000","last_fullsized":"2024-02-15T22:58:03.845209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:03.845081+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:03.845081+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.845081+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:36.772070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.010523+0000","last_change":"2024-02-15T22:57:55.010523+0000","last_active":"2024-02-15T22:57:55.010523+0000","last_peered":"2024-02-15T22:57:55.010523+0000","last_clean":"2024-02-15T22:57:55.010523+0000","last_became_active":"2024-02-15T22:56:09.715996+0000","last_became_peered":"2024-02-15T22:56:09.715996+0000","last_unstale":"2024-02-15T22:57:55.010523+0000","last_undegraded":"2024-02-15T22:57:55.010523+0000","last_fullsized":"2024-02-15T22:57:55.010523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:57:55.010359+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:57:55.010359+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.010359+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:25.907925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":302,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.998940+0000","last_change":"2024-02-15T22:57:59.998940+0000","last_active":"2024-02-15T22:57:59.998940+0000","last_peered":"2024-02-15T22:57:59.998940+0000","last_clean":"2024-02-15T22:57:59.998940+0000","last_became_active":"2024-02-15T22:56:11.724520+0000","last_became_peered":"2024-02-15T22:56:11.724520+0000","last_unstale":"2024-02-15T22:57:59.998940+0000","last_undegraded":"2024-02-15T22:57:59.998940+0000","last_fullsized":"2024-02-15T22:57:59.998940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:59.998810+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:59.998810+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.998810+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:37.951898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372616+0000","last_change":"2024-02-15T22:56:13.731954+0000","last_active":"2024-02-15T22:57:47.372616+0000","last_peered":"2024-02-15T22:57:47.372616+0000","last_clean":"2024-02-15T22:57:47.372616+0000","last_became_active":"2024-02-15T22:56:13.731683+0000","last_became_peered":"2024-02-15T22:56:13.731683+0000","last_unstale":"2024-02-15T22:57:47.372616+0000","last_undegraded":"2024-02-15T22:57:47.372616+0000","last_fullsized":"2024-02-15T22:57:47.372616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.904716+0000","last_change":"2024-02-15T22:58:11.904716+0000","last_active":"2024-02-15T22:58:11.904716+0000","last_peered":"2024-02-15T22:58:11.904716+0000","last_clean":"2024-02-15T22:58:11.904716+0000","last_became_active":"2024-02-15T22:56:05.700922+0000","last_became_peered":"2024-02-15T22:56:05.700922+0000","last_unstale":"2024-02-15T22:58:11.904716+0000","last_undegraded":"2024-02-15T22:58:11.904716+0000","last_fullsized":"2024-02-15T22:58:11.904716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.904604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.904604+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.904604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:48.029771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.842958+0000","last_change":"2024-02-15T22:58:34.842958+0000","last_active":"2024-02-15T22:58:34.842958+0000","last_peered":"2024-02-15T22:58:34.842958+0000","last_clean":"2024-02-15T22:58:34.842958+0000","last_became_active":"2024-02-15T22:56:03.696168+0000","last_became_peered":"2024-02-15T22:56:03.696168+0000","last_unstale":"2024-02-15T22:58:34.842958+0000","last_undegraded":"2024-02-15T22:58:34.842958+0000","last_fullsized":"2024-02-15T22:58:34.842958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:34.842794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:34.842794+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.842794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:10.608670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.855063+0000","last_change":"2024-02-15T22:58:05.855063+0000","last_active":"2024-02-15T22:58:05.855063+0000","last_peered":"2024-02-15T22:58:05.855063+0000","last_clean":"2024-02-15T22:58:05.855063+0000","last_became_active":"2024-02-15T22:56:07.701777+0000","last_became_peered":"2024-02-15T22:56:07.701777+0000","last_unstale":"2024-02-15T22:58:05.855063+0000","last_undegraded":"2024-02-15T22:58:05.855063+0000","last_fullsized":"2024-02-15T22:58:05.855063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:05.854938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:05.854938+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.854938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:45.103674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'44","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.877670+0000","last_change":"2024-02-15T22:57:54.877670+0000","last_active":"2024-02-15T22:57:54.877670+0000","last_peered":"2024-02-15T22:57:54.877670+0000","last_clean":"2024-02-15T22:57:54.877670+0000","last_became_active":"2024-02-15T22:56:09.713636+0000","last_became_peered":"2024-02-15T22:56:09.713636+0000","last_unstale":"2024-02-15T22:57:54.877670+0000","last_undegraded":"2024-02-15T22:57:54.877670+0000","last_fullsized":"2024-02-15T22:57:54.877670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:57:54.877538+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:57:54.877538+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.877538+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:18.263250+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.331421+0000","last_change":"2024-02-15T22:57:46.331421+0000","last_active":"2024-02-15T22:57:46.331421+0000","last_peered":"2024-02-15T22:57:46.331421+0000","last_clean":"2024-02-15T22:57:46.331421+0000","last_became_active":"2024-02-15T22:56:11.722374+0000","last_became_peered":"2024-02-15T22:56:11.722374+0000","last_unstale":"2024-02-15T22:57:46.331421+0000","last_undegraded":"2024-02-15T22:57:46.331421+0000","last_fullsized":"2024-02-15T22:57:46.331421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:46.331332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:46.331332+0000","last_clean_scrub_stamp":"2024-02-15T22:57:46.331332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:32.555922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:42.836090+0000","last_change":"2024-02-15T22:58:42.836114+0000","last_active":"2024-02-15T22:58:42.836090+0000","last_peered":"2024-02-15T22:58:42.836090+0000","last_clean":"2024-02-15T22:58:42.836090+0000","last_became_active":"2024-02-15T22:56:13.733576+0000","last_became_peered":"2024-02-15T22:56:13.733576+0000","last_unstale":"2024-02-15T22:58:42.836090+0000","last_undegraded":"2024-02-15T22:58:42.836090+0000","last_fullsized":"2024-02-15T22:58:42.836090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:42.836000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:42.836000+0000","last_clean_scrub_stamp":"2024-02-15T22:58:42.836000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:46:25.598350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.944063+0000","last_change":"2024-02-15T22:58:09.944063+0000","last_active":"2024-02-15T22:58:09.944063+0000","last_peered":"2024-02-15T22:58:09.944063+0000","last_clean":"2024-02-15T22:58:09.944063+0000","last_became_active":"2024-02-15T22:56:05.701026+0000","last_became_peered":"2024-02-15T22:56:05.701026+0000","last_unstale":"2024-02-15T22:58:09.944063+0000","last_undegraded":"2024-02-15T22:58:09.944063+0000","last_fullsized":"2024-02-15T22:58:09.944063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:09.943931+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:09.943931+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.943931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:46:04.334961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371443+0000","last_change":"2024-02-15T22:56:03.706706+0000","last_active":"2024-02-15T22:57:47.371443+0000","last_peered":"2024-02-15T22:57:47.371443+0000","last_clean":"2024-02-15T22:57:47.371443+0000","last_became_active":"2024-02-15T22:56:03.706422+0000","last_became_peered":"2024-02-15T22:56:03.706422+0000","last_unstale":"2024-02-15T22:57:47.371443+0000","last_undegraded":"2024-02-15T22:57:47.371443+0000","last_fullsized":"2024-02-15T22:57:47.371443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.004957+0000","last_change":"2024-02-15T22:58:02.004957+0000","last_active":"2024-02-15T22:58:02.004957+0000","last_peered":"2024-02-15T22:58:02.004957+0000","last_clean":"2024-02-15T22:58:02.004957+0000","last_became_active":"2024-02-15T22:56:07.707265+0000","last_became_peered":"2024-02-15T22:56:07.707265+0000","last_unstale":"2024-02-15T22:58:02.004957+0000","last_undegraded":"2024-02-15T22:58:02.004957+0000","last_fullsized":"2024-02-15T22:58:02.004957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:02.004846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:02.004846+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.004846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:25.390557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.350886+0000","last_change":"2024-02-15T22:57:57.350886+0000","last_active":"2024-02-15T22:57:57.350886+0000","last_peered":"2024-02-15T22:57:57.350886+0000","last_clean":"2024-02-15T22:57:57.350886+0000","last_became_active":"2024-02-15T22:56:09.716749+0000","last_became_peered":"2024-02-15T22:56:09.716749+0000","last_unstale":"2024-02-15T22:57:57.350886+0000","last_undegraded":"2024-02-15T22:57:57.350886+0000","last_fullsized":"2024-02-15T22:57:57.350886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-02-15T22:57:57.350743+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-02-15T22:57:57.350743+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.350743+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:56.373225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.125944+0000","last_change":"2024-02-15T22:58:17.125944+0000","last_active":"2024-02-15T22:58:17.125944+0000","last_peered":"2024-02-15T22:58:17.125944+0000","last_clean":"2024-02-15T22:58:17.125944+0000","last_became_active":"2024-02-15T22:56:11.725667+0000","last_became_peered":"2024-02-15T22:56:11.725667+0000","last_unstale":"2024-02-15T22:58:17.125944+0000","last_undegraded":"2024-02-15T22:58:17.125944+0000","last_fullsized":"2024-02-15T22:58:17.125944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:17.125792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:17.125792+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.125792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:36:22.884918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'8","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372674+0000","last_change":"2024-02-15T22:56:13.729381+0000","last_active":"2024-02-15T22:57:47.372674+0000","last_peered":"2024-02-15T22:57:47.372674+0000","last_clean":"2024-02-15T22:57:47.372674+0000","last_became_active":"2024-02-15T22:56:13.728844+0000","last_became_peered":"2024-02-15T22:56:13.728844+0000","last_unstale":"2024-02-15T22:57:47.372674+0000","last_undegraded":"2024-02-15T22:57:47.372674+0000","last_fullsized":"2024-02-15T22:57:47.372674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.115835+0000","last_change":"2024-02-15T22:58:32.115868+0000","last_active":"2024-02-15T22:58:32.115835+0000","last_peered":"2024-02-15T22:58:32.115835+0000","last_clean":"2024-02-15T22:58:32.115835+0000","last_became_active":"2024-02-15T22:56:05.700908+0000","last_became_peered":"2024-02-15T22:56:05.700908+0000","last_unstale":"2024-02-15T22:58:32.115835+0000","last_undegraded":"2024-02-15T22:58:32.115835+0000","last_fullsized":"2024-02-15T22:58:32.115835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:32.115751+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:32.115751+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.115751+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:52:27.671060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.253825+0000","last_change":"2024-02-15T22:58:21.253850+0000","last_active":"2024-02-15T22:58:21.253825+0000","last_peered":"2024-02-15T22:58:21.253825+0000","last_clean":"2024-02-15T22:58:21.253825+0000","last_became_active":"2024-02-15T22:56:03.704081+0000","last_became_peered":"2024-02-15T22:56:03.704081+0000","last_unstale":"2024-02-15T22:58:21.253825+0000","last_undegraded":"2024-02-15T22:58:21.253825+0000","last_fullsized":"2024-02-15T22:58:21.253825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:21.253735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:21.253735+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.253735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:33.248382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.886355+0000","last_change":"2024-02-15T22:57:58.886355+0000","last_active":"2024-02-15T22:57:58.886355+0000","last_peered":"2024-02-15T22:57:58.886355+0000","last_clean":"2024-02-15T22:57:58.886355+0000","last_became_active":"2024-02-15T22:56:07.708530+0000","last_became_peered":"2024-02-15T22:56:07.708530+0000","last_unstale":"2024-02-15T22:57:58.886355+0000","last_undegraded":"2024-02-15T22:57:58.886355+0000","last_fullsized":"2024-02-15T22:57:58.886355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:58.886242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:58.886242+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.886242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:28.475625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.000899+0000","last_change":"2024-02-15T22:57:57.000899+0000","last_active":"2024-02-15T22:57:57.000899+0000","last_peered":"2024-02-15T22:57:57.000899+0000","last_clean":"2024-02-15T22:57:57.000899+0000","last_became_active":"2024-02-15T22:56:09.716134+0000","last_became_peered":"2024-02-15T22:56:09.716134+0000","last_unstale":"2024-02-15T22:57:57.000899+0000","last_undegraded":"2024-02-15T22:57:57.000899+0000","last_fullsized":"2024-02-15T22:57:57.000899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-02-15T22:57:57.000753+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-02-15T22:57:57.000753+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.000753+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:47.478957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":49,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.185631+0000","last_change":"2024-02-15T22:58:13.185631+0000","last_active":"2024-02-15T22:58:13.185631+0000","last_peered":"2024-02-15T22:58:13.185631+0000","last_clean":"2024-02-15T22:58:13.185631+0000","last_became_active":"2024-02-15T22:56:11.725271+0000","last_became_peered":"2024-02-15T22:56:11.725271+0000","last_unstale":"2024-02-15T22:58:13.185631+0000","last_undegraded":"2024-02-15T22:58:13.185631+0000","last_fullsized":"2024-02-15T22:58:13.185631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:13.185521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:13.185521+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.185521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:35.729575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372705+0000","last_change":"2024-02-15T22:56:13.735140+0000","last_active":"2024-02-15T22:57:47.372705+0000","last_peered":"2024-02-15T22:57:47.372705+0000","last_clean":"2024-02-15T22:57:47.372705+0000","last_became_active":"2024-02-15T22:56:13.734871+0000","last_became_peered":"2024-02-15T22:56:13.734871+0000","last_unstale":"2024-02-15T22:57:47.372705+0000","last_undegraded":"2024-02-15T22:57:47.372705+0000","last_fullsized":"2024-02-15T22:57:47.372705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'16","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.955321+0000","last_change":"2024-02-15T22:58:10.955321+0000","last_active":"2024-02-15T22:58:10.955321+0000","last_peered":"2024-02-15T22:58:10.955321+0000","last_clean":"2024-02-15T22:58:10.955321+0000","last_became_active":"2024-02-15T22:56:05.700066+0000","last_became_peered":"2024-02-15T22:56:05.700066+0000","last_unstale":"2024-02-15T22:58:10.955321+0000","last_undegraded":"2024-02-15T22:58:10.955321+0000","last_fullsized":"2024-02-15T22:58:10.955321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-15T22:58:10.955167+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-15T22:58:10.955167+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.955167+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:41:48.202367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.878922+0000","last_change":"2024-02-15T22:58:33.878985+0000","last_active":"2024-02-15T22:58:33.878922+0000","last_peered":"2024-02-15T22:58:33.878922+0000","last_clean":"2024-02-15T22:58:33.878922+0000","last_became_active":"2024-02-15T22:56:03.693300+0000","last_became_peered":"2024-02-15T22:56:03.693300+0000","last_unstale":"2024-02-15T22:58:33.878922+0000","last_undegraded":"2024-02-15T22:58:33.878922+0000","last_fullsized":"2024-02-15T22:58:33.878922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:33.878818+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:33.878818+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.878818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:36:02.728765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.879672+0000","last_change":"2024-02-15T22:57:57.879672+0000","last_active":"2024-02-15T22:57:57.879672+0000","last_peered":"2024-02-15T22:57:57.879672+0000","last_clean":"2024-02-15T22:57:57.879672+0000","last_became_active":"2024-02-15T22:56:07.708720+0000","last_became_peered":"2024-02-15T22:56:07.708720+0000","last_unstale":"2024-02-15T22:57:57.879672+0000","last_undegraded":"2024-02-15T22:57:57.879672+0000","last_fullsized":"2024-02-15T22:57:57.879672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:57:57.879545+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:57:57.879545+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.879545+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:33.402218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.181089+0000","last_change":"2024-02-15T22:58:20.181089+0000","last_active":"2024-02-15T22:58:20.181089+0000","last_peered":"2024-02-15T22:58:20.181089+0000","last_clean":"2024-02-15T22:58:20.181089+0000","last_became_active":"2024-02-15T22:56:09.717846+0000","last_became_peered":"2024-02-15T22:56:09.717846+0000","last_unstale":"2024-02-15T22:58:20.181089+0000","last_undegraded":"2024-02-15T22:58:20.181089+0000","last_fullsized":"2024-02-15T22:58:20.181089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-15T22:58:20.180944+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-15T22:58:20.180944+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.180944+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:11:37.794373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.339582+0000","last_change":"2024-02-15T22:57:48.339582+0000","last_active":"2024-02-15T22:57:48.339582+0000","last_peered":"2024-02-15T22:57:48.339582+0000","last_clean":"2024-02-15T22:57:48.339582+0000","last_became_active":"2024-02-15T22:56:11.722402+0000","last_became_peered":"2024-02-15T22:56:11.722402+0000","last_unstale":"2024-02-15T22:57:48.339582+0000","last_undegraded":"2024-02-15T22:57:48.339582+0000","last_fullsized":"2024-02-15T22:57:48.339582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:48.339482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:48.339482+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.339482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:51.537660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.372635+0000","last_change":"2024-02-15T22:56:13.733552+0000","last_active":"2024-02-15T22:57:47.372635+0000","last_peered":"2024-02-15T22:57:47.372635+0000","last_clean":"2024-02-15T22:57:47.372635+0000","last_became_active":"2024-02-15T22:56:13.733285+0000","last_became_peered":"2024-02-15T22:56:13.733285+0000","last_unstale":"2024-02-15T22:57:47.372635+0000","last_undegraded":"2024-02-15T22:57:47.372635+0000","last_fullsized":"2024-02-15T22:57:47.372635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:12.706258+0000","last_clean_scrub_stamp":"2024-02-15T22:56:12.706258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.867874+0000","last_change":"2024-02-15T22:58:06.867874+0000","last_active":"2024-02-15T22:58:06.867874+0000","last_peered":"2024-02-15T22:58:06.867874+0000","last_clean":"2024-02-15T22:58:06.867874+0000","last_became_active":"2024-02-15T22:56:05.715609+0000","last_became_peered":"2024-02-15T22:56:05.715609+0000","last_unstale":"2024-02-15T22:58:06.867874+0000","last_undegraded":"2024-02-15T22:58:06.867874+0000","last_fullsized":"2024-02-15T22:58:06.867874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-02-15T22:58:06.867728+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-02-15T22:58:06.867728+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.867728+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:34.691909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.939014+0000","last_change":"2024-02-15T22:58:29.939039+0000","last_active":"2024-02-15T22:58:29.939014+0000","last_peered":"2024-02-15T22:58:29.939014+0000","last_clean":"2024-02-15T22:58:29.939014+0000","last_became_active":"2024-02-15T22:56:03.691266+0000","last_became_peered":"2024-02-15T22:56:03.691266+0000","last_unstale":"2024-02-15T22:58:29.939014+0000","last_undegraded":"2024-02-15T22:58:29.939014+0000","last_fullsized":"2024-02-15T22:58:29.939014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:29.938899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:29.938899+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.938899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:41.933547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.222659+0000","last_change":"2024-02-15T22:58:17.222659+0000","last_active":"2024-02-15T22:58:17.222659+0000","last_peered":"2024-02-15T22:58:17.222659+0000","last_clean":"2024-02-15T22:58:17.222659+0000","last_became_active":"2024-02-15T22:56:05.707492+0000","last_became_peered":"2024-02-15T22:56:05.707492+0000","last_unstale":"2024-02-15T22:58:17.222659+0000","last_undegraded":"2024-02-15T22:58:17.222659+0000","last_fullsized":"2024-02-15T22:58:17.222659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:17.222540+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:17.222540+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.222540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:43.244450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.338054+0000","last_change":"2024-02-15T22:58:38.338096+0000","last_active":"2024-02-15T22:58:38.338054+0000","last_peered":"2024-02-15T22:58:38.338054+0000","last_clean":"2024-02-15T22:58:38.338054+0000","last_became_active":"2024-02-15T22:56:03.692909+0000","last_became_peered":"2024-02-15T22:56:03.692909+0000","last_unstale":"2024-02-15T22:58:38.338054+0000","last_undegraded":"2024-02-15T22:58:38.338054+0000","last_fullsized":"2024-02-15T22:58:38.338054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:38.337963+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:38.337963+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.337963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:04:55.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.142444+0000","last_change":"2024-02-15T22:58:10.142444+0000","last_active":"2024-02-15T22:58:10.142444+0000","last_peered":"2024-02-15T22:58:10.142444+0000","last_clean":"2024-02-15T22:58:10.142444+0000","last_became_active":"2024-02-15T22:56:05.710095+0000","last_became_peered":"2024-02-15T22:56:05.710095+0000","last_unstale":"2024-02-15T22:58:10.142444+0000","last_undegraded":"2024-02-15T22:58:10.142444+0000","last_fullsized":"2024-02-15T22:58:10.142444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:10.142332+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:10.142332+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.142332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:29:45.908209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371453+0000","last_change":"2024-02-15T22:56:03.695701+0000","last_active":"2024-02-15T22:57:47.371453+0000","last_peered":"2024-02-15T22:57:47.371453+0000","last_clean":"2024-02-15T22:57:47.371453+0000","last_became_active":"2024-02-15T22:56:03.695362+0000","last_became_peered":"2024-02-15T22:56:03.695362+0000","last_unstale":"2024-02-15T22:57:47.371453+0000","last_undegraded":"2024-02-15T22:57:47.371453+0000","last_fullsized":"2024-02-15T22:57:47.371453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.211865+0000","last_change":"2024-02-15T22:58:18.211865+0000","last_active":"2024-02-15T22:58:18.211865+0000","last_peered":"2024-02-15T22:58:18.211865+0000","last_clean":"2024-02-15T22:58:18.211865+0000","last_became_active":"2024-02-15T22:56:05.701253+0000","last_became_peered":"2024-02-15T22:56:05.701253+0000","last_unstale":"2024-02-15T22:58:18.211865+0000","last_undegraded":"2024-02-15T22:58:18.211865+0000","last_fullsized":"2024-02-15T22:58:18.211865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:18.211741+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:18.211741+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.211741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:08.689945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.354906+0000","last_change":"2024-02-15T22:58:31.354934+0000","last_active":"2024-02-15T22:58:31.354906+0000","last_peered":"2024-02-15T22:58:31.354906+0000","last_clean":"2024-02-15T22:58:31.354906+0000","last_became_active":"2024-02-15T22:56:03.699881+0000","last_became_peered":"2024-02-15T22:56:03.699881+0000","last_unstale":"2024-02-15T22:58:31.354906+0000","last_undegraded":"2024-02-15T22:58:31.354906+0000","last_fullsized":"2024-02-15T22:58:31.354906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:31.354815+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:31.354815+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.354815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:36:00.204762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:49.320513+0000","last_change":"2024-02-15T22:58:49.320539+0000","last_active":"2024-02-15T22:58:49.320513+0000","last_peered":"2024-02-15T22:58:49.320513+0000","last_clean":"2024-02-15T22:58:49.320513+0000","last_became_active":"2024-02-15T22:56:45.886976+0000","last_became_peered":"2024-02-15T22:56:45.886976+0000","last_unstale":"2024-02-15T22:58:49.320513+0000","last_undegraded":"2024-02-15T22:58:49.320513+0000","last_fullsized":"2024-02-15T22:58:49.320513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:49.320438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:49.320438+0000","last_clean_scrub_stamp":"2024-02-15T22:58:49.320438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:34.790682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.317868+0000","last_change":"2024-02-15T22:58:37.317895+0000","last_active":"2024-02-15T22:58:37.317868+0000","last_peered":"2024-02-15T22:58:37.317868+0000","last_clean":"2024-02-15T22:58:37.317868+0000","last_became_active":"2024-02-15T22:56:03.692939+0000","last_became_peered":"2024-02-15T22:56:03.692939+0000","last_unstale":"2024-02-15T22:58:37.317868+0000","last_undegraded":"2024-02-15T22:58:37.317868+0000","last_fullsized":"2024-02-15T22:58:37.317868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:37.317783+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:37.317783+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.317783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:26:18.134612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.838311+0000","last_change":"2024-02-15T22:58:09.838311+0000","last_active":"2024-02-15T22:58:09.838311+0000","last_peered":"2024-02-15T22:58:09.838311+0000","last_clean":"2024-02-15T22:58:09.838311+0000","last_became_active":"2024-02-15T22:56:05.713670+0000","last_became_peered":"2024-02-15T22:56:05.713670+0000","last_unstale":"2024-02-15T22:58:09.838311+0000","last_undegraded":"2024-02-15T22:58:09.838311+0000","last_fullsized":"2024-02-15T22:58:09.838311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:09.838137+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:09.838137+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.838137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:24:40.314346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.899329+0000","last_change":"2024-02-15T22:58:37.899378+0000","last_active":"2024-02-15T22:58:37.899329+0000","last_peered":"2024-02-15T22:58:37.899329+0000","last_clean":"2024-02-15T22:58:37.899329+0000","last_became_active":"2024-02-15T22:56:03.696174+0000","last_became_peered":"2024-02-15T22:56:03.696174+0000","last_unstale":"2024-02-15T22:58:37.899329+0000","last_undegraded":"2024-02-15T22:58:37.899329+0000","last_fullsized":"2024-02-15T22:58:37.899329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:37.899233+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:37.899233+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.899233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:52:00.443287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.217171+0000","last_change":"2024-02-15T22:58:20.217197+0000","last_active":"2024-02-15T22:58:20.217171+0000","last_peered":"2024-02-15T22:58:20.217171+0000","last_clean":"2024-02-15T22:58:20.217171+0000","last_became_active":"2024-02-15T22:56:05.703183+0000","last_became_peered":"2024-02-15T22:56:05.703183+0000","last_unstale":"2024-02-15T22:58:20.217171+0000","last_undegraded":"2024-02-15T22:58:20.217171+0000","last_fullsized":"2024-02-15T22:58:20.217171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:20.217082+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:20.217082+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.217082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:26.212867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.899622+0000","last_change":"2024-02-15T22:58:18.899658+0000","last_active":"2024-02-15T22:58:18.899622+0000","last_peered":"2024-02-15T22:58:18.899622+0000","last_clean":"2024-02-15T22:58:18.899622+0000","last_became_active":"2024-02-15T22:56:03.699989+0000","last_became_peered":"2024-02-15T22:56:03.699989+0000","last_unstale":"2024-02-15T22:58:18.899622+0000","last_undegraded":"2024-02-15T22:58:18.899622+0000","last_fullsized":"2024-02-15T22:58:18.899622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:18.899525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:18.899525+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.899525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:19.320652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.867837+0000","last_change":"2024-02-15T22:58:14.867862+0000","last_active":"2024-02-15T22:58:14.867837+0000","last_peered":"2024-02-15T22:58:14.867837+0000","last_clean":"2024-02-15T22:58:14.867837+0000","last_became_active":"2024-02-15T22:56:05.701193+0000","last_became_peered":"2024-02-15T22:56:05.701193+0000","last_unstale":"2024-02-15T22:58:14.867837+0000","last_undegraded":"2024-02-15T22:58:14.867837+0000","last_fullsized":"2024-02-15T22:58:14.867837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:14.867745+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:14.867745+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.867745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:45.079186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.339449+0000","last_change":"2024-02-15T22:58:36.339475+0000","last_active":"2024-02-15T22:58:36.339449+0000","last_peered":"2024-02-15T22:58:36.339449+0000","last_clean":"2024-02-15T22:58:36.339449+0000","last_became_active":"2024-02-15T22:56:03.692902+0000","last_became_peered":"2024-02-15T22:56:03.692902+0000","last_unstale":"2024-02-15T22:58:36.339449+0000","last_undegraded":"2024-02-15T22:58:36.339449+0000","last_fullsized":"2024-02-15T22:58:36.339449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:36.339345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:36.339345+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.339345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:47.179116+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.832083+0000","last_change":"2024-02-15T22:58:16.832083+0000","last_active":"2024-02-15T22:58:16.832083+0000","last_peered":"2024-02-15T22:58:16.832083+0000","last_clean":"2024-02-15T22:58:16.832083+0000","last_became_active":"2024-02-15T22:56:05.702455+0000","last_became_peered":"2024-02-15T22:56:05.702455+0000","last_unstale":"2024-02-15T22:58:16.832083+0000","last_undegraded":"2024-02-15T22:58:16.832083+0000","last_fullsized":"2024-02-15T22:58:16.832083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:16.831958+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:16.831958+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.831958+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:31.233589+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.371427+0000","last_change":"2024-02-15T22:56:03.695480+0000","last_active":"2024-02-15T22:57:47.371427+0000","last_peered":"2024-02-15T22:57:47.371427+0000","last_clean":"2024-02-15T22:57:47.371427+0000","last_became_active":"2024-02-15T22:56:03.695149+0000","last_became_peered":"2024-02-15T22:56:03.695149+0000","last_unstale":"2024-02-15T22:57:47.371427+0000","last_undegraded":"2024-02-15T22:57:47.371427+0000","last_fullsized":"2024-02-15T22:57:47.371427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:56:02.673716+0000","last_clean_scrub_stamp":"2024-02-15T22:56:02.673716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.160635+0000","last_change":"2024-02-15T22:58:27.160657+0000","last_active":"2024-02-15T22:58:27.160635+0000","last_peered":"2024-02-15T22:58:27.160635+0000","last_clean":"2024-02-15T22:58:27.160635+0000","last_became_active":"2024-02-15T22:56:05.704211+0000","last_became_peered":"2024-02-15T22:56:05.704211+0000","last_unstale":"2024-02-15T22:58:27.160635+0000","last_undegraded":"2024-02-15T22:58:27.160635+0000","last_fullsized":"2024-02-15T22:58:27.160635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.160532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.160532+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.160532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:12.630776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:41.376176+0000","last_change":"2024-02-15T22:58:41.376207+0000","last_active":"2024-02-15T22:58:41.376176+0000","last_peered":"2024-02-15T22:58:41.376176+0000","last_clean":"2024-02-15T22:58:41.376176+0000","last_became_active":"2024-02-15T22:56:03.699419+0000","last_became_peered":"2024-02-15T22:56:03.699419+0000","last_unstale":"2024-02-15T22:58:41.376176+0000","last_undegraded":"2024-02-15T22:58:41.376176+0000","last_fullsized":"2024-02-15T22:58:41.376176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:41.376083+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:41.376083+0000","last_clean_scrub_stamp":"2024-02-15T22:58:41.376083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:07:04.420054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.239317+0000","last_change":"2024-02-15T22:58:15.239317+0000","last_active":"2024-02-15T22:58:15.239317+0000","last_peered":"2024-02-15T22:58:15.239317+0000","last_clean":"2024-02-15T22:58:15.239317+0000","last_became_active":"2024-02-15T22:56:05.710665+0000","last_became_peered":"2024-02-15T22:56:05.710665+0000","last_unstale":"2024-02-15T22:58:15.239317+0000","last_undegraded":"2024-02-15T22:58:15.239317+0000","last_fullsized":"2024-02-15T22:58:15.239317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:15.239206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:15.239206+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.239206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:58.794458+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.898287+0000","last_change":"2024-02-15T22:58:23.898307+0000","last_active":"2024-02-15T22:58:23.898287+0000","last_peered":"2024-02-15T22:58:23.898287+0000","last_clean":"2024-02-15T22:58:23.898287+0000","last_became_active":"2024-02-15T22:56:03.705871+0000","last_became_peered":"2024-02-15T22:56:03.705871+0000","last_unstale":"2024-02-15T22:58:23.898287+0000","last_undegraded":"2024-02-15T22:58:23.898287+0000","last_fullsized":"2024-02-15T22:58:23.898287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.898186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.898186+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.898186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:29.893971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.881465+0000","last_change":"2024-02-15T22:58:22.881496+0000","last_active":"2024-02-15T22:58:22.881465+0000","last_peered":"2024-02-15T22:58:22.881465+0000","last_clean":"2024-02-15T22:58:22.881465+0000","last_became_active":"2024-02-15T22:56:05.704505+0000","last_became_peered":"2024-02-15T22:56:05.704505+0000","last_unstale":"2024-02-15T22:58:22.881465+0000","last_undegraded":"2024-02-15T22:58:22.881465+0000","last_fullsized":"2024-02-15T22:58:22.881465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:22.881364+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:22.881364+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.881364+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:32:11.297043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.853912+0000","last_change":"2024-02-15T22:58:21.853937+0000","last_active":"2024-02-15T22:58:21.853912+0000","last_peered":"2024-02-15T22:58:21.853912+0000","last_clean":"2024-02-15T22:58:21.853912+0000","last_became_active":"2024-02-15T22:56:03.705904+0000","last_became_peered":"2024-02-15T22:56:03.705904+0000","last_unstale":"2024-02-15T22:58:21.853912+0000","last_undegraded":"2024-02-15T22:58:21.853912+0000","last_fullsized":"2024-02-15T22:58:21.853912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:21.853819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:21.853819+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.853819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:12.332024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.864194+0000","last_change":"2024-02-15T22:58:13.864194+0000","last_active":"2024-02-15T22:58:13.864194+0000","last_peered":"2024-02-15T22:58:13.864194+0000","last_clean":"2024-02-15T22:58:13.864194+0000","last_became_active":"2024-02-15T22:56:05.713035+0000","last_became_peered":"2024-02-15T22:56:05.713035+0000","last_unstale":"2024-02-15T22:58:13.864194+0000","last_undegraded":"2024-02-15T22:58:13.864194+0000","last_fullsized":"2024-02-15T22:58:13.864194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:13.864083+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:13.864083+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.864083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:17.062902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:52.177347+0000","last_change":"2024-02-15T22:58:52.177371+0000","last_active":"2024-02-15T22:58:52.177347+0000","last_peered":"2024-02-15T22:58:52.177347+0000","last_clean":"2024-02-15T22:58:52.177347+0000","last_became_active":"2024-02-15T22:56:03.696045+0000","last_became_peered":"2024-02-15T22:56:03.696045+0000","last_unstale":"2024-02-15T22:58:52.177347+0000","last_undegraded":"2024-02-15T22:58:52.177347+0000","last_fullsized":"2024-02-15T22:58:52.177347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:52.177257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:52.177257+0000","last_clean_scrub_stamp":"2024-02-15T22:58:52.177257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:58:08.765639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.867031+0000","last_change":"2024-02-15T22:58:20.867085+0000","last_active":"2024-02-15T22:58:20.867031+0000","last_peered":"2024-02-15T22:58:20.867031+0000","last_clean":"2024-02-15T22:58:20.867031+0000","last_became_active":"2024-02-15T22:56:05.704733+0000","last_became_peered":"2024-02-15T22:56:05.704733+0000","last_unstale":"2024-02-15T22:58:20.867031+0000","last_undegraded":"2024-02-15T22:58:20.867031+0000","last_fullsized":"2024-02-15T22:58:20.867031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-02-15T22:58:20.866916+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-02-15T22:58:20.866916+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.866916+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:09:47.979444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:56.222539+0000","last_change":"2024-02-15T22:58:56.222564+0000","last_active":"2024-02-15T22:58:56.222539+0000","last_peered":"2024-02-15T22:58:56.222539+0000","last_clean":"2024-02-15T22:58:56.222539+0000","last_became_active":"2024-02-15T22:56:03.695454+0000","last_became_peered":"2024-02-15T22:56:03.695454+0000","last_unstale":"2024-02-15T22:58:56.222539+0000","last_undegraded":"2024-02-15T22:58:56.222539+0000","last_fullsized":"2024-02-15T22:58:56.222539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:56.222413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:56.222413+0000","last_clean_scrub_stamp":"2024-02-15T22:58:56.222413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:32:51.559781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.191943+0000","last_change":"2024-02-15T22:58:26.191993+0000","last_active":"2024-02-15T22:58:26.191943+0000","last_peered":"2024-02-15T22:58:26.191943+0000","last_clean":"2024-02-15T22:58:26.191943+0000","last_became_active":"2024-02-15T22:56:05.707464+0000","last_became_peered":"2024-02-15T22:56:05.707464+0000","last_unstale":"2024-02-15T22:58:26.191943+0000","last_undegraded":"2024-02-15T22:58:26.191943+0000","last_fullsized":"2024-02-15T22:58:26.191943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:26.191834+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:26.191834+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.191834+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:13:44.299345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.893079+0000","last_change":"2024-02-15T22:58:30.893122+0000","last_active":"2024-02-15T22:58:30.893079+0000","last_peered":"2024-02-15T22:58:30.893079+0000","last_clean":"2024-02-15T22:58:30.893079+0000","last_became_active":"2024-02-15T22:56:03.696267+0000","last_became_peered":"2024-02-15T22:56:03.696267+0000","last_unstale":"2024-02-15T22:58:30.893079+0000","last_undegraded":"2024-02-15T22:58:30.893079+0000","last_fullsized":"2024-02-15T22:58:30.893079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:30.892968+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:30.892968+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.892968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:21:14.370027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.933019+0000","last_change":"2024-02-15T22:58:26.933047+0000","last_active":"2024-02-15T22:58:26.933019+0000","last_peered":"2024-02-15T22:58:26.933019+0000","last_clean":"2024-02-15T22:58:26.933019+0000","last_became_active":"2024-02-15T22:56:05.705496+0000","last_became_peered":"2024-02-15T22:56:05.705496+0000","last_unstale":"2024-02-15T22:58:26.933019+0000","last_undegraded":"2024-02-15T22:58:26.933019+0000","last_fullsized":"2024-02-15T22:58:26.933019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:26.932917+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:26.932917+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.932917+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:21.663794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.155914+0000","last_change":"2024-02-15T22:58:39.155989+0000","last_active":"2024-02-15T22:58:39.155914+0000","last_peered":"2024-02-15T22:58:39.155914+0000","last_clean":"2024-02-15T22:58:39.155914+0000","last_became_active":"2024-02-15T22:56:03.707033+0000","last_became_peered":"2024-02-15T22:56:03.707033+0000","last_unstale":"2024-02-15T22:58:39.155914+0000","last_undegraded":"2024-02-15T22:58:39.155914+0000","last_fullsized":"2024-02-15T22:58:39.155914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:39.155824+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:39.155824+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.155824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:29.633424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:55.188840+0000","last_change":"2024-02-15T22:58:55.188868+0000","last_active":"2024-02-15T22:58:55.188840+0000","last_peered":"2024-02-15T22:58:55.188840+0000","last_clean":"2024-02-15T22:58:55.188840+0000","last_became_active":"2024-02-15T22:56:03.705853+0000","last_became_peered":"2024-02-15T22:56:03.705853+0000","last_unstale":"2024-02-15T22:58:55.188840+0000","last_undegraded":"2024-02-15T22:58:55.188840+0000","last_fullsized":"2024-02-15T22:58:55.188840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:55.188733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:55.188733+0000","last_clean_scrub_stamp":"2024-02-15T22:58:55.188733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:49.965757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.186899+0000","last_change":"2024-02-15T22:58:19.186899+0000","last_active":"2024-02-15T22:58:19.186899+0000","last_peered":"2024-02-15T22:58:19.186899+0000","last_clean":"2024-02-15T22:58:19.186899+0000","last_became_active":"2024-02-15T22:56:05.699141+0000","last_became_peered":"2024-02-15T22:56:05.699141+0000","last_unstale":"2024-02-15T22:58:19.186899+0000","last_undegraded":"2024-02-15T22:58:19.186899+0000","last_fullsized":"2024-02-15T22:58:19.186899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:19.186738+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:19.186738+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.186738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:54.706314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.303775+0000","last_change":"2024-02-15T22:58:27.303798+0000","last_active":"2024-02-15T22:58:27.303775+0000","last_peered":"2024-02-15T22:58:27.303775+0000","last_clean":"2024-02-15T22:58:27.303775+0000","last_became_active":"2024-02-15T22:56:03.700107+0000","last_became_peered":"2024-02-15T22:56:03.700107+0000","last_unstale":"2024-02-15T22:58:27.303775+0000","last_undegraded":"2024-02-15T22:58:27.303775+0000","last_fullsized":"2024-02-15T22:58:27.303775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.303690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.303690+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.303690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:32:26.922533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.897645+0000","last_change":"2024-02-15T22:58:11.897645+0000","last_active":"2024-02-15T22:58:11.897645+0000","last_peered":"2024-02-15T22:58:11.897645+0000","last_clean":"2024-02-15T22:58:11.897645+0000","last_became_active":"2024-02-15T22:56:05.713142+0000","last_became_peered":"2024-02-15T22:56:05.713142+0000","last_unstale":"2024-02-15T22:58:11.897645+0000","last_undegraded":"2024-02-15T22:58:11.897645+0000","last_fullsized":"2024-02-15T22:58:11.897645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:11.897529+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:11.897529+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.897529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:37.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1419,"ondisk_log_size":1419,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":46,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673003,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35764,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336076,"statfs":{"total":96636764160,"available":96600141824,"internally_reserved":0,"allocated":438272,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.34599999999999997,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51900000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.42199999999999999,"15min":0.42099999999999999},"min":{"1min":0.32500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.54600000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Feb 15 22:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.32100000000000001},"min":{"1min":0.26400000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48199999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.25700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44900000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Feb 15 22:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.35399999999999998,"15min":0.35599999999999998},"min":{"1min":0.28100000000000003,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.32400000000000001,"15min":0.32800000000000001},"min":{"1min":0.247,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.505,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.505}]}]},{"osd":2,"up_from":10,"seq":42949673004,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":978944,"data_stored":722767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.42199999999999999},"min":{"1min":0.32900000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.52000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.42799999999999999,"15min":0.42499999999999999},"min":{"1min":0.31900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58499999999999996,"5min":0.623,"15min":0.623},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Feb 15 22:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.308,"15min":0.30599999999999999},"min":{"1min":0.23899999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.44400000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.32000000000000001,"15min":0.313},"min":{"1min":0.254,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.46700000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Feb 15 22:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.251,"5min":0.192,"15min":0.192},"max":{"1min":0.5,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.26700000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.47699999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.34899999999999998}]}]},{"osd":1,"up_from":10,"seq":42949673003,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:58:53 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Feb 15 22:58:53 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.311,"15min":0.30499999999999999},"min":{"1min":0.23999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.31,"15min":0.30399999999999999},"min":{"1min":0.255,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:58:53 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.313,"15min":0.31},"min":{"1min":0.22500000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.41599999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.28199999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47199999999999998,"5min":0.5,"15min":0.5},"last":0.432}]}]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:58:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63600000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50600000000000001,"15min":0.505},"min":{"1min":0.36799999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60599999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Feb 15 22:58:56 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48999999999999999,"15min":0.48099999999999998},"min":{"1min":0.29399999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.505,"15min":0.502},"min":{"1min":0.39700000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67600000000000005,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Feb 15 22:58:56 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.35899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65600000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.625},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.41699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.72599999999999998,"5min":0.75,"15min":0.75},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:59:09.201 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:59:09.203 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-15T22:56:06.687025+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=6, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:59:09.203 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:59:09.204 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:59:09.204 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:59:09.204 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:59:09.204 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:59:09.205 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-15T22:56:12.706258+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=12, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:59:09.205 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:59:09.205 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-15T22:56:02.673716+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=2, tm_wday=3, tm_yday=46, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=15, tm_hour=22, tm_min=57, tm_sec=44, tm_wday=3, tm_yday=46, tm_isdst=0) 2024-02-15T22:59:09.205 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-15T22:59:29.206 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-15T22:59:29.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.315+0000 7f5b101cd640 1 Processor -- start 2024-02-15T22:59:29.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.315+0000 7f5b101cd640 1 -- start start 2024-02-15T22:59:29.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.316+0000 7f5b101cd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b080993f0 0x7f5b08133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:29.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.316+0000 7f5b101cd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0809dc90 con 0x7f5b08098900 2024-02-15T22:59:29.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.316+0000 7f5b101cd640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0809a170 con 0x7f5b080993f0 2024-02-15T22:59:29.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.316+0000 7f5b0d768640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b080993f0 0x7f5b08133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:29.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.316+0000 7f5b0df69640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5b08098900 0x7f5b08098ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45982/0 (socket says 172.21.15.52:45982) 2024-02-15T22:59:29.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.316+0000 7f5b0df69640 1 -- 172.21.15.52:0/2261789218 learned_addr learned my addr 172.21.15.52:0/2261789218 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:59:29.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.316+0000 7f5b0d768640 1 -- 172.21.15.52:0/2261789218 >> v1:172.21.15.52:6789/0 conn(0x7f5b08098900 legacy=0x7f5b08098ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:29.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.316+0000 7f5b0d768640 1 -- 172.21.15.52:0/2261789218 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08099d30 con 0x7f5b080993f0 2024-02-15T22:59:29.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.317+0000 7f5b0d768640 1 --2- 172.21.15.52:0/2261789218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b080993f0 0x7f5b08133350 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009720 tx=0x7f5afc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df815611ca98044 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:29.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.317+0000 7f5b0cf67640 1 -- 172.21.15.52:0/2261789218 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5afc02e070 con 0x7f5b080993f0 2024-02-15T22:59:29.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.317+0000 7f5b0cf67640 1 -- 172.21.15.52:0/2261789218 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc0316d0 con 0x7f5b080993f0 2024-02-15T22:59:29.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.317+0000 7f5b0cf67640 1 -- 172.21.15.52:0/2261789218 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5afc031990 con 0x7f5b080993f0 2024-02-15T22:59:29.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.318+0000 7f5b101cd640 1 -- 172.21.15.52:0/2261789218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b080993f0 msgr2=0x7f5b08133350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:29.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.318+0000 7f5b101cd640 1 --2- 172.21.15.52:0/2261789218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b080993f0 0x7f5b08133350 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009720 tx=0x7f5afc02b840 comp rx=0 tx=0).stop 2024-02-15T22:59:29.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.318+0000 7f5b101cd640 1 -- 172.21.15.52:0/2261789218 shutdown_connections 2024-02-15T22:59:29.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.318+0000 7f5b101cd640 1 --2- 172.21.15.52:0/2261789218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b080993f0 0x7f5b08133350 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:29.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.318+0000 7f5b101cd640 1 -- 172.21.15.52:0/2261789218 >> 172.21.15.52:0/2261789218 conn(0x7f5b080a0a20 msgr2=0x7f5b0809cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:29.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.318+0000 7f5b101cd640 1 -- 172.21.15.52:0/2261789218 shutdown_connections 2024-02-15T22:59:29.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.318+0000 7f5b101cd640 1 -- 172.21.15.52:0/2261789218 wait complete. 2024-02-15T22:59:29.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.319+0000 7f5b101cd640 1 Processor -- start 2024-02-15T22:59:29.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.319+0000 7f5b101cd640 1 -- start start 2024-02-15T22:59:29.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.319+0000 7f5b101cd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b08098900 0x7f5b081c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:29.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.319+0000 7f5b101cd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0812cc50 con 0x7f5b08098900 2024-02-15T22:59:29.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.319+0000 7f5b0df69640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b08098900 0x7f5b081c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:29.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.319+0000 7f5b0df69640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b08098900 0x7f5b081c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50834/0 (socket says 172.21.15.52:50834) 2024-02-15T22:59:29.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.319+0000 7f5b0df69640 1 -- 172.21.15.52:0/484617773 learned_addr learned my addr 172.21.15.52:0/484617773 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:59:29.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.319+0000 7f5b0df69640 1 -- 172.21.15.52:0/484617773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc009400 con 0x7f5b08098900 2024-02-15T22:59:29.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.320+0000 7f5b0df69640 1 --2- 172.21.15.52:0/484617773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b08098900 0x7f5b081c2a30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000c4a0 tx=0x7f5b0000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:29.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.320+0000 7f5b067fc640 1 -- 172.21.15.52:0/484617773 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b00005c10 con 0x7f5b08098900 2024-02-15T22:59:29.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.320+0000 7f5b067fc640 1 -- 172.21.15.52:0/484617773 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b00005d70 con 0x7f5b08098900 2024-02-15T22:59:29.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.320+0000 7f5b101cd640 1 -- 172.21.15.52:0/484617773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0812ce50 con 0x7f5b08098900 2024-02-15T22:59:29.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.320+0000 7f5b067fc640 1 -- 172.21.15.52:0/484617773 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b000071a0 con 0x7f5b08098900 2024-02-15T22:59:29.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.320+0000 7f5b101cd640 1 -- 172.21.15.52:0/484617773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b08132e40 con 0x7f5b08098900 2024-02-15T22:59:29.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.321+0000 7f5b067fc640 1 -- 172.21.15.52:0/484617773 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5b00007300 con 0x7f5b08098900 2024-02-15T22:59:29.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.321+0000 7f5b101cd640 1 -- 172.21.15.52:0/484617773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b080627b0 con 0x7f5b08098900 2024-02-15T22:59:29.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.321+0000 7f5b067fc640 1 --2- 172.21.15.52:0/484617773 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5af4037ef0 0x7f5af403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:29.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.321+0000 7f5b067fc640 1 -- 172.21.15.52:0/484617773 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f5b0004a850 con 0x7f5b08098900 2024-02-15T22:59:29.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.321+0000 7f5b0d768640 1 --2- 172.21.15.52:0/484617773 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5af4037ef0 0x7f5af403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:29.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.322+0000 7f5b0d768640 1 --2- 172.21.15.52:0/484617773 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5af4037ef0 0x7f5af403a3b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5afc036000 tx=0x7f5afc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:29.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.326+0000 7f5b067fc640 1 -- 172.21.15.52:0/484617773 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b00010c20 con 0x7f5b08098900 2024-02-15T22:59:29.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.500+0000 7f5b101cd640 1 -- 172.21.15.52:0/484617773 --> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b0809d7e0 con 0x7f5af4037ef0 2024-02-15T22:59:29.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.516+0000 7f5b067fc640 1 -- 172.21.15.52:0/484617773 <== mgr.4101 v2:172.21.15.133:6824/1517102141 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673496 (secure 0 0 0) 0x7f5afc031ba0 con 0x7f5af4037ef0 2024-02-15T22:59:29.526 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-02-15T22:59:29.532 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-02-15T22:59:29.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.521+0000 7f5b101cd640 1 -- 172.21.15.52:0/484617773 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5af4037ef0 msgr2=0x7f5af403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:29.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.521+0000 7f5b101cd640 1 --2- 172.21.15.52:0/484617773 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5af4037ef0 0x7f5af403a3b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5afc036000 tx=0x7f5afc008030 comp rx=0 tx=0).stop 2024-02-15T22:59:29.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.521+0000 7f5b101cd640 1 -- 172.21.15.52:0/484617773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b08098900 msgr2=0x7f5b081c2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:29.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.521+0000 7f5b101cd640 1 --2- 172.21.15.52:0/484617773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b08098900 0x7f5b081c2a30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000c4a0 tx=0x7f5b0000c960 comp rx=0 tx=0).stop 2024-02-15T22:59:29.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.521+0000 7f5b101cd640 1 -- 172.21.15.52:0/484617773 shutdown_connections 2024-02-15T22:59:29.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.521+0000 7f5b101cd640 1 --2- 172.21.15.52:0/484617773 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f5af4037ef0 0x7f5af403a3b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:29.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.521+0000 7f5b101cd640 1 --2- 172.21.15.52:0/484617773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b08098900 0x7f5b081c2a30 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:29.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.521+0000 7f5b101cd640 1 -- 172.21.15.52:0/484617773 >> 172.21.15.52:0/484617773 conn(0x7f5b080a0a20 msgr2=0x7f5b0809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:29.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.521+0000 7f5b101cd640 1 -- 172.21.15.52:0/484617773 shutdown_connections 2024-02-15T22:59:29.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.521+0000 7f5b101cd640 1 -- 172.21.15.52:0/484617773 wait complete. 2024-02-15T22:59:29.535 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-02-15T22:59:28.868519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4011,"num_read_kb":3661,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3968,"ondisk_log_size":3968,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135792,"kb_used_data":2768,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351568,"statfs":{"total":386547056640,"available":386408005632,"internally_reserved":0,"allocated":2834432,"data_stored":1715324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004281"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.912061+0000","last_change":"2024-02-15T22:58:20.912083+0000","last_active":"2024-02-15T22:58:20.912061+0000","last_peered":"2024-02-15T22:58:20.912061+0000","last_clean":"2024-02-15T22:58:20.912061+0000","last_became_active":"2024-02-15T22:56:03.699163+0000","last_became_peered":"2024-02-15T22:56:03.699163+0000","last_unstale":"2024-02-15T22:58:20.912061+0000","last_undegraded":"2024-02-15T22:58:20.912061+0000","last_fullsized":"2024-02-15T22:58:20.912061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:20.911968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:20.911968+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.911968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:40.922588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.936654+0000","last_change":"2024-02-15T22:58:28.936654+0000","last_active":"2024-02-15T22:58:28.936654+0000","last_peered":"2024-02-15T22:58:28.936654+0000","last_clean":"2024-02-15T22:58:28.936654+0000","last_became_active":"2024-02-15T22:56:05.708415+0000","last_became_peered":"2024-02-15T22:56:05.708415+0000","last_unstale":"2024-02-15T22:58:28.936654+0000","last_undegraded":"2024-02-15T22:58:28.936654+0000","last_fullsized":"2024-02-15T22:58:28.936654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:28.936526+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:28.936526+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.936526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:34.423952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.335594+0000","last_change":"2024-02-15T22:58:23.335618+0000","last_active":"2024-02-15T22:58:23.335594+0000","last_peered":"2024-02-15T22:58:23.335594+0000","last_clean":"2024-02-15T22:58:23.335594+0000","last_became_active":"2024-02-15T22:56:03.704043+0000","last_became_peered":"2024-02-15T22:56:03.704043+0000","last_unstale":"2024-02-15T22:58:23.335594+0000","last_undegraded":"2024-02-15T22:58:23.335594+0000","last_fullsized":"2024-02-15T22:58:23.335594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.335501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.335501+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.335501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:18.066378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.128742+0000","last_change":"2024-02-15T22:58:30.128742+0000","last_active":"2024-02-15T22:58:30.128742+0000","last_peered":"2024-02-15T22:58:30.128742+0000","last_clean":"2024-02-15T22:58:30.128742+0000","last_became_active":"2024-02-15T22:56:05.703587+0000","last_became_peered":"2024-02-15T22:56:05.703587+0000","last_unstale":"2024-02-15T22:58:30.128742+0000","last_undegraded":"2024-02-15T22:58:30.128742+0000","last_fullsized":"2024-02-15T22:58:30.128742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:30.128618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:30.128618+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.128618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:26:46.358215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:49.129929+0000","last_change":"2024-02-15T22:58:49.129953+0000","last_active":"2024-02-15T22:58:49.129929+0000","last_peered":"2024-02-15T22:58:49.129929+0000","last_clean":"2024-02-15T22:58:49.129929+0000","last_became_active":"2024-02-15T22:56:03.703702+0000","last_became_peered":"2024-02-15T22:56:03.703702+0000","last_unstale":"2024-02-15T22:58:49.129929+0000","last_undegraded":"2024-02-15T22:58:49.129929+0000","last_fullsized":"2024-02-15T22:58:49.129929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:49.129836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:49.129836+0000","last_clean_scrub_stamp":"2024-02-15T22:58:49.129836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:05:30.943348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.151651+0000","last_change":"2024-02-15T22:58:24.151651+0000","last_active":"2024-02-15T22:58:24.151651+0000","last_peered":"2024-02-15T22:58:24.151651+0000","last_clean":"2024-02-15T22:58:24.151651+0000","last_became_active":"2024-02-15T22:56:05.709003+0000","last_became_peered":"2024-02-15T22:56:05.709003+0000","last_unstale":"2024-02-15T22:58:24.151651+0000","last_undegraded":"2024-02-15T22:58:24.151651+0000","last_fullsized":"2024-02-15T22:58:24.151651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:24.151517+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:24.151517+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.151517+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:49:20.993618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.972432+0000","last_change":"2024-02-15T22:58:26.972464+0000","last_active":"2024-02-15T22:58:26.972432+0000","last_peered":"2024-02-15T22:58:26.972432+0000","last_clean":"2024-02-15T22:58:26.972432+0000","last_became_active":"2024-02-15T22:56:03.691753+0000","last_became_peered":"2024-02-15T22:56:03.691753+0000","last_unstale":"2024-02-15T22:58:26.972432+0000","last_undegraded":"2024-02-15T22:58:26.972432+0000","last_fullsized":"2024-02-15T22:58:26.972432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:26.972306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:26.972306+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.972306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:17.450511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.106482+0000","last_change":"2024-02-15T22:58:31.106482+0000","last_active":"2024-02-15T22:58:31.106482+0000","last_peered":"2024-02-15T22:58:31.106482+0000","last_clean":"2024-02-15T22:58:31.106482+0000","last_became_active":"2024-02-15T22:56:05.703541+0000","last_became_peered":"2024-02-15T22:56:05.703541+0000","last_unstale":"2024-02-15T22:58:31.106482+0000","last_undegraded":"2024-02-15T22:58:31.106482+0000","last_fullsized":"2024-02-15T22:58:31.106482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:31.106368+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:31.106368+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.106368+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:09:52.155517+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:04.232655+0000","last_change":"2024-02-15T22:59:04.232691+0000","last_active":"2024-02-15T22:59:04.232655+0000","last_peered":"2024-02-15T22:59:04.232655+0000","last_clean":"2024-02-15T22:59:04.232655+0000","last_became_active":"2024-02-15T22:56:03.694522+0000","last_became_peered":"2024-02-15T22:56:03.694522+0000","last_unstale":"2024-02-15T22:59:04.232655+0000","last_undegraded":"2024-02-15T22:59:04.232655+0000","last_fullsized":"2024-02-15T22:59:04.232655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:04.232567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:04.232567+0000","last_clean_scrub_stamp":"2024-02-15T22:59:04.232567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:07:11.322782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.896989+0000","last_change":"2024-02-15T22:58:24.897030+0000","last_active":"2024-02-15T22:58:24.896989+0000","last_peered":"2024-02-15T22:58:24.896989+0000","last_clean":"2024-02-15T22:58:24.896989+0000","last_became_active":"2024-02-15T22:56:05.704411+0000","last_became_peered":"2024-02-15T22:56:05.704411+0000","last_unstale":"2024-02-15T22:58:24.896989+0000","last_undegraded":"2024-02-15T22:58:24.896989+0000","last_fullsized":"2024-02-15T22:58:24.896989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:24.896851+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:24.896851+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.896851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:14.186370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.993859+0000","last_change":"2024-02-15T22:58:27.993859+0000","last_active":"2024-02-15T22:58:27.993859+0000","last_peered":"2024-02-15T22:58:27.993859+0000","last_clean":"2024-02-15T22:58:27.993859+0000","last_became_active":"2024-02-15T22:56:03.692316+0000","last_became_peered":"2024-02-15T22:56:03.692316+0000","last_unstale":"2024-02-15T22:58:27.993859+0000","last_undegraded":"2024-02-15T22:58:27.993859+0000","last_fullsized":"2024-02-15T22:58:27.993859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.993707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.993707+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.993707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:03.513283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.226214+0000","last_change":"2024-02-15T22:58:04.226214+0000","last_active":"2024-02-15T22:58:04.226214+0000","last_peered":"2024-02-15T22:58:04.226214+0000","last_clean":"2024-02-15T22:58:04.226214+0000","last_became_active":"2024-02-15T22:56:05.715460+0000","last_became_peered":"2024-02-15T22:56:05.715460+0000","last_unstale":"2024-02-15T22:58:04.226214+0000","last_undegraded":"2024-02-15T22:58:04.226214+0000","last_fullsized":"2024-02-15T22:58:04.226214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:04.226104+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:04.226104+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.226104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:09.713529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:46.217162+0000","last_change":"2024-02-15T22:58:46.217199+0000","last_active":"2024-02-15T22:58:46.217162+0000","last_peered":"2024-02-15T22:58:46.217162+0000","last_clean":"2024-02-15T22:58:46.217162+0000","last_became_active":"2024-02-15T22:56:03.700908+0000","last_became_peered":"2024-02-15T22:56:03.700908+0000","last_unstale":"2024-02-15T22:58:46.217162+0000","last_undegraded":"2024-02-15T22:58:46.217162+0000","last_fullsized":"2024-02-15T22:58:46.217162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:46.217073+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:46.217073+0000","last_clean_scrub_stamp":"2024-02-15T22:58:46.217073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:47:16.883350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.814673+0000","last_change":"2024-02-15T22:58:33.814700+0000","last_active":"2024-02-15T22:58:33.814673+0000","last_peered":"2024-02-15T22:58:33.814673+0000","last_clean":"2024-02-15T22:58:33.814673+0000","last_became_active":"2024-02-15T22:56:05.706078+0000","last_became_peered":"2024-02-15T22:56:05.706078+0000","last_unstale":"2024-02-15T22:58:33.814673+0000","last_undegraded":"2024-02-15T22:58:33.814673+0000","last_fullsized":"2024-02-15T22:58:33.814673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:33.814536+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:33.814536+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.814536+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:39.301962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.375633+0000","last_change":"2024-02-15T22:58:39.375658+0000","last_active":"2024-02-15T22:58:39.375633+0000","last_peered":"2024-02-15T22:58:39.375633+0000","last_clean":"2024-02-15T22:58:39.375633+0000","last_became_active":"2024-02-15T22:56:03.697327+0000","last_became_peered":"2024-02-15T22:56:03.697327+0000","last_unstale":"2024-02-15T22:58:39.375633+0000","last_undegraded":"2024-02-15T22:58:39.375633+0000","last_fullsized":"2024-02-15T22:58:39.375633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:39.375530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:39.375530+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.375530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:53:42.378564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.901912+0000","last_change":"2024-02-15T22:58:17.901959+0000","last_active":"2024-02-15T22:58:17.901912+0000","last_peered":"2024-02-15T22:58:17.901912+0000","last_clean":"2024-02-15T22:58:17.901912+0000","last_became_active":"2024-02-15T22:56:05.705173+0000","last_became_peered":"2024-02-15T22:56:05.705173+0000","last_unstale":"2024-02-15T22:58:17.901912+0000","last_undegraded":"2024-02-15T22:58:17.901912+0000","last_fullsized":"2024-02-15T22:58:17.901912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:17.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:17.901806+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:43.081246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.138179+0000","last_change":"2024-02-15T22:58:28.138210+0000","last_active":"2024-02-15T22:58:28.138179+0000","last_peered":"2024-02-15T22:58:28.138179+0000","last_clean":"2024-02-15T22:58:28.138179+0000","last_became_active":"2024-02-15T22:56:05.703708+0000","last_became_peered":"2024-02-15T22:56:05.703708+0000","last_unstale":"2024-02-15T22:58:28.138179+0000","last_undegraded":"2024-02-15T22:58:28.138179+0000","last_fullsized":"2024-02-15T22:58:28.138179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:28.138094+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:28.138094+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.138094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:24.448130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.889280+0000","last_change":"2024-02-15T22:58:36.889321+0000","last_active":"2024-02-15T22:58:36.889280+0000","last_peered":"2024-02-15T22:58:36.889280+0000","last_clean":"2024-02-15T22:58:36.889280+0000","last_became_active":"2024-02-15T22:56:03.696959+0000","last_became_peered":"2024-02-15T22:56:03.696959+0000","last_unstale":"2024-02-15T22:58:36.889280+0000","last_undegraded":"2024-02-15T22:58:36.889280+0000","last_fullsized":"2024-02-15T22:58:36.889280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:36.889188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:36.889188+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.889188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:18:14.962422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.876807+0000","last_change":"2024-02-15T22:58:15.876807+0000","last_active":"2024-02-15T22:58:15.876807+0000","last_peered":"2024-02-15T22:58:15.876807+0000","last_clean":"2024-02-15T22:58:15.876807+0000","last_became_active":"2024-02-15T22:56:05.700071+0000","last_became_peered":"2024-02-15T22:56:05.700071+0000","last_unstale":"2024-02-15T22:58:15.876807+0000","last_undegraded":"2024-02-15T22:58:15.876807+0000","last_fullsized":"2024-02-15T22:58:15.876807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:15.876691+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:15.876691+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.876691+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:07:22.097823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.942805+0000","last_change":"2024-02-15T22:58:22.942805+0000","last_active":"2024-02-15T22:58:22.942805+0000","last_peered":"2024-02-15T22:58:22.942805+0000","last_clean":"2024-02-15T22:58:22.942805+0000","last_became_active":"2024-02-15T22:56:03.699574+0000","last_became_peered":"2024-02-15T22:56:03.699574+0000","last_unstale":"2024-02-15T22:58:22.942805+0000","last_undegraded":"2024-02-15T22:58:22.942805+0000","last_fullsized":"2024-02-15T22:58:22.942805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:22.942683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:22.942683+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.942683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:12:51.398096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.860710+0000","last_change":"2024-02-15T22:58:18.860710+0000","last_active":"2024-02-15T22:58:18.860710+0000","last_peered":"2024-02-15T22:58:18.860710+0000","last_clean":"2024-02-15T22:58:18.860710+0000","last_became_active":"2024-02-15T22:56:05.702488+0000","last_became_peered":"2024-02-15T22:56:05.702488+0000","last_unstale":"2024-02-15T22:58:18.860710+0000","last_undegraded":"2024-02-15T22:58:18.860710+0000","last_fullsized":"2024-02-15T22:58:18.860710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:18.860532+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:18.860532+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.860532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:34:02.415784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:44.833931+0000","last_change":"2024-02-15T22:58:44.833965+0000","last_active":"2024-02-15T22:58:44.833931+0000","last_peered":"2024-02-15T22:58:44.833931+0000","last_clean":"2024-02-15T22:58:44.833931+0000","last_became_active":"2024-02-15T22:56:45.885555+0000","last_became_peered":"2024-02-15T22:56:45.885555+0000","last_unstale":"2024-02-15T22:58:44.833931+0000","last_undegraded":"2024-02-15T22:58:44.833931+0000","last_fullsized":"2024-02-15T22:58:44.833931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:44.833847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:44.833847+0000","last_clean_scrub_stamp":"2024-02-15T22:58:44.833847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:30:21.375226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.370992+0000","last_change":"2024-02-15T22:58:30.370992+0000","last_active":"2024-02-15T22:58:30.370992+0000","last_peered":"2024-02-15T22:58:30.370992+0000","last_clean":"2024-02-15T22:58:30.370992+0000","last_became_active":"2024-02-15T22:56:05.705386+0000","last_became_peered":"2024-02-15T22:56:05.705386+0000","last_unstale":"2024-02-15T22:58:30.370992+0000","last_undegraded":"2024-02-15T22:58:30.370992+0000","last_fullsized":"2024-02-15T22:58:30.370992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:30.370877+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:30.370877+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.370877+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:50.153151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.911133+0000","last_change":"2024-02-15T22:58:32.911159+0000","last_active":"2024-02-15T22:58:32.911133+0000","last_peered":"2024-02-15T22:58:32.911133+0000","last_clean":"2024-02-15T22:58:32.911133+0000","last_became_active":"2024-02-15T22:56:03.693329+0000","last_became_peered":"2024-02-15T22:56:03.693329+0000","last_unstale":"2024-02-15T22:58:32.911133+0000","last_undegraded":"2024-02-15T22:58:32.911133+0000","last_fullsized":"2024-02-15T22:58:32.911133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:32.911045+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:32.911045+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.911045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:51.086189+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.936285+0000","last_change":"2024-02-15T22:58:15.936285+0000","last_active":"2024-02-15T22:58:15.936285+0000","last_peered":"2024-02-15T22:58:15.936285+0000","last_clean":"2024-02-15T22:58:15.936285+0000","last_became_active":"2024-02-15T22:56:05.704729+0000","last_became_peered":"2024-02-15T22:56:05.704729+0000","last_unstale":"2024-02-15T22:58:15.936285+0000","last_undegraded":"2024-02-15T22:58:15.936285+0000","last_fullsized":"2024-02-15T22:58:15.936285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:15.936168+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:15.936168+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.936168+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:39:13.873642+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.327486+0000","last_change":"2024-02-15T22:58:25.327486+0000","last_active":"2024-02-15T22:58:25.327486+0000","last_peered":"2024-02-15T22:58:25.327486+0000","last_clean":"2024-02-15T22:58:25.327486+0000","last_became_active":"2024-02-15T22:56:03.703885+0000","last_became_peered":"2024-02-15T22:56:03.703885+0000","last_unstale":"2024-02-15T22:58:25.327486+0000","last_undegraded":"2024-02-15T22:58:25.327486+0000","last_fullsized":"2024-02-15T22:58:25.327486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.327361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.327361+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.327361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:30.814787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.872443+0000","last_change":"2024-02-15T22:58:17.872443+0000","last_active":"2024-02-15T22:58:17.872443+0000","last_peered":"2024-02-15T22:58:17.872443+0000","last_clean":"2024-02-15T22:58:17.872443+0000","last_became_active":"2024-02-15T22:56:05.698553+0000","last_became_peered":"2024-02-15T22:56:05.698553+0000","last_unstale":"2024-02-15T22:58:17.872443+0000","last_undegraded":"2024-02-15T22:58:17.872443+0000","last_fullsized":"2024-02-15T22:58:17.872443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:17.872326+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:17.872326+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.872326+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:41.035527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:44.252285+0000","last_change":"2024-02-15T22:58:44.252311+0000","last_active":"2024-02-15T22:58:44.252285+0000","last_peered":"2024-02-15T22:58:44.252285+0000","last_clean":"2024-02-15T22:58:44.252285+0000","last_became_active":"2024-02-15T22:56:03.701819+0000","last_became_peered":"2024-02-15T22:56:03.701819+0000","last_unstale":"2024-02-15T22:58:44.252285+0000","last_undegraded":"2024-02-15T22:58:44.252285+0000","last_fullsized":"2024-02-15T22:58:44.252285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:44.252191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:44.252191+0000","last_clean_scrub_stamp":"2024-02-15T22:58:44.252191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:09:18.350889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'18","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.869532+0000","last_change":"2024-02-15T22:58:40.869563+0000","last_active":"2024-02-15T22:58:40.869532+0000","last_peered":"2024-02-15T22:58:40.869532+0000","last_clean":"2024-02-15T22:58:40.869532+0000","last_became_active":"2024-02-15T22:56:13.730499+0000","last_became_peered":"2024-02-15T22:56:13.730499+0000","last_unstale":"2024-02-15T22:58:40.869532+0000","last_undegraded":"2024-02-15T22:58:40.869532+0000","last_fullsized":"2024-02-15T22:58:40.869532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-02-15T22:58:40.869438+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-02-15T22:58:40.869438+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.869438+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:35:38.385067+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.223665+0000","last_change":"2024-02-15T22:58:36.223717+0000","last_active":"2024-02-15T22:58:36.223665+0000","last_peered":"2024-02-15T22:58:36.223665+0000","last_clean":"2024-02-15T22:58:36.223665+0000","last_became_active":"2024-02-15T22:56:05.699821+0000","last_became_peered":"2024-02-15T22:56:05.699821+0000","last_unstale":"2024-02-15T22:58:36.223665+0000","last_undegraded":"2024-02-15T22:58:36.223665+0000","last_fullsized":"2024-02-15T22:58:36.223665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:36.223565+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:36.223565+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.223565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:37:39.745954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:57.197755+0000","last_change":"2024-02-15T22:58:57.197786+0000","last_active":"2024-02-15T22:58:57.197755+0000","last_peered":"2024-02-15T22:58:57.197755+0000","last_clean":"2024-02-15T22:58:57.197755+0000","last_became_active":"2024-02-15T22:56:03.705881+0000","last_became_peered":"2024-02-15T22:56:03.705881+0000","last_unstale":"2024-02-15T22:58:57.197755+0000","last_undegraded":"2024-02-15T22:58:57.197755+0000","last_fullsized":"2024-02-15T22:58:57.197755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:57.197651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:57.197651+0000","last_clean_scrub_stamp":"2024-02-15T22:58:57.197651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:39:49.528497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:13.372233+0000","last_change":"2024-02-15T22:59:13.372257+0000","last_active":"2024-02-15T22:59:13.372233+0000","last_peered":"2024-02-15T22:59:13.372233+0000","last_clean":"2024-02-15T22:59:13.372233+0000","last_became_active":"2024-02-15T22:56:45.893067+0000","last_became_peered":"2024-02-15T22:56:45.893067+0000","last_unstale":"2024-02-15T22:59:13.372233+0000","last_undegraded":"2024-02-15T22:59:13.372233+0000","last_fullsized":"2024-02-15T22:59:13.372233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:13.372134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:13.372134+0000","last_clean_scrub_stamp":"2024-02-15T22:59:13.372134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:36:20.134699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.887564+0000","last_change":"2024-02-15T22:57:48.887564+0000","last_active":"2024-02-15T22:57:48.887564+0000","last_peered":"2024-02-15T22:57:48.887564+0000","last_clean":"2024-02-15T22:57:48.887564+0000","last_became_active":"2024-02-15T22:56:09.714201+0000","last_became_peered":"2024-02-15T22:56:09.714201+0000","last_unstale":"2024-02-15T22:57:48.887564+0000","last_undegraded":"2024-02-15T22:57:48.887564+0000","last_fullsized":"2024-02-15T22:57:48.887564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:48.887402+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:48.887402+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.887402+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:13:20.076360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.920914+0000","last_change":"2024-02-15T22:57:56.920914+0000","last_active":"2024-02-15T22:57:56.920914+0000","last_peered":"2024-02-15T22:57:56.920914+0000","last_clean":"2024-02-15T22:57:56.920914+0000","last_became_active":"2024-02-15T22:56:11.722257+0000","last_became_peered":"2024-02-15T22:56:11.722257+0000","last_unstale":"2024-02-15T22:57:56.920914+0000","last_undegraded":"2024-02-15T22:57:56.920914+0000","last_fullsized":"2024-02-15T22:57:56.920914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.920756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.920756+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.920756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:24:37.182344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.844517+0000","last_change":"2024-02-15T22:58:08.844517+0000","last_active":"2024-02-15T22:58:08.844517+0000","last_peered":"2024-02-15T22:58:08.844517+0000","last_clean":"2024-02-15T22:58:08.844517+0000","last_became_active":"2024-02-15T22:56:13.729067+0000","last_became_peered":"2024-02-15T22:56:13.729067+0000","last_unstale":"2024-02-15T22:58:08.844517+0000","last_undegraded":"2024-02-15T22:58:08.844517+0000","last_fullsized":"2024-02-15T22:58:08.844517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-02-15T22:58:08.844397+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-02-15T22:58:08.844397+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.844397+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:59.059018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.151094+0000","last_change":"2024-02-15T22:58:23.151094+0000","last_active":"2024-02-15T22:58:23.151094+0000","last_peered":"2024-02-15T22:58:23.151094+0000","last_clean":"2024-02-15T22:58:23.151094+0000","last_became_active":"2024-02-15T22:56:05.709632+0000","last_became_peered":"2024-02-15T22:56:05.709632+0000","last_unstale":"2024-02-15T22:58:23.151094+0000","last_undegraded":"2024-02-15T22:58:23.151094+0000","last_fullsized":"2024-02-15T22:58:23.151094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:23.150930+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:23.150930+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.150930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:00:49.803296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.934779+0000","last_change":"2024-02-15T22:58:24.934798+0000","last_active":"2024-02-15T22:58:24.934779+0000","last_peered":"2024-02-15T22:58:24.934779+0000","last_clean":"2024-02-15T22:58:24.934779+0000","last_became_active":"2024-02-15T22:56:03.699250+0000","last_became_peered":"2024-02-15T22:56:03.699250+0000","last_unstale":"2024-02-15T22:58:24.934779+0000","last_undegraded":"2024-02-15T22:58:24.934779+0000","last_fullsized":"2024-02-15T22:58:24.934779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:24.934666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:24.934666+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.934666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:55.832233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.213704+0000","last_change":"2024-02-15T22:58:09.213704+0000","last_active":"2024-02-15T22:58:09.213704+0000","last_peered":"2024-02-15T22:58:09.213704+0000","last_clean":"2024-02-15T22:58:09.213704+0000","last_became_active":"2024-02-15T22:56:07.705828+0000","last_became_peered":"2024-02-15T22:56:07.705828+0000","last_unstale":"2024-02-15T22:58:09.213704+0000","last_undegraded":"2024-02-15T22:58:09.213704+0000","last_fullsized":"2024-02-15T22:58:09.213704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:09.213585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:09.213585+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.213585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:09.634712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.924930+0000","last_change":"2024-02-15T22:57:55.924930+0000","last_active":"2024-02-15T22:57:55.924930+0000","last_peered":"2024-02-15T22:57:55.924930+0000","last_clean":"2024-02-15T22:57:55.924930+0000","last_became_active":"2024-02-15T22:56:09.712812+0000","last_became_peered":"2024-02-15T22:56:09.712812+0000","last_unstale":"2024-02-15T22:57:55.924930+0000","last_undegraded":"2024-02-15T22:57:55.924930+0000","last_fullsized":"2024-02-15T22:57:55.924930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-15T22:57:55.924760+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-15T22:57:55.924760+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.924760+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:30.496577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.900635+0000","last_change":"2024-02-15T22:57:52.900635+0000","last_active":"2024-02-15T22:57:52.900635+0000","last_peered":"2024-02-15T22:57:52.900635+0000","last_clean":"2024-02-15T22:57:52.900635+0000","last_became_active":"2024-02-15T22:56:11.721486+0000","last_became_peered":"2024-02-15T22:56:11.721486+0000","last_unstale":"2024-02-15T22:57:52.900635+0000","last_undegraded":"2024-02-15T22:57:52.900635+0000","last_fullsized":"2024-02-15T22:57:52.900635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.900511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.900511+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.900511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:44.599545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:47.364401+0000","last_change":"2024-02-15T22:58:47.364428+0000","last_active":"2024-02-15T22:58:47.364401+0000","last_peered":"2024-02-15T22:58:47.364401+0000","last_clean":"2024-02-15T22:58:47.364401+0000","last_became_active":"2024-02-15T22:56:13.734418+0000","last_became_peered":"2024-02-15T22:56:13.734418+0000","last_unstale":"2024-02-15T22:58:47.364401+0000","last_undegraded":"2024-02-15T22:58:47.364401+0000","last_fullsized":"2024-02-15T22:58:47.364401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:47.364309+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:47.364309+0000","last_clean_scrub_stamp":"2024-02-15T22:58:47.364309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:55:08.387965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.225352+0000","last_change":"2024-02-15T22:58:35.225417+0000","last_active":"2024-02-15T22:58:35.225352+0000","last_peered":"2024-02-15T22:58:35.225352+0000","last_clean":"2024-02-15T22:58:35.225352+0000","last_became_active":"2024-02-15T22:56:05.699398+0000","last_became_peered":"2024-02-15T22:56:05.699398+0000","last_unstale":"2024-02-15T22:58:35.225352+0000","last_undegraded":"2024-02-15T22:58:35.225352+0000","last_fullsized":"2024-02-15T22:58:35.225352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:35.225215+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:35.225215+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.225215+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:11:04.131887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:42.187864+0000","last_change":"2024-02-15T22:58:42.187887+0000","last_active":"2024-02-15T22:58:42.187864+0000","last_peered":"2024-02-15T22:58:42.187864+0000","last_clean":"2024-02-15T22:58:42.187864+0000","last_became_active":"2024-02-15T22:56:03.706818+0000","last_became_peered":"2024-02-15T22:56:03.706818+0000","last_unstale":"2024-02-15T22:58:42.187864+0000","last_undegraded":"2024-02-15T22:58:42.187864+0000","last_fullsized":"2024-02-15T22:58:42.187864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:42.187772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:42.187772+0000","last_clean_scrub_stamp":"2024-02-15T22:58:42.187772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:18:04.461318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.225506+0000","last_change":"2024-02-15T22:58:14.225506+0000","last_active":"2024-02-15T22:58:14.225506+0000","last_peered":"2024-02-15T22:58:14.225506+0000","last_clean":"2024-02-15T22:58:14.225506+0000","last_became_active":"2024-02-15T22:56:07.704168+0000","last_became_peered":"2024-02-15T22:56:07.704168+0000","last_unstale":"2024-02-15T22:58:14.225506+0000","last_undegraded":"2024-02-15T22:58:14.225506+0000","last_fullsized":"2024-02-15T22:58:14.225506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:14.225364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:14.225364+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.225364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:37.388564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.998999+0000","last_change":"2024-02-15T22:57:54.998999+0000","last_active":"2024-02-15T22:57:54.998999+0000","last_peered":"2024-02-15T22:57:54.998999+0000","last_clean":"2024-02-15T22:57:54.998999+0000","last_became_active":"2024-02-15T22:56:09.718326+0000","last_became_peered":"2024-02-15T22:56:09.718326+0000","last_unstale":"2024-02-15T22:57:54.998999+0000","last_undegraded":"2024-02-15T22:57:54.998999+0000","last_fullsized":"2024-02-15T22:57:54.998999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:57:54.998836+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:57:54.998836+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.998836+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:33:48.011800+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":315,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.156370+0000","last_change":"2024-02-15T22:58:21.156370+0000","last_active":"2024-02-15T22:58:21.156370+0000","last_peered":"2024-02-15T22:58:21.156370+0000","last_clean":"2024-02-15T22:58:21.156370+0000","last_became_active":"2024-02-15T22:56:11.724138+0000","last_became_peered":"2024-02-15T22:56:11.724138+0000","last_unstale":"2024-02-15T22:58:21.156370+0000","last_undegraded":"2024-02-15T22:58:21.156370+0000","last_fullsized":"2024-02-15T22:58:21.156370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-02-15T22:58:21.156191+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-02-15T22:58:21.156191+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.156191+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:39:40.871645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.775334+0000","last_change":"2024-02-15T22:58:37.775334+0000","last_active":"2024-02-15T22:58:37.775334+0000","last_peered":"2024-02-15T22:58:37.775334+0000","last_clean":"2024-02-15T22:58:37.775334+0000","last_became_active":"2024-02-15T22:56:13.732762+0000","last_became_peered":"2024-02-15T22:56:13.732762+0000","last_unstale":"2024-02-15T22:58:37.775334+0000","last_undegraded":"2024-02-15T22:58:37.775334+0000","last_fullsized":"2024-02-15T22:58:37.775334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:37.775222+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:37.775222+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.775222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:55.950367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.295013+0000","last_change":"2024-02-15T22:58:22.295013+0000","last_active":"2024-02-15T22:58:22.295013+0000","last_peered":"2024-02-15T22:58:22.295013+0000","last_clean":"2024-02-15T22:58:22.295013+0000","last_became_active":"2024-02-15T22:56:05.705360+0000","last_became_peered":"2024-02-15T22:56:05.705360+0000","last_unstale":"2024-02-15T22:58:22.295013+0000","last_undegraded":"2024-02-15T22:58:22.295013+0000","last_fullsized":"2024-02-15T22:58:22.295013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:22.294850+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:22.294850+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.294850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:21:05.771908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.956494+0000","last_change":"2024-02-15T22:58:27.956522+0000","last_active":"2024-02-15T22:58:27.956494+0000","last_peered":"2024-02-15T22:58:27.956494+0000","last_clean":"2024-02-15T22:58:27.956494+0000","last_became_active":"2024-02-15T22:56:03.698225+0000","last_became_peered":"2024-02-15T22:56:03.698225+0000","last_unstale":"2024-02-15T22:58:27.956494+0000","last_undegraded":"2024-02-15T22:58:27.956494+0000","last_fullsized":"2024-02-15T22:58:27.956494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.956385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.956385+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.956385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:33.825795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.851925+0000","last_change":"2024-02-15T22:57:47.851925+0000","last_active":"2024-02-15T22:57:47.851925+0000","last_peered":"2024-02-15T22:57:47.851925+0000","last_clean":"2024-02-15T22:57:47.851925+0000","last_became_active":"2024-02-15T22:56:07.709236+0000","last_became_peered":"2024-02-15T22:56:07.709236+0000","last_unstale":"2024-02-15T22:57:47.851925+0000","last_undegraded":"2024-02-15T22:57:47.851925+0000","last_fullsized":"2024-02-15T22:57:47.851925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.851815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.851815+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.851815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:42.039354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.003016+0000","last_change":"2024-02-15T22:57:53.003016+0000","last_active":"2024-02-15T22:57:53.003016+0000","last_peered":"2024-02-15T22:57:53.003016+0000","last_clean":"2024-02-15T22:57:53.003016+0000","last_became_active":"2024-02-15T22:56:09.729556+0000","last_became_peered":"2024-02-15T22:56:09.729556+0000","last_unstale":"2024-02-15T22:57:53.003016+0000","last_undegraded":"2024-02-15T22:57:53.003016+0000","last_fullsized":"2024-02-15T22:57:53.003016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:53.002893+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:53.002893+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.002893+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:27:11.902505+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":342,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.310138+0000","last_change":"2024-02-15T22:57:53.310138+0000","last_active":"2024-02-15T22:57:53.310138+0000","last_peered":"2024-02-15T22:57:53.310138+0000","last_clean":"2024-02-15T22:57:53.310138+0000","last_became_active":"2024-02-15T22:56:11.719588+0000","last_became_peered":"2024-02-15T22:56:11.719588+0000","last_unstale":"2024-02-15T22:57:53.310138+0000","last_undegraded":"2024-02-15T22:57:53.310138+0000","last_fullsized":"2024-02-15T22:57:53.310138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:53.309962+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:53.309962+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.309962+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:05.319309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.137427+0000","last_change":"2024-02-15T22:58:07.137427+0000","last_active":"2024-02-15T22:58:07.137427+0000","last_peered":"2024-02-15T22:58:07.137427+0000","last_clean":"2024-02-15T22:58:07.137427+0000","last_became_active":"2024-02-15T22:56:05.710578+0000","last_became_peered":"2024-02-15T22:56:05.710578+0000","last_unstale":"2024-02-15T22:58:07.137427+0000","last_undegraded":"2024-02-15T22:58:07.137427+0000","last_fullsized":"2024-02-15T22:58:07.137427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.137300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.137300+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.137300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:02:26.024097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.890089+0000","last_change":"2024-02-15T22:58:14.890089+0000","last_active":"2024-02-15T22:58:14.890089+0000","last_peered":"2024-02-15T22:58:14.890089+0000","last_clean":"2024-02-15T22:58:14.890089+0000","last_became_active":"2024-02-15T22:56:03.702187+0000","last_became_peered":"2024-02-15T22:56:03.702187+0000","last_unstale":"2024-02-15T22:58:14.890089+0000","last_undegraded":"2024-02-15T22:58:14.890089+0000","last_fullsized":"2024-02-15T22:58:14.890089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:14.889959+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:14.889959+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.889959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:33.400014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.884933+0000","last_change":"2024-02-15T22:57:59.884933+0000","last_active":"2024-02-15T22:57:59.884933+0000","last_peered":"2024-02-15T22:57:59.884933+0000","last_clean":"2024-02-15T22:57:59.884933+0000","last_became_active":"2024-02-15T22:56:07.707328+0000","last_became_peered":"2024-02-15T22:56:07.707328+0000","last_unstale":"2024-02-15T22:57:59.884933+0000","last_undegraded":"2024-02-15T22:57:59.884933+0000","last_fullsized":"2024-02-15T22:57:59.884933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:59.884790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:59.884790+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.884790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:05.894308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.000916+0000","last_change":"2024-02-15T22:57:57.000916+0000","last_active":"2024-02-15T22:57:57.000916+0000","last_peered":"2024-02-15T22:57:57.000916+0000","last_clean":"2024-02-15T22:57:57.000916+0000","last_became_active":"2024-02-15T22:56:09.715019+0000","last_became_peered":"2024-02-15T22:56:09.715019+0000","last_unstale":"2024-02-15T22:57:57.000916+0000","last_undegraded":"2024-02-15T22:57:57.000916+0000","last_fullsized":"2024-02-15T22:57:57.000916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-15T22:57:57.000759+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-15T22:57:57.000759+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.000759+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:45:12.812634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.357140+0000","last_change":"2024-02-15T22:57:50.357140+0000","last_active":"2024-02-15T22:57:50.357140+0000","last_peered":"2024-02-15T22:57:50.357140+0000","last_clean":"2024-02-15T22:57:50.357140+0000","last_became_active":"2024-02-15T22:56:11.719845+0000","last_became_peered":"2024-02-15T22:56:11.719845+0000","last_unstale":"2024-02-15T22:57:50.357140+0000","last_undegraded":"2024-02-15T22:57:50.357140+0000","last_fullsized":"2024-02-15T22:57:50.357140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.357021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.357021+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.357021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:06.000871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.823633+0000","last_change":"2024-02-15T22:58:34.823667+0000","last_active":"2024-02-15T22:58:34.823633+0000","last_peered":"2024-02-15T22:58:34.823633+0000","last_clean":"2024-02-15T22:58:34.823633+0000","last_became_active":"2024-02-15T22:56:13.732321+0000","last_became_peered":"2024-02-15T22:56:13.732321+0000","last_unstale":"2024-02-15T22:58:34.823633+0000","last_undegraded":"2024-02-15T22:58:34.823633+0000","last_fullsized":"2024-02-15T22:58:34.823633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:58:34.823529+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:58:34.823529+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.823529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:12:30.547146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.868943+0000","last_change":"2024-02-15T22:58:19.869033+0000","last_active":"2024-02-15T22:58:19.868943+0000","last_peered":"2024-02-15T22:58:19.868943+0000","last_clean":"2024-02-15T22:58:19.868943+0000","last_became_active":"2024-02-15T22:56:05.697834+0000","last_became_peered":"2024-02-15T22:56:05.697834+0000","last_unstale":"2024-02-15T22:58:19.868943+0000","last_undegraded":"2024-02-15T22:58:19.868943+0000","last_fullsized":"2024-02-15T22:58:19.868943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:19.868817+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:19.868817+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.868817+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:50.766383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.855300+0000","last_change":"2024-02-15T22:58:12.855300+0000","last_active":"2024-02-15T22:58:12.855300+0000","last_peered":"2024-02-15T22:58:12.855300+0000","last_clean":"2024-02-15T22:58:12.855300+0000","last_became_active":"2024-02-15T22:56:03.702353+0000","last_became_peered":"2024-02-15T22:56:03.702353+0000","last_unstale":"2024-02-15T22:58:12.855300+0000","last_undegraded":"2024-02-15T22:58:12.855300+0000","last_fullsized":"2024-02-15T22:58:12.855300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.855162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.855162+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.855162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:40.679343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.208925+0000","last_change":"2024-02-15T22:58:07.208925+0000","last_active":"2024-02-15T22:58:07.208925+0000","last_peered":"2024-02-15T22:58:07.208925+0000","last_clean":"2024-02-15T22:58:07.208925+0000","last_became_active":"2024-02-15T22:56:07.706656+0000","last_became_peered":"2024-02-15T22:56:07.706656+0000","last_unstale":"2024-02-15T22:58:07.208925+0000","last_undegraded":"2024-02-15T22:58:07.208925+0000","last_fullsized":"2024-02-15T22:58:07.208925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.208777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.208777+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.208777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:31.806933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.993269+0000","last_change":"2024-02-15T22:57:52.993269+0000","last_active":"2024-02-15T22:57:52.993269+0000","last_peered":"2024-02-15T22:57:52.993269+0000","last_clean":"2024-02-15T22:57:52.993269+0000","last_became_active":"2024-02-15T22:56:09.716138+0000","last_became_peered":"2024-02-15T22:56:09.716138+0000","last_unstale":"2024-02-15T22:57:52.993269+0000","last_undegraded":"2024-02-15T22:57:52.993269+0000","last_fullsized":"2024-02-15T22:57:52.993269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:57:52.993117+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:57:52.993117+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.993117+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:16.156318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.238737+0000","last_change":"2024-02-15T22:58:04.238737+0000","last_active":"2024-02-15T22:58:04.238737+0000","last_peered":"2024-02-15T22:58:04.238737+0000","last_clean":"2024-02-15T22:58:04.238737+0000","last_became_active":"2024-02-15T22:56:11.724317+0000","last_became_peered":"2024-02-15T22:56:11.724317+0000","last_unstale":"2024-02-15T22:58:04.238737+0000","last_undegraded":"2024-02-15T22:58:04.238737+0000","last_fullsized":"2024-02-15T22:58:04.238737+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:04.238614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:04.238614+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.238614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:27.604291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:41.860482+0000","last_change":"2024-02-15T22:58:41.860509+0000","last_active":"2024-02-15T22:58:41.860482+0000","last_peered":"2024-02-15T22:58:41.860482+0000","last_clean":"2024-02-15T22:58:41.860482+0000","last_became_active":"2024-02-15T22:56:13.733118+0000","last_became_peered":"2024-02-15T22:56:13.733118+0000","last_unstale":"2024-02-15T22:58:41.860482+0000","last_undegraded":"2024-02-15T22:58:41.860482+0000","last_fullsized":"2024-02-15T22:58:41.860482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:41.860400+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:41.860400+0000","last_clean_scrub_stamp":"2024-02-15T22:58:41.860400+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:36:47.619526+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'20","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.823539+0000","last_change":"2024-02-15T22:58:38.823565+0000","last_active":"2024-02-15T22:58:38.823539+0000","last_peered":"2024-02-15T22:58:38.823539+0000","last_clean":"2024-02-15T22:58:38.823539+0000","last_became_active":"2024-02-15T22:56:45.886248+0000","last_became_peered":"2024-02-15T22:56:45.886248+0000","last_unstale":"2024-02-15T22:58:38.823539+0000","last_undegraded":"2024-02-15T22:58:38.823539+0000","last_fullsized":"2024-02-15T22:58:38.823539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-02-15T22:58:38.823451+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-02-15T22:58:38.823451+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.823451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:58.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:48.175496+0000","last_change":"2024-02-15T22:58:48.175523+0000","last_active":"2024-02-15T22:58:48.175496+0000","last_peered":"2024-02-15T22:58:48.175496+0000","last_clean":"2024-02-15T22:58:48.175496+0000","last_became_active":"2024-02-15T22:56:03.700087+0000","last_became_peered":"2024-02-15T22:56:03.700087+0000","last_unstale":"2024-02-15T22:58:48.175496+0000","last_undegraded":"2024-02-15T22:58:48.175496+0000","last_fullsized":"2024-02-15T22:58:48.175496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:48.175395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:48.175395+0000","last_clean_scrub_stamp":"2024-02-15T22:58:48.175395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:19.955411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.176919+0000","last_change":"2024-02-15T22:58:10.176919+0000","last_active":"2024-02-15T22:58:10.176919+0000","last_peered":"2024-02-15T22:58:10.176919+0000","last_clean":"2024-02-15T22:58:10.176919+0000","last_became_active":"2024-02-15T22:56:07.704502+0000","last_became_peered":"2024-02-15T22:56:07.704502+0000","last_unstale":"2024-02-15T22:58:10.176919+0000","last_undegraded":"2024-02-15T22:58:10.176919+0000","last_fullsized":"2024-02-15T22:58:10.176919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:10.176806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:10.176806+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.176806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:13.375626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'44","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.182521+0000","last_change":"2024-02-15T22:58:22.182562+0000","last_active":"2024-02-15T22:58:22.182521+0000","last_peered":"2024-02-15T22:58:22.182521+0000","last_clean":"2024-02-15T22:58:22.182521+0000","last_became_active":"2024-02-15T22:56:09.717174+0000","last_became_peered":"2024-02-15T22:56:09.717174+0000","last_unstale":"2024-02-15T22:58:22.182521+0000","last_undegraded":"2024-02-15T22:58:22.182521+0000","last_fullsized":"2024-02-15T22:58:22.182521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:58:22.182437+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:58:22.182437+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.182437+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:01.680145+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":313,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.299547+0000","last_change":"2024-02-15T22:58:00.299547+0000","last_active":"2024-02-15T22:58:00.299547+0000","last_peered":"2024-02-15T22:58:00.299547+0000","last_clean":"2024-02-15T22:58:00.299547+0000","last_became_active":"2024-02-15T22:56:11.724273+0000","last_became_peered":"2024-02-15T22:56:11.724273+0000","last_unstale":"2024-02-15T22:58:00.299547+0000","last_undegraded":"2024-02-15T22:58:00.299547+0000","last_fullsized":"2024-02-15T22:58:00.299547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:58:00.299415+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:58:00.299415+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.299415+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:33.226403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.241434+0000","last_change":"2024-02-15T22:58:12.241434+0000","last_active":"2024-02-15T22:58:12.241434+0000","last_peered":"2024-02-15T22:58:12.241434+0000","last_clean":"2024-02-15T22:58:12.241434+0000","last_became_active":"2024-02-15T22:56:13.726858+0000","last_became_peered":"2024-02-15T22:56:13.726858+0000","last_unstale":"2024-02-15T22:58:12.241434+0000","last_undegraded":"2024-02-15T22:58:12.241434+0000","last_fullsized":"2024-02-15T22:58:12.241434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.241315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.241315+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.241315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:07:18.462448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.889358+0000","last_change":"2024-02-15T22:58:13.889358+0000","last_active":"2024-02-15T22:58:13.889358+0000","last_peered":"2024-02-15T22:58:13.889358+0000","last_clean":"2024-02-15T22:58:13.889358+0000","last_became_active":"2024-02-15T22:56:05.701568+0000","last_became_peered":"2024-02-15T22:56:05.701568+0000","last_unstale":"2024-02-15T22:58:13.889358+0000","last_undegraded":"2024-02-15T22:58:13.889358+0000","last_fullsized":"2024-02-15T22:58:13.889358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:13.889250+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:13.889250+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.889250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:22.586047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:58.179744+0000","last_change":"2024-02-15T22:58:58.179768+0000","last_active":"2024-02-15T22:58:58.179744+0000","last_peered":"2024-02-15T22:58:58.179744+0000","last_clean":"2024-02-15T22:58:58.179744+0000","last_became_active":"2024-02-15T22:56:03.694668+0000","last_became_peered":"2024-02-15T22:56:03.694668+0000","last_unstale":"2024-02-15T22:58:58.179744+0000","last_undegraded":"2024-02-15T22:58:58.179744+0000","last_fullsized":"2024-02-15T22:58:58.179744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:58.179652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:58.179652+0000","last_clean_scrub_stamp":"2024-02-15T22:58:58.179652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:02:07.739954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.212958+0000","last_change":"2024-02-15T22:58:13.212958+0000","last_active":"2024-02-15T22:58:13.212958+0000","last_peered":"2024-02-15T22:58:13.212958+0000","last_clean":"2024-02-15T22:58:13.212958+0000","last_became_active":"2024-02-15T22:56:07.704054+0000","last_became_peered":"2024-02-15T22:56:07.704054+0000","last_unstale":"2024-02-15T22:58:13.212958+0000","last_undegraded":"2024-02-15T22:58:13.212958+0000","last_fullsized":"2024-02-15T22:58:13.212958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:13.212847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:13.212847+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.212847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:27.614478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.173318+0000","last_change":"2024-02-15T22:58:09.173318+0000","last_active":"2024-02-15T22:58:09.173318+0000","last_peered":"2024-02-15T22:58:09.173318+0000","last_clean":"2024-02-15T22:58:09.173318+0000","last_became_active":"2024-02-15T22:56:09.717264+0000","last_became_peered":"2024-02-15T22:56:09.717264+0000","last_unstale":"2024-02-15T22:58:09.173318+0000","last_undegraded":"2024-02-15T22:58:09.173318+0000","last_fullsized":"2024-02-15T22:58:09.173318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-15T22:58:09.173193+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-15T22:58:09.173193+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.173193+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:35:38.023140+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.388857+0000","last_change":"2024-02-15T22:57:49.388857+0000","last_active":"2024-02-15T22:57:49.388857+0000","last_peered":"2024-02-15T22:57:49.388857+0000","last_clean":"2024-02-15T22:57:49.388857+0000","last_became_active":"2024-02-15T22:56:11.720616+0000","last_became_peered":"2024-02-15T22:56:11.720616+0000","last_unstale":"2024-02-15T22:57:49.388857+0000","last_undegraded":"2024-02-15T22:57:49.388857+0000","last_fullsized":"2024-02-15T22:57:49.388857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.388740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.388740+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.388740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:41.087774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.231314+0000","last_change":"2024-02-15T22:58:16.231314+0000","last_active":"2024-02-15T22:58:16.231314+0000","last_peered":"2024-02-15T22:58:16.231314+0000","last_clean":"2024-02-15T22:58:16.231314+0000","last_became_active":"2024-02-15T22:56:13.729015+0000","last_became_peered":"2024-02-15T22:56:13.729015+0000","last_unstale":"2024-02-15T22:58:16.231314+0000","last_undegraded":"2024-02-15T22:58:16.231314+0000","last_fullsized":"2024-02-15T22:58:16.231314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:16.231166+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:16.231166+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.231166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:47.128732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.838371+0000","last_change":"2024-02-15T22:58:39.838371+0000","last_active":"2024-02-15T22:58:39.838371+0000","last_peered":"2024-02-15T22:58:39.838371+0000","last_clean":"2024-02-15T22:58:39.838371+0000","last_became_active":"2024-02-15T22:56:45.893017+0000","last_became_peered":"2024-02-15T22:56:45.893017+0000","last_unstale":"2024-02-15T22:58:39.838371+0000","last_undegraded":"2024-02-15T22:58:39.838371+0000","last_fullsized":"2024-02-15T22:58:39.838371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:39.838252+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:39.838252+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.838252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:36:08.688199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:48.361917+0000","last_change":"2024-02-15T22:58:48.361940+0000","last_active":"2024-02-15T22:58:48.361917+0000","last_peered":"2024-02-15T22:58:48.361917+0000","last_clean":"2024-02-15T22:58:48.361917+0000","last_became_active":"2024-02-15T22:56:45.886530+0000","last_became_peered":"2024-02-15T22:56:45.886530+0000","last_unstale":"2024-02-15T22:58:48.361917+0000","last_undegraded":"2024-02-15T22:58:48.361917+0000","last_fullsized":"2024-02-15T22:58:48.361917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:48.361832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:48.361832+0000","last_clean_scrub_stamp":"2024-02-15T22:58:48.361832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:04:00.156122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.012863+0000","last_change":"2024-02-15T22:58:03.012863+0000","last_active":"2024-02-15T22:58:03.012863+0000","last_peered":"2024-02-15T22:58:03.012863+0000","last_clean":"2024-02-15T22:58:03.012863+0000","last_became_active":"2024-02-15T22:56:07.707207+0000","last_became_peered":"2024-02-15T22:56:07.707207+0000","last_unstale":"2024-02-15T22:58:03.012863+0000","last_undegraded":"2024-02-15T22:58:03.012863+0000","last_fullsized":"2024-02-15T22:58:03.012863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:03.012756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:03.012756+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.012756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:57:24.662100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.911848+0000","last_change":"2024-02-15T22:57:51.911848+0000","last_active":"2024-02-15T22:57:51.911848+0000","last_peered":"2024-02-15T22:57:51.911848+0000","last_clean":"2024-02-15T22:57:51.911848+0000","last_became_active":"2024-02-15T22:56:09.714592+0000","last_became_peered":"2024-02-15T22:56:09.714592+0000","last_unstale":"2024-02-15T22:57:51.911848+0000","last_undegraded":"2024-02-15T22:57:51.911848+0000","last_fullsized":"2024-02-15T22:57:51.911848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-15T22:57:51.911723+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-15T22:57:51.911723+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.911723+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:55.109902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.119618+0000","last_change":"2024-02-15T22:58:15.119618+0000","last_active":"2024-02-15T22:58:15.119618+0000","last_peered":"2024-02-15T22:58:15.119618+0000","last_clean":"2024-02-15T22:58:15.119618+0000","last_became_active":"2024-02-15T22:56:11.723557+0000","last_became_peered":"2024-02-15T22:56:11.723557+0000","last_unstale":"2024-02-15T22:58:15.119618+0000","last_undegraded":"2024-02-15T22:58:15.119618+0000","last_fullsized":"2024-02-15T22:58:15.119618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:15.119498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:15.119498+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.119498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:26.132469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.172807+0000","last_change":"2024-02-15T22:58:29.172829+0000","last_active":"2024-02-15T22:58:29.172807+0000","last_peered":"2024-02-15T22:58:29.172807+0000","last_clean":"2024-02-15T22:58:29.172807+0000","last_became_active":"2024-02-15T22:56:13.726586+0000","last_became_peered":"2024-02-15T22:56:13.726586+0000","last_unstale":"2024-02-15T22:58:29.172807+0000","last_undegraded":"2024-02-15T22:58:29.172807+0000","last_fullsized":"2024-02-15T22:58:29.172807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:29.172716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:29.172716+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.172716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:48:22.998360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.049602+0000","last_change":"2024-02-15T22:57:59.049602+0000","last_active":"2024-02-15T22:57:59.049602+0000","last_peered":"2024-02-15T22:57:59.049602+0000","last_clean":"2024-02-15T22:57:59.049602+0000","last_became_active":"2024-02-15T22:56:05.716590+0000","last_became_peered":"2024-02-15T22:56:05.716590+0000","last_unstale":"2024-02-15T22:57:59.049602+0000","last_undegraded":"2024-02-15T22:57:59.049602+0000","last_fullsized":"2024-02-15T22:57:59.049602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-15T22:57:59.049477+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-15T22:57:59.049477+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.049477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:05.045262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:47.194380+0000","last_change":"2024-02-15T22:58:47.194421+0000","last_active":"2024-02-15T22:58:47.194380+0000","last_peered":"2024-02-15T22:58:47.194380+0000","last_clean":"2024-02-15T22:58:47.194380+0000","last_became_active":"2024-02-15T22:56:03.702875+0000","last_became_peered":"2024-02-15T22:56:03.702875+0000","last_unstale":"2024-02-15T22:58:47.194380+0000","last_undegraded":"2024-02-15T22:58:47.194380+0000","last_fullsized":"2024-02-15T22:58:47.194380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:47.194284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:47.194284+0000","last_clean_scrub_stamp":"2024-02-15T22:58:47.194284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:24:31.964461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.194271+0000","last_change":"2024-02-15T22:58:11.194271+0000","last_active":"2024-02-15T22:58:11.194271+0000","last_peered":"2024-02-15T22:58:11.194271+0000","last_clean":"2024-02-15T22:58:11.194271+0000","last_became_active":"2024-02-15T22:56:07.704058+0000","last_became_peered":"2024-02-15T22:56:07.704058+0000","last_unstale":"2024-02-15T22:58:11.194271+0000","last_undegraded":"2024-02-15T22:58:11.194271+0000","last_fullsized":"2024-02-15T22:58:11.194271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.194159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.194159+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.194159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:19:30.005727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'44","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.970287+0000","last_change":"2024-02-15T22:57:57.970287+0000","last_active":"2024-02-15T22:57:57.970287+0000","last_peered":"2024-02-15T22:57:57.970287+0000","last_clean":"2024-02-15T22:57:57.970287+0000","last_became_active":"2024-02-15T22:56:09.712113+0000","last_became_peered":"2024-02-15T22:56:09.712113+0000","last_unstale":"2024-02-15T22:57:57.970287+0000","last_undegraded":"2024-02-15T22:57:57.970287+0000","last_fullsized":"2024-02-15T22:57:57.970287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:57:57.970127+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:57:57.970127+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.970127+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:59.472492+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":344,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.871443+0000","last_change":"2024-02-15T22:57:47.871443+0000","last_active":"2024-02-15T22:57:47.871443+0000","last_peered":"2024-02-15T22:57:47.871443+0000","last_clean":"2024-02-15T22:57:47.871443+0000","last_became_active":"2024-02-15T22:56:11.720390+0000","last_became_peered":"2024-02-15T22:56:11.720390+0000","last_unstale":"2024-02-15T22:57:47.871443+0000","last_undegraded":"2024-02-15T22:57:47.871443+0000","last_fullsized":"2024-02-15T22:57:47.871443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:47.871285+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:47.871285+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.871285+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:51.713747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:44.376467+0000","last_change":"2024-02-15T22:58:44.376496+0000","last_active":"2024-02-15T22:58:44.376467+0000","last_peered":"2024-02-15T22:58:44.376467+0000","last_clean":"2024-02-15T22:58:44.376467+0000","last_became_active":"2024-02-15T22:56:13.734227+0000","last_became_peered":"2024-02-15T22:56:13.734227+0000","last_unstale":"2024-02-15T22:58:44.376467+0000","last_undegraded":"2024-02-15T22:58:44.376467+0000","last_fullsized":"2024-02-15T22:58:44.376467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:44.376377+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:44.376377+0000","last_clean_scrub_stamp":"2024-02-15T22:58:44.376377+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:23.874085+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.945487+0000","last_change":"2024-02-15T22:58:23.945528+0000","last_active":"2024-02-15T22:58:23.945487+0000","last_peered":"2024-02-15T22:58:23.945487+0000","last_clean":"2024-02-15T22:58:23.945487+0000","last_became_active":"2024-02-15T22:56:05.705551+0000","last_became_peered":"2024-02-15T22:56:05.705551+0000","last_unstale":"2024-02-15T22:58:23.945487+0000","last_undegraded":"2024-02-15T22:58:23.945487+0000","last_fullsized":"2024-02-15T22:58:23.945487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.945394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.945394+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.945394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:34:07.500646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:51.174836+0000","last_change":"2024-02-15T22:58:51.174864+0000","last_active":"2024-02-15T22:58:51.174836+0000","last_peered":"2024-02-15T22:58:51.174836+0000","last_clean":"2024-02-15T22:58:51.174836+0000","last_became_active":"2024-02-15T22:56:03.704526+0000","last_became_peered":"2024-02-15T22:56:03.704526+0000","last_unstale":"2024-02-15T22:58:51.174836+0000","last_undegraded":"2024-02-15T22:58:51.174836+0000","last_fullsized":"2024-02-15T22:58:51.174836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:51.174743+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:51.174743+0000","last_clean_scrub_stamp":"2024-02-15T22:58:51.174743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:14:59.893936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'9","reported_seq":547,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.866099+0000","last_change":"2024-02-15T22:58:01.866099+0000","last_active":"2024-02-15T22:58:01.866099+0000","last_peered":"2024-02-15T22:58:01.866099+0000","last_clean":"2024-02-15T22:58:01.866099+0000","last_became_active":"2024-02-15T22:56:07.704281+0000","last_became_peered":"2024-02-15T22:56:07.704281+0000","last_unstale":"2024-02-15T22:58:01.866099+0000","last_undegraded":"2024-02-15T22:58:01.866099+0000","last_fullsized":"2024-02-15T22:58:01.866099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-15T22:58:01.865973+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-15T22:58:01.865973+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.865973+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:28.422958+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":595,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.204666+0000","last_change":"2024-02-15T22:58:05.204666+0000","last_active":"2024-02-15T22:58:05.204666+0000","last_peered":"2024-02-15T22:58:05.204666+0000","last_clean":"2024-02-15T22:58:05.204666+0000","last_became_active":"2024-02-15T22:56:09.717735+0000","last_became_peered":"2024-02-15T22:56:09.717735+0000","last_unstale":"2024-02-15T22:58:05.204666+0000","last_undegraded":"2024-02-15T22:58:05.204666+0000","last_fullsized":"2024-02-15T22:58:05.204666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:58:05.204500+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:58:05.204500+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.204500+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:17:36.367930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":387,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.877265+0000","last_change":"2024-02-15T22:57:46.877265+0000","last_active":"2024-02-15T22:57:46.877265+0000","last_peered":"2024-02-15T22:57:46.877265+0000","last_clean":"2024-02-15T22:57:46.877265+0000","last_became_active":"2024-02-15T22:56:11.717380+0000","last_became_peered":"2024-02-15T22:56:11.717380+0000","last_unstale":"2024-02-15T22:57:46.877265+0000","last_undegraded":"2024-02-15T22:57:46.877265+0000","last_fullsized":"2024-02-15T22:57:46.877265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:46.877108+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:46.877108+0000","last_clean_scrub_stamp":"2024-02-15T22:57:46.877108+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:13:26.299004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.974720+0000","last_change":"2024-02-15T22:58:03.974720+0000","last_active":"2024-02-15T22:58:03.974720+0000","last_peered":"2024-02-15T22:58:03.974720+0000","last_clean":"2024-02-15T22:58:03.974720+0000","last_became_active":"2024-02-15T22:56:13.729467+0000","last_became_peered":"2024-02-15T22:56:13.729467+0000","last_unstale":"2024-02-15T22:58:03.974720+0000","last_undegraded":"2024-02-15T22:58:03.974720+0000","last_fullsized":"2024-02-15T22:58:03.974720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:03.974606+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:03.974606+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.974606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:15.983952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"30'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.800305+0000","last_change":"2024-02-15T22:58:40.800305+0000","last_active":"2024-02-15T22:58:40.800305+0000","last_peered":"2024-02-15T22:58:40.800305+0000","last_clean":"2024-02-15T22:58:40.800305+0000","last_became_active":"2024-02-15T22:56:45.892949+0000","last_became_peered":"2024-02-15T22:56:45.892949+0000","last_unstale":"2024-02-15T22:58:40.800305+0000","last_undegraded":"2024-02-15T22:58:40.800305+0000","last_fullsized":"2024-02-15T22:58:40.800305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:40.800199+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:40.800199+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.800199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:54.182110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:43.210282+0000","last_change":"2024-02-15T22:58:43.210317+0000","last_active":"2024-02-15T22:58:43.210282+0000","last_peered":"2024-02-15T22:58:43.210282+0000","last_clean":"2024-02-15T22:58:43.210282+0000","last_became_active":"2024-02-15T22:56:03.702035+0000","last_became_peered":"2024-02-15T22:56:03.702035+0000","last_unstale":"2024-02-15T22:58:43.210282+0000","last_undegraded":"2024-02-15T22:58:43.210282+0000","last_fullsized":"2024-02-15T22:58:43.210282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:43.210199+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:43.210199+0000","last_clean_scrub_stamp":"2024-02-15T22:58:43.210199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:24:20.480239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.003934+0000","last_change":"2024-02-15T22:57:52.003934+0000","last_active":"2024-02-15T22:57:52.003934+0000","last_peered":"2024-02-15T22:57:52.003934+0000","last_clean":"2024-02-15T22:57:52.003934+0000","last_became_active":"2024-02-15T22:56:07.706615+0000","last_became_peered":"2024-02-15T22:56:07.706615+0000","last_unstale":"2024-02-15T22:57:52.003934+0000","last_undegraded":"2024-02-15T22:57:52.003934+0000","last_fullsized":"2024-02-15T22:57:52.003934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.003831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.003831+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.003831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:06.405461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.860641+0000","last_change":"2024-02-15T22:57:53.860641+0000","last_active":"2024-02-15T22:57:53.860641+0000","last_peered":"2024-02-15T22:57:53.860641+0000","last_clean":"2024-02-15T22:57:53.860641+0000","last_became_active":"2024-02-15T22:56:09.713660+0000","last_became_peered":"2024-02-15T22:56:09.713660+0000","last_unstale":"2024-02-15T22:57:53.860641+0000","last_undegraded":"2024-02-15T22:57:53.860641+0000","last_fullsized":"2024-02-15T22:57:53.860641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-02-15T22:57:53.860514+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-02-15T22:57:53.860514+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.860514+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:09.504364+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.953591+0000","last_change":"2024-02-15T22:57:51.953591+0000","last_active":"2024-02-15T22:57:51.953591+0000","last_peered":"2024-02-15T22:57:51.953591+0000","last_clean":"2024-02-15T22:57:51.953591+0000","last_became_active":"2024-02-15T22:56:11.724575+0000","last_became_peered":"2024-02-15T22:56:11.724575+0000","last_unstale":"2024-02-15T22:57:51.953591+0000","last_undegraded":"2024-02-15T22:57:51.953591+0000","last_fullsized":"2024-02-15T22:57:51.953591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:51.953487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:51.953487+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.953487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:16:47.214571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.822668+0000","last_change":"2024-02-15T22:58:04.822668+0000","last_active":"2024-02-15T22:58:04.822668+0000","last_peered":"2024-02-15T22:58:04.822668+0000","last_clean":"2024-02-15T22:58:04.822668+0000","last_became_active":"2024-02-15T22:56:13.722550+0000","last_became_peered":"2024-02-15T22:56:13.722550+0000","last_unstale":"2024-02-15T22:58:04.822668+0000","last_undegraded":"2024-02-15T22:58:04.822668+0000","last_fullsized":"2024-02-15T22:58:04.822668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:04.822525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:04.822525+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.822525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:19.922383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.150482+0000","last_change":"2024-02-15T22:58:02.150482+0000","last_active":"2024-02-15T22:58:02.150482+0000","last_peered":"2024-02-15T22:58:02.150482+0000","last_clean":"2024-02-15T22:58:02.150482+0000","last_became_active":"2024-02-15T22:56:05.715513+0000","last_became_peered":"2024-02-15T22:56:05.715513+0000","last_unstale":"2024-02-15T22:58:02.150482+0000","last_undegraded":"2024-02-15T22:58:02.150482+0000","last_fullsized":"2024-02-15T22:58:02.150482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-15T22:58:02.150334+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-15T22:58:02.150334+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.150334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:52:56.881211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":210,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.912168+0000","last_change":"2024-02-15T22:58:30.912209+0000","last_active":"2024-02-15T22:58:30.912168+0000","last_peered":"2024-02-15T22:58:30.912168+0000","last_clean":"2024-02-15T22:58:30.912168+0000","last_became_active":"2024-02-15T22:55:52.657750+0000","last_became_peered":"2024-02-15T22:55:52.657750+0000","last_unstale":"2024-02-15T22:58:30.912168+0000","last_undegraded":"2024-02-15T22:58:30.912168+0000","last_fullsized":"2024-02-15T22:58:30.912168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-02-15T22:58:30.912082+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-02-15T22:58:30.912082+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.912082+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:11.193723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:01.177631+0000","last_change":"2024-02-15T22:59:01.177658+0000","last_active":"2024-02-15T22:59:01.177631+0000","last_peered":"2024-02-15T22:59:01.177631+0000","last_clean":"2024-02-15T22:59:01.177631+0000","last_became_active":"2024-02-15T22:55:57.672281+0000","last_became_peered":"2024-02-15T22:55:57.672281+0000","last_unstale":"2024-02-15T22:59:01.177631+0000","last_undegraded":"2024-02-15T22:59:01.177631+0000","last_fullsized":"2024-02-15T22:59:01.177631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:01.177537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:01.177537+0000","last_clean_scrub_stamp":"2024-02-15T22:59:01.177537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:01.479337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.159145+0000","last_change":"2024-02-15T22:58:40.159166+0000","last_active":"2024-02-15T22:58:40.159145+0000","last_peered":"2024-02-15T22:58:40.159145+0000","last_clean":"2024-02-15T22:58:40.159145+0000","last_became_active":"2024-02-15T22:56:03.706721+0000","last_became_peered":"2024-02-15T22:56:03.706721+0000","last_unstale":"2024-02-15T22:58:40.159145+0000","last_undegraded":"2024-02-15T22:58:40.159145+0000","last_fullsized":"2024-02-15T22:58:40.159145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:40.159068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:40.159068+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.159068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:21:27.293449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:45.829169+0000","last_change":"2024-02-15T22:58:45.829191+0000","last_active":"2024-02-15T22:58:45.829169+0000","last_peered":"2024-02-15T22:58:45.829169+0000","last_clean":"2024-02-15T22:58:45.829169+0000","last_became_active":"2024-02-15T22:56:45.887260+0000","last_became_peered":"2024-02-15T22:56:45.887260+0000","last_unstale":"2024-02-15T22:58:45.829169+0000","last_undegraded":"2024-02-15T22:58:45.829169+0000","last_fullsized":"2024-02-15T22:58:45.829169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:45.829085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:45.829085+0000","last_clean_scrub_stamp":"2024-02-15T22:58:45.829085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:40:05.544538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'81","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.126986+0000","last_change":"2024-02-15T22:58:01.126986+0000","last_active":"2024-02-15T22:58:01.126986+0000","last_peered":"2024-02-15T22:58:01.126986+0000","last_clean":"2024-02-15T22:58:01.126986+0000","last_became_active":"2024-02-15T22:56:09.716109+0000","last_became_peered":"2024-02-15T22:56:09.716109+0000","last_unstale":"2024-02-15T22:58:01.126986+0000","last_undegraded":"2024-02-15T22:58:01.126986+0000","last_fullsized":"2024-02-15T22:58:01.126986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-02-15T22:58:01.126822+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-02-15T22:58:01.126822+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.126822+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:24.668741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:52.351175+0000","last_change":"2024-02-15T22:57:52.351175+0000","last_active":"2024-02-15T22:57:52.351175+0000","last_peered":"2024-02-15T22:57:52.351175+0000","last_clean":"2024-02-15T22:57:52.351175+0000","last_became_active":"2024-02-15T22:56:11.722390+0000","last_became_peered":"2024-02-15T22:56:11.722390+0000","last_unstale":"2024-02-15T22:57:52.351175+0000","last_undegraded":"2024-02-15T22:57:52.351175+0000","last_fullsized":"2024-02-15T22:57:52.351175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:52.351041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:52.351041+0000","last_clean_scrub_stamp":"2024-02-15T22:57:52.351041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:26.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.817643+0000","last_change":"2024-02-15T22:58:36.817669+0000","last_active":"2024-02-15T22:58:36.817643+0000","last_peered":"2024-02-15T22:58:36.817643+0000","last_clean":"2024-02-15T22:58:36.817643+0000","last_became_active":"2024-02-15T22:56:13.732437+0000","last_became_peered":"2024-02-15T22:56:13.732437+0000","last_unstale":"2024-02-15T22:58:36.817643+0000","last_undegraded":"2024-02-15T22:58:36.817643+0000","last_fullsized":"2024-02-15T22:58:36.817643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-15T22:58:36.817537+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-15T22:58:36.817537+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.817537+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:42:08.747988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.192867+0000","last_change":"2024-02-15T22:58:34.192905+0000","last_active":"2024-02-15T22:58:34.192867+0000","last_peered":"2024-02-15T22:58:34.192867+0000","last_clean":"2024-02-15T22:58:34.192867+0000","last_became_active":"2024-02-15T22:56:05.699679+0000","last_became_peered":"2024-02-15T22:56:05.699679+0000","last_unstale":"2024-02-15T22:58:34.192867+0000","last_undegraded":"2024-02-15T22:58:34.192867+0000","last_fullsized":"2024-02-15T22:58:34.192867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:34.192733+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:34.192733+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.192733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:46:23.150003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:02.218879+0000","last_change":"2024-02-15T22:59:02.218908+0000","last_active":"2024-02-15T22:59:02.218879+0000","last_peered":"2024-02-15T22:59:02.218879+0000","last_clean":"2024-02-15T22:59:02.218879+0000","last_became_active":"2024-02-15T22:55:57.672705+0000","last_became_peered":"2024-02-15T22:55:57.672705+0000","last_unstale":"2024-02-15T22:59:02.218879+0000","last_undegraded":"2024-02-15T22:59:02.218879+0000","last_fullsized":"2024-02-15T22:59:02.218879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:02.218745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:02.218745+0000","last_clean_scrub_stamp":"2024-02-15T22:59:02.218745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:51.502439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.330569+0000","last_change":"2024-02-15T22:58:29.330612+0000","last_active":"2024-02-15T22:58:29.330569+0000","last_peered":"2024-02-15T22:58:29.330569+0000","last_clean":"2024-02-15T22:58:29.330569+0000","last_became_active":"2024-02-15T22:56:03.699864+0000","last_became_peered":"2024-02-15T22:56:03.699864+0000","last_unstale":"2024-02-15T22:58:29.330569+0000","last_undegraded":"2024-02-15T22:58:29.330569+0000","last_fullsized":"2024-02-15T22:58:29.330569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:29.330452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:29.330452+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.330452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:47.505596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.977656+0000","last_change":"2024-02-15T22:57:50.977656+0000","last_active":"2024-02-15T22:57:50.977656+0000","last_peered":"2024-02-15T22:57:50.977656+0000","last_clean":"2024-02-15T22:57:50.977656+0000","last_became_active":"2024-02-15T22:56:07.707620+0000","last_became_peered":"2024-02-15T22:56:07.707620+0000","last_unstale":"2024-02-15T22:57:50.977656+0000","last_undegraded":"2024-02-15T22:57:50.977656+0000","last_fullsized":"2024-02-15T22:57:50.977656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.977533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.977533+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.977533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:06:57.198666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":447,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.870292+0000","last_change":"2024-02-15T22:57:50.870292+0000","last_active":"2024-02-15T22:57:50.870292+0000","last_peered":"2024-02-15T22:57:50.870292+0000","last_clean":"2024-02-15T22:57:50.870292+0000","last_became_active":"2024-02-15T22:56:09.718396+0000","last_became_peered":"2024-02-15T22:56:09.718396+0000","last_unstale":"2024-02-15T22:57:50.870292+0000","last_undegraded":"2024-02-15T22:57:50.870292+0000","last_fullsized":"2024-02-15T22:57:50.870292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-02-15T22:57:50.870120+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-02-15T22:57:50.870120+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.870120+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:17:52.372485+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.133283+0000","last_change":"2024-02-15T22:58:11.133283+0000","last_active":"2024-02-15T22:58:11.133283+0000","last_peered":"2024-02-15T22:58:11.133283+0000","last_clean":"2024-02-15T22:58:11.133283+0000","last_became_active":"2024-02-15T22:56:11.725005+0000","last_became_peered":"2024-02-15T22:56:11.725005+0000","last_unstale":"2024-02-15T22:58:11.133283+0000","last_undegraded":"2024-02-15T22:58:11.133283+0000","last_fullsized":"2024-02-15T22:58:11.133283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.133157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.133157+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.133157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:19:51.739962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:43.851177+0000","last_change":"2024-02-15T22:58:43.851204+0000","last_active":"2024-02-15T22:58:43.851177+0000","last_peered":"2024-02-15T22:58:43.851177+0000","last_clean":"2024-02-15T22:58:43.851177+0000","last_became_active":"2024-02-15T22:56:13.733760+0000","last_became_peered":"2024-02-15T22:56:13.733760+0000","last_unstale":"2024-02-15T22:58:43.851177+0000","last_undegraded":"2024-02-15T22:58:43.851177+0000","last_fullsized":"2024-02-15T22:58:43.851177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:58:43.851088+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:58:43.851088+0000","last_clean_scrub_stamp":"2024-02-15T22:58:43.851088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:42.577719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.342257+0000","last_change":"2024-02-15T22:58:28.342294+0000","last_active":"2024-02-15T22:58:28.342257+0000","last_peered":"2024-02-15T22:58:28.342257+0000","last_clean":"2024-02-15T22:58:28.342257+0000","last_became_active":"2024-02-15T22:56:05.704953+0000","last_became_peered":"2024-02-15T22:56:05.704953+0000","last_unstale":"2024-02-15T22:58:28.342257+0000","last_undegraded":"2024-02-15T22:58:28.342257+0000","last_fullsized":"2024-02-15T22:58:28.342257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:28.342172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:28.342172+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.342172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:42:00.272623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.926087+0000","last_change":"2024-02-15T22:58:25.926114+0000","last_active":"2024-02-15T22:58:25.926087+0000","last_peered":"2024-02-15T22:58:25.926087+0000","last_clean":"2024-02-15T22:58:25.926087+0000","last_became_active":"2024-02-15T22:55:57.671130+0000","last_became_peered":"2024-02-15T22:55:57.671130+0000","last_unstale":"2024-02-15T22:58:25.926087+0000","last_undegraded":"2024-02-15T22:58:25.926087+0000","last_fullsized":"2024-02-15T22:58:25.926087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.925997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.925997+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.925997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:51.947906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.386100+0000","last_change":"2024-02-15T22:58:33.386127+0000","last_active":"2024-02-15T22:58:33.386100+0000","last_peered":"2024-02-15T22:58:33.386100+0000","last_clean":"2024-02-15T22:58:33.386100+0000","last_became_active":"2024-02-15T22:56:03.699598+0000","last_became_peered":"2024-02-15T22:56:03.699598+0000","last_unstale":"2024-02-15T22:58:33.386100+0000","last_undegraded":"2024-02-15T22:58:33.386100+0000","last_fullsized":"2024-02-15T22:58:33.386100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:33.385993+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:33.385993+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.385993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:03:57.567548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.962853+0000","last_change":"2024-02-15T22:58:05.962853+0000","last_active":"2024-02-15T22:58:05.962853+0000","last_peered":"2024-02-15T22:58:05.962853+0000","last_clean":"2024-02-15T22:58:05.962853+0000","last_became_active":"2024-02-15T22:56:07.704107+0000","last_became_peered":"2024-02-15T22:56:07.704107+0000","last_unstale":"2024-02-15T22:58:05.962853+0000","last_undegraded":"2024-02-15T22:58:05.962853+0000","last_fullsized":"2024-02-15T22:58:05.962853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:05.962670+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:05.962670+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.962670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:35.552053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.972000+0000","last_change":"2024-02-15T22:57:58.972000+0000","last_active":"2024-02-15T22:57:58.972000+0000","last_peered":"2024-02-15T22:57:58.972000+0000","last_clean":"2024-02-15T22:57:58.972000+0000","last_became_active":"2024-02-15T22:56:09.711494+0000","last_became_peered":"2024-02-15T22:56:09.711494+0000","last_unstale":"2024-02-15T22:57:58.972000+0000","last_undegraded":"2024-02-15T22:57:58.972000+0000","last_fullsized":"2024-02-15T22:57:58.972000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-02-15T22:57:58.971860+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-02-15T22:57:58.971860+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.971860+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:36:02.170038+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.345803+0000","last_change":"2024-02-15T22:57:47.345803+0000","last_active":"2024-02-15T22:57:47.345803+0000","last_peered":"2024-02-15T22:57:47.345803+0000","last_clean":"2024-02-15T22:57:47.345803+0000","last_became_active":"2024-02-15T22:56:11.722277+0000","last_became_peered":"2024-02-15T22:56:11.722277+0000","last_unstale":"2024-02-15T22:57:47.345803+0000","last_undegraded":"2024-02-15T22:57:47.345803+0000","last_fullsized":"2024-02-15T22:57:47.345803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.345669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.345669+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.345669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:53:30.201838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.154491+0000","last_change":"2024-02-15T22:58:25.154491+0000","last_active":"2024-02-15T22:58:25.154491+0000","last_peered":"2024-02-15T22:58:25.154491+0000","last_clean":"2024-02-15T22:58:25.154491+0000","last_became_active":"2024-02-15T22:56:13.726165+0000","last_became_peered":"2024-02-15T22:56:13.726165+0000","last_unstale":"2024-02-15T22:58:25.154491+0000","last_undegraded":"2024-02-15T22:58:25.154491+0000","last_fullsized":"2024-02-15T22:58:25.154491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.154393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.154393+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.154393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:00:50.346134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.355105+0000","last_change":"2024-02-15T22:58:32.355136+0000","last_active":"2024-02-15T22:58:32.355105+0000","last_peered":"2024-02-15T22:58:32.355105+0000","last_clean":"2024-02-15T22:58:32.355105+0000","last_became_active":"2024-02-15T22:56:05.707171+0000","last_became_peered":"2024-02-15T22:56:05.707171+0000","last_unstale":"2024-02-15T22:58:32.355105+0000","last_undegraded":"2024-02-15T22:58:32.355105+0000","last_fullsized":"2024-02-15T22:58:32.355105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:32.355014+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:32.355014+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.355014+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:45.736925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:00.222031+0000","last_change":"2024-02-15T22:59:00.222060+0000","last_active":"2024-02-15T22:59:00.222031+0000","last_peered":"2024-02-15T22:59:00.222031+0000","last_clean":"2024-02-15T22:59:00.222031+0000","last_became_active":"2024-02-15T22:55:57.672268+0000","last_became_peered":"2024-02-15T22:55:57.672268+0000","last_unstale":"2024-02-15T22:59:00.222031+0000","last_undegraded":"2024-02-15T22:59:00.222031+0000","last_fullsized":"2024-02-15T22:59:00.222031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:00.221899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:00.221899+0000","last_clean_scrub_stamp":"2024-02-15T22:59:00.221899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:56:05.029478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.861421+0000","last_change":"2024-02-15T22:58:31.861445+0000","last_active":"2024-02-15T22:58:31.861421+0000","last_peered":"2024-02-15T22:58:31.861421+0000","last_clean":"2024-02-15T22:58:31.861421+0000","last_became_active":"2024-02-15T22:56:03.693487+0000","last_became_peered":"2024-02-15T22:56:03.693487+0000","last_unstale":"2024-02-15T22:58:31.861421+0000","last_undegraded":"2024-02-15T22:58:31.861421+0000","last_fullsized":"2024-02-15T22:58:31.861421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:31.861328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:31.861328+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.861328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:26.592205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.228589+0000","last_change":"2024-02-15T22:58:06.228589+0000","last_active":"2024-02-15T22:58:06.228589+0000","last_peered":"2024-02-15T22:58:06.228589+0000","last_clean":"2024-02-15T22:58:06.228589+0000","last_became_active":"2024-02-15T22:56:07.707227+0000","last_became_peered":"2024-02-15T22:56:07.707227+0000","last_unstale":"2024-02-15T22:58:06.228589+0000","last_undegraded":"2024-02-15T22:58:06.228589+0000","last_fullsized":"2024-02-15T22:58:06.228589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:06.228482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:06.228482+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.228482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:24:36.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.146475+0000","last_change":"2024-02-15T22:58:18.146475+0000","last_active":"2024-02-15T22:58:18.146475+0000","last_peered":"2024-02-15T22:58:18.146475+0000","last_clean":"2024-02-15T22:58:18.146475+0000","last_became_active":"2024-02-15T22:56:09.719999+0000","last_became_peered":"2024-02-15T22:56:09.719999+0000","last_unstale":"2024-02-15T22:58:18.146475+0000","last_undegraded":"2024-02-15T22:58:18.146475+0000","last_fullsized":"2024-02-15T22:58:18.146475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-02-15T22:58:18.146343+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-02-15T22:58:18.146343+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.146343+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:46:00.908693+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.141146+0000","last_change":"2024-02-15T22:58:14.141146+0000","last_active":"2024-02-15T22:58:14.141146+0000","last_peered":"2024-02-15T22:58:14.141146+0000","last_clean":"2024-02-15T22:58:14.141146+0000","last_became_active":"2024-02-15T22:56:11.723718+0000","last_became_peered":"2024-02-15T22:56:11.723718+0000","last_unstale":"2024-02-15T22:58:14.141146+0000","last_undegraded":"2024-02-15T22:58:14.141146+0000","last_fullsized":"2024-02-15T22:58:14.141146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:14.141029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:14.141029+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.141029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:54:12.738246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.889819+0000","last_change":"2024-02-15T22:58:39.889864+0000","last_active":"2024-02-15T22:58:39.889819+0000","last_peered":"2024-02-15T22:58:39.889819+0000","last_clean":"2024-02-15T22:58:39.889819+0000","last_became_active":"2024-02-15T22:56:13.730551+0000","last_became_peered":"2024-02-15T22:56:13.730551+0000","last_unstale":"2024-02-15T22:58:39.889819+0000","last_undegraded":"2024-02-15T22:58:39.889819+0000","last_fullsized":"2024-02-15T22:58:39.889819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:39.889725+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:39.889725+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.889725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:50.902696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.886211+0000","last_change":"2024-02-15T22:58:07.886211+0000","last_active":"2024-02-15T22:58:07.886211+0000","last_peered":"2024-02-15T22:58:07.886211+0000","last_clean":"2024-02-15T22:58:07.886211+0000","last_became_active":"2024-02-15T22:56:05.714389+0000","last_became_peered":"2024-02-15T22:56:05.714389+0000","last_unstale":"2024-02-15T22:58:07.886211+0000","last_undegraded":"2024-02-15T22:58:07.886211+0000","last_fullsized":"2024-02-15T22:58:07.886211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:07.886088+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:07.886088+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.886088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:31.251765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:28.952076+0000","last_change":"2024-02-15T22:58:28.952099+0000","last_active":"2024-02-15T22:58:28.952076+0000","last_peered":"2024-02-15T22:58:28.952076+0000","last_clean":"2024-02-15T22:58:28.952076+0000","last_became_active":"2024-02-15T22:56:03.693005+0000","last_became_peered":"2024-02-15T22:56:03.693005+0000","last_unstale":"2024-02-15T22:58:28.952076+0000","last_undegraded":"2024-02-15T22:58:28.952076+0000","last_fullsized":"2024-02-15T22:58:28.952076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:28.951988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:28.951988+0000","last_clean_scrub_stamp":"2024-02-15T22:58:28.951988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:34.947773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.360612+0000","last_change":"2024-02-15T22:58:35.360642+0000","last_active":"2024-02-15T22:58:35.360612+0000","last_peered":"2024-02-15T22:58:35.360612+0000","last_clean":"2024-02-15T22:58:35.360612+0000","last_became_active":"2024-02-15T22:55:57.671524+0000","last_became_peered":"2024-02-15T22:55:57.671524+0000","last_unstale":"2024-02-15T22:58:35.360612+0000","last_undegraded":"2024-02-15T22:58:35.360612+0000","last_fullsized":"2024-02-15T22:58:35.360612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:35.360528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:35.360528+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.360528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:16:02.723261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.254714+0000","last_change":"2024-02-15T22:58:03.254714+0000","last_active":"2024-02-15T22:58:03.254714+0000","last_peered":"2024-02-15T22:58:03.254714+0000","last_clean":"2024-02-15T22:58:03.254714+0000","last_became_active":"2024-02-15T22:56:07.707281+0000","last_became_peered":"2024-02-15T22:56:07.707281+0000","last_unstale":"2024-02-15T22:58:03.254714+0000","last_undegraded":"2024-02-15T22:58:03.254714+0000","last_fullsized":"2024-02-15T22:58:03.254714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:03.254575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:03.254575+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.254575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:31.078756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.385601+0000","last_change":"2024-02-15T22:57:55.385601+0000","last_active":"2024-02-15T22:57:55.385601+0000","last_peered":"2024-02-15T22:57:55.385601+0000","last_clean":"2024-02-15T22:57:55.385601+0000","last_became_active":"2024-02-15T22:56:09.717692+0000","last_became_peered":"2024-02-15T22:56:09.717692+0000","last_unstale":"2024-02-15T22:57:55.385601+0000","last_undegraded":"2024-02-15T22:57:55.385601+0000","last_fullsized":"2024-02-15T22:57:55.385601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-02-15T22:57:55.385469+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-02-15T22:57:55.385469+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.385469+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:24.974853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.917439+0000","last_change":"2024-02-15T22:57:49.917439+0000","last_active":"2024-02-15T22:57:49.917439+0000","last_peered":"2024-02-15T22:57:49.917439+0000","last_clean":"2024-02-15T22:57:49.917439+0000","last_became_active":"2024-02-15T22:56:11.718332+0000","last_became_peered":"2024-02-15T22:56:11.718332+0000","last_unstale":"2024-02-15T22:57:49.917439+0000","last_undegraded":"2024-02-15T22:57:49.917439+0000","last_fullsized":"2024-02-15T22:57:49.917439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.917248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.917248+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.917248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:48.180880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.184633+0000","last_change":"2024-02-15T22:58:08.184633+0000","last_active":"2024-02-15T22:58:08.184633+0000","last_peered":"2024-02-15T22:58:08.184633+0000","last_clean":"2024-02-15T22:58:08.184633+0000","last_became_active":"2024-02-15T22:56:13.723512+0000","last_became_peered":"2024-02-15T22:56:13.723512+0000","last_unstale":"2024-02-15T22:58:08.184633+0000","last_undegraded":"2024-02-15T22:58:08.184633+0000","last_fullsized":"2024-02-15T22:58:08.184633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-02-15T22:58:08.184528+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-02-15T22:58:08.184528+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.184528+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:33.363968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.905431+0000","last_change":"2024-02-15T22:58:38.905461+0000","last_active":"2024-02-15T22:58:38.905431+0000","last_peered":"2024-02-15T22:58:38.905431+0000","last_clean":"2024-02-15T22:58:38.905431+0000","last_became_active":"2024-02-15T22:56:05.713036+0000","last_became_peered":"2024-02-15T22:56:05.713036+0000","last_unstale":"2024-02-15T22:58:38.905431+0000","last_undegraded":"2024-02-15T22:58:38.905431+0000","last_fullsized":"2024-02-15T22:58:38.905431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:38.905348+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:38.905348+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.905348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:54:37.502566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:40.358592+0000","last_change":"2024-02-15T22:58:40.358643+0000","last_active":"2024-02-15T22:58:40.358592+0000","last_peered":"2024-02-15T22:58:40.358592+0000","last_clean":"2024-02-15T22:58:40.358592+0000","last_became_active":"2024-02-15T22:56:03.699564+0000","last_became_peered":"2024-02-15T22:56:03.699564+0000","last_unstale":"2024-02-15T22:58:40.358592+0000","last_undegraded":"2024-02-15T22:58:40.358592+0000","last_fullsized":"2024-02-15T22:58:40.358592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:40.358505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:40.358505+0000","last_clean_scrub_stamp":"2024-02-15T22:58:40.358505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:56:17.281060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:59.196819+0000","last_change":"2024-02-15T22:58:59.196870+0000","last_active":"2024-02-15T22:58:59.196819+0000","last_peered":"2024-02-15T22:58:59.196819+0000","last_clean":"2024-02-15T22:58:59.196819+0000","last_became_active":"2024-02-15T22:55:57.672053+0000","last_became_peered":"2024-02-15T22:55:57.672053+0000","last_unstale":"2024-02-15T22:58:59.196819+0000","last_undegraded":"2024-02-15T22:58:59.196819+0000","last_fullsized":"2024-02-15T22:58:59.196819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:59.196699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:59.196699+0000","last_clean_scrub_stamp":"2024-02-15T22:58:59.196699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:41:21.846177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:14.371390+0000","last_change":"2024-02-15T22:59:14.371429+0000","last_active":"2024-02-15T22:59:14.371390+0000","last_peered":"2024-02-15T22:59:14.371390+0000","last_clean":"2024-02-15T22:59:14.371390+0000","last_became_active":"2024-02-15T22:56:45.893109+0000","last_became_peered":"2024-02-15T22:56:45.893109+0000","last_unstale":"2024-02-15T22:59:14.371390+0000","last_undegraded":"2024-02-15T22:59:14.371390+0000","last_fullsized":"2024-02-15T22:59:14.371390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:14.371281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:14.371281+0000","last_clean_scrub_stamp":"2024-02-15T22:59:14.371281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:44:28.553483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.859195+0000","last_change":"2024-02-15T22:57:49.859195+0000","last_active":"2024-02-15T22:57:49.859195+0000","last_peered":"2024-02-15T22:57:49.859195+0000","last_clean":"2024-02-15T22:57:49.859195+0000","last_became_active":"2024-02-15T22:56:09.721140+0000","last_became_peered":"2024-02-15T22:56:09.721140+0000","last_unstale":"2024-02-15T22:57:49.859195+0000","last_undegraded":"2024-02-15T22:57:49.859195+0000","last_fullsized":"2024-02-15T22:57:49.859195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-02-15T22:57:49.859068+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-02-15T22:57:49.859068+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.859068+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:24:17.693114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":290,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.831746+0000","last_change":"2024-02-15T22:57:48.831746+0000","last_active":"2024-02-15T22:57:48.831746+0000","last_peered":"2024-02-15T22:57:48.831746+0000","last_clean":"2024-02-15T22:57:48.831746+0000","last_became_active":"2024-02-15T22:56:11.717544+0000","last_became_peered":"2024-02-15T22:56:11.717544+0000","last_unstale":"2024-02-15T22:57:48.831746+0000","last_undegraded":"2024-02-15T22:57:48.831746+0000","last_fullsized":"2024-02-15T22:57:48.831746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:48.831614+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:48.831614+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.831614+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:25.818844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:41.175420+0000","last_change":"2024-02-15T22:58:41.175444+0000","last_active":"2024-02-15T22:58:41.175420+0000","last_peered":"2024-02-15T22:58:41.175420+0000","last_clean":"2024-02-15T22:58:41.175420+0000","last_became_active":"2024-02-15T22:56:13.728228+0000","last_became_peered":"2024-02-15T22:56:13.728228+0000","last_unstale":"2024-02-15T22:58:41.175420+0000","last_undegraded":"2024-02-15T22:58:41.175420+0000","last_fullsized":"2024-02-15T22:58:41.175420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:41.175331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:41.175331+0000","last_clean_scrub_stamp":"2024-02-15T22:58:41.175331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:05:22.295896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.164396+0000","last_change":"2024-02-15T22:58:06.164425+0000","last_active":"2024-02-15T22:58:06.164396+0000","last_peered":"2024-02-15T22:58:06.164396+0000","last_clean":"2024-02-15T22:58:06.164396+0000","last_became_active":"2024-02-15T22:56:05.710924+0000","last_became_peered":"2024-02-15T22:56:05.710924+0000","last_unstale":"2024-02-15T22:58:06.164396+0000","last_undegraded":"2024-02-15T22:58:06.164396+0000","last_fullsized":"2024-02-15T22:58:06.164396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:06.164305+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:06.164305+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.164305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:46.445946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:54.159559+0000","last_change":"2024-02-15T22:58:54.159619+0000","last_active":"2024-02-15T22:58:54.159559+0000","last_peered":"2024-02-15T22:58:54.159559+0000","last_clean":"2024-02-15T22:58:54.159559+0000","last_became_active":"2024-02-15T22:56:03.695921+0000","last_became_peered":"2024-02-15T22:56:03.695921+0000","last_unstale":"2024-02-15T22:58:54.159559+0000","last_undegraded":"2024-02-15T22:58:54.159559+0000","last_fullsized":"2024-02-15T22:58:54.159559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:54.159435+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:54.159435+0000","last_clean_scrub_stamp":"2024-02-15T22:58:54.159435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:30:26.662932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.343375+0000","last_change":"2024-02-15T22:58:34.343403+0000","last_active":"2024-02-15T22:58:34.343375+0000","last_peered":"2024-02-15T22:58:34.343375+0000","last_clean":"2024-02-15T22:58:34.343375+0000","last_became_active":"2024-02-15T22:55:57.671257+0000","last_became_peered":"2024-02-15T22:55:57.671257+0000","last_unstale":"2024-02-15T22:58:34.343375+0000","last_undegraded":"2024-02-15T22:58:34.343375+0000","last_fullsized":"2024-02-15T22:58:34.343375+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:34.343288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:34.343288+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.343288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:20.945858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.993271+0000","last_change":"2024-02-15T22:57:53.993271+0000","last_active":"2024-02-15T22:57:53.993271+0000","last_peered":"2024-02-15T22:57:53.993271+0000","last_clean":"2024-02-15T22:57:53.993271+0000","last_became_active":"2024-02-15T22:56:07.705323+0000","last_became_peered":"2024-02-15T22:56:07.705323+0000","last_unstale":"2024-02-15T22:57:53.993271+0000","last_undegraded":"2024-02-15T22:57:53.993271+0000","last_fullsized":"2024-02-15T22:57:53.993271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:53.993161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:53.993161+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.993161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:37.548413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.097818+0000","last_change":"2024-02-15T22:58:16.097856+0000","last_active":"2024-02-15T22:58:16.097818+0000","last_peered":"2024-02-15T22:58:16.097818+0000","last_clean":"2024-02-15T22:58:16.097818+0000","last_became_active":"2024-02-15T22:56:09.729131+0000","last_became_peered":"2024-02-15T22:56:09.729131+0000","last_unstale":"2024-02-15T22:58:16.097818+0000","last_undegraded":"2024-02-15T22:58:16.097818+0000","last_fullsized":"2024-02-15T22:58:16.097818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-15T22:58:16.097737+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-15T22:58:16.097737+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.097737+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:35:13.613365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":323,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:51.400056+0000","last_change":"2024-02-15T22:57:51.400056+0000","last_active":"2024-02-15T22:57:51.400056+0000","last_peered":"2024-02-15T22:57:51.400056+0000","last_clean":"2024-02-15T22:57:51.400056+0000","last_became_active":"2024-02-15T22:56:11.719685+0000","last_became_peered":"2024-02-15T22:56:11.719685+0000","last_unstale":"2024-02-15T22:57:51.400056+0000","last_undegraded":"2024-02-15T22:57:51.400056+0000","last_fullsized":"2024-02-15T22:57:51.400056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:51.399947+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:51.399947+0000","last_clean_scrub_stamp":"2024-02-15T22:57:51.399947+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:14.785659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.892686+0000","last_change":"2024-02-15T22:58:12.892686+0000","last_active":"2024-02-15T22:58:12.892686+0000","last_peered":"2024-02-15T22:58:12.892686+0000","last_clean":"2024-02-15T22:58:12.892686+0000","last_became_active":"2024-02-15T22:56:13.730494+0000","last_became_peered":"2024-02-15T22:56:13.730494+0000","last_unstale":"2024-02-15T22:58:12.892686+0000","last_undegraded":"2024-02-15T22:58:12.892686+0000","last_fullsized":"2024-02-15T22:58:12.892686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-15T22:58:12.892569+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-15T22:58:12.892569+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.892569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:13.313696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.895931+0000","last_change":"2024-02-15T22:58:21.895961+0000","last_active":"2024-02-15T22:58:21.895931+0000","last_peered":"2024-02-15T22:58:21.895931+0000","last_clean":"2024-02-15T22:58:21.895931+0000","last_became_active":"2024-02-15T22:56:05.705764+0000","last_became_peered":"2024-02-15T22:56:05.705764+0000","last_unstale":"2024-02-15T22:58:21.895931+0000","last_undegraded":"2024-02-15T22:58:21.895931+0000","last_fullsized":"2024-02-15T22:58:21.895931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:21.895840+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:21.895840+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.895840+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:54:12.132052+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:25.912018+0000","last_change":"2024-02-15T22:58:25.912041+0000","last_active":"2024-02-15T22:58:25.912018+0000","last_peered":"2024-02-15T22:58:25.912018+0000","last_clean":"2024-02-15T22:58:25.912018+0000","last_became_active":"2024-02-15T22:56:03.705783+0000","last_became_peered":"2024-02-15T22:56:03.705783+0000","last_unstale":"2024-02-15T22:58:25.912018+0000","last_undegraded":"2024-02-15T22:58:25.912018+0000","last_fullsized":"2024-02-15T22:58:25.912018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:25.911921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:25.911921+0000","last_clean_scrub_stamp":"2024-02-15T22:58:25.911921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:37:49.453839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:03.192710+0000","last_change":"2024-02-15T22:59:03.192735+0000","last_active":"2024-02-15T22:59:03.192710+0000","last_peered":"2024-02-15T22:59:03.192710+0000","last_clean":"2024-02-15T22:59:03.192710+0000","last_became_active":"2024-02-15T22:55:57.853714+0000","last_became_peered":"2024-02-15T22:55:57.853714+0000","last_unstale":"2024-02-15T22:59:03.192710+0000","last_undegraded":"2024-02-15T22:59:03.192710+0000","last_fullsized":"2024-02-15T22:59:03.192710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:03.192622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:03.192622+0000","last_clean_scrub_stamp":"2024-02-15T22:59:03.192622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:50:57.415025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.020401+0000","last_change":"2024-02-15T22:57:58.020401+0000","last_active":"2024-02-15T22:57:58.020401+0000","last_peered":"2024-02-15T22:57:58.020401+0000","last_clean":"2024-02-15T22:57:58.020401+0000","last_became_active":"2024-02-15T22:56:07.705013+0000","last_became_peered":"2024-02-15T22:56:07.705013+0000","last_unstale":"2024-02-15T22:57:58.020401+0000","last_undegraded":"2024-02-15T22:57:58.020401+0000","last_fullsized":"2024-02-15T22:57:58.020401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:58.020263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:58.020263+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.020263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:46.435941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:53.962295+0000","last_change":"2024-02-15T22:57:53.962295+0000","last_active":"2024-02-15T22:57:53.962295+0000","last_peered":"2024-02-15T22:57:53.962295+0000","last_clean":"2024-02-15T22:57:53.962295+0000","last_became_active":"2024-02-15T22:56:09.719916+0000","last_became_peered":"2024-02-15T22:56:09.719916+0000","last_unstale":"2024-02-15T22:57:53.962295+0000","last_undegraded":"2024-02-15T22:57:53.962295+0000","last_fullsized":"2024-02-15T22:57:53.962295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-02-15T22:57:53.962112+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-02-15T22:57:53.962112+0000","last_clean_scrub_stamp":"2024-02-15T22:57:53.962112+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:13:33.384008+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.358256+0000","last_change":"2024-02-15T22:57:54.358256+0000","last_active":"2024-02-15T22:57:54.358256+0000","last_peered":"2024-02-15T22:57:54.358256+0000","last_clean":"2024-02-15T22:57:54.358256+0000","last_became_active":"2024-02-15T22:56:11.717758+0000","last_became_peered":"2024-02-15T22:56:11.717758+0000","last_unstale":"2024-02-15T22:57:54.358256+0000","last_undegraded":"2024-02-15T22:57:54.358256+0000","last_fullsized":"2024-02-15T22:57:54.358256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:54.358148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:54.358148+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.358148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:29.880821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.851752+0000","last_change":"2024-02-15T22:58:35.851776+0000","last_active":"2024-02-15T22:58:35.851752+0000","last_peered":"2024-02-15T22:58:35.851752+0000","last_clean":"2024-02-15T22:58:35.851752+0000","last_became_active":"2024-02-15T22:56:13.732325+0000","last_became_peered":"2024-02-15T22:56:13.732325+0000","last_unstale":"2024-02-15T22:58:35.851752+0000","last_undegraded":"2024-02-15T22:58:35.851752+0000","last_fullsized":"2024-02-15T22:58:35.851752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:35.851664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:35.851664+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.851664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:32:35.470507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:07.926533+0000","last_change":"2024-02-15T22:58:07.926533+0000","last_active":"2024-02-15T22:58:07.926533+0000","last_peered":"2024-02-15T22:58:07.926533+0000","last_clean":"2024-02-15T22:58:07.926533+0000","last_became_active":"2024-02-15T22:56:13.732216+0000","last_became_peered":"2024-02-15T22:56:13.732216+0000","last_unstale":"2024-02-15T22:58:07.926533+0000","last_undegraded":"2024-02-15T22:58:07.926533+0000","last_fullsized":"2024-02-15T22:58:07.926533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:07.926378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:07.926378+0000","last_clean_scrub_stamp":"2024-02-15T22:58:07.926378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:01:00.958886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.897351+0000","last_change":"2024-02-15T22:58:19.897351+0000","last_active":"2024-02-15T22:58:19.897351+0000","last_peered":"2024-02-15T22:58:19.897351+0000","last_clean":"2024-02-15T22:58:19.897351+0000","last_became_active":"2024-02-15T22:56:05.704959+0000","last_became_peered":"2024-02-15T22:56:05.704959+0000","last_unstale":"2024-02-15T22:58:19.897351+0000","last_undegraded":"2024-02-15T22:58:19.897351+0000","last_fullsized":"2024-02-15T22:58:19.897351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:19.897173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:19.897173+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.897173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:28:13.350809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:53.190108+0000","last_change":"2024-02-15T22:58:53.190133+0000","last_active":"2024-02-15T22:58:53.190108+0000","last_peered":"2024-02-15T22:58:53.190108+0000","last_clean":"2024-02-15T22:58:53.190108+0000","last_became_active":"2024-02-15T22:56:03.705176+0000","last_became_peered":"2024-02-15T22:56:03.705176+0000","last_unstale":"2024-02-15T22:58:53.190108+0000","last_undegraded":"2024-02-15T22:58:53.190108+0000","last_fullsized":"2024-02-15T22:58:53.190108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:53.190019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:53.190019+0000","last_clean_scrub_stamp":"2024-02-15T22:58:53.190019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:42:21.245324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.818396+0000","last_change":"2024-02-15T22:58:02.818396+0000","last_active":"2024-02-15T22:58:02.818396+0000","last_peered":"2024-02-15T22:58:02.818396+0000","last_clean":"2024-02-15T22:58:02.818396+0000","last_became_active":"2024-02-15T22:56:07.703060+0000","last_became_peered":"2024-02-15T22:56:07.703060+0000","last_unstale":"2024-02-15T22:58:02.818396+0000","last_undegraded":"2024-02-15T22:58:02.818396+0000","last_fullsized":"2024-02-15T22:58:02.818396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:02.818259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:02.818259+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.818259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:34.242902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.172307+0000","last_change":"2024-02-15T22:58:19.172307+0000","last_active":"2024-02-15T22:58:19.172307+0000","last_peered":"2024-02-15T22:58:19.172307+0000","last_clean":"2024-02-15T22:58:19.172307+0000","last_became_active":"2024-02-15T22:56:09.720627+0000","last_became_peered":"2024-02-15T22:56:09.720627+0000","last_unstale":"2024-02-15T22:58:19.172307+0000","last_undegraded":"2024-02-15T22:58:19.172307+0000","last_fullsized":"2024-02-15T22:58:19.172307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-15T22:58:19.172190+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-15T22:58:19.172190+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.172190+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:17.898821+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:12.182843+0000","last_change":"2024-02-15T22:58:12.182843+0000","last_active":"2024-02-15T22:58:12.182843+0000","last_peered":"2024-02-15T22:58:12.182843+0000","last_clean":"2024-02-15T22:58:12.182843+0000","last_became_active":"2024-02-15T22:56:11.724592+0000","last_became_peered":"2024-02-15T22:56:11.724592+0000","last_unstale":"2024-02-15T22:58:12.182843+0000","last_undegraded":"2024-02-15T22:58:12.182843+0000","last_fullsized":"2024-02-15T22:58:12.182843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:12.182689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:12.182689+0000","last_clean_scrub_stamp":"2024-02-15T22:58:12.182689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:17:50.255923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:43.398046+0000","last_change":"2024-02-15T22:58:43.398078+0000","last_active":"2024-02-15T22:58:43.398046+0000","last_peered":"2024-02-15T22:58:43.398046+0000","last_clean":"2024-02-15T22:58:43.398046+0000","last_became_active":"2024-02-15T22:56:13.729931+0000","last_became_peered":"2024-02-15T22:56:13.729931+0000","last_unstale":"2024-02-15T22:58:43.398046+0000","last_undegraded":"2024-02-15T22:58:43.398046+0000","last_fullsized":"2024-02-15T22:58:43.398046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:43.397960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:43.397960+0000","last_clean_scrub_stamp":"2024-02-15T22:58:43.397960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:19.186513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.873645+0000","last_change":"2024-02-15T22:58:10.873645+0000","last_active":"2024-02-15T22:58:10.873645+0000","last_peered":"2024-02-15T22:58:10.873645+0000","last_clean":"2024-02-15T22:58:10.873645+0000","last_became_active":"2024-02-15T22:56:05.714024+0000","last_became_peered":"2024-02-15T22:56:05.714024+0000","last_unstale":"2024-02-15T22:58:10.873645+0000","last_undegraded":"2024-02-15T22:58:10.873645+0000","last_fullsized":"2024-02-15T22:58:10.873645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:10.873523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:10.873523+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.873523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:35.471679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.861301+0000","last_change":"2024-02-15T22:58:32.861325+0000","last_active":"2024-02-15T22:58:32.861301+0000","last_peered":"2024-02-15T22:58:32.861301+0000","last_clean":"2024-02-15T22:58:32.861301+0000","last_became_active":"2024-02-15T22:56:03.695339+0000","last_became_peered":"2024-02-15T22:56:03.695339+0000","last_unstale":"2024-02-15T22:58:32.861301+0000","last_undegraded":"2024-02-15T22:58:32.861301+0000","last_fullsized":"2024-02-15T22:58:32.861301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:32.861212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:32.861212+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.861212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:38.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:49.932729+0000","last_change":"2024-02-15T22:57:49.932729+0000","last_active":"2024-02-15T22:57:49.932729+0000","last_peered":"2024-02-15T22:57:49.932729+0000","last_clean":"2024-02-15T22:57:49.932729+0000","last_became_active":"2024-02-15T22:56:07.708692+0000","last_became_peered":"2024-02-15T22:56:07.708692+0000","last_unstale":"2024-02-15T22:57:49.932729+0000","last_undegraded":"2024-02-15T22:57:49.932729+0000","last_fullsized":"2024-02-15T22:57:49.932729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:49.932578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:49.932578+0000","last_clean_scrub_stamp":"2024-02-15T22:57:49.932578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:19:08.744146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.213042+0000","last_change":"2024-02-15T22:58:02.213042+0000","last_active":"2024-02-15T22:58:02.213042+0000","last_peered":"2024-02-15T22:58:02.213042+0000","last_clean":"2024-02-15T22:58:02.213042+0000","last_became_active":"2024-02-15T22:56:09.710942+0000","last_became_peered":"2024-02-15T22:56:09.710942+0000","last_unstale":"2024-02-15T22:58:02.213042+0000","last_undegraded":"2024-02-15T22:58:02.213042+0000","last_fullsized":"2024-02-15T22:58:02.213042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:02.212917+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:02.212917+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.212917+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:41.461653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.958962+0000","last_change":"2024-02-15T22:57:55.958962+0000","last_active":"2024-02-15T22:57:55.958962+0000","last_peered":"2024-02-15T22:57:55.958962+0000","last_clean":"2024-02-15T22:57:55.958962+0000","last_became_active":"2024-02-15T22:56:11.724533+0000","last_became_peered":"2024-02-15T22:56:11.724533+0000","last_unstale":"2024-02-15T22:57:55.958962+0000","last_undegraded":"2024-02-15T22:57:55.958962+0000","last_fullsized":"2024-02-15T22:57:55.958962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:55.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:55.958822+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:16:29.483298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:45.343807+0000","last_change":"2024-02-15T22:58:45.343831+0000","last_active":"2024-02-15T22:58:45.343807+0000","last_peered":"2024-02-15T22:58:45.343807+0000","last_clean":"2024-02-15T22:58:45.343807+0000","last_became_active":"2024-02-15T22:56:13.734428+0000","last_became_peered":"2024-02-15T22:56:13.734428+0000","last_unstale":"2024-02-15T22:58:45.343807+0000","last_undegraded":"2024-02-15T22:58:45.343807+0000","last_fullsized":"2024-02-15T22:58:45.343807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:45.343720+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:45.343720+0000","last_clean_scrub_stamp":"2024-02-15T22:58:45.343720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:39:29.928656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.301512+0000","last_change":"2024-02-15T22:58:26.301512+0000","last_active":"2024-02-15T22:58:26.301512+0000","last_peered":"2024-02-15T22:58:26.301512+0000","last_clean":"2024-02-15T22:58:26.301512+0000","last_became_active":"2024-02-15T22:56:05.705385+0000","last_became_peered":"2024-02-15T22:56:05.705385+0000","last_unstale":"2024-02-15T22:58:26.301512+0000","last_undegraded":"2024-02-15T22:58:26.301512+0000","last_fullsized":"2024-02-15T22:58:26.301512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:26.301369+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:26.301369+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.301369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:12:22.024986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.928974+0000","last_change":"2024-02-15T22:58:16.928974+0000","last_active":"2024-02-15T22:58:16.928974+0000","last_peered":"2024-02-15T22:58:16.928974+0000","last_clean":"2024-02-15T22:58:16.928974+0000","last_became_active":"2024-02-15T22:56:03.699626+0000","last_became_peered":"2024-02-15T22:56:03.699626+0000","last_unstale":"2024-02-15T22:58:16.928974+0000","last_undegraded":"2024-02-15T22:58:16.928974+0000","last_fullsized":"2024-02-15T22:58:16.928974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:16.928864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:16.928864+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.928864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:26.875704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:04.924988+0000","last_change":"2024-02-15T22:58:04.924988+0000","last_active":"2024-02-15T22:58:04.924988+0000","last_peered":"2024-02-15T22:58:04.924988+0000","last_clean":"2024-02-15T22:58:04.924988+0000","last_became_active":"2024-02-15T22:56:07.705705+0000","last_became_peered":"2024-02-15T22:56:07.705705+0000","last_unstale":"2024-02-15T22:58:04.924988+0000","last_undegraded":"2024-02-15T22:58:04.924988+0000","last_fullsized":"2024-02-15T22:58:04.924988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:04.924869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:04.924869+0000","last_clean_scrub_stamp":"2024-02-15T22:58:04.924869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:40.447542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'41","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:01.256585+0000","last_change":"2024-02-15T22:58:01.256585+0000","last_active":"2024-02-15T22:58:01.256585+0000","last_peered":"2024-02-15T22:58:01.256585+0000","last_clean":"2024-02-15T22:58:01.256585+0000","last_became_active":"2024-02-15T22:56:09.712337+0000","last_became_peered":"2024-02-15T22:56:09.712337+0000","last_unstale":"2024-02-15T22:58:01.256585+0000","last_undegraded":"2024-02-15T22:58:01.256585+0000","last_fullsized":"2024-02-15T22:58:01.256585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-02-15T22:58:01.256409+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-02-15T22:58:01.256409+0000","last_clean_scrub_stamp":"2024-02-15T22:58:01.256409+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:19:16.356268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:47.870103+0000","last_change":"2024-02-15T22:57:47.870103+0000","last_active":"2024-02-15T22:57:47.870103+0000","last_peered":"2024-02-15T22:57:47.870103+0000","last_clean":"2024-02-15T22:57:47.870103+0000","last_became_active":"2024-02-15T22:56:11.715697+0000","last_became_peered":"2024-02-15T22:56:11.715697+0000","last_unstale":"2024-02-15T22:57:47.870103+0000","last_undegraded":"2024-02-15T22:57:47.870103+0000","last_fullsized":"2024-02-15T22:57:47.870103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:47.869954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:47.869954+0000","last_clean_scrub_stamp":"2024-02-15T22:57:47.869954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:54.471463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:11.354039+0000","last_change":"2024-02-15T22:59:11.354093+0000","last_active":"2024-02-15T22:59:11.354039+0000","last_peered":"2024-02-15T22:59:11.354039+0000","last_clean":"2024-02-15T22:59:11.354039+0000","last_became_active":"2024-02-15T22:56:13.734565+0000","last_became_peered":"2024-02-15T22:56:13.734565+0000","last_unstale":"2024-02-15T22:59:11.354039+0000","last_undegraded":"2024-02-15T22:59:11.354039+0000","last_fullsized":"2024-02-15T22:59:11.354039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:11.353924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:11.353924+0000","last_clean_scrub_stamp":"2024-02-15T22:59:11.353924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:13.721640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.177141+0000","last_change":"2024-02-15T22:58:08.177141+0000","last_active":"2024-02-15T22:58:08.177141+0000","last_peered":"2024-02-15T22:58:08.177141+0000","last_clean":"2024-02-15T22:58:08.177141+0000","last_became_active":"2024-02-15T22:56:05.710562+0000","last_became_peered":"2024-02-15T22:56:05.710562+0000","last_unstale":"2024-02-15T22:58:08.177141+0000","last_undegraded":"2024-02-15T22:58:08.177141+0000","last_fullsized":"2024-02-15T22:58:08.177141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:08.177027+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:08.177027+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.177027+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:26.352171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:35.843667+0000","last_change":"2024-02-15T22:58:35.843691+0000","last_active":"2024-02-15T22:58:35.843667+0000","last_peered":"2024-02-15T22:58:35.843667+0000","last_clean":"2024-02-15T22:58:35.843667+0000","last_became_active":"2024-02-15T22:56:03.696590+0000","last_became_peered":"2024-02-15T22:56:03.696590+0000","last_unstale":"2024-02-15T22:58:35.843667+0000","last_undegraded":"2024-02-15T22:58:35.843667+0000","last_fullsized":"2024-02-15T22:58:35.843667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:35.843557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:35.843557+0000","last_clean_scrub_stamp":"2024-02-15T22:58:35.843557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:20:16.450362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.041220+0000","last_change":"2024-02-15T22:57:56.041220+0000","last_active":"2024-02-15T22:57:56.041220+0000","last_peered":"2024-02-15T22:57:56.041220+0000","last_clean":"2024-02-15T22:57:56.041220+0000","last_became_active":"2024-02-15T22:56:07.705239+0000","last_became_peered":"2024-02-15T22:56:07.705239+0000","last_unstale":"2024-02-15T22:57:56.041220+0000","last_undegraded":"2024-02-15T22:57:56.041220+0000","last_fullsized":"2024-02-15T22:57:56.041220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.041105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.041105+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.041105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:22.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.989290+0000","last_change":"2024-02-15T22:58:00.989290+0000","last_active":"2024-02-15T22:58:00.989290+0000","last_peered":"2024-02-15T22:58:00.989290+0000","last_clean":"2024-02-15T22:58:00.989290+0000","last_became_active":"2024-02-15T22:56:09.710616+0000","last_became_peered":"2024-02-15T22:56:09.710616+0000","last_unstale":"2024-02-15T22:58:00.989290+0000","last_undegraded":"2024-02-15T22:58:00.989290+0000","last_fullsized":"2024-02-15T22:58:00.989290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-15T22:58:00.989160+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-15T22:58:00.989160+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.989160+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:23:16.633010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.881779+0000","last_change":"2024-02-15T22:57:48.881779+0000","last_active":"2024-02-15T22:57:48.881779+0000","last_peered":"2024-02-15T22:57:48.881779+0000","last_clean":"2024-02-15T22:57:48.881779+0000","last_became_active":"2024-02-15T22:56:11.718995+0000","last_became_peered":"2024-02-15T22:56:11.718995+0000","last_unstale":"2024-02-15T22:57:48.881779+0000","last_undegraded":"2024-02-15T22:57:48.881779+0000","last_fullsized":"2024-02-15T22:57:48.881779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:48.881655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:48.881655+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.881655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:00:14.755649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.179900+0000","last_change":"2024-02-15T22:58:38.179928+0000","last_active":"2024-02-15T22:58:38.179900+0000","last_peered":"2024-02-15T22:58:38.179900+0000","last_clean":"2024-02-15T22:58:38.179900+0000","last_became_active":"2024-02-15T22:56:05.699196+0000","last_became_peered":"2024-02-15T22:56:05.699196+0000","last_unstale":"2024-02-15T22:58:38.179900+0000","last_undegraded":"2024-02-15T22:58:38.179900+0000","last_fullsized":"2024-02-15T22:58:38.179900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:38.179767+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:38.179767+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.179767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:54:16.863075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'3","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:45.264206+0000","last_change":"2024-02-15T22:58:45.264248+0000","last_active":"2024-02-15T22:58:45.264206+0000","last_peered":"2024-02-15T22:58:45.264206+0000","last_clean":"2024-02-15T22:58:45.264206+0000","last_became_active":"2024-02-15T22:56:03.702007+0000","last_became_peered":"2024-02-15T22:56:03.702007+0000","last_unstale":"2024-02-15T22:58:45.264206+0000","last_undegraded":"2024-02-15T22:58:45.264206+0000","last_fullsized":"2024-02-15T22:58:45.264206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:58:45.264113+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:58:45.264113+0000","last_clean_scrub_stamp":"2024-02-15T22:58:45.264113+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:46.236878+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.277094+0000","last_change":"2024-02-15T22:58:05.277094+0000","last_active":"2024-02-15T22:58:05.277094+0000","last_peered":"2024-02-15T22:58:05.277094+0000","last_clean":"2024-02-15T22:58:05.277094+0000","last_became_active":"2024-02-15T22:56:07.707124+0000","last_became_peered":"2024-02-15T22:56:07.707124+0000","last_unstale":"2024-02-15T22:58:05.277094+0000","last_undegraded":"2024-02-15T22:58:05.277094+0000","last_fullsized":"2024-02-15T22:58:05.277094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:05.276922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:05.276922+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.276922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:57:55.491543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.341829+0000","last_change":"2024-02-15T22:57:59.341829+0000","last_active":"2024-02-15T22:57:59.341829+0000","last_peered":"2024-02-15T22:57:59.341829+0000","last_clean":"2024-02-15T22:57:59.341829+0000","last_became_active":"2024-02-15T22:56:09.713076+0000","last_became_peered":"2024-02-15T22:56:09.713076+0000","last_unstale":"2024-02-15T22:57:59.341829+0000","last_undegraded":"2024-02-15T22:57:59.341829+0000","last_fullsized":"2024-02-15T22:57:59.341829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-15T22:57:59.341704+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-15T22:57:59.341704+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.341704+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:32:30.766347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:50.956049+0000","last_change":"2024-02-15T22:57:50.956049+0000","last_active":"2024-02-15T22:57:50.956049+0000","last_peered":"2024-02-15T22:57:50.956049+0000","last_clean":"2024-02-15T22:57:50.956049+0000","last_became_active":"2024-02-15T22:56:11.718102+0000","last_became_peered":"2024-02-15T22:56:11.718102+0000","last_unstale":"2024-02-15T22:57:50.956049+0000","last_undegraded":"2024-02-15T22:57:50.956049+0000","last_fullsized":"2024-02-15T22:57:50.956049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:50.955925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:50.955925+0000","last_clean_scrub_stamp":"2024-02-15T22:57:50.955925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:28.393475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:46.316594+0000","last_change":"2024-02-15T22:58:46.316619+0000","last_active":"2024-02-15T22:58:46.316594+0000","last_peered":"2024-02-15T22:58:46.316594+0000","last_clean":"2024-02-15T22:58:46.316594+0000","last_became_active":"2024-02-15T22:56:13.734372+0000","last_became_peered":"2024-02-15T22:56:13.734372+0000","last_unstale":"2024-02-15T22:58:46.316594+0000","last_undegraded":"2024-02-15T22:58:46.316594+0000","last_fullsized":"2024-02-15T22:58:46.316594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-15T22:58:46.316508+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-15T22:58:46.316508+0000","last_clean_scrub_stamp":"2024-02-15T22:58:46.316508+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:54:26.350765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:24.298195+0000","last_change":"2024-02-15T22:58:24.298221+0000","last_active":"2024-02-15T22:58:24.298195+0000","last_peered":"2024-02-15T22:58:24.298195+0000","last_clean":"2024-02-15T22:58:24.298195+0000","last_became_active":"2024-02-15T22:56:05.705473+0000","last_became_peered":"2024-02-15T22:56:05.705473+0000","last_unstale":"2024-02-15T22:58:24.298195+0000","last_undegraded":"2024-02-15T22:58:24.298195+0000","last_fullsized":"2024-02-15T22:58:24.298195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:24.298093+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:24.298093+0000","last_clean_scrub_stamp":"2024-02-15T22:58:24.298093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:30.167502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.894042+0000","last_change":"2024-02-15T22:58:29.894066+0000","last_active":"2024-02-15T22:58:29.894042+0000","last_peered":"2024-02-15T22:58:29.894042+0000","last_clean":"2024-02-15T22:58:29.894042+0000","last_became_active":"2024-02-15T22:56:03.697691+0000","last_became_peered":"2024-02-15T22:56:03.697691+0000","last_unstale":"2024-02-15T22:58:29.894042+0000","last_undegraded":"2024-02-15T22:58:29.894042+0000","last_fullsized":"2024-02-15T22:58:29.894042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:29.893936+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:29.893936+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.893936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:01.057365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:08.898500+0000","last_change":"2024-02-15T22:58:08.898500+0000","last_active":"2024-02-15T22:58:08.898500+0000","last_peered":"2024-02-15T22:58:08.898500+0000","last_clean":"2024-02-15T22:58:08.898500+0000","last_became_active":"2024-02-15T22:56:07.704018+0000","last_became_peered":"2024-02-15T22:56:07.704018+0000","last_unstale":"2024-02-15T22:58:08.898500+0000","last_undegraded":"2024-02-15T22:58:08.898500+0000","last_fullsized":"2024-02-15T22:58:08.898500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:08.898335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:08.898335+0000","last_clean_scrub_stamp":"2024-02-15T22:58:08.898335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:35.455319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.180851+0000","last_change":"2024-02-15T22:58:03.180851+0000","last_active":"2024-02-15T22:58:03.180851+0000","last_peered":"2024-02-15T22:58:03.180851+0000","last_clean":"2024-02-15T22:58:03.180851+0000","last_became_active":"2024-02-15T22:56:09.717105+0000","last_became_peered":"2024-02-15T22:56:09.717105+0000","last_unstale":"2024-02-15T22:58:03.180851+0000","last_undegraded":"2024-02-15T22:58:03.180851+0000","last_fullsized":"2024-02-15T22:58:03.180851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-15T22:58:03.180724+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-15T22:58:03.180724+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.180724+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:48:09.050134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.880001+0000","last_change":"2024-02-15T22:58:00.880001+0000","last_active":"2024-02-15T22:58:00.880001+0000","last_peered":"2024-02-15T22:58:00.880001+0000","last_clean":"2024-02-15T22:58:00.880001+0000","last_became_active":"2024-02-15T22:56:11.722865+0000","last_became_peered":"2024-02-15T22:56:11.722865+0000","last_unstale":"2024-02-15T22:58:00.880001+0000","last_undegraded":"2024-02-15T22:58:00.880001+0000","last_fullsized":"2024-02-15T22:58:00.880001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:00.879874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:00.879874+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.879874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:59.902356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.151443+0000","last_change":"2024-02-15T22:58:33.151443+0000","last_active":"2024-02-15T22:58:33.151443+0000","last_peered":"2024-02-15T22:58:33.151443+0000","last_clean":"2024-02-15T22:58:33.151443+0000","last_became_active":"2024-02-15T22:56:13.726748+0000","last_became_peered":"2024-02-15T22:56:13.726748+0000","last_unstale":"2024-02-15T22:58:33.151443+0000","last_undegraded":"2024-02-15T22:58:33.151443+0000","last_fullsized":"2024-02-15T22:58:33.151443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:33.151251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:33.151251+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.151251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:05:46.319989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:00.092893+0000","last_change":"2024-02-15T22:58:00.092893+0000","last_active":"2024-02-15T22:58:00.092893+0000","last_peered":"2024-02-15T22:58:00.092893+0000","last_clean":"2024-02-15T22:58:00.092893+0000","last_became_active":"2024-02-15T22:56:05.716677+0000","last_became_peered":"2024-02-15T22:56:05.716677+0000","last_unstale":"2024-02-15T22:58:00.092893+0000","last_undegraded":"2024-02-15T22:58:00.092893+0000","last_fullsized":"2024-02-15T22:58:00.092893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:00.092774+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:00.092774+0000","last_clean_scrub_stamp":"2024-02-15T22:58:00.092774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:55:49.382293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.946666+0000","last_change":"2024-02-15T22:58:31.946666+0000","last_active":"2024-02-15T22:58:31.946666+0000","last_peered":"2024-02-15T22:58:31.946666+0000","last_clean":"2024-02-15T22:58:31.946666+0000","last_became_active":"2024-02-15T22:56:03.692632+0000","last_became_peered":"2024-02-15T22:56:03.692632+0000","last_unstale":"2024-02-15T22:58:31.946666+0000","last_undegraded":"2024-02-15T22:58:31.946666+0000","last_fullsized":"2024-02-15T22:58:31.946666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:31.946551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:31.946551+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.946551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:02:50.833349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.944080+0000","last_change":"2024-02-15T22:58:06.944080+0000","last_active":"2024-02-15T22:58:06.944080+0000","last_peered":"2024-02-15T22:58:06.944080+0000","last_clean":"2024-02-15T22:58:06.944080+0000","last_became_active":"2024-02-15T22:56:07.704208+0000","last_became_peered":"2024-02-15T22:56:07.704208+0000","last_unstale":"2024-02-15T22:58:06.944080+0000","last_undegraded":"2024-02-15T22:58:06.944080+0000","last_fullsized":"2024-02-15T22:58:06.944080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:06.943951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:06.943951+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.943951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:12.953469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.383705+0000","last_change":"2024-02-15T22:57:58.383705+0000","last_active":"2024-02-15T22:57:58.383705+0000","last_peered":"2024-02-15T22:57:58.383705+0000","last_clean":"2024-02-15T22:57:58.383705+0000","last_became_active":"2024-02-15T22:56:09.716753+0000","last_became_peered":"2024-02-15T22:56:09.716753+0000","last_unstale":"2024-02-15T22:57:58.383705+0000","last_undegraded":"2024-02-15T22:57:58.383705+0000","last_fullsized":"2024-02-15T22:57:58.383705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-15T22:57:58.383553+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-15T22:57:58.383553+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.383553+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:19:24.940537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:56.373579+0000","last_change":"2024-02-15T22:57:56.373579+0000","last_active":"2024-02-15T22:57:56.373579+0000","last_peered":"2024-02-15T22:57:56.373579+0000","last_clean":"2024-02-15T22:57:56.373579+0000","last_became_active":"2024-02-15T22:56:11.722738+0000","last_became_peered":"2024-02-15T22:56:11.722738+0000","last_unstale":"2024-02-15T22:57:56.373579+0000","last_undegraded":"2024-02-15T22:57:56.373579+0000","last_fullsized":"2024-02-15T22:57:56.373579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:56.373469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:56.373469+0000","last_clean_scrub_stamp":"2024-02-15T22:57:56.373469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:22:02.382987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.215685+0000","last_change":"2024-02-15T22:58:37.215724+0000","last_active":"2024-02-15T22:58:37.215685+0000","last_peered":"2024-02-15T22:58:37.215685+0000","last_clean":"2024-02-15T22:58:37.215685+0000","last_became_active":"2024-02-15T22:56:13.727216+0000","last_became_peered":"2024-02-15T22:56:13.727216+0000","last_unstale":"2024-02-15T22:58:37.215685+0000","last_undegraded":"2024-02-15T22:58:37.215685+0000","last_fullsized":"2024-02-15T22:58:37.215685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:37.215594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:37.215594+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.215594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:56:44.091191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:42.355635+0000","last_change":"2024-02-15T22:58:42.355660+0000","last_active":"2024-02-15T22:58:42.355635+0000","last_peered":"2024-02-15T22:58:42.355635+0000","last_clean":"2024-02-15T22:58:42.355635+0000","last_became_active":"2024-02-15T22:56:05.707154+0000","last_became_peered":"2024-02-15T22:56:05.707154+0000","last_unstale":"2024-02-15T22:58:42.355635+0000","last_undegraded":"2024-02-15T22:58:42.355635+0000","last_fullsized":"2024-02-15T22:58:42.355635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:42.355546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:42.355546+0000","last_clean_scrub_stamp":"2024-02-15T22:58:42.355546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:37.329988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:50.165885+0000","last_change":"2024-02-15T22:58:50.165910+0000","last_active":"2024-02-15T22:58:50.165885+0000","last_peered":"2024-02-15T22:58:50.165885+0000","last_clean":"2024-02-15T22:58:50.165885+0000","last_became_active":"2024-02-15T22:56:03.699843+0000","last_became_peered":"2024-02-15T22:56:03.699843+0000","last_unstale":"2024-02-15T22:58:50.165885+0000","last_undegraded":"2024-02-15T22:58:50.165885+0000","last_fullsized":"2024-02-15T22:58:50.165885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:50.165791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:50.165791+0000","last_clean_scrub_stamp":"2024-02-15T22:58:50.165791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:31:52.639273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'2","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:03.845209+0000","last_change":"2024-02-15T22:58:03.845209+0000","last_active":"2024-02-15T22:58:03.845209+0000","last_peered":"2024-02-15T22:58:03.845209+0000","last_clean":"2024-02-15T22:58:03.845209+0000","last_became_active":"2024-02-15T22:56:07.702014+0000","last_became_peered":"2024-02-15T22:56:07.702014+0000","last_unstale":"2024-02-15T22:58:03.845209+0000","last_undegraded":"2024-02-15T22:58:03.845209+0000","last_fullsized":"2024-02-15T22:58:03.845209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:03.845081+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:03.845081+0000","last_clean_scrub_stamp":"2024-02-15T22:58:03.845081+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:52:36.772070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:55.010523+0000","last_change":"2024-02-15T22:57:55.010523+0000","last_active":"2024-02-15T22:57:55.010523+0000","last_peered":"2024-02-15T22:57:55.010523+0000","last_clean":"2024-02-15T22:57:55.010523+0000","last_became_active":"2024-02-15T22:56:09.715996+0000","last_became_peered":"2024-02-15T22:56:09.715996+0000","last_unstale":"2024-02-15T22:57:55.010523+0000","last_undegraded":"2024-02-15T22:57:55.010523+0000","last_fullsized":"2024-02-15T22:57:55.010523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-15T22:57:55.010359+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-15T22:57:55.010359+0000","last_clean_scrub_stamp":"2024-02-15T22:57:55.010359+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:47:25.907925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":302,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:59.998940+0000","last_change":"2024-02-15T22:57:59.998940+0000","last_active":"2024-02-15T22:57:59.998940+0000","last_peered":"2024-02-15T22:57:59.998940+0000","last_clean":"2024-02-15T22:57:59.998940+0000","last_became_active":"2024-02-15T22:56:11.724520+0000","last_became_peered":"2024-02-15T22:56:11.724520+0000","last_unstale":"2024-02-15T22:57:59.998940+0000","last_undegraded":"2024-02-15T22:57:59.998940+0000","last_fullsized":"2024-02-15T22:57:59.998940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-15T22:57:59.998810+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-15T22:57:59.998810+0000","last_clean_scrub_stamp":"2024-02-15T22:57:59.998810+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:37.951898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:09.371606+0000","last_change":"2024-02-15T22:59:09.371628+0000","last_active":"2024-02-15T22:59:09.371606+0000","last_peered":"2024-02-15T22:59:09.371606+0000","last_clean":"2024-02-15T22:59:09.371606+0000","last_became_active":"2024-02-15T22:56:13.731683+0000","last_became_peered":"2024-02-15T22:56:13.731683+0000","last_unstale":"2024-02-15T22:59:09.371606+0000","last_undegraded":"2024-02-15T22:59:09.371606+0000","last_fullsized":"2024-02-15T22:59:09.371606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:09.371513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:09.371513+0000","last_clean_scrub_stamp":"2024-02-15T22:59:09.371513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:27:11.048168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.904716+0000","last_change":"2024-02-15T22:58:11.904716+0000","last_active":"2024-02-15T22:58:11.904716+0000","last_peered":"2024-02-15T22:58:11.904716+0000","last_clean":"2024-02-15T22:58:11.904716+0000","last_became_active":"2024-02-15T22:56:05.700922+0000","last_became_peered":"2024-02-15T22:56:05.700922+0000","last_unstale":"2024-02-15T22:58:11.904716+0000","last_undegraded":"2024-02-15T22:58:11.904716+0000","last_fullsized":"2024-02-15T22:58:11.904716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:11.904604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:11.904604+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.904604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:30:48.029771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:34.842958+0000","last_change":"2024-02-15T22:58:34.842958+0000","last_active":"2024-02-15T22:58:34.842958+0000","last_peered":"2024-02-15T22:58:34.842958+0000","last_clean":"2024-02-15T22:58:34.842958+0000","last_became_active":"2024-02-15T22:56:03.696168+0000","last_became_peered":"2024-02-15T22:56:03.696168+0000","last_unstale":"2024-02-15T22:58:34.842958+0000","last_undegraded":"2024-02-15T22:58:34.842958+0000","last_fullsized":"2024-02-15T22:58:34.842958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:34.842794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:34.842794+0000","last_clean_scrub_stamp":"2024-02-15T22:58:34.842794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:10.608670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:05.855063+0000","last_change":"2024-02-15T22:58:05.855063+0000","last_active":"2024-02-15T22:58:05.855063+0000","last_peered":"2024-02-15T22:58:05.855063+0000","last_clean":"2024-02-15T22:58:05.855063+0000","last_became_active":"2024-02-15T22:56:07.701777+0000","last_became_peered":"2024-02-15T22:56:07.701777+0000","last_unstale":"2024-02-15T22:58:05.855063+0000","last_undegraded":"2024-02-15T22:58:05.855063+0000","last_fullsized":"2024-02-15T22:58:05.855063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:05.854938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:05.854938+0000","last_clean_scrub_stamp":"2024-02-15T22:58:05.854938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:45.103674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'44","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:54.877670+0000","last_change":"2024-02-15T22:57:54.877670+0000","last_active":"2024-02-15T22:57:54.877670+0000","last_peered":"2024-02-15T22:57:54.877670+0000","last_clean":"2024-02-15T22:57:54.877670+0000","last_became_active":"2024-02-15T22:56:09.713636+0000","last_became_peered":"2024-02-15T22:56:09.713636+0000","last_unstale":"2024-02-15T22:57:54.877670+0000","last_undegraded":"2024-02-15T22:57:54.877670+0000","last_fullsized":"2024-02-15T22:57:54.877670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-02-15T22:57:54.877538+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-02-15T22:57:54.877538+0000","last_clean_scrub_stamp":"2024-02-15T22:57:54.877538+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:18.263250+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:46.331421+0000","last_change":"2024-02-15T22:57:46.331421+0000","last_active":"2024-02-15T22:57:46.331421+0000","last_peered":"2024-02-15T22:57:46.331421+0000","last_clean":"2024-02-15T22:57:46.331421+0000","last_became_active":"2024-02-15T22:56:11.722374+0000","last_became_peered":"2024-02-15T22:56:11.722374+0000","last_unstale":"2024-02-15T22:57:46.331421+0000","last_undegraded":"2024-02-15T22:57:46.331421+0000","last_fullsized":"2024-02-15T22:57:46.331421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:46.331332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:46.331332+0000","last_clean_scrub_stamp":"2024-02-15T22:57:46.331332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:09:32.555922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:42.836090+0000","last_change":"2024-02-15T22:58:42.836114+0000","last_active":"2024-02-15T22:58:42.836090+0000","last_peered":"2024-02-15T22:58:42.836090+0000","last_clean":"2024-02-15T22:58:42.836090+0000","last_became_active":"2024-02-15T22:56:13.733576+0000","last_became_peered":"2024-02-15T22:56:13.733576+0000","last_unstale":"2024-02-15T22:58:42.836090+0000","last_undegraded":"2024-02-15T22:58:42.836090+0000","last_fullsized":"2024-02-15T22:58:42.836090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:42.836000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:42.836000+0000","last_clean_scrub_stamp":"2024-02-15T22:58:42.836000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:46:25.598350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.944063+0000","last_change":"2024-02-15T22:58:09.944063+0000","last_active":"2024-02-15T22:58:09.944063+0000","last_peered":"2024-02-15T22:58:09.944063+0000","last_clean":"2024-02-15T22:58:09.944063+0000","last_became_active":"2024-02-15T22:56:05.701026+0000","last_became_peered":"2024-02-15T22:56:05.701026+0000","last_unstale":"2024-02-15T22:58:09.944063+0000","last_undegraded":"2024-02-15T22:58:09.944063+0000","last_fullsized":"2024-02-15T22:58:09.944063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:09.943931+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:09.943931+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.943931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:46:04.334961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:07.313919+0000","last_change":"2024-02-15T22:59:07.313944+0000","last_active":"2024-02-15T22:59:07.313919+0000","last_peered":"2024-02-15T22:59:07.313919+0000","last_clean":"2024-02-15T22:59:07.313919+0000","last_became_active":"2024-02-15T22:56:03.706422+0000","last_became_peered":"2024-02-15T22:56:03.706422+0000","last_unstale":"2024-02-15T22:59:07.313919+0000","last_undegraded":"2024-02-15T22:59:07.313919+0000","last_fullsized":"2024-02-15T22:59:07.313919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:07.313833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:07.313833+0000","last_clean_scrub_stamp":"2024-02-15T22:59:07.313833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:42:18.156489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:02.004957+0000","last_change":"2024-02-15T22:58:02.004957+0000","last_active":"2024-02-15T22:58:02.004957+0000","last_peered":"2024-02-15T22:58:02.004957+0000","last_clean":"2024-02-15T22:58:02.004957+0000","last_became_active":"2024-02-15T22:56:07.707265+0000","last_became_peered":"2024-02-15T22:56:07.707265+0000","last_unstale":"2024-02-15T22:58:02.004957+0000","last_undegraded":"2024-02-15T22:58:02.004957+0000","last_fullsized":"2024-02-15T22:58:02.004957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:02.004846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:02.004846+0000","last_clean_scrub_stamp":"2024-02-15T22:58:02.004846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:54:25.390557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.350886+0000","last_change":"2024-02-15T22:57:57.350886+0000","last_active":"2024-02-15T22:57:57.350886+0000","last_peered":"2024-02-15T22:57:57.350886+0000","last_clean":"2024-02-15T22:57:57.350886+0000","last_became_active":"2024-02-15T22:56:09.716749+0000","last_became_peered":"2024-02-15T22:56:09.716749+0000","last_unstale":"2024-02-15T22:57:57.350886+0000","last_undegraded":"2024-02-15T22:57:57.350886+0000","last_fullsized":"2024-02-15T22:57:57.350886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-02-15T22:57:57.350743+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-02-15T22:57:57.350743+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.350743+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:56.373225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.125944+0000","last_change":"2024-02-15T22:58:17.125944+0000","last_active":"2024-02-15T22:58:17.125944+0000","last_peered":"2024-02-15T22:58:17.125944+0000","last_clean":"2024-02-15T22:58:17.125944+0000","last_became_active":"2024-02-15T22:56:11.725667+0000","last_became_peered":"2024-02-15T22:56:11.725667+0000","last_unstale":"2024-02-15T22:58:17.125944+0000","last_undegraded":"2024-02-15T22:58:17.125944+0000","last_fullsized":"2024-02-15T22:58:17.125944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:17.125792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:17.125792+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.125792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:36:22.884918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:08.336001+0000","last_change":"2024-02-15T22:59:08.336043+0000","last_active":"2024-02-15T22:59:08.336001+0000","last_peered":"2024-02-15T22:59:08.336001+0000","last_clean":"2024-02-15T22:59:08.336001+0000","last_became_active":"2024-02-15T22:56:13.728844+0000","last_became_peered":"2024-02-15T22:56:13.728844+0000","last_unstale":"2024-02-15T22:59:08.336001+0000","last_undegraded":"2024-02-15T22:59:08.336001+0000","last_fullsized":"2024-02-15T22:59:08.336001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:59:08.335895+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:59:08.335895+0000","last_clean_scrub_stamp":"2024-02-15T22:59:08.335895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:09.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:32.115835+0000","last_change":"2024-02-15T22:58:32.115868+0000","last_active":"2024-02-15T22:58:32.115835+0000","last_peered":"2024-02-15T22:58:32.115835+0000","last_clean":"2024-02-15T22:58:32.115835+0000","last_became_active":"2024-02-15T22:56:05.700908+0000","last_became_peered":"2024-02-15T22:56:05.700908+0000","last_unstale":"2024-02-15T22:58:32.115835+0000","last_undegraded":"2024-02-15T22:58:32.115835+0000","last_fullsized":"2024-02-15T22:58:32.115835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:32.115751+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:32.115751+0000","last_clean_scrub_stamp":"2024-02-15T22:58:32.115751+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:52:27.671060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.253825+0000","last_change":"2024-02-15T22:58:21.253850+0000","last_active":"2024-02-15T22:58:21.253825+0000","last_peered":"2024-02-15T22:58:21.253825+0000","last_clean":"2024-02-15T22:58:21.253825+0000","last_became_active":"2024-02-15T22:56:03.704081+0000","last_became_peered":"2024-02-15T22:56:03.704081+0000","last_unstale":"2024-02-15T22:58:21.253825+0000","last_undegraded":"2024-02-15T22:58:21.253825+0000","last_fullsized":"2024-02-15T22:58:21.253825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:21.253735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:21.253735+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.253735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:33.248382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:58.886355+0000","last_change":"2024-02-15T22:57:58.886355+0000","last_active":"2024-02-15T22:57:58.886355+0000","last_peered":"2024-02-15T22:57:58.886355+0000","last_clean":"2024-02-15T22:57:58.886355+0000","last_became_active":"2024-02-15T22:56:07.708530+0000","last_became_peered":"2024-02-15T22:56:07.708530+0000","last_unstale":"2024-02-15T22:57:58.886355+0000","last_undegraded":"2024-02-15T22:57:58.886355+0000","last_fullsized":"2024-02-15T22:57:58.886355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:58.886242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:58.886242+0000","last_clean_scrub_stamp":"2024-02-15T22:57:58.886242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:51:28.475625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.000899+0000","last_change":"2024-02-15T22:57:57.000899+0000","last_active":"2024-02-15T22:57:57.000899+0000","last_peered":"2024-02-15T22:57:57.000899+0000","last_clean":"2024-02-15T22:57:57.000899+0000","last_became_active":"2024-02-15T22:56:09.716134+0000","last_became_peered":"2024-02-15T22:56:09.716134+0000","last_unstale":"2024-02-15T22:57:57.000899+0000","last_undegraded":"2024-02-15T22:57:57.000899+0000","last_fullsized":"2024-02-15T22:57:57.000899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-02-15T22:57:57.000753+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-02-15T22:57:57.000753+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.000753+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:47.478957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":49,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.185631+0000","last_change":"2024-02-15T22:58:13.185631+0000","last_active":"2024-02-15T22:58:13.185631+0000","last_peered":"2024-02-15T22:58:13.185631+0000","last_clean":"2024-02-15T22:58:13.185631+0000","last_became_active":"2024-02-15T22:56:11.725271+0000","last_became_peered":"2024-02-15T22:56:11.725271+0000","last_unstale":"2024-02-15T22:58:13.185631+0000","last_undegraded":"2024-02-15T22:58:13.185631+0000","last_fullsized":"2024-02-15T22:58:13.185631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:13.185521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:13.185521+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.185521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:35.729575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:12.403434+0000","last_change":"2024-02-15T22:59:12.403462+0000","last_active":"2024-02-15T22:59:12.403434+0000","last_peered":"2024-02-15T22:59:12.403434+0000","last_clean":"2024-02-15T22:59:12.403434+0000","last_became_active":"2024-02-15T22:56:13.734871+0000","last_became_peered":"2024-02-15T22:56:13.734871+0000","last_unstale":"2024-02-15T22:59:12.403434+0000","last_undegraded":"2024-02-15T22:59:12.403434+0000","last_fullsized":"2024-02-15T22:59:12.403434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-15T22:59:12.403346+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-15T22:59:12.403346+0000","last_clean_scrub_stamp":"2024-02-15T22:59:12.403346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:42:32.227841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'16","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.955321+0000","last_change":"2024-02-15T22:58:10.955321+0000","last_active":"2024-02-15T22:58:10.955321+0000","last_peered":"2024-02-15T22:58:10.955321+0000","last_clean":"2024-02-15T22:58:10.955321+0000","last_became_active":"2024-02-15T22:56:05.700066+0000","last_became_peered":"2024-02-15T22:56:05.700066+0000","last_unstale":"2024-02-15T22:58:10.955321+0000","last_undegraded":"2024-02-15T22:58:10.955321+0000","last_fullsized":"2024-02-15T22:58:10.955321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-15T22:58:10.955167+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-15T22:58:10.955167+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.955167+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:41:48.202367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:33.878922+0000","last_change":"2024-02-15T22:58:33.878985+0000","last_active":"2024-02-15T22:58:33.878922+0000","last_peered":"2024-02-15T22:58:33.878922+0000","last_clean":"2024-02-15T22:58:33.878922+0000","last_became_active":"2024-02-15T22:56:03.693300+0000","last_became_peered":"2024-02-15T22:56:03.693300+0000","last_unstale":"2024-02-15T22:58:33.878922+0000","last_undegraded":"2024-02-15T22:58:33.878922+0000","last_fullsized":"2024-02-15T22:58:33.878922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:33.878818+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:33.878818+0000","last_clean_scrub_stamp":"2024-02-15T22:58:33.878818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:36:02.728765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:57.879672+0000","last_change":"2024-02-15T22:57:57.879672+0000","last_active":"2024-02-15T22:57:57.879672+0000","last_peered":"2024-02-15T22:57:57.879672+0000","last_clean":"2024-02-15T22:57:57.879672+0000","last_became_active":"2024-02-15T22:56:07.708720+0000","last_became_peered":"2024-02-15T22:56:07.708720+0000","last_unstale":"2024-02-15T22:57:57.879672+0000","last_undegraded":"2024-02-15T22:57:57.879672+0000","last_fullsized":"2024-02-15T22:57:57.879672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-15T22:57:57.879545+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-15T22:57:57.879545+0000","last_clean_scrub_stamp":"2024-02-15T22:57:57.879545+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:33.402218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.181089+0000","last_change":"2024-02-15T22:58:20.181089+0000","last_active":"2024-02-15T22:58:20.181089+0000","last_peered":"2024-02-15T22:58:20.181089+0000","last_clean":"2024-02-15T22:58:20.181089+0000","last_became_active":"2024-02-15T22:56:09.717846+0000","last_became_peered":"2024-02-15T22:56:09.717846+0000","last_unstale":"2024-02-15T22:58:20.181089+0000","last_undegraded":"2024-02-15T22:58:20.181089+0000","last_fullsized":"2024-02-15T22:58:20.181089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-15T22:58:20.180944+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-15T22:58:20.180944+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.180944+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:11:37.794373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:57:48.339582+0000","last_change":"2024-02-15T22:57:48.339582+0000","last_active":"2024-02-15T22:57:48.339582+0000","last_peered":"2024-02-15T22:57:48.339582+0000","last_clean":"2024-02-15T22:57:48.339582+0000","last_became_active":"2024-02-15T22:56:11.722402+0000","last_became_peered":"2024-02-15T22:56:11.722402+0000","last_unstale":"2024-02-15T22:57:48.339582+0000","last_undegraded":"2024-02-15T22:57:48.339582+0000","last_fullsized":"2024-02-15T22:57:48.339582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:57:48.339482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:57:48.339482+0000","last_clean_scrub_stamp":"2024-02-15T22:57:48.339482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:35:51.537660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:10.362541+0000","last_change":"2024-02-15T22:59:10.362607+0000","last_active":"2024-02-15T22:59:10.362541+0000","last_peered":"2024-02-15T22:59:10.362541+0000","last_clean":"2024-02-15T22:59:10.362541+0000","last_became_active":"2024-02-15T22:56:13.733285+0000","last_became_peered":"2024-02-15T22:56:13.733285+0000","last_unstale":"2024-02-15T22:59:10.362541+0000","last_undegraded":"2024-02-15T22:59:10.362541+0000","last_fullsized":"2024-02-15T22:59:10.362541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:10.362436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:10.362436+0000","last_clean_scrub_stamp":"2024-02-15T22:59:10.362436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:37.528680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:06.867874+0000","last_change":"2024-02-15T22:58:06.867874+0000","last_active":"2024-02-15T22:58:06.867874+0000","last_peered":"2024-02-15T22:58:06.867874+0000","last_clean":"2024-02-15T22:58:06.867874+0000","last_became_active":"2024-02-15T22:56:05.715609+0000","last_became_peered":"2024-02-15T22:56:05.715609+0000","last_unstale":"2024-02-15T22:58:06.867874+0000","last_undegraded":"2024-02-15T22:58:06.867874+0000","last_fullsized":"2024-02-15T22:58:06.867874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-02-15T22:58:06.867728+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-02-15T22:58:06.867728+0000","last_clean_scrub_stamp":"2024-02-15T22:58:06.867728+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:46:34.691909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:29.939014+0000","last_change":"2024-02-15T22:58:29.939039+0000","last_active":"2024-02-15T22:58:29.939014+0000","last_peered":"2024-02-15T22:58:29.939014+0000","last_clean":"2024-02-15T22:58:29.939014+0000","last_became_active":"2024-02-15T22:56:03.691266+0000","last_became_peered":"2024-02-15T22:56:03.691266+0000","last_unstale":"2024-02-15T22:58:29.939014+0000","last_undegraded":"2024-02-15T22:58:29.939014+0000","last_fullsized":"2024-02-15T22:58:29.939014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:29.938899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:29.938899+0000","last_clean_scrub_stamp":"2024-02-15T22:58:29.938899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:51:41.933547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:17.222659+0000","last_change":"2024-02-15T22:58:17.222659+0000","last_active":"2024-02-15T22:58:17.222659+0000","last_peered":"2024-02-15T22:58:17.222659+0000","last_clean":"2024-02-15T22:58:17.222659+0000","last_became_active":"2024-02-15T22:56:05.707492+0000","last_became_peered":"2024-02-15T22:56:05.707492+0000","last_unstale":"2024-02-15T22:58:17.222659+0000","last_undegraded":"2024-02-15T22:58:17.222659+0000","last_fullsized":"2024-02-15T22:58:17.222659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:17.222540+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:17.222540+0000","last_clean_scrub_stamp":"2024-02-15T22:58:17.222540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:02:43.244450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:38.338054+0000","last_change":"2024-02-15T22:58:38.338096+0000","last_active":"2024-02-15T22:58:38.338054+0000","last_peered":"2024-02-15T22:58:38.338054+0000","last_clean":"2024-02-15T22:58:38.338054+0000","last_became_active":"2024-02-15T22:56:03.692909+0000","last_became_peered":"2024-02-15T22:56:03.692909+0000","last_unstale":"2024-02-15T22:58:38.338054+0000","last_undegraded":"2024-02-15T22:58:38.338054+0000","last_fullsized":"2024-02-15T22:58:38.338054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:38.337963+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:38.337963+0000","last_clean_scrub_stamp":"2024-02-15T22:58:38.337963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:04:55.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:10.142444+0000","last_change":"2024-02-15T22:58:10.142444+0000","last_active":"2024-02-15T22:58:10.142444+0000","last_peered":"2024-02-15T22:58:10.142444+0000","last_clean":"2024-02-15T22:58:10.142444+0000","last_became_active":"2024-02-15T22:56:05.710095+0000","last_became_peered":"2024-02-15T22:56:05.710095+0000","last_unstale":"2024-02-15T22:58:10.142444+0000","last_undegraded":"2024-02-15T22:58:10.142444+0000","last_fullsized":"2024-02-15T22:58:10.142444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:10.142332+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:10.142332+0000","last_clean_scrub_stamp":"2024-02-15T22:58:10.142332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:29:45.908209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:06.300158+0000","last_change":"2024-02-15T22:59:06.300186+0000","last_active":"2024-02-15T22:59:06.300158+0000","last_peered":"2024-02-15T22:59:06.300158+0000","last_clean":"2024-02-15T22:59:06.300158+0000","last_became_active":"2024-02-15T22:56:03.695362+0000","last_became_peered":"2024-02-15T22:56:03.695362+0000","last_unstale":"2024-02-15T22:59:06.300158+0000","last_undegraded":"2024-02-15T22:59:06.300158+0000","last_fullsized":"2024-02-15T22:59:06.300158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:06.300066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:06.300066+0000","last_clean_scrub_stamp":"2024-02-15T22:59:06.300066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:29:10.848441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.211865+0000","last_change":"2024-02-15T22:58:18.211865+0000","last_active":"2024-02-15T22:58:18.211865+0000","last_peered":"2024-02-15T22:58:18.211865+0000","last_clean":"2024-02-15T22:58:18.211865+0000","last_became_active":"2024-02-15T22:56:05.701253+0000","last_became_peered":"2024-02-15T22:56:05.701253+0000","last_unstale":"2024-02-15T22:58:18.211865+0000","last_undegraded":"2024-02-15T22:58:18.211865+0000","last_fullsized":"2024-02-15T22:58:18.211865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:18.211741+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:18.211741+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.211741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:08.689945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:31.354906+0000","last_change":"2024-02-15T22:58:31.354934+0000","last_active":"2024-02-15T22:58:31.354906+0000","last_peered":"2024-02-15T22:58:31.354906+0000","last_clean":"2024-02-15T22:58:31.354906+0000","last_became_active":"2024-02-15T22:56:03.699881+0000","last_became_peered":"2024-02-15T22:56:03.699881+0000","last_unstale":"2024-02-15T22:58:31.354906+0000","last_undegraded":"2024-02-15T22:58:31.354906+0000","last_fullsized":"2024-02-15T22:58:31.354906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:31.354815+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:31.354815+0000","last_clean_scrub_stamp":"2024-02-15T22:58:31.354815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:36:00.204762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:49.320513+0000","last_change":"2024-02-15T22:58:49.320539+0000","last_active":"2024-02-15T22:58:49.320513+0000","last_peered":"2024-02-15T22:58:49.320513+0000","last_clean":"2024-02-15T22:58:49.320513+0000","last_became_active":"2024-02-15T22:56:45.886976+0000","last_became_peered":"2024-02-15T22:56:45.886976+0000","last_unstale":"2024-02-15T22:58:49.320513+0000","last_undegraded":"2024-02-15T22:58:49.320513+0000","last_fullsized":"2024-02-15T22:58:49.320513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:49.320438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:49.320438+0000","last_clean_scrub_stamp":"2024-02-15T22:58:49.320438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:34.790682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.317868+0000","last_change":"2024-02-15T22:58:37.317895+0000","last_active":"2024-02-15T22:58:37.317868+0000","last_peered":"2024-02-15T22:58:37.317868+0000","last_clean":"2024-02-15T22:58:37.317868+0000","last_became_active":"2024-02-15T22:56:03.692939+0000","last_became_peered":"2024-02-15T22:56:03.692939+0000","last_unstale":"2024-02-15T22:58:37.317868+0000","last_undegraded":"2024-02-15T22:58:37.317868+0000","last_fullsized":"2024-02-15T22:58:37.317868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:37.317783+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:37.317783+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.317783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:26:18.134612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:09.838311+0000","last_change":"2024-02-15T22:58:09.838311+0000","last_active":"2024-02-15T22:58:09.838311+0000","last_peered":"2024-02-15T22:58:09.838311+0000","last_clean":"2024-02-15T22:58:09.838311+0000","last_became_active":"2024-02-15T22:56:05.713670+0000","last_became_peered":"2024-02-15T22:56:05.713670+0000","last_unstale":"2024-02-15T22:58:09.838311+0000","last_undegraded":"2024-02-15T22:58:09.838311+0000","last_fullsized":"2024-02-15T22:58:09.838311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:09.838137+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:09.838137+0000","last_clean_scrub_stamp":"2024-02-15T22:58:09.838137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:24:40.314346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:37.899329+0000","last_change":"2024-02-15T22:58:37.899378+0000","last_active":"2024-02-15T22:58:37.899329+0000","last_peered":"2024-02-15T22:58:37.899329+0000","last_clean":"2024-02-15T22:58:37.899329+0000","last_became_active":"2024-02-15T22:56:03.696174+0000","last_became_peered":"2024-02-15T22:56:03.696174+0000","last_unstale":"2024-02-15T22:58:37.899329+0000","last_undegraded":"2024-02-15T22:58:37.899329+0000","last_fullsized":"2024-02-15T22:58:37.899329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:37.899233+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:37.899233+0000","last_clean_scrub_stamp":"2024-02-15T22:58:37.899233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:52:00.443287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.217171+0000","last_change":"2024-02-15T22:58:20.217197+0000","last_active":"2024-02-15T22:58:20.217171+0000","last_peered":"2024-02-15T22:58:20.217171+0000","last_clean":"2024-02-15T22:58:20.217171+0000","last_became_active":"2024-02-15T22:56:05.703183+0000","last_became_peered":"2024-02-15T22:56:05.703183+0000","last_unstale":"2024-02-15T22:58:20.217171+0000","last_undegraded":"2024-02-15T22:58:20.217171+0000","last_fullsized":"2024-02-15T22:58:20.217171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:20.217082+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:20.217082+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.217082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:26.212867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:18.899622+0000","last_change":"2024-02-15T22:58:18.899658+0000","last_active":"2024-02-15T22:58:18.899622+0000","last_peered":"2024-02-15T22:58:18.899622+0000","last_clean":"2024-02-15T22:58:18.899622+0000","last_became_active":"2024-02-15T22:56:03.699989+0000","last_became_peered":"2024-02-15T22:56:03.699989+0000","last_unstale":"2024-02-15T22:58:18.899622+0000","last_undegraded":"2024-02-15T22:58:18.899622+0000","last_fullsized":"2024-02-15T22:58:18.899622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:18.899525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:18.899525+0000","last_clean_scrub_stamp":"2024-02-15T22:58:18.899525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:25:19.320652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:14.867837+0000","last_change":"2024-02-15T22:58:14.867862+0000","last_active":"2024-02-15T22:58:14.867837+0000","last_peered":"2024-02-15T22:58:14.867837+0000","last_clean":"2024-02-15T22:58:14.867837+0000","last_became_active":"2024-02-15T22:56:05.701193+0000","last_became_peered":"2024-02-15T22:56:05.701193+0000","last_unstale":"2024-02-15T22:58:14.867837+0000","last_undegraded":"2024-02-15T22:58:14.867837+0000","last_fullsized":"2024-02-15T22:58:14.867837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:14.867745+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:14.867745+0000","last_clean_scrub_stamp":"2024-02-15T22:58:14.867745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:45.079186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:36.339449+0000","last_change":"2024-02-15T22:58:36.339475+0000","last_active":"2024-02-15T22:58:36.339449+0000","last_peered":"2024-02-15T22:58:36.339449+0000","last_clean":"2024-02-15T22:58:36.339449+0000","last_became_active":"2024-02-15T22:56:03.692902+0000","last_became_peered":"2024-02-15T22:56:03.692902+0000","last_unstale":"2024-02-15T22:58:36.339449+0000","last_undegraded":"2024-02-15T22:58:36.339449+0000","last_fullsized":"2024-02-15T22:58:36.339449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:36.339345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:36.339345+0000","last_clean_scrub_stamp":"2024-02-15T22:58:36.339345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:38:47.179116+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:16.832083+0000","last_change":"2024-02-15T22:58:16.832083+0000","last_active":"2024-02-15T22:58:16.832083+0000","last_peered":"2024-02-15T22:58:16.832083+0000","last_clean":"2024-02-15T22:58:16.832083+0000","last_became_active":"2024-02-15T22:56:05.702455+0000","last_became_peered":"2024-02-15T22:56:05.702455+0000","last_unstale":"2024-02-15T22:58:16.832083+0000","last_undegraded":"2024-02-15T22:58:16.832083+0000","last_fullsized":"2024-02-15T22:58:16.832083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:16.831958+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:16.831958+0000","last_clean_scrub_stamp":"2024-02-15T22:58:16.831958+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:37:31.233589+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:59:05.260114+0000","last_change":"2024-02-15T22:59:05.260139+0000","last_active":"2024-02-15T22:59:05.260114+0000","last_peered":"2024-02-15T22:59:05.260114+0000","last_clean":"2024-02-15T22:59:05.260114+0000","last_became_active":"2024-02-15T22:56:03.695149+0000","last_became_peered":"2024-02-15T22:56:03.695149+0000","last_unstale":"2024-02-15T22:59:05.260114+0000","last_undegraded":"2024-02-15T22:59:05.260114+0000","last_fullsized":"2024-02-15T22:59:05.260114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:59:05.260027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:59:05.260027+0000","last_clean_scrub_stamp":"2024-02-15T22:59:05.260027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:38.174013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.160635+0000","last_change":"2024-02-15T22:58:27.160657+0000","last_active":"2024-02-15T22:58:27.160635+0000","last_peered":"2024-02-15T22:58:27.160635+0000","last_clean":"2024-02-15T22:58:27.160635+0000","last_became_active":"2024-02-15T22:56:05.704211+0000","last_became_peered":"2024-02-15T22:56:05.704211+0000","last_unstale":"2024-02-15T22:58:27.160635+0000","last_undegraded":"2024-02-15T22:58:27.160635+0000","last_fullsized":"2024-02-15T22:58:27.160635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.160532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.160532+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.160532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:12.630776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:41.376176+0000","last_change":"2024-02-15T22:58:41.376207+0000","last_active":"2024-02-15T22:58:41.376176+0000","last_peered":"2024-02-15T22:58:41.376176+0000","last_clean":"2024-02-15T22:58:41.376176+0000","last_became_active":"2024-02-15T22:56:03.699419+0000","last_became_peered":"2024-02-15T22:56:03.699419+0000","last_unstale":"2024-02-15T22:58:41.376176+0000","last_undegraded":"2024-02-15T22:58:41.376176+0000","last_fullsized":"2024-02-15T22:58:41.376176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-15T22:58:41.376083+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-15T22:58:41.376083+0000","last_clean_scrub_stamp":"2024-02-15T22:58:41.376083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:07:04.420054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:15.239317+0000","last_change":"2024-02-15T22:58:15.239317+0000","last_active":"2024-02-15T22:58:15.239317+0000","last_peered":"2024-02-15T22:58:15.239317+0000","last_clean":"2024-02-15T22:58:15.239317+0000","last_became_active":"2024-02-15T22:56:05.710665+0000","last_became_peered":"2024-02-15T22:56:05.710665+0000","last_unstale":"2024-02-15T22:58:15.239317+0000","last_undegraded":"2024-02-15T22:58:15.239317+0000","last_fullsized":"2024-02-15T22:58:15.239317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:15.239206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:15.239206+0000","last_clean_scrub_stamp":"2024-02-15T22:58:15.239206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:58.794458+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:23.898287+0000","last_change":"2024-02-15T22:58:23.898307+0000","last_active":"2024-02-15T22:58:23.898287+0000","last_peered":"2024-02-15T22:58:23.898287+0000","last_clean":"2024-02-15T22:58:23.898287+0000","last_became_active":"2024-02-15T22:56:03.705871+0000","last_became_peered":"2024-02-15T22:56:03.705871+0000","last_unstale":"2024-02-15T22:58:23.898287+0000","last_undegraded":"2024-02-15T22:58:23.898287+0000","last_fullsized":"2024-02-15T22:58:23.898287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:23.898186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:23.898186+0000","last_clean_scrub_stamp":"2024-02-15T22:58:23.898186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:29.893971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:22.881465+0000","last_change":"2024-02-15T22:58:22.881496+0000","last_active":"2024-02-15T22:58:22.881465+0000","last_peered":"2024-02-15T22:58:22.881465+0000","last_clean":"2024-02-15T22:58:22.881465+0000","last_became_active":"2024-02-15T22:56:05.704505+0000","last_became_peered":"2024-02-15T22:56:05.704505+0000","last_unstale":"2024-02-15T22:58:22.881465+0000","last_undegraded":"2024-02-15T22:58:22.881465+0000","last_fullsized":"2024-02-15T22:58:22.881465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:22.881364+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:22.881364+0000","last_clean_scrub_stamp":"2024-02-15T22:58:22.881364+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:32:11.297043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:21.853912+0000","last_change":"2024-02-15T22:58:21.853937+0000","last_active":"2024-02-15T22:58:21.853912+0000","last_peered":"2024-02-15T22:58:21.853912+0000","last_clean":"2024-02-15T22:58:21.853912+0000","last_became_active":"2024-02-15T22:56:03.705904+0000","last_became_peered":"2024-02-15T22:56:03.705904+0000","last_unstale":"2024-02-15T22:58:21.853912+0000","last_undegraded":"2024-02-15T22:58:21.853912+0000","last_fullsized":"2024-02-15T22:58:21.853912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:21.853819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:21.853819+0000","last_clean_scrub_stamp":"2024-02-15T22:58:21.853819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:12.332024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:13.864194+0000","last_change":"2024-02-15T22:58:13.864194+0000","last_active":"2024-02-15T22:58:13.864194+0000","last_peered":"2024-02-15T22:58:13.864194+0000","last_clean":"2024-02-15T22:58:13.864194+0000","last_became_active":"2024-02-15T22:56:05.713035+0000","last_became_peered":"2024-02-15T22:56:05.713035+0000","last_unstale":"2024-02-15T22:58:13.864194+0000","last_undegraded":"2024-02-15T22:58:13.864194+0000","last_fullsized":"2024-02-15T22:58:13.864194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:13.864083+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:13.864083+0000","last_clean_scrub_stamp":"2024-02-15T22:58:13.864083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:17.062902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:52.177347+0000","last_change":"2024-02-15T22:58:52.177371+0000","last_active":"2024-02-15T22:58:52.177347+0000","last_peered":"2024-02-15T22:58:52.177347+0000","last_clean":"2024-02-15T22:58:52.177347+0000","last_became_active":"2024-02-15T22:56:03.696045+0000","last_became_peered":"2024-02-15T22:56:03.696045+0000","last_unstale":"2024-02-15T22:58:52.177347+0000","last_undegraded":"2024-02-15T22:58:52.177347+0000","last_fullsized":"2024-02-15T22:58:52.177347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:52.177257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:52.177257+0000","last_clean_scrub_stamp":"2024-02-15T22:58:52.177257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:58:08.765639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:20.867031+0000","last_change":"2024-02-15T22:58:20.867085+0000","last_active":"2024-02-15T22:58:20.867031+0000","last_peered":"2024-02-15T22:58:20.867031+0000","last_clean":"2024-02-15T22:58:20.867031+0000","last_became_active":"2024-02-15T22:56:05.704733+0000","last_became_peered":"2024-02-15T22:56:05.704733+0000","last_unstale":"2024-02-15T22:58:20.867031+0000","last_undegraded":"2024-02-15T22:58:20.867031+0000","last_fullsized":"2024-02-15T22:58:20.867031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-02-15T22:58:20.866916+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-02-15T22:58:20.866916+0000","last_clean_scrub_stamp":"2024-02-15T22:58:20.866916+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T23:09:47.979444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:56.222539+0000","last_change":"2024-02-15T22:58:56.222564+0000","last_active":"2024-02-15T22:58:56.222539+0000","last_peered":"2024-02-15T22:58:56.222539+0000","last_clean":"2024-02-15T22:58:56.222539+0000","last_became_active":"2024-02-15T22:56:03.695454+0000","last_became_peered":"2024-02-15T22:56:03.695454+0000","last_unstale":"2024-02-15T22:58:56.222539+0000","last_undegraded":"2024-02-15T22:58:56.222539+0000","last_fullsized":"2024-02-15T22:58:56.222539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:56.222413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:56.222413+0000","last_clean_scrub_stamp":"2024-02-15T22:58:56.222413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:32:51.559781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.191943+0000","last_change":"2024-02-15T22:58:26.191993+0000","last_active":"2024-02-15T22:58:26.191943+0000","last_peered":"2024-02-15T22:58:26.191943+0000","last_clean":"2024-02-15T22:58:26.191943+0000","last_became_active":"2024-02-15T22:56:05.707464+0000","last_became_peered":"2024-02-15T22:56:05.707464+0000","last_unstale":"2024-02-15T22:58:26.191943+0000","last_undegraded":"2024-02-15T22:58:26.191943+0000","last_fullsized":"2024-02-15T22:58:26.191943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:26.191834+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:26.191834+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.191834+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:13:44.299345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:30.893079+0000","last_change":"2024-02-15T22:58:30.893122+0000","last_active":"2024-02-15T22:58:30.893079+0000","last_peered":"2024-02-15T22:58:30.893079+0000","last_clean":"2024-02-15T22:58:30.893079+0000","last_became_active":"2024-02-15T22:56:03.696267+0000","last_became_peered":"2024-02-15T22:56:03.696267+0000","last_unstale":"2024-02-15T22:58:30.893079+0000","last_undegraded":"2024-02-15T22:58:30.893079+0000","last_fullsized":"2024-02-15T22:58:30.893079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-15T22:58:30.892968+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-15T22:58:30.892968+0000","last_clean_scrub_stamp":"2024-02-15T22:58:30.892968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:21:14.370027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:26.933019+0000","last_change":"2024-02-15T22:58:26.933047+0000","last_active":"2024-02-15T22:58:26.933019+0000","last_peered":"2024-02-15T22:58:26.933019+0000","last_clean":"2024-02-15T22:58:26.933019+0000","last_became_active":"2024-02-15T22:56:05.705496+0000","last_became_peered":"2024-02-15T22:56:05.705496+0000","last_unstale":"2024-02-15T22:58:26.933019+0000","last_undegraded":"2024-02-15T22:58:26.933019+0000","last_fullsized":"2024-02-15T22:58:26.933019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:26.932917+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:26.932917+0000","last_clean_scrub_stamp":"2024-02-15T22:58:26.932917+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:21.663794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:39.155914+0000","last_change":"2024-02-15T22:58:39.155989+0000","last_active":"2024-02-15T22:58:39.155914+0000","last_peered":"2024-02-15T22:58:39.155914+0000","last_clean":"2024-02-15T22:58:39.155914+0000","last_became_active":"2024-02-15T22:56:03.707033+0000","last_became_peered":"2024-02-15T22:56:03.707033+0000","last_unstale":"2024-02-15T22:58:39.155914+0000","last_undegraded":"2024-02-15T22:58:39.155914+0000","last_fullsized":"2024-02-15T22:58:39.155914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-15T22:58:39.155824+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-15T22:58:39.155824+0000","last_clean_scrub_stamp":"2024-02-15T22:58:39.155824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:59:29.633424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:55.188840+0000","last_change":"2024-02-15T22:58:55.188868+0000","last_active":"2024-02-15T22:58:55.188840+0000","last_peered":"2024-02-15T22:58:55.188840+0000","last_clean":"2024-02-15T22:58:55.188840+0000","last_became_active":"2024-02-15T22:56:03.705853+0000","last_became_peered":"2024-02-15T22:56:03.705853+0000","last_unstale":"2024-02-15T22:58:55.188840+0000","last_undegraded":"2024-02-15T22:58:55.188840+0000","last_fullsized":"2024-02-15T22:58:55.188840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:55.188733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:55.188733+0000","last_clean_scrub_stamp":"2024-02-15T22:58:55.188733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:49:49.965757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:19.186899+0000","last_change":"2024-02-15T22:58:19.186899+0000","last_active":"2024-02-15T22:58:19.186899+0000","last_peered":"2024-02-15T22:58:19.186899+0000","last_clean":"2024-02-15T22:58:19.186899+0000","last_became_active":"2024-02-15T22:56:05.699141+0000","last_became_peered":"2024-02-15T22:56:05.699141+0000","last_unstale":"2024-02-15T22:58:19.186899+0000","last_undegraded":"2024-02-15T22:58:19.186899+0000","last_fullsized":"2024-02-15T22:58:19.186899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-15T22:58:19.186738+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-15T22:58:19.186738+0000","last_clean_scrub_stamp":"2024-02-15T22:58:19.186738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:54.706314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:27.303775+0000","last_change":"2024-02-15T22:58:27.303798+0000","last_active":"2024-02-15T22:58:27.303775+0000","last_peered":"2024-02-15T22:58:27.303775+0000","last_clean":"2024-02-15T22:58:27.303775+0000","last_became_active":"2024-02-15T22:56:03.700107+0000","last_became_peered":"2024-02-15T22:56:03.700107+0000","last_unstale":"2024-02-15T22:58:27.303775+0000","last_undegraded":"2024-02-15T22:58:27.303775+0000","last_fullsized":"2024-02-15T22:58:27.303775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:58:27.303690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:58:27.303690+0000","last_clean_scrub_stamp":"2024-02-15T22:58:27.303690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:32:26.922533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-15T22:58:11.897645+0000","last_change":"2024-02-15T22:58:11.897645+0000","last_active":"2024-02-15T22:58:11.897645+0000","last_peered":"2024-02-15T22:58:11.897645+0000","last_clean":"2024-02-15T22:58:11.897645+0000","last_became_active":"2024-02-15T22:56:05.713142+0000","last_became_peered":"2024-02-15T22:56:05.713142+0000","last_unstale":"2024-02-15T22:58:11.897645+0000","last_undegraded":"2024-02-15T22:58:11.897645+0000","last_fullsized":"2024-02-15T22:58:11.897645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-15T22:58:11.897529+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-15T22:58:11.897529+0000","last_clean_scrub_stamp":"2024-02-15T22:58:11.897529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:37.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1419,"ondisk_log_size":1419,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":46,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35764,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336076,"statfs":{"total":96636764160,"available":96600141824,"internally_reserved":0,"allocated":438272,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.34599999999999997,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51900000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.371},{"interface":"front","average":{"1min":0.439,"5min":0.42199999999999999,"15min":0.42099999999999999},"min":{"1min":0.32500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.54600000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Feb 15 22:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.32100000000000001},"min":{"1min":0.26400000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48199999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.25700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44900000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Feb 15 22:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.35399999999999998,"15min":0.35599999999999998},"min":{"1min":0.28100000000000003,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.32400000000000001,"15min":0.32800000000000001},"min":{"1min":0.247,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.505,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.30199999999999999}]}]},{"osd":2,"up_from":10,"seq":42949673008,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":978944,"data_stored":722767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.42199999999999999},"min":{"1min":0.32900000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.52000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.42799999999999999,"15min":0.42499999999999999},"min":{"1min":0.31900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58499999999999996,"5min":0.623,"15min":0.623},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Feb 15 22:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.308,"15min":0.30599999999999999},"min":{"1min":0.23899999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.44400000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.32000000000000001,"15min":0.313},"min":{"1min":0.254,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.46700000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Feb 15 22:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.251,"5min":0.192,"15min":0.192},"max":{"1min":0.5,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.26700000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.47699999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.24299999999999999}]}]},{"osd":1,"up_from":10,"seq":42949673007,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:58:53 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Feb 15 22:58:53 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.311,"15min":0.30499999999999999},"min":{"1min":0.23999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.31,"15min":0.30399999999999999},"min":{"1min":0.255,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Feb 15 22:58:53 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.313,"15min":0.31},"min":{"1min":0.22500000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.41599999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.309},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.28199999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47199999999999998,"5min":0.5,"15min":0.5},"last":0.374}]}]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":133900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:58:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63600000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50600000000000001,"15min":0.505},"min":{"1min":0.36799999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60599999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Feb 15 22:58:56 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48999999999999999,"15min":0.48099999999999998},"min":{"1min":0.29399999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.505,"15min":0.502},"min":{"1min":0.39700000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67600000000000005,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Feb 15 22:58:56 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.35899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65600000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.503},"min":{"1min":0.41699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.72599999999999998,"5min":0.75,"15min":0.75},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:59:29.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-15T22:59:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.672+0000 7f868324a640 1 Processor -- start 2024-02-15T22:59:29.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.672+0000 7f868324a640 1 -- start start 2024-02-15T22:59:29.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.673+0000 7f868324a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f867c12de20 0x7f867c12e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:29.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.673+0000 7f868324a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c099460 con 0x7f867c12e740 2024-02-15T22:59:29.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.673+0000 7f868324a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c099690 con 0x7f867c12de20 2024-02-15T22:59:29.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.673+0000 7f8680fe6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f867c12de20 0x7f867c12e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.673+0000 7f867bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f867c12e740 0x7f867c12a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45996/0 (socket says 172.21.15.52:45996) 2024-02-15T22:59:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.673+0000 7f867bfff640 1 -- 172.21.15.52:0/1725860337 learned_addr learned my addr 172.21.15.52:0/1725860337 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-02-15T22:59:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.673+0000 7f8680fe6640 1 -- 172.21.15.52:0/1725860337 >> v1:172.21.15.52:6789/0 conn(0x7f867c12e740 legacy=0x7f867c12a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.673+0000 7f8680fe6640 1 -- 172.21.15.52:0/1725860337 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c099d80 con 0x7f867c12de20 2024-02-15T22:59:29.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.674+0000 7f8680fe6640 1 --2- 172.21.15.52:0/1725860337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c12de20 0x7f867c12e200 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8674009d90 tx=0x7f867402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4e67a541b4bb9d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:29.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.674+0000 7f867b7fe640 1 -- 172.21.15.52:0/1725860337 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f867402cb10 con 0x7f867c12de20 2024-02-15T22:59:29.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.674+0000 7f867b7fe640 1 -- 172.21.15.52:0/1725860337 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867402cc70 con 0x7f867c12de20 2024-02-15T22:59:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.674+0000 7f867b7fe640 1 -- 172.21.15.52:0/1725860337 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8674034440 con 0x7f867c12de20 2024-02-15T22:59:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.674+0000 7f868324a640 1 -- 172.21.15.52:0/1725860337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c12de20 msgr2=0x7f867c12e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.674+0000 7f868324a640 1 --2- 172.21.15.52:0/1725860337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c12de20 0x7f867c12e200 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8674009d90 tx=0x7f867402beb0 comp rx=0 tx=0).stop 2024-02-15T22:59:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.674+0000 7f868324a640 1 -- 172.21.15.52:0/1725860337 shutdown_connections 2024-02-15T22:59:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.674+0000 7f868324a640 1 --2- 172.21.15.52:0/1725860337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c12de20 0x7f867c12e200 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.674+0000 7f868324a640 1 -- 172.21.15.52:0/1725860337 >> 172.21.15.52:0/1725860337 conn(0x7f867c0a07a0 msgr2=0x7f867c0a0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.675+0000 7f868324a640 1 -- 172.21.15.52:0/1725860337 shutdown_connections 2024-02-15T22:59:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.675+0000 7f868324a640 1 -- 172.21.15.52:0/1725860337 wait complete. 2024-02-15T22:59:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.675+0000 7f868324a640 1 Processor -- start 2024-02-15T22:59:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.675+0000 7f868324a640 1 -- start start 2024-02-15T22:59:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.676+0000 7f868324a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c12de20 0x7f867c1c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.676+0000 7f868324a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0722b0 con 0x7f867c12de20 2024-02-15T22:59:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.676+0000 7f8680fe6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c12de20 0x7f867c1c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.676+0000 7f8680fe6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c12de20 0x7f867c1c2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50860/0 (socket says 172.21.15.52:50860) 2024-02-15T22:59:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.676+0000 7f8680fe6640 1 -- 172.21.15.52:0/3058100722 learned_addr learned my addr 172.21.15.52:0/3058100722 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-02-15T22:59:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.676+0000 7f8680fe6640 1 -- 172.21.15.52:0/3058100722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674009a70 con 0x7f867c12de20 2024-02-15T22:59:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.676+0000 7f8680fe6640 1 --2- 172.21.15.52:0/3058100722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c12de20 0x7f867c1c2780 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8674000f80 tx=0x7f8674004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.676+0000 7f86797fa640 1 -- 172.21.15.52:0/3058100722 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f867403e540 con 0x7f867c12de20 2024-02-15T22:59:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.676+0000 7f86797fa640 1 -- 172.21.15.52:0/3058100722 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867403e6a0 con 0x7f867c12de20 2024-02-15T22:59:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.676+0000 7f868324a640 1 -- 172.21.15.52:0/3058100722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c12aee0 con 0x7f867c12de20 2024-02-15T22:59:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.676+0000 7f86797fa640 1 -- 172.21.15.52:0/3058100722 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f867403e960 con 0x7f867c12de20 2024-02-15T22:59:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.677+0000 7f868324a640 1 -- 172.21.15.52:0/3058100722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c06d8c0 con 0x7f867c12de20 2024-02-15T22:59:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.677+0000 7f86797fa640 1 -- 172.21.15.52:0/3058100722 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f867403b050 con 0x7f867c12de20 2024-02-15T22:59:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.677+0000 7f868324a640 1 -- 172.21.15.52:0/3058100722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c0627b0 con 0x7f867c12de20 2024-02-15T22:59:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.677+0000 7f86797fa640 1 --2- 172.21.15.52:0/3058100722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f865c037ef0 0x7f865c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.677+0000 7f86797fa640 1 -- 172.21.15.52:0/3058100722 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f867406dde0 con 0x7f867c12de20 2024-02-15T22:59:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.678+0000 7f867bfff640 1 --2- 172.21.15.52:0/3058100722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f865c037ef0 0x7f865c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:29.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.678+0000 7f867bfff640 1 --2- 172.21.15.52:0/3058100722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f865c037ef0 0x7f865c03a3b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8664007fd0 tx=0x7f8664007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:29.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.682+0000 7f86797fa640 1 -- 172.21.15.52:0/3058100722 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8674032930 con 0x7f867c12de20 2024-02-15T22:59:29.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.862+0000 7f868324a640 1 -- 172.21.15.52:0/3058100722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f867c1c2330 con 0x7f867c12de20 2024-02-15T22:59:29.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.864+0000 7f86797fa640 1 -- 172.21.15.52:0/3058100722 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8674039030 con 0x7f867c12de20 2024-02-15T22:59:29.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.865+0000 7f86797fa640 1 -- 172.21.15.52:0/3058100722 <== mon.0 v2:172.21.15.52:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8674032930 con 0x7f867c12de20 2024-02-15T22:59:29.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.866+0000 7f868324a640 1 -- 172.21.15.52:0/3058100722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f865c037ef0 msgr2=0x7f865c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:29.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.866+0000 7f868324a640 1 --2- 172.21.15.52:0/3058100722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f865c037ef0 0x7f865c03a3b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8664007fd0 tx=0x7f8664007ac0 comp rx=0 tx=0).stop 2024-02-15T22:59:29.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.866+0000 7f868324a640 1 -- 172.21.15.52:0/3058100722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c12de20 msgr2=0x7f867c1c2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:29.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.866+0000 7f868324a640 1 --2- 172.21.15.52:0/3058100722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c12de20 0x7f867c1c2780 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8674000f80 tx=0x7f8674004a40 comp rx=0 tx=0).stop 2024-02-15T22:59:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.866+0000 7f868324a640 1 -- 172.21.15.52:0/3058100722 shutdown_connections 2024-02-15T22:59:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.866+0000 7f868324a640 1 --2- 172.21.15.52:0/3058100722 >> [v2:172.21.15.133:6824/1517102141,v1:172.21.15.133:6825/1517102141] conn(0x7f865c037ef0 0x7f865c03a3b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.866+0000 7f868324a640 1 --2- 172.21.15.52:0/3058100722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f867c12de20 0x7f867c1c2780 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.866+0000 7f868324a640 1 -- 172.21.15.52:0/3058100722 >> 172.21.15.52:0/3058100722 conn(0x7f867c0a07a0 msgr2=0x7f867c12c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.866+0000 7f868324a640 1 -- 172.21.15.52:0/3058100722 shutdown_connections 2024-02-15T22:59:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-02-15T22:59:29.867+0000 7f868324a640 1 -- 172.21.15.52:0/3058100722 wait complete. 2024-02-15T22:59:29.879 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-15T22:59:29.879 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-15T22:59:29.880 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-15T22:59:29.880 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T22:59:29.921 INFO:tasks.ceph.osd.0:Stopped 2024-02-15T22:59:29.921 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-15T22:59:29.922 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T22:59:29.966 INFO:tasks.ceph.osd.1:Stopped 2024-02-15T22:59:29.966 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-15T22:59:29.966 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T22:59:30.015 INFO:tasks.ceph.osd.2:Stopped 2024-02-15T22:59:30.015 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-15T22:59:30.016 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T22:59:30.060 INFO:tasks.ceph.osd.3:Stopped 2024-02-15T22:59:30.060 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-15T22:59:30.060 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-15T22:59:30.060 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T22:59:30.089 INFO:tasks.ceph.mgr.x:Stopped 2024-02-15T22:59:30.090 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-15T22:59:30.090 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-15T22:59:30.090 INFO:teuthology.orchestra.run:waiting for 300 2024-02-15T22:59:30.100 INFO:tasks.ceph.mon.a:Stopped 2024-02-15T22:59:30.101 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-15T22:59:30.101 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-02-15T22:59:30.170 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi052.front.sepia.ceph.com 2024-02-15T22:59:30.170 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-15T22:59:30.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T22:59:30.366 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-15T22:59:30.529 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T22:59:30.529 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-15T22:59:30.603 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T22:59:30.604 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-15T22:59:30.670 INFO:tasks.ceph:Archiving mon data... 2024-02-15T22:59:30.671 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707/data/mon.a.tgz 2024-02-15T22:59:30.671 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-02-15T22:59:30.686 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.wFuKTwt9Ib 2024-02-15T22:59:30.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wFuKTwt9Ib 2024-02-15T22:59:30.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.wFuKTwt9Ib 2024-02-15T22:59:30.901 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.wFuKTwt9Ib is 243KB 2024-02-15T22:59:30.997 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.wFuKTwt9Ib 2024-02-15T22:59:31.011 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-15T22:59:31.011 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-15T22:59:31.053 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-15T22:59:31.132 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-15T22:59:31.149 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-15T22:59:31.149 INFO:tasks.ceph:Archiving crash dumps... 2024-02-15T22:59:31.151 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707/remote/smithi052/crash 2024-02-15T22:59:31.152 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-15T22:59:31.198 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707/remote/smithi133/crash 2024-02-15T22:59:31.199 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-15T22:59:31.238 INFO:tasks.ceph:Compressing logs... 2024-02-15T22:59:31.238 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T22:59:31.242 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T22:59:31.265 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31773.log 2024-02-15T22:59:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-15T22:59:31.282 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31335.log 2024-02-15T22:59:31.282 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32091.log 2024-02-15T22:59:31.283 INFO:teuthology.orchestra.run.smithi052.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31773.log.gz 2024-02-15T22:59:31.283 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31461.log 2024-02-15T22:59:31.283 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32091.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31335.log.gz 2024-02-15T22:59:31.283 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31604.log 2024-02-15T22:59:31.283 INFO:teuthology.orchestra.run.smithi052.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32091.log.gz 2024-02-15T22:59:31.283 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32049.log 2024-02-15T22:59:31.283 INFO:teuthology.orchestra.run.smithi052.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31461.log.gz 2024-02-15T22:59:31.283 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32901.log 2024-02-15T22:59:31.284 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32049.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31604.log.gz 2024-02-15T22:59:31.284 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32733.log 2024-02-15T22:59:31.284 INFO:teuthology.orchestra.run.smithi052.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32049.log.gz 2024-02-15T22:59:31.284 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32775.log 2024-02-15T22:59:31.284 INFO:teuthology.orchestra.run.smithi052.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32901.log.gz 2024-02-15T22:59:31.284 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30285.log 2024-02-15T22:59:31.284 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32775.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32733.log.gz 2024-02-15T22:59:31.284 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31881.log 2024-02-15T22:59:31.284 INFO:teuthology.orchestra.run.smithi052.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32775.log.gz 2024-02-15T22:59:31.285 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31770.log 2024-02-15T22:59:31.285 INFO:teuthology.orchestra.run.smithi052.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.30285.log.gz 2024-02-15T22:59:31.285 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32649.log 2024-02-15T22:59:31.285 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31770.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31881.log.gz 2024-02-15T22:59:31.285 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30129.log 2024-02-15T22:59:31.285 INFO:teuthology.orchestra.run.smithi052.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31770.log.gz 2024-02-15T22:59:31.285 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31771.log 2024-02-15T22:59:31.285 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30129.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32649.log.gz 2024-02-15T22:59:31.285 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32607.log 2024-02-15T22:59:31.286 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31771.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30129.log.gz 2024-02-15T22:59:31.286 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31377.log 2024-02-15T22:59:31.286 INFO:teuthology.orchestra.run.smithi052.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31771.log.gz 2024-02-15T22:59:31.286 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32397.log 2024-02-15T22:59:31.286 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31377.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32607.log.gz 2024-02-15T22:59:31.286 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32229.log 2024-02-15T22:59:31.286 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32397.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31377.log.gz 2024-02-15T22:59:31.286 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-15T22:59:31.286 INFO:teuthology.orchestra.run.smithi052.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.32397.log.gz 2024-02-15T22:59:31.287 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32817.log 2024-02-15T22:59:31.287 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- 85.5% /var/log/ceph/ceph-client.admin.31602.log 2024-02-15T22:59:31.287 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32229.log.gz 2024-02-15T22:59:31.287 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31419.log 2024-02-15T22:59:31.287 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32817.log.gz -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-15T22:59:31.287 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-02-15T22:59:31.287 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32187.log 2024-02-15T22:59:31.287 INFO:teuthology.orchestra.run.smithi052.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31602.log.gz 2024-02-15T22:59:31.287 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32133.log 2024-02-15T22:59:31.287 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31419.log: /var/log/ceph/ceph-client.admin.32187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32523.log 2024-02-15T22:59:31.288 INFO:teuthology.orchestra.run.smithi052.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32187.log.gz 2024-02-15T22:59:31.288 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 86.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.31419.log.gz /var/log/ceph/ceph-client.admin.32481.log 2024-02-15T22:59:31.288 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-02-15T22:59:31.288 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32133.log: /var/log/ceph/ceph-client.admin.32523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31503.log 2024-02-15T22:59:31.288 INFO:teuthology.orchestra.run.smithi052.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32133.log.gz 2024-02-15T22:59:31.288 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32481.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32523.log.gz 2024-02-15T22:59:31.288 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32859.log 2024-02-15T22:59:31.288 INFO:teuthology.orchestra.run.smithi052.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32481.log.gz 2024-02-15T22:59:31.289 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31940.log 2024-02-15T22:59:31.289 INFO:teuthology.orchestra.run.smithi052.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31503.log.gz 2024-02-15T22:59:31.289 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30247.log 2024-02-15T22:59:31.289 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31940.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32859.log.gz 2024-02-15T22:59:31.289 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32271.log 2024-02-15T22:59:31.289 INFO:teuthology.orchestra.run.smithi052.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.31940.log.gz 2024-02-15T22:59:31.289 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31279.log 2024-02-15T22:59:31.289 INFO:teuthology.orchestra.run.smithi052.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.30247.log.gz 2024-02-15T22:59:31.290 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31772.log 2024-02-15T22:59:31.290 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31279.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32271.log.gz 2024-02-15T22:59:31.290 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32313.log 2024-02-15T22:59:31.290 INFO:teuthology.orchestra.run.smithi052.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31279.log.gz 2024-02-15T22:59:31.290 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31941.log 2024-02-15T22:59:31.290 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31772.log.gz 2024-02-15T22:59:31.290 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32313.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28415.log 2024-02-15T22:59:31.290 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31941.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32313.log.gz 2024-02-15T22:59:31.290 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31605.log 2024-02-15T22:59:31.291 INFO:teuthology.orchestra.run.smithi052.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31941.log.gz 2024-02-15T22:59:31.291 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.tmp-client.admin.28415.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-15T22:59:31.291 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28415.log.gz 2024-02-15T22:59:31.291 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31605.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-15T22:59:31.291 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.0.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31605.log.gz 2024-02-15T22:59:31.291 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32355.log 2024-02-15T22:59:31.291 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32565.log 2024-02-15T22:59:31.291 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32941.log 2024-02-15T22:59:31.292 INFO:teuthology.orchestra.run.smithi052.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32355.log.gz 2024-02-15T22:59:31.292 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31939.log 2024-02-15T22:59:31.292 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31603.log 2024-02-15T22:59:31.292 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32941.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32565.log.gz 2024-02-15T22:59:31.292 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32439.log 2024-02-15T22:59:31.292 INFO:teuthology.orchestra.run.smithi052.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32941.log.gz 2024-02-15T22:59:31.292 INFO:teuthology.orchestra.run.smithi052.stderr: 85.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-15T22:59:31.292 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31603.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31939.log.gz 2024-02-15T22:59:31.292 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31222.log 2024-02-15T22:59:31.293 INFO:teuthology.orchestra.run.smithi052.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31603.log.gz 2024-02-15T22:59:31.293 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32691.log 2024-02-15T22:59:31.293 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32439.log: /var/log/ceph/ceph-client.admin.31222.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32439.log.gz 2024-02-15T22:59:31.293 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32691.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31222.log.gz 2024-02-15T22:59:31.293 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32691.log.gz 2024-02-15T22:59:31.310 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49752.log 2024-02-15T22:59:31.310 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36747.log 2024-02-15T22:59:31.313 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50357.log 2024-02-15T22:59:31.313 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.49752.log: /var/log/ceph/ceph-client.admin.36747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36787.log 2024-02-15T22:59:31.314 INFO:teuthology.orchestra.run.smithi133.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36747.log.gz 2024-02-15T22:59:31.314 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.50357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70927.log 2024-02-15T22:59:31.314 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32935.log 2024-02-15T22:59:31.314 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.49752.log.gz 2024-02-15T22:59:31.314 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.70927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69112.log 2024-02-15T22:59:31.314 INFO:teuthology.orchestra.run.smithi133.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36787.log.gz 2024-02-15T22:59:31.314 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3%/var/log/ceph/ceph-client.admin.32935.log: -- replaced with /var/log/ceph/ceph-client.0.50357.log.gz 2024-02-15T22:59:31.314 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89047.log 2024-02-15T22:59:31.315 INFO:teuthology.orchestra.run.smithi133.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.32935.log.gz 2024-02-15T22:59:31.315 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.69112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65482.log 2024-02-15T22:59:31.315 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.89047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68507.log 2024-02-15T22:59:31.315 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.65482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47937.log 2024-02-15T22:59:31.315 INFO:teuthology.orchestra.run.smithi133.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.89047.log.gz 2024-02-15T22:59:31.340 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.68507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58827.log 2024-02-15T22:59:31.340 INFO:teuthology.orchestra.run.smithi133.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.70927.log.gz 2024-02-15T22:59:31.340 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.69112.log.gz 2024-02-15T22:59:31.340 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.47937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43097.log 2024-02-15T22:59:31.340 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.58827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52172.log 2024-02-15T22:59:31.340 INFO:teuthology.orchestra.run.smithi133.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.65482.log.gz 2024-02-15T22:59:31.340 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.43097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43702.log 2024-02-15T22:59:31.341 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.68507.log.gz 2024-02-15T22:59:31.341 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47937.log.gz 2024-02-15T22:59:31.341 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.52172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80607.log 2024-02-15T22:59:31.341 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.43702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69717.log 2024-02-15T22:59:31.341 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.80607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87849.log 2024-02-15T22:59:31.341 INFO:teuthology.orchestra.run.smithi133.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.58827.log.gz 2024-02-15T22:59:31.341 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43097.log.gz 2024-02-15T22:59:31.341 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.69717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83027.log 2024-02-15T22:59:31.341 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52172.log.gz 2024-02-15T22:59:31.342 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73347.log 2024-02-15T22:59:31.342 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.87849.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43702.log.gz 2024-02-15T22:59:31.342 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.83027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86052.log 2024-02-15T22:59:31.342 INFO:teuthology.orchestra.run.smithi133.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.0.87849.log.gz 2024-02-15T22:59:31.342 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.73347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53987.log 2024-02-15T22:59:31.342 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52777.log 2024-02-15T22:59:31.342 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.86052.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.80607.log.gz 2024-02-15T22:59:31.342 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.53987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32975.log 2024-02-15T22:59:31.342 INFO:teuthology.orchestra.run.smithi133.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86052.log.gz 2024-02-15T22:59:31.343 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.52777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81817.log 2024-02-15T22:59:31.343 INFO:teuthology.orchestra.run.smithi133.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.0.69717.log.gz 2024-02-15T22:59:31.343 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41887.log 2024-02-15T22:59:31.343 INFO:teuthology.orchestra.run.smithi133.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.32975.log.gz 2024-02-15T22:59:31.343 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.81817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46122.log 2024-02-15T22:59:31.343 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53987.log.gz 2024-02-15T22:59:31.343 INFO:teuthology.orchestra.run.smithi133.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73347.log.gz 2024-02-15T22:59:31.343 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.83027.log.gz 2024-02-15T22:59:31.344 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.41887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74557.log 2024-02-15T22:59:31.344 INFO:teuthology.orchestra.run.smithi133.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.52777.log.gz 2024-02-15T22:59:31.344 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38868.log 2024-02-15T22:59:31.344 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.46122.log: /var/log/ceph/ceph-client.0.74557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42492.log 2024-02-15T22:59:31.344 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81817.log.gz 2024-02-15T22:59:31.344 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.38868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82422.log 2024-02-15T22:59:31.344 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.42492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89646.log 2024-02-15T22:59:31.344 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.41887.log.gz 2024-02-15T22:59:31.344 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.46122.log.gz 2024-02-15T22:59:31.345 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.82422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40683.log 2024-02-15T22:59:31.345 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.74557.log.gz 2024-02-15T22:59:31.345 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72742.log 2024-02-15T22:59:31.345 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.89646.log: /var/log/ceph/ceph-client.0.40683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55197.log 2024-02-15T22:59:31.345 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.72742.log: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85447.log 2024-02-15T22:59:31.345 INFO:teuthology.orchestra.run.smithi133.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.0.89646.log.gz 2024-02-15T22:59:31.345 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.0.38868.log.gz 2024-02-15T22:59:31.345 INFO:teuthology.orchestra.run.smithi133.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.40683.log.gz 2024-02-15T22:59:31.345 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42492.log.gz 2024-02-15T22:59:31.346 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.55197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78792.log 2024-02-15T22:59:31.346 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.85447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60642.log 2024-02-15T22:59:31.346 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82422.log.gz 2024-02-15T22:59:31.346 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.78792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75767.log 2024-02-15T22:59:31.346 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.60642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46727.log 2024-02-15T22:59:31.346 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.72742.log.gz 2024-02-15T22:59:31.346 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.55197.log.gz 2024-02-15T22:59:31.346 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.75767.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85447.log.gz 2024-02-15T22:59:31.347 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71532.log 2024-02-15T22:59:31.347 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76372.log 2024-02-15T22:59:31.347 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.46727.log: /var/log/ceph/ceph-client.0.71532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81212.log 2024-02-15T22:59:31.347 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78792.log.gz 2024-02-15T22:59:31.347 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.76372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61852.log 2024-02-15T22:59:31.347 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.60642.log.gz 2024-02-15T22:59:31.347 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.81212.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-15T22:59:31.347 INFO:teuthology.orchestra.run.smithi133.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.75767.log.gz 2024-02-15T22:59:31.347 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.61852.log: gzip 91.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.46727.log.gz -- 2024-02-15T22:59:31.348 INFO:teuthology.orchestra.run.smithi133.stderr: /var/log/ceph/ceph-client.0.88448.log 2024-02-15T22:59:31.348 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76977.log 2024-02-15T22:59:31.348 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71532.log.gz 2024-02-15T22:59:31.348 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.88448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77582.log 2024-02-15T22:59:31.348 INFO:teuthology.orchestra.run.smithi133.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.76372.log.gz 2024-02-15T22:59:31.348 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81212.log.gz 2024-02-15T22:59:31.348 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.76977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63667.log 2024-02-15T22:59:31.348 INFO:teuthology.orchestra.run.smithi133.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.88448.log.gz 2024-02-15T22:59:31.349 INFO:teuthology.orchestra.run.smithi133.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61852.log.gz 2024-02-15T22:59:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57012.log 2024-02-15T22:59:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.77582.log: /var/log/ceph/ceph-client.0.63667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48542.log 2024-02-15T22:59:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.57012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45517.log 2024-02-15T22:59:31.349 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76977.log.gz 2024-02-15T22:59:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.48542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55802.log 2024-02-15T22:59:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.45517.log: gzip 91.2% -5 --verbose -- /var/log/ceph/ceph-client.0.41282.log 2024-02-15T22:59:31.349 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.0.77582.log.gz 2024-02-15T22:59:31.349 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.63667.log.gz 2024-02-15T22:59:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.55802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59432.log 2024-02-15T22:59:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.41282.log: gzip 91.5% -- replaced with /var/log/ceph/ceph-client.0.57012.log.gz 2024-02-15T22:59:31.350 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.80002.log 2024-02-15T22:59:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.59432.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48542.log.gz 2024-02-15T22:59:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75162.log 2024-02-15T22:59:31.350 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45517.log.gz 2024-02-15T22:59:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.80002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36827.log 2024-02-15T22:59:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.75162.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.55802.log.gz 2024-02-15T22:59:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61247.log 2024-02-15T22:59:31.351 INFO:teuthology.orchestra.run.smithi133.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.41282.log.gz 2024-02-15T22:59:31.351 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36827.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-15T22:59:31.351 INFO:teuthology.orchestra.run.smithi133.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36827.log.gz 2024-02-15T22:59:31.351 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.59432.log.gz 2024-02-15T22:59:31.351 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.61247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56407.log 2024-02-15T22:59:31.351 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80002.log.gz 2024-02-15T22:59:31.351 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83632.log 2024-02-15T22:59:31.351 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.56407.log: gzip 91.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.75162.log.gz -- 2024-02-15T22:59:31.351 INFO:teuthology.orchestra.run.smithi133.stderr: /var/log/ceph/ceph-client.admin.33015.log 2024-02-15T22:59:31.352 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.83632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78187.log 2024-02-15T22:59:31.352 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.61247.log.gz 2024-02-15T22:59:31.352 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53382.log 2024-02-15T22:59:31.352 INFO:teuthology.orchestra.run.smithi133.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.33015.log.gz 2024-02-15T22:59:31.352 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.78187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44912.log 2024-02-15T22:59:31.352 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.53382.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.83632.log.gz 2024-02-15T22:59:31.352 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64272.log 2024-02-15T22:59:31.352 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.0.56407.log.gz 2024-02-15T22:59:31.353 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72137.log 2024-02-15T22:59:31.353 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.44912.log: /var/log/ceph/ceph-client.0.64272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86651.log 2024-02-15T22:59:31.353 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78187.log.gz 2024-02-15T22:59:31.353 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.72137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84842.log 91.1% -- replaced with /var/log/ceph/ceph-client.0.53382.log.gz 2024-02-15T22:59:31.353 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-02-15T22:59:31.353 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.86651.log: gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.44912.log.gz 2024-02-15T22:59:31.353 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-15T22:59:31.353 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.84842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79397.log 91.1% -- replaced with /var/log/ceph/ceph-client.0.64272.log.gz 2024-02-15T22:59:31.353 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-02-15T22:59:31.354 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.86651.log.gz 2024-02-15T22:59:31.354 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mgr.x.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72137.log.gz 2024-02-15T22:59:31.354 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87250.log 2024-02-15T22:59:31.354 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.79397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70322.log 2024-02-15T22:59:31.354 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.87250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90297.log 2024-02-15T22:59:31.354 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.70322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66692.log 2024-02-15T22:59:31.354 INFO:teuthology.orchestra.run.smithi133.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.87250.log.gz 2024-02-15T22:59:31.354 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.79397.log.gz 2024-02-15T22:59:31.355 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.90297.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.84842.log.gz 2024-02-15T22:59:31.355 INFO:teuthology.orchestra.run.smithi133.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.70322.log.gz 2024-02-15T22:59:31.368 INFO:teuthology.orchestra.run.smithi133.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.90297.log.gz 2024-02-15T22:59:31.368 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54592.log 2024-02-15T22:59:31.368 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.66692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40078.log 2024-02-15T22:59:31.368 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.54592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49147.log 2024-02-15T22:59:31.369 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.40078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66087.log 2024-02-15T22:59:31.369 INFO:teuthology.orchestra.run.smithi133.stderr:gzip/var/log/ceph/ceph-client.0.49147.log: -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-02-15T22:59:31.369 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.66087.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54592.log.gz 2024-02-15T22:59:31.369 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.66692.log.gz 2024-02-15T22:59:31.369 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49147.log.gz 2024-02-15T22:59:31.369 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.40078.log.gz 2024-02-15T22:59:31.369 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.66087.log.gz 2024-02-15T22:59:31.369 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67297.log 2024-02-15T22:59:31.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51567.log 2024-02-15T22:59:31.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.67297.log: 90.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-02-15T22:59:31.370 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84237.log 2024-02-15T22:59:31.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.51567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63062.log 2024-02-15T22:59:31.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.84237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47332.log 2024-02-15T22:59:31.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.63062.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-15T22:59:31.370 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.67297.log.gz 2024-02-15T22:59:31.370 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3%/var/log/ceph/ceph-client.0.47332.log: -- replaced with /var/log/ceph/ceph-client.0.51567.log.gz 2024-02-15T22:59:31.370 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84237.log.gz 2024-02-15T22:59:31.371 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63062.log.gz 2024-02-15T22:59:31.371 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.47332.log.gz 2024-02-15T22:59:31.371 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73952.log 2024-02-15T22:59:31.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33055.log 2024-02-15T22:59:31.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.73952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50962.log 2024-02-15T22:59:31.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67902.log 2024-02-15T22:59:31.371 INFO:teuthology.orchestra.run.smithi133.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.33055.log.gz/var/log/ceph/ceph-client.0.50962.log: 2024-02-15T22:59:31.371 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37658.log 2024-02-15T22:59:31.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.67902.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.73952.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.58222.log 2024-02-15T22:59:31.372 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-02-15T22:59:31.372 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44307.log 2024-02-15T22:59:31.372 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.58222.log: /var/log/ceph/ceph-client.0.37658.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50962.log.gz 2024-02-15T22:59:31.372 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64877.log 2024-02-15T22:59:31.372 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.44307.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.67902.log.gz 2024-02-15T22:59:31.372 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58222.log.gz 2024-02-15T22:59:31.372 INFO:teuthology.orchestra.run.smithi133.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.37658.log.gz 2024-02-15T22:59:31.372 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-02-15T22:59:31.373 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44307.log.gz 2024-02-15T22:59:31.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.64877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39473.log 2024-02-15T22:59:31.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62457.log 2024-02-15T22:59:31.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.39473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36867.log 2024-02-15T22:59:31.373 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64877.log.gz 2024-02-15T22:59:31.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.62457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60037.log 2024-02-15T22:59:31.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36867.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36867.log.gz 2024-02-15T22:59:31.373 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39473.log.gz 2024-02-15T22:59:31.374 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38263.log 2024-02-15T22:59:31.374 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.60037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57617.log 2024-02-15T22:59:31.374 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.38263.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.62457.log.gz 2024-02-15T22:59:31.374 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.57617.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60037.log.gz 2024-02-15T22:59:31.374 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38263.log.gz 2024-02-15T22:59:31.374 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.57617.log.gz 2024-02-15T22:59:31.382 INFO:teuthology.orchestra.run.smithi133.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-02-15T22:59:31.385 INFO:teuthology.orchestra.run.smithi133.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-15T22:59:31.416 INFO:teuthology.orchestra.run.smithi052.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-15T22:59:31.976 INFO:teuthology.orchestra.run.smithi133.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-15T22:59:32.012 INFO:teuthology.orchestra.run.smithi052.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-15T22:59:32.014 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-02-15T22:59:32.014 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m0.760s 2024-02-15T22:59:32.014 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m0.888s 2024-02-15T22:59:32.014 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m0.063s 2024-02-15T22:59:32.080 INFO:teuthology.orchestra.run.smithi133.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-15T22:59:32.093 INFO:teuthology.orchestra.run.smithi133.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-15T22:59:32.096 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-02-15T22:59:32.096 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m0.799s 2024-02-15T22:59:32.096 INFO:teuthology.orchestra.run.smithi133.stderr:user 0m2.283s 2024-02-15T22:59:32.096 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m0.164s 2024-02-15T22:59:32.096 INFO:tasks.ceph:Archiving logs... 2024-02-15T22:59:32.097 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707/remote/smithi052/log 2024-02-15T22:59:32.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T22:59:32.299 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707/remote/smithi133/log 2024-02-15T22:59:32.300 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T22:59:32.741 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-15T22:59:32.750 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-15T22:59:32.750 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T22:59:32.753 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T22:59:32.835 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-15T22:59:32.844 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-15T22:59:32.844 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T22:59:32.846 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T22:59:32.859 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-02-15T22:59:32.860 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-02-15T22:59:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T22:59:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-02-15T22:59:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +1269us[+1269us] +/- 82ms 2024-02-15T22:59:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv02.front.sepia.ceph.com 3 6 377 37 -1161us[-1118us] +/- 57ms 2024-02-15T22:59:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +969us[ +969us] +/- 103ms 2024-02-15T22:59:32.865 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:59:32.866 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T22:59:32.866 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-02-15T22:59:32.867 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 34 +1253us[+1253us] +/- 82ms 2024-02-15T22:59:32.867 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 -1191us[-1163us] +/- 57ms 2024-02-15T22:59:32.867 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +952us[ +952us] +/- 103ms 2024-02-15T22:59:32.867 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:59:32.867 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-15T22:59:32.875 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-15T22:59:32.876 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-15T22:59:32.884 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-15T22:59:32.976 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-15T22:59:33.039 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T22:59:33.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:59:33.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T22:59:33.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:59:33.098 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-15T22:59:33.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-15T22:59:33.116 INFO:teuthology.task.internal:Duration was 684.916755 seconds 2024-02-15T22:59:33.116 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-15T22:59:33.125 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-15T22:59:33.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T22:59:33.128 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T22:59:33.169 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T22:59:33.182 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T22:59:33.510 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-15T22:59:33.510 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-02-15T22:59:33.510 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T22:59:33.570 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T22:59:33.570 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T22:59:33.593 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-15T22:59:33.593 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T22:59:33.612 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T22:59:33.661 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-15T22:59:33.661 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T22:59:33.681 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T22:59:33.796 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-15T22:59:33.806 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-15T22:59:33.806 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T22:59:33.832 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T22:59:33.859 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-15T22:59:33.869 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T22:59:33.875 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T22:59:33.897 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-02-15T22:59:33.924 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2024-02-15T22:59:33.956 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T22:59:33.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:59:33.972 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T22:59:34.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:59:34.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-15T22:59:34.020 INFO:teuthology.task.internal:Transferring archived files... 2024-02-15T22:59:34.021 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707/remote/smithi052 2024-02-15T22:59:34.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T22:59:34.057 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707/remote/smithi133 2024-02-15T22:59:34.057 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T22:59:34.092 INFO:teuthology.task.internal:Removing archive directory... 2024-02-15T22:59:34.092 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T22:59:34.094 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T22:59:34.142 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-15T22:59:34.153 INFO:teuthology.task.internal:Not uploading archives. 2024-02-15T22:59:34.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-15T22:59:34.165 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-15T22:59:34.165 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T22:59:34.168 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T22:59:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 22:59 /home/ubuntu/cephtest 2024-02-15T22:59:34.196 INFO:teuthology.orchestra.run.smithi133.stdout: 266023 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 22:59 /home/ubuntu/cephtest 2024-02-15T22:59:34.200 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-15T22:59:34.210 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-15T22:59:34.327 INFO:teuthology.nuke:Checking targets against current locks 2024-02-15T22:59:34.353 DEBUG:teuthology.nuke:shortname: smithi052 2024-02-15T22:59:34.353 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T22:59:34.376 DEBUG:teuthology.nuke:shortname: smithi133 2024-02-15T22:59:34.376 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T22:59:34.380 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:40:06.509864', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKCk4BwJnZymaHN/ARCzS3eOsR0slziOZuvfx0UsCDD5bj2XIGFF5DrCUAu+9PGI3+TWMx9K5w8XUq/HbPPEea4='} 2024-02-15T22:59:34.400 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561707', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:40:06.511499', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0WhKIadFldsvJzv+uLEq/oD+fbtnukUMhfslv/NPByzWgRcLNvq+Mzt4nxxjSWfDBGCtxrcJLos5hvLNWA7DA='} 2024-02-15T22:59:34.432 INFO:teuthology.orchestra.console.smithi052:Power off 2024-02-15T22:59:34.433 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T22:59:34.460 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2024-02-15T22:59:34.460 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:59:34.479 INFO:teuthology.orchestra.console.smithi133:Power off 2024-02-15T22:59:34.479 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T22:59:34.490 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-02-15T22:59:34.503 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-02-15T22:59:34.504 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:59:34.527 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-15T22:59:38.491 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:59:38.528 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:59:38.604 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-02-15T22:59:38.638 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-15T22:59:42.605 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:59:42.639 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:59:42.718 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2024-02-15T22:59:42.751 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-15T22:59:42.819 INFO:teuthology.orchestra.console.smithi052:Power off completed 2024-02-15T22:59:46.755 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T22:59:46.869 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-02-15T22:59:46.970 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-02-15T22:59:47.075 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} duration: 684.916755437851 failure_reason: 'S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000841df1718337325e-0065ce96e0-4222-default4222-default-default' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=005f6a929c6447bf94f77b8b4cf3deaa status: fail success: false 2024-02-15T22:59:47.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T22:59:47.157 INFO:teuthology.run:FAIL